02.12.2021 17:25:00,009 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:00,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,027 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,027 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 282
02.12.2021 17:25:00,042 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:00,056 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119977ms delay out of 120000ms. Remaining 23ms. Executor queue at 0
02.12.2021 17:25:00,057 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119736ms for 120000ms of delay, sleeping for 274ms
02.12.2021 17:25:00,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,080 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,080 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,099 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,128 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 181
02.12.2021 17:25:00,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,133 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 177
02.12.2021 17:25:00,182 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239650ms for 240000ms of delay, sleeping for 360ms
02.12.2021 17:25:00,183 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:00,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,194 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:00,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 80
02.12.2021 17:25:00,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 76
02.12.2021 17:25:00,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,234 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,235 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,235 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,235 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,235 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,235 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,284 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:00,297 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59278ms for 60000ms of delay, sleeping for 732ms
02.12.2021 17:25:00,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:00,309 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,309 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 185 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,309 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=663) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null}
02.12.2021 17:25:00,309 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,310 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 217
02.12.2021 17:25:00,310 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=663): org.apache.kafka.common.requests.HeartbeatResponse@700468ac
02.12.2021 17:25:00,310 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:00,310 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 185 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2
02.12.2021 17:25:00,310 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:00,310 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:00,310 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 81, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,310 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,311 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 185 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,310 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,310 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=664) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:00,311 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 216
02.12.2021 17:25:00,311 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=683) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null}
02.12.2021 17:25:00,313 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 321
02.12.2021 17:25:00,313 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=683): org.apache.kafka.common.requests.HeartbeatResponse@535e994a
02.12.2021 17:25:00,313 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:00,313 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 185 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e
02.12.2021 17:25:00,313 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:00,313 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:00,313 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 81, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,313 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=684) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:00,313 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 320
02.12.2021 17:25:00,332 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119364ms for 120000ms of delay, sleeping for 646ms
02.12.2021 17:25:00,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:00,402 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:00,410 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:00,412 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:00,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:00,503 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:00,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,532 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:00,544 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239352ms for 240000ms of delay, sleeping for 658ms
02.12.2021 17:25:00,580 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,581 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:00,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,602 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,624 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,625 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:00,625 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=947) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:00,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,634 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,634 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,634 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:00,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:00,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,694 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,695 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:00,725 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=947): org.apache.kafka.common.requests.HeartbeatResponse@46f3b559
02.12.2021 17:25:00,725 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:00,735 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,735 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,735 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,735 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,736 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,782 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:00,805 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:00,884 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:00,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:00,980 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119959ms for 120000ms of delay, sleeping for 51ms
02.12.2021 17:25:00,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:01,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:01,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,032 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,032 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118954ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:01,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 10 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:01,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:01,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 0 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:01,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:01,034 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1151274, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:01,034 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1151284, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:01,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:01,034 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-6, new queue size is 10
02.12.2021 17:25:01,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,034 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:01,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:01,036 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59807ms for 60000ms of delay, sleeping for 203ms
02.12.2021 17:25:01,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,081 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,082 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,104 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,135 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,136 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:01,182 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:01,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,195 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,203 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239131ms for 240000ms of delay, sleeping for 879ms
02.12.2021 17:25:01,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:01,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,236 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,251 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59742ms for 60000ms of delay, sleeping for 268ms
02.12.2021 17:25:01,282 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:01,305 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:01,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:01,405 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:01,483 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:01,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:01,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:01,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,543 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,543 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,538 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59560ms for 60000ms of delay, sleeping for 450ms
02.12.2021 17:25:01,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,584 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,605 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,640 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,685 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:01,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,696 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,697 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:01,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,737 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,737 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,785 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:01,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:01,889 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:01,915 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:01,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:02,004 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59353ms for 60000ms of delay, sleeping for 657ms
02.12.2021 17:25:02,018 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:02,033 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119955ms delay out of 120000ms. Remaining 45ms. Executor queue at 0
02.12.2021 17:25:02,034 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119873ms for 120000ms of delay, sleeping for 137ms
02.12.2021 17:25:02,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,044 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,084 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239019ms for 240000ms of delay, sleeping for 991ms
02.12.2021 17:25:02,086 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:02,086 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 54 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:02,086 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1275) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=54,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null}
02.12.2021 17:25:02,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,086 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,086 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 161
02.12.2021 17:25:02,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,106 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,106 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 121
02.12.2021 17:25:02,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:02,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,149 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,150 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 64 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:02,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 186013ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:02,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:02,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 65 iterations.
02.12.2021 17:25:02,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 65 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:02,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 186013ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:02,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:02,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:02,173 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1036): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=185, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', members=[])
02.12.2021 17:25:02,173 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=185, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', members=[])
02.12.2021 17:25:02,173 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:02,173 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=185, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}
02.12.2021 17:25:02,173 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=185, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=185, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:02,173 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024242, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:02,173 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024252, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:02,173 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1037) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null,assignments=[]}
02.12.2021 17:25:02,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:02,174 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:02,174 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,174 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:02,174 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,174 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 65 iterations.
02.12.2021 17:25:02,175 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1037): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:02,175 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=185, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}
02.12.2021 17:25:02,175 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119972ms for 120000ms of delay, sleeping for 38ms
02.12.2021 17:25:02,186 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1275): org.apache.kafka.common.requests.HeartbeatResponse@3cc85ff8
02.12.2021 17:25:02,186 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:02,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 60
02.12.2021 17:25:02,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:02,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,197 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 21
02.12.2021 17:25:02,215 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119088ms for 120000ms of delay, sleeping for 922ms
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,231 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:02,231 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:02,231 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=649) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:02,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 375
02.12.2021 17:25:02,232 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=649): org.apache.kafka.common.requests.HeartbeatResponse@62404ac
02.12.2021 17:25:02,232 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:02,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 374
02.12.2021 17:25:02,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 374
02.12.2021 17:25:02,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,239 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,247 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:02,251 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:02,251 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=649) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:02,247 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,252 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=649): org.apache.kafka.common.requests.HeartbeatResponse@eaa8402
02.12.2021 17:25:02,252 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:02,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 334
02.12.2021 17:25:02,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 334
02.12.2021 17:25:02,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 274
02.12.2021 17:25:02,353 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 233
02.12.2021 17:25:02,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 172
02.12.2021 17:25:02,453 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 133
02.12.2021 17:25:02,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 70
02.12.2021 17:25:02,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,546 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,553 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 33
02.12.2021 17:25:02,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:02,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,591 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:02,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:02,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,606 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:02,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,651 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,651 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,665 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58826ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:02,693 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:02,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:02,698 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,698 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,699 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,707 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:02,743 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:02,743 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,744 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,745 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,745 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:02,807 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:02,898 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:02,910 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:03,000 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:03,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,076 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239901ms for 240000ms of delay, sleeping for 109ms
02.12.2021 17:25:03,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,092 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,108 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,108 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,142 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119827ms for 120000ms of delay, sleeping for 183ms
02.12.2021 17:25:03,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,152 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,152 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,187 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239388ms for 240000ms of delay, sleeping for 622ms
02.12.2021 17:25:03,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:03,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,200 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,200 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:03,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,245 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:03,309 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:03,327 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119957ms for 120000ms of delay, sleeping for 53ms
02.12.2021 17:25:03,384 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119444ms for 120000ms of delay, sleeping for 566ms
02.12.2021 17:25:03,394 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:03,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:03,495 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:03,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:03,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,548 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,596 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,599 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,599 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,599 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,599 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,599 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,601 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,608 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,609 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,609 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,610 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,641 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:03,641 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:03,641 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=948) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:03,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,660 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,660 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,665 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59826ms delay out of 60000ms. Remaining 174ms. Executor queue at 0
02.12.2021 17:25:03,671 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59663ms for 60000ms of delay, sleeping for 347ms
02.12.2021 17:25:03,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,701 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,701 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 392
02.12.2021 17:25:03,711 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:03,742 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=948): org.apache.kafka.common.requests.HeartbeatResponse@66425506
02.12.2021 17:25:03,742 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:03,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,746 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,746 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 10 records with 53 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:03,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 154812ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:03,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:03,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 54 iterations.
02.12.2021 17:25:03,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 0 records with 54 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:03,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 154812ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:03,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:03,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:03,810 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 291
02.12.2021 17:25:03,812 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:03,811 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:03,816 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:03,816 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:03,817 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 98, -37, -94, -95, -98, 75, 74, -34, -67, -86, 25, 43, 40, 125, 10, 127, 0, 0, 0, 0, 0, 0, 0, 0, 32, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 6])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:03,824 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1276) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:03,836 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=656): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', members=[])
02.12.2021 17:25:03,836 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=656): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', members=[])
02.12.2021 17:25:03,845 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', members=[])
02.12.2021 17:25:03,845 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:03,845 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=55, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', protocol='stream'}
02.12.2021 17:25:03,845 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=55, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=55, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:03,845 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=657) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null,assignments=[]}
02.12.2021 17:25:03,835 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=971000, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:03,845 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', members=[])
02.12.2021 17:25:03,846 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:03,846 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=55, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', protocol='stream'}
02.12.2021 17:25:03,846 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 401
02.12.2021 17:25:03,846 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=971010, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:03,848 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=55, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=55, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:03,849 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=657) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null,assignments=[]}
02.12.2021 17:25:03,849 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1276): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', members=[])
02.12.2021 17:25:03,853 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 348
02.12.2021 17:25:03,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Main Consumer poll completed in 43 ms and fetched 10 records
02.12.2021 17:25:03,860 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-6, new queue size is 10
02.12.2021 17:25:03,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,860 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:03,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 54 iterations.
02.12.2021 17:25:03,863 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239927ms for 240000ms of delay, sleeping for 83ms
02.12.2021 17:25:03,889 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:03,911 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=657): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:03,911 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:03,911 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=55, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', protocol='stream'}
02.12.2021 17:25:03,911 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 55 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab
02.12.2021 17:25:03,911 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:03,911 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=657): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:03,911 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:03,912 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:03,912 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:03,912 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:03,912 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:03,913 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:03,913 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f] State transition from RUNNING to REBALANCING
02.12.2021 17:25:03,913 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:03,912 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=55, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', protocol='stream'}
02.12.2021 17:25:03,915 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:03,913 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 290
02.12.2021 17:25:03,915 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 55 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164
02.12.2021 17:25:03,916 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:03,917 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:03,917 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:03,918 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:03,918 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:03,919 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:03,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 334
02.12.2021 17:25:03,948 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239527ms for 240000ms of delay, sleeping for 483ms
02.12.2021 17:25:03,952 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118966ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:04,012 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:04,016 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:04,016 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 185
02.12.2021 17:25:04,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 10 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:04,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:04,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 0 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:04,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:04,020 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 226
02.12.2021 17:25:04,020 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1151284, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:04,023 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1151294, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:04,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:04,024 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-6, new queue size is 10
02.12.2021 17:25:04,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,024 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:04,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:04,027 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59797ms for 60000ms of delay, sleeping for 213ms
02.12.2021 17:25:04,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:04,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,051 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,051 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:04,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,103 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,103 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:04,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,110 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,111 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,117 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 84
02.12.2021 17:25:04,122 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 124
02.12.2021 17:25:04,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:04,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,163 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:04,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:04,201 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:04,201 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:04,201 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:04,201 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:04,202 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:04,202 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:04,202 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:04,202 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:04,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:04,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,202 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,203 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,203 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:04,211 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:04,223 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 23
02.12.2021 17:25:04,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:04,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:04,251 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:04,244 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59203ms for 60000ms of delay, sleeping for 807ms
02.12.2021 17:25:04,251 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:04,254 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:04,255 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:04,255 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:04,255 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:04,256 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:04,256 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:04,256 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f] State transition from REBALANCING to RUNNING
02.12.2021 17:25:04,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:04,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,257 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,303 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:04,304 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:04,311 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:04,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:04,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:04,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:04,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:04,434 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239352ms for 240000ms of delay, sleeping for 658ms
02.12.2021 17:25:04,459 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:04,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:04,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:04,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:04,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,552 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,559 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:04,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:04,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,603 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:04,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,612 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,612 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,661 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:04,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,664 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,665 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,665 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:04,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,703 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,703 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,703 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:04,712 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:04,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,761 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,804 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:04,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:04,814 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:04,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:04,907 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:04,908 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:04,916 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:04,952 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119966ms delay out of 120000ms. Remaining 34ms. Executor queue at 0
02.12.2021 17:25:04,953 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119959ms for 120000ms of delay, sleeping for 51ms
02.12.2021 17:25:04,962 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:05,006 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 65 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,006 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:05,006 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 188847ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:05,006 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:05,006 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 66 iterations.
02.12.2021 17:25:05,006 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 66 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,006 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:05,006 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 188847ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:05,006 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:05,006 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:05,007 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:05,007 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:05,007 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:05,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:05,007 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 81, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 1])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:05,007 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1038) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:05,008 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024252, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:05,008 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024262, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:05,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:05,008 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:05,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,009 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:05,009 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,009 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 66 iterations.
02.12.2021 17:25:05,008 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=684): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', members=[])
02.12.2021 17:25:05,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:05,008 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=664): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', members=[])
02.12.2021 17:25:05,009 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', members=[])
02.12.2021 17:25:05,009 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:05,009 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=186, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}
02.12.2021 17:25:05,009 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=186, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=186, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:05,009 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', members=[])
02.12.2021 17:25:05,010 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:05,010 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=186, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}
02.12.2021 17:25:05,010 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119890ms for 120000ms of delay, sleeping for 120ms
02.12.2021 17:25:05,009 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=685) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:05,010 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=186, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=186, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:05,010 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 155
02.12.2021 17:25:05,010 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=665) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null,assignments=[]}
02.12.2021 17:25:05,010 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 42
02.12.2021 17:25:05,016 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:05,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,053 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,053 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,057 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=665): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,057 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=685): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,057 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,057 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=186, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}
02.12.2021 17:25:05,057 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,058 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=186, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}
02.12.2021 17:25:05,057 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 186 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e
02.12.2021 17:25:05,058 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:05,058 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:05,058 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:05,058 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:05,058 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:05,058 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3] State transition from RUNNING to REBALANCING
02.12.2021 17:25:05,059 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:05,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 108
02.12.2021 17:25:05,058 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 186 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2
02.12.2021 17:25:05,059 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:05,059 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:05,060 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:05,060 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:05,060 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:05,060 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:05,060 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 496
02.12.2021 17:25:05,063 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58883ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:05,062 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:05,084 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:05,094 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239818ms for 240000ms of delay, sleeping for 192ms
02.12.2021 17:25:05,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,104 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 143
02.12.2021 17:25:05,107 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:05,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:05,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,112 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 118
02.12.2021 17:25:05,132 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119993ms for 120000ms of delay, sleeping for 17ms
02.12.2021 17:25:05,150 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119989ms for 120000ms of delay, sleeping for 21ms
02.12.2021 17:25:05,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 6
02.12.2021 17:25:05,161 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 392
02.12.2021 17:25:05,164 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:05,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:05,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:05,165 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:05,166 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:05,166 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:05,166 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:05,166 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:05,166 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:05,166 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:05,166 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:05,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:05,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,166 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,166 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,173 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119258ms for 120000ms of delay, sleeping for 752ms
02.12.2021 17:25:05,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 42
02.12.2021 17:25:05,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:05,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,206 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,207 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,207 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,207 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,213 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 18
02.12.2021 17:25:05,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:05,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:05,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:05,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:05,232 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:05,232 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:05,232 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=650) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:05,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 381
02.12.2021 17:25:05,232 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=650): org.apache.kafka.common.requests.HeartbeatResponse@27c03be1
02.12.2021 17:25:05,232 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:05,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 381
02.12.2021 17:25:05,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 380
02.12.2021 17:25:05,248 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:05,249 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:05,249 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=650) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:05,248 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:05,249 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 355
02.12.2021 17:25:05,253 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=650): org.apache.kafka.common.requests.HeartbeatResponse@1af807f5
02.12.2021 17:25:05,253 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:05,254 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 351
02.12.2021 17:25:05,254 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 350
02.12.2021 17:25:05,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:05,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,261 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,261 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 292
02.12.2021 17:25:05,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:05,288 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239284ms for 240000ms of delay, sleeping for 726ms
02.12.2021 17:25:05,307 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:05,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 280
02.12.2021 17:25:05,356 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 248
02.12.2021 17:25:05,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 191
02.12.2021 17:25:05,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:05,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:05,408 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:05,433 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 180
02.12.2021 17:25:05,456 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 148
02.12.2021 17:25:05,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:05,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:05,471 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 195
02.12.2021 17:25:05,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:05,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 80
02.12.2021 17:25:05,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:05,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:05,553 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:05,553 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:05,554 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:05,554 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:05,554 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:05,554 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:05,554 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:05,554 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:05,554 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3] State transition from REBALANCING to RUNNING
02.12.2021 17:25:05,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:05,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,555 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,555 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 48
02.12.2021 17:25:05,563 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:05,572 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:05,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,611 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:05,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,614 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,610 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:05,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:05,655 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:05,675 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 86
02.12.2021 17:25:05,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:05,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,676 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,680 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:05,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,715 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:05,715 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,726 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 388
02.12.2021 17:25:05,756 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:05,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,762 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,763 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,787 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 393
02.12.2021 17:25:05,816 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:05,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 287
02.12.2021 17:25:05,824 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:05,857 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:05,863 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:05,900 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 281
02.12.2021 17:25:05,917 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:05,928 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:05,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 294
02.12.2021 17:25:05,948 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119566ms for 120000ms of delay, sleeping for 444ms
02.12.2021 17:25:05,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 89
02.12.2021 17:25:05,973 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 290
02.12.2021 17:25:06,012 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 168
02.12.2021 17:25:06,017 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239743ms for 240000ms of delay, sleeping for 267ms
02.12.2021 17:25:06,017 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:06,028 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:06,039 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 185
02.12.2021 17:25:06,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,057 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,057 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,063 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59883ms delay out of 60000ms. Remaining 117ms. Executor queue at 0
02.12.2021 17:25:06,064 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59278ms for 60000ms of delay, sleeping for 732ms
02.12.2021 17:25:06,078 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 186
02.12.2021 17:25:06,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,112 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,112 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 67
02.12.2021 17:25:06,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,114 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,115 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,139 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 85
02.12.2021 17:25:06,157 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:06,178 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 85
02.12.2021 17:25:06,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:06,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,180 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,181 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,212 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:06,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:06,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:06,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,225 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:06,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:06,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,264 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:06,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:06,286 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239166ms for 240000ms of delay, sleeping for 844ms
02.12.2021 17:25:06,313 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:06,315 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:06,325 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:06,358 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:06,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:06,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:06,393 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119931ms for 120000ms of delay, sleeping for 79ms
02.12.2021 17:25:06,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:06,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:06,426 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:06,458 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:06,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:06,473 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119398ms for 120000ms of delay, sleeping for 612ms
02.12.2021 17:25:06,482 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:06,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:06,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:06,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:06,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,557 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,558 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,568 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:06,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:06,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,613 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,615 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,616 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,627 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:06,649 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:06,649 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:06,649 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=949) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:06,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:06,668 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:06,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:06,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,683 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:06,718 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:06,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,728 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,728 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 118
02.12.2021 17:25:06,749 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=949): org.apache.kafka.common.requests.HeartbeatResponse@58b16e30
02.12.2021 17:25:06,749 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:06,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:06,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:06,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,766 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 79
02.12.2021 17:25:06,785 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:06,804 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59919ms for 60000ms of delay, sleeping for 91ms
02.12.2021 17:25:06,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:06,818 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:06,828 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 18
02.12.2021 17:25:06,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,847 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:06,849 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:06,849 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=658) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null}
02.12.2021 17:25:06,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:06,849 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 379
02.12.2021 17:25:06,849 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=658): org.apache.kafka.common.requests.HeartbeatResponse@129fc2e2
02.12.2021 17:25:06,849 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:06,847 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:06,851 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:06,852 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=658) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null}
02.12.2021 17:25:06,852 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 419
02.12.2021 17:25:06,852 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=658): org.apache.kafka.common.requests.HeartbeatResponse@366a1924
02.12.2021 17:25:06,852 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:06,852 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 55 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164
02.12.2021 17:25:06,852 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:06,852 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:06,853 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 98, -37, -94, -95, -98, 75, 74, -34, -67, -86, 25, 43, 40, 125, 10, 127, 0, 0, 0, 0, 0, 0, 0, 0, 33, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:06,853 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=659) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:06,853 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 413
02.12.2021 17:25:06,851 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 55 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab
02.12.2021 17:25:06,854 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:06,854 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:06,854 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 98, -37, -94, -95, -98, 75, 74, -34, -67, -86, 25, 43, 40, 125, 10, 127, 0, 0, 0, 0, 0, 0, 0, 0, 33, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:06,856 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=659) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:06,856 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 372
02.12.2021 17:25:06,859 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:06,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:06,898 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59860ms for 60000ms of delay, sleeping for 150ms
02.12.2021 17:25:06,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:06,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:06,949 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:06,953 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:06,962 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:06,988 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:07,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:07,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:07,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,059 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:07,060 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59799ms for 60000ms of delay, sleeping for 211ms
02.12.2021 17:25:07,088 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119870ms for 120000ms of delay, sleeping for 140ms
02.12.2021 17:25:07,089 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:07,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,114 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,117 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,117 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,131 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239954ms for 240000ms of delay, sleeping for 56ms
02.12.2021 17:25:07,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:07,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,184 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,185 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:07,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 10 records with 54 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:07,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 158190ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:07,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:07,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 55 iterations.
02.12.2021 17:25:07,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 0 records with 55 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:07,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 158190ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:07,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:07,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:07,189 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', members=[])
02.12.2021 17:25:07,189 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:07,189 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=55, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', protocol='stream'}
02.12.2021 17:25:07,189 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=55, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=55, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:07,189 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1277) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null,assignments=[]}
02.12.2021 17:25:07,191 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=971010, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:07,191 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=971020, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:07,191 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1277): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:07,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:07,192 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-6, new queue size is 10
02.12.2021 17:25:07,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,192 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:07,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 55 iterations.
02.12.2021 17:25:07,192 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239123ms for 240000ms of delay, sleeping for 887ms
02.12.2021 17:25:07,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:07,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:07,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,229 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,230 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119361ms for 120000ms of delay, sleeping for 649ms
02.12.2021 17:25:07,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:07,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,267 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,268 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 10 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:07,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:07,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 0 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:07,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:07,273 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1151294, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:07,273 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1151304, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:07,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:07,274 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-6, new queue size is 10
02.12.2021 17:25:07,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,274 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:07,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:07,275 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59140ms for 60000ms of delay, sleeping for 870ms
02.12.2021 17:25:07,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:07,291 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=55, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', protocol='stream'}
02.12.2021 17:25:07,315 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:07,318 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:07,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:07,387 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:07,416 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:07,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:07,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:07,488 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:07,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:07,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:07,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,560 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,560 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 450
02.12.2021 17:25:07,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:07,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,614 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:07,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,623 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,623 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,626 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,661 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 349
02.12.2021 17:25:07,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,686 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,686 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 323
02.12.2021 17:25:07,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:07,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:07,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,731 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 249
02.12.2021 17:25:07,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:07,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,771 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,786 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 223
02.12.2021 17:25:07,817 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:07,828 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:07,863 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 147
02.12.2021 17:25:07,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 66 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:07,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 191723ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:07,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:07,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 67 iterations.
02.12.2021 17:25:07,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 67 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:07,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 191725ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:07,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:07,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:07,885 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1038): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', members=[])
02.12.2021 17:25:07,885 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', members=[])
02.12.2021 17:25:07,885 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:07,885 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=186, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}
02.12.2021 17:25:07,885 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=186, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=186, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:07,885 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1039) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null,assignments=[]}
02.12.2021 17:25:07,885 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024262, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:07,887 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024272, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:07,887 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1039): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:07,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:07,888 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:07,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,888 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:07,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 67 iterations.
02.12.2021 17:25:07,889 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119621ms for 120000ms of delay, sleeping for 389ms
02.12.2021 17:25:07,893 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 116
02.12.2021 17:25:07,917 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:07,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:07,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 40
02.12.2021 17:25:07,986 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=186, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}
02.12.2021 17:25:07,993 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 16
02.12.2021 17:25:08,009 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,009 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,010 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 186 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,010 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=686) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null}
02.12.2021 17:25:08,010 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 176
02.12.2021 17:25:08,010 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=686): org.apache.kafka.common.requests.HeartbeatResponse@27e60292
02.12.2021 17:25:08,010 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:08,010 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 186 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e
02.12.2021 17:25:08,010 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:08,010 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:08,010 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,011 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 186 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,010 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,011 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=666) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null}
02.12.2021 17:25:08,011 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 82, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,011 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=687) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:08,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 175
02.12.2021 17:25:08,011 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=666): org.apache.kafka.common.requests.HeartbeatResponse@6bda89f4
02.12.2021 17:25:08,011 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:08,012 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 186 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2
02.12.2021 17:25:08,012 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:08,012 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:08,012 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 82, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,012 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=667) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:08,012 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 48
02.12.2021 17:25:08,017 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:08,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:08,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,061 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,061 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,081 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 236454ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:08,110 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:08,112 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:08,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:08,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,116 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,116 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 132
02.12.2021 17:25:08,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:08,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,127 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,127 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 105
02.12.2021 17:25:08,148 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59454ms for 60000ms of delay, sleeping for 556ms
02.12.2021 17:25:08,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:08,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,187 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,216 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 32
02.12.2021 17:25:08,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 5
02.12.2021 17:25:08,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,233 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,233 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:08,233 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=651) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:08,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 394
02.12.2021 17:25:08,234 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=651): org.apache.kafka.common.requests.HeartbeatResponse@6c1525c9
02.12.2021 17:25:08,234 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:08,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 393
02.12.2021 17:25:08,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 393
02.12.2021 17:25:08,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:08,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,234 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,249 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,249 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:08,249 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=651) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:08,248 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,250 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=651): org.apache.kafka.common.requests.HeartbeatResponse@2e4ed72b
02.12.2021 17:25:08,250 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:08,250 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 366
02.12.2021 17:25:08,250 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 366
02.12.2021 17:25:08,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:08,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,273 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,280 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119155ms for 120000ms of delay, sleeping for 855ms
02.12.2021 17:25:08,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:08,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 266
02.12.2021 17:25:08,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:08,451 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 165
02.12.2021 17:25:08,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:08,551 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 65
02.12.2021 17:25:08,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,562 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,563 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:08,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,616 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,617 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,617 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,617 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,617 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,617 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:08,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,631 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,631 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:08,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,688 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,690 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,706 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59849ms for 60000ms of delay, sleeping for 161ms
02.12.2021 17:25:08,717 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:08,732 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:08,735 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,735 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,735 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,735 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,735 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,735 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,735 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,735 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,735 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,774 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,783 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,818 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:08,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:08,870 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59797ms for 60000ms of delay, sleeping for 213ms
02.12.2021 17:25:08,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:08,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:09,019 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:09,035 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:09,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,064 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,064 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,081 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 237454ms delay out of 240000ms. Remaining 2546ms. Executor queue at 0
02.12.2021 17:25:09,082 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 237453ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:09,085 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59166ms for 60000ms of delay, sleeping for 844ms
02.12.2021 17:25:09,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,118 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,131 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,131 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,137 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119987ms for 120000ms of delay, sleeping for 23ms
02.12.2021 17:25:09,162 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119787ms for 120000ms of delay, sleeping for 223ms
02.12.2021 17:25:09,190 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:09,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,191 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,191 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:09,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:09,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,236 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,285 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,285 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,319 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:09,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:09,388 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119278ms for 120000ms of delay, sleeping for 732ms
02.12.2021 17:25:09,419 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:09,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:09,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:09,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:09,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,565 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,565 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,627 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,627 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,636 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,658 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:09,671 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:09,671 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=950) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:09,692 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,701 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,702 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,704 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:09,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,737 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,737 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,750 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:09,772 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=950): org.apache.kafka.common.requests.HeartbeatResponse@24106631
02.12.2021 17:25:09,776 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:09,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:09,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,787 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,816 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,828 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:09,853 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:09,928 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:09,931 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59565ms for 60000ms of delay, sleeping for 445ms
02.12.2021 17:25:09,956 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:10,028 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:10,056 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:10,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,067 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,067 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,082 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 238453ms delay out of 240000ms. Remaining 1547ms. Executor queue at 1
02.12.2021 17:25:10,083 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238439ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:10,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 67 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:10,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 193965ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:10,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:10,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 68 iterations.
02.12.2021 17:25:10,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 68 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:10,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 193965ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:10,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:10,124 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:10,124 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:10,124 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:10,124 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:10,125 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 82, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 1])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:10,125 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1040) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:10,125 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024272, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:10,125 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024282, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:10,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:10,126 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:10,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,126 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:10,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,127 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 68 iterations.
02.12.2021 17:25:10,127 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119008ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:10,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,128 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,128 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 513 ms and fetched 0 records
02.12.2021 17:25:10,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,149 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,149 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,189 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:10,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:10,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,205 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,218 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:10,218 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:10,218 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1278) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null}
02.12.2021 17:25:10,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:10,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,238 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30130ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:10,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:10,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:10,249 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:10,319 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1278): org.apache.kafka.common.requests.HeartbeatResponse@250d79a5
02.12.2021 17:25:10,319 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:10,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 519 ms and fetched 0 records
02.12.2021 17:25:10,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,319 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30215ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:10,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:10,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:10,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:10,354 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:10,379 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59665ms for 60000ms of delay, sleeping for 345ms
02.12.2021 17:25:10,429 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:10,456 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:10,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:10,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:10,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:10,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,568 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,568 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,629 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,629 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,650 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,650 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,706 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,706 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,725 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59891ms for 60000ms of delay, sleeping for 119ms
02.12.2021 17:25:10,730 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:10,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:10,738 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,739 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30631ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:10,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:10,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,739 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,751 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:10,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:10,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,819 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30715ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:10,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:10,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,830 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:10,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 10 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:10,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:10,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 0 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:10,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:10,858 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:10,854 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1151304, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:10,859 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1151314, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:10,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Main Consumer poll completed in 8 ms and fetched 10 records
02.12.2021 17:25:10,864 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-6, new queue size is 10
02.12.2021 17:25:10,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,864 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:10,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:10,864 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59695ms for 60000ms of delay, sleeping for 315ms
02.12.2021 17:25:10,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:10,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:11,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:11,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:11,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,069 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,069 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,083 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239439ms delay out of 240000ms. Remaining 561ms. Executor queue at 2
02.12.2021 17:25:11,084 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239183ms for 240000ms of delay, sleeping for 827ms
02.12.2021 17:25:11,128 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119233ms for 120000ms of delay, sleeping for 777ms
02.12.2021 17:25:11,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,129 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,130 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 119
02.12.2021 17:25:11,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,150 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,151 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 82
02.12.2021 17:25:11,181 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59459ms for 60000ms of delay, sleeping for 551ms
02.12.2021 17:25:11,207 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,207 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,207 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 19
02.12.2021 17:25:11,233 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:11,233 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:11,233 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=652) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:11,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 418
02.12.2021 17:25:11,234 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=652): org.apache.kafka.common.requests.HeartbeatResponse@56cbde93
02.12.2021 17:25:11,234 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:11,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 417
02.12.2021 17:25:11,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 417
02.12.2021 17:25:11,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,240 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31132ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:11,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:11,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,249 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:11,250 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:11,249 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,250 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=652) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:11,251 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 379
02.12.2021 17:25:11,258 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=652): org.apache.kafka.common.requests.HeartbeatResponse@222dfbec
02.12.2021 17:25:11,258 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:11,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 372
02.12.2021 17:25:11,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 372
02.12.2021 17:25:11,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,320 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31217ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:11,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:11,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 316
02.12.2021 17:25:11,358 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 272
02.12.2021 17:25:11,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 216
02.12.2021 17:25:11,460 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 170
02.12.2021 17:25:11,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 116
02.12.2021 17:25:11,560 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 70
02.12.2021 17:25:11,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:11,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,571 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30152ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:11,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:11,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,631 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,631 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,631 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:11,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 15
02.12.2021 17:25:11,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,651 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,652 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:11,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:11,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,716 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30188ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:11,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:11,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:11,736 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59615ms for 60000ms of delay, sleeping for 395ms
02.12.2021 17:25:11,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,752 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:11,751 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31648ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:11,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:11,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,831 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31728ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:11,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:11,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,832 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:11,832 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,856 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:11,910 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119768ms for 120000ms of delay, sleeping for 242ms
02.12.2021 17:25:11,932 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239902ms for 240000ms of delay, sleeping for 108ms
02.12.2021 17:25:11,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:11,964 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 187
02.12.2021 17:25:12,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:12,042 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239913ms for 240000ms of delay, sleeping for 97ms
02.12.2021 17:25:12,065 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:12,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,072 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30653ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:12,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:12,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,073 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:12,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,132 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,132 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,134 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59890ms for 60000ms of delay, sleeping for 120ms
02.12.2021 17:25:12,140 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239570ms for 240000ms of delay, sleeping for 440ms
02.12.2021 17:25:12,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,152 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,152 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,154 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119998ms for 120000ms of delay, sleeping for 12ms
02.12.2021 17:25:12,168 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119778ms for 120000ms of delay, sleeping for 232ms
02.12.2021 17:25:12,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,217 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30689ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:12,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:12,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:12,253 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:12,260 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59439ms for 60000ms of delay, sleeping for 571ms
02.12.2021 17:25:12,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:12,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,267 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32161ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:12,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:12,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,333 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,333 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:12,333 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32230ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:12,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:12,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,353 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:12,403 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119669ms for 120000ms of delay, sleeping for 341ms
02.12.2021 17:25:12,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:12,454 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:12,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:12,554 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:12,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,574 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31155ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:12,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:12,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,574 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,582 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239246ms for 240000ms of delay, sleeping for 764ms
02.12.2021 17:25:12,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,633 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,654 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,654 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,680 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:12,686 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:12,687 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=951) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:12,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,718 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31190ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:12,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:12,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,718 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,734 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:12,746 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119804ms for 120000ms of delay, sleeping for 206ms
02.12.2021 17:25:12,754 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:12,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:12,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,790 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32683ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:12,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:12,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,791 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,791 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=951): org.apache.kafka.common.requests.HeartbeatResponse@7f125697
02.12.2021 17:25:12,792 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:12,835 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59860ms for 60000ms of delay, sleeping for 150ms
02.12.2021 17:25:12,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:12,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,836 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32732ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:12,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:12,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,838 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,873 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 281
02.12.2021 17:25:12,935 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:12,953 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119969ms for 120000ms of delay, sleeping for 41ms
02.12.2021 17:25:12,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 178
02.12.2021 17:25:12,988 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59134ms for 60000ms of delay, sleeping for 876ms
02.12.2021 17:25:12,997 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118883ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:13,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:13,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,075 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31656ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:13,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:13,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,075 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,076 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 78
02.12.2021 17:25:13,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,133 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,155 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,155 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,155 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,219 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31691ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:13,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:13,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,223 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:13,224 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:13,224 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1279) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null}
02.12.2021 17:25:13,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:13,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:13,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,292 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Committing all active tasks [] and standby tasks [] since 33184ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:13,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:13,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,325 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1279): org.apache.kafka.common.requests.HeartbeatResponse@189af321
02.12.2021 17:25:13,325 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:13,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:13,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:13,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,340 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Committing all active tasks [] and standby tasks [] since 33236ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:13,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:13,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,340 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,348 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239304ms for 240000ms of delay, sleeping for 706ms
02.12.2021 17:25:13,356 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:13,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:13,459 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:13,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:13,559 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:13,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,576 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32157ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:13,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:13,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,635 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,636 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,655 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,659 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,660 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,721 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32193ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:13,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:13,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,723 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,737 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:13,760 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:13,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:13,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,805 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Committing all active tasks [] and standby tasks [] since 33698ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:13,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:13,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:13,839 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:13,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,843 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Committing all active tasks [] and standby tasks [] since 33739ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:13,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:13,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,843 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:13,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 10 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:13,870 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:13,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 0 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:13,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:13,880 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=687): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', members=[])
02.12.2021 17:25:13,879 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=667): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', members=[])
02.12.2021 17:25:13,889 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', members=[])
02.12.2021 17:25:13,890 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:13,889 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', members=[])
02.12.2021 17:25:13,890 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:13,890 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=187, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}
02.12.2021 17:25:13,888 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1151314, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:13,891 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1151324, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:13,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Main Consumer poll completed in 7 ms and fetched 10 records
02.12.2021 17:25:13,891 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-6, new queue size is 10
02.12.2021 17:25:13,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,891 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:13,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:13,890 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=187, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=187, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:13,894 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=688) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:13,890 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=187, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}
02.12.2021 17:25:13,895 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=187, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=187, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:13,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 328
02.12.2021 17:25:13,900 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59847ms for 60000ms of delay, sleeping for 163ms
02.12.2021 17:25:13,896 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=668) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null,assignments=[]}
02.12.2021 17:25:13,901 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 176
02.12.2021 17:25:13,940 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:13,973 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 187
02.12.2021 17:25:13,997 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119883ms delay out of 120000ms. Remaining 117ms. Executor queue at 0
02.12.2021 17:25:13,998 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118913ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:14,012 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=668): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,012 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,012 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=187, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}
02.12.2021 17:25:14,012 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 187 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2
02.12.2021 17:25:14,012 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:14,012 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,013 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,013 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:14,013 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,013 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3] State transition from RUNNING to REBALANCING
02.12.2021 17:25:14,013 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:14,012 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=688): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,014 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,014 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=187, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}
02.12.2021 17:25:14,013 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 65
02.12.2021 17:25:14,014 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 187 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e
02.12.2021 17:25:14,019 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:14,019 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,019 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,020 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:14,020 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,020 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:14,020 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 209
02.12.2021 17:25:14,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:14,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 10 records with 55 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 165058ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:14,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:14,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 56 iterations.
02.12.2021 17:25:14,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 0 records with 56 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 165058ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:14,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:14,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:14,056 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:14,056 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:14,056 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:14,057 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 98, -37, -94, -95, -98, 75, 74, -34, -67, -86, 25, 43, 40, 125, 10, 127, 0, 0, 0, 0, 0, 0, 0, 0, 33, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 6])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:14,057 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1280) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:14,057 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=971020, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:14,057 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=971030, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:14,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:14,057 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-6, new queue size is 10
02.12.2021 17:25:14,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,057 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:14,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 56 iterations.
02.12.2021 17:25:14,058 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=659): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', members=[])
02.12.2021 17:25:14,058 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', members=[])
02.12.2021 17:25:14,058 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:14,058 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=56, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', protocol='stream'}
02.12.2021 17:25:14,058 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=56, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=56, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,058 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=660) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,058 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=659): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', members=[])
02.12.2021 17:25:14,058 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', members=[])
02.12.2021 17:25:14,058 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:14,059 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=56, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', protocol='stream'}
02.12.2021 17:25:14,059 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=56, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=56, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,059 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=660) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 284
02.12.2021 17:25:14,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 250
02.12.2021 17:25:14,059 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239938ms for 240000ms of delay, sleeping for 72ms
02.12.2021 17:25:14,064 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59084ms for 60000ms of delay, sleeping for 926ms
02.12.2021 17:25:14,075 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 85
02.12.2021 17:25:14,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:14,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,080 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:14,080 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,080 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,081 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:14,081 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:14,081 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,081 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,081 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:14,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,081 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32662ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:14,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,081 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,101 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=660): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,101 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,101 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=56, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', protocol='stream'}
02.12.2021 17:25:14,101 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 56 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab
02.12.2021 17:25:14,101 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:14,101 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,101 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,102 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:14,102 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,102 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f] State transition from RUNNING to REBALANCING
02.12.2021 17:25:14,102 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:14,102 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 207
02.12.2021 17:25:14,101 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=660): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,102 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,102 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=56, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', protocol='stream'}
02.12.2021 17:25:14,102 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 56 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164
02.12.2021 17:25:14,102 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:14,103 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,103 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,103 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:14,103 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,103 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:14,103 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 241
02.12.2021 17:25:14,120 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 103
02.12.2021 17:25:14,128 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:14,133 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239251ms for 240000ms of delay, sleeping for 759ms
02.12.2021 17:25:14,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,137 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,137 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 112
02.12.2021 17:25:14,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,161 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,161 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 72
02.12.2021 17:25:14,182 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:14,203 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 140
02.12.2021 17:25:14,203 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 105
02.12.2021 17:25:14,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 3
02.12.2021 17:25:14,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:14,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,224 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:14,224 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,224 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,224 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:14,224 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:14,224 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,224 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,224 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,225 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3] State transition from REBALANCING to RUNNING
02.12.2021 17:25:14,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:14,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,226 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32698ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:14,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,233 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:14,233 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:14,234 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=653) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:14,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 428
02.12.2021 17:25:14,234 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=653): org.apache.kafka.common.requests.HeartbeatResponse@706ca182
02.12.2021 17:25:14,234 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:14,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 427
02.12.2021 17:25:14,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 427
02.12.2021 17:25:14,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 12
02.12.2021 17:25:14,249 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,250 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:14,250 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:14,250 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=653) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:14,250 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 387
02.12.2021 17:25:14,251 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=653): org.apache.kafka.common.requests.HeartbeatResponse@787de13f
02.12.2021 17:25:14,256 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:14,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 381
02.12.2021 17:25:14,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 379
02.12.2021 17:25:14,282 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:14,304 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 4
02.12.2021 17:25:14,304 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 39
02.12.2021 17:25:14,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,308 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:14,308 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,308 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,308 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:14,308 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:14,308 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,309 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,309 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:14,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,309 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Committing all active tasks [] and standby tasks [] since 34201ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:14,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,309 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,327 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:14,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 326
02.12.2021 17:25:14,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,343 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:14,343 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,343 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,343 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:14,344 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:14,344 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,344 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,344 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,344 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f] State transition from REBALANCING to RUNNING
02.12.2021 17:25:14,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:14,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,344 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Committing all active tasks [] and standby tasks [] since 34240ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:14,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,360 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 277
02.12.2021 17:25:14,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:14,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:14,427 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:14,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 226
02.12.2021 17:25:14,444 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:14,460 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 177
02.12.2021 17:25:14,483 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:14,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:14,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:14,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 125
02.12.2021 17:25:14,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:14,561 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 76
02.12.2021 17:25:14,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,581 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,610 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:14,627 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:14,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 25
02.12.2021 17:25:14,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,637 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:14,645 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:14,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,662 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,662 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,662 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:14,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:14,711 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:14,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:14,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,728 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,739 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:14,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:14,763 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:14,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:14,809 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,812 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,812 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:14,843 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:14,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:14,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,855 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,872 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 290
02.12.2021 17:25:14,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 195
02.12.2021 17:25:14,906 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239591ms for 240000ms of delay, sleeping for 419ms
02.12.2021 17:25:14,912 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:14,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:14,954 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 183
02.12.2021 17:25:14,960 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:14,974 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 188
02.12.2021 17:25:14,986 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:14,992 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59947ms for 60000ms of delay, sleeping for 63ms
02.12.2021 17:25:14,998 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119913ms delay out of 120000ms. Remaining 87ms. Executor queue at 0
02.12.2021 17:25:14,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 68 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 198839ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:14,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:14,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 69 iterations.
02.12.2021 17:25:14,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 69 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 198840ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:14,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:14,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:14,999 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1040): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', members=[])
02.12.2021 17:25:14,999 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', members=[])
02.12.2021 17:25:14,999 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:14,999 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=187, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}
02.12.2021 17:25:14,999 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=187, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=187, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:15,000 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024282, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:15,000 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024292, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:15,000 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1041) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null,assignments=[]}
02.12.2021 17:25:15,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:15,001 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:15,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,001 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:15,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 69 iterations.
02.12.2021 17:25:15,001 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119476ms for 120000ms of delay, sleeping for 534ms
02.12.2021 17:25:15,013 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:15,035 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:15,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:15,057 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58344ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:15,060 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:15,074 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:15,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,082 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,082 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,100 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1041): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:15,100 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=187, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}
02.12.2021 17:25:15,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:15,135 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:15,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,138 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,161 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:15,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,164 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,165 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,183 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:15,213 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:15,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,232 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:15,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:15,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:15,286 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:15,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,313 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,313 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,328 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239483ms for 240000ms of delay, sleeping for 527ms
02.12.2021 17:25:15,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:15,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:15,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:15,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,360 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,360 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,371 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:15,390 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 192
02.12.2021 17:25:15,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:15,433 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:15,443 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:15,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:15,473 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:15,491 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:15,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:15,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:15,539 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119394ms for 120000ms of delay, sleeping for 616ms
02.12.2021 17:25:15,543 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:15,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:15,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:15,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,586 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:15,638 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,639 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,639 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,639 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,639 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,639 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,639 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,639 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,634 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:15,662 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:15,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,670 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,670 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,693 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:15,706 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:15,707 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:15,707 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=952) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:15,715 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:15,739 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:15,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 517 ms and fetched 0 records
02.12.2021 17:25:15,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,758 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,758 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,771 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:15,763 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:15,793 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:15,810 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=952): org.apache.kafka.common.requests.HeartbeatResponse@b0cc616
02.12.2021 17:25:15,812 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:15,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:15,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,822 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,823 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,823 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,829 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,840 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:15,858 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:15,860 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239467ms for 240000ms of delay, sleeping for 543ms
02.12.2021 17:25:15,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:15,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,869 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,869 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:15,894 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:15,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:15,940 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:15,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:15,969 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:15,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:15,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:16,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:16,040 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:16,058 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59346ms delay out of 60000ms. Remaining 654ms. Executor queue at 0
02.12.2021 17:25:16,059 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59179ms for 60000ms of delay, sleeping for 831ms
02.12.2021 17:25:16,065 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 193
02.12.2021 17:25:16,070 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:16,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:16,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:16,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,095 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,095 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:16,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:16,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,140 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,140 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,159 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119938ms for 120000ms of delay, sleeping for 72ms
02.12.2021 17:25:16,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:16,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,170 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,170 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:16,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,195 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:16,233 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119979ms for 120000ms of delay, sleeping for 31ms
02.12.2021 17:25:16,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:16,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:16,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,263 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:16,272 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119348ms for 120000ms of delay, sleeping for 662ms
02.12.2021 17:25:16,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:16,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:16,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:16,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:16,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,329 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,329 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:16,340 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:16,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,370 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:16,373 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:16,373 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:16,396 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:16,404 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238545ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:16,430 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:16,441 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:16,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:16,474 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:16,474 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:16,496 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:16,530 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:16,541 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:16,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:16,574 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:16,574 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:16,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,597 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 292
02.12.2021 17:25:16,631 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:16,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,640 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,641 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,671 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:16,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,672 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,672 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,675 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:16,699 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 191
02.12.2021 17:25:16,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:16,741 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:16,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:16,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 510 ms and fetched 0 records
02.12.2021 17:25:16,774 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,774 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:16,774 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 111
02.12.2021 17:25:16,799 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:16,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,830 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 225
02.12.2021 17:25:16,841 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:16,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:16,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,872 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,873 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 186
02.12.2021 17:25:16,874 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:16,881 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 9
02.12.2021 17:25:16,890 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:16,891 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:16,891 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:16,891 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:16,891 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 187 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:16,891 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:16,891 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=689) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null}
02.12.2021 17:25:16,891 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 388
02.12.2021 17:25:16,892 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=689): org.apache.kafka.common.requests.HeartbeatResponse@1be4ce1
02.12.2021 17:25:16,892 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:16,892 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 187 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e
02.12.2021 17:25:16,892 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:16,892 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:16,892 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 83, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:16,892 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=690) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:16,892 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 387
02.12.2021 17:25:16,893 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59831ms for 60000ms of delay, sleeping for 179ms
02.12.2021 17:25:16,894 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:16,894 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:16,894 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:16,895 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:16,895 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 187 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:16,895 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=669) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null}
02.12.2021 17:25:16,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 204
02.12.2021 17:25:16,895 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=669): org.apache.kafka.common.requests.HeartbeatResponse@2b1e9e0f
02.12.2021 17:25:16,895 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:16,895 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 187 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2
02.12.2021 17:25:16,895 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:16,895 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:16,895 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 83, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:16,896 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=670) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:16,896 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 202
02.12.2021 17:25:16,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 124
02.12.2021 17:25:16,936 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118777ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:16,942 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:16,973 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 86
02.12.2021 17:25:16,974 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:16,992 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:16,995 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:17,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 24
02.12.2021 17:25:17,042 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:17,058 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,059 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,059 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 56 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,059 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=661) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null}
02.12.2021 17:25:17,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 274
02.12.2021 17:25:17,059 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,059 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 56 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,060 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=661) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null}
02.12.2021 17:25:17,060 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=661): org.apache.kafka.common.requests.HeartbeatResponse@3bb00f78
02.12.2021 17:25:17,060 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 314
02.12.2021 17:25:17,060 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,060 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=661): org.apache.kafka.common.requests.HeartbeatResponse@2b045d24
02.12.2021 17:25:17,060 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,060 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 56 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164
02.12.2021 17:25:17,060 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 56 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab
02.12.2021 17:25:17,060 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:17,060 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:17,061 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 98, -37, -94, -95, -98, 75, 74, -34, -67, -86, 25, 43, 40, 125, 10, 127, 0, 0, 0, 0, 0, 0, 0, 0, 34, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,061 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=662) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,061 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 312
02.12.2021 17:25:17,060 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:17,061 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:17,061 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 98, -37, -94, -95, -98, 75, 74, -34, -67, -86, 25, 43, 40, 125, 10, 127, 0, 0, 0, 0, 0, 0, 0, 0, 34, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,061 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=662) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,062 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 271
02.12.2021 17:25:17,074 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59963ms for 60000ms of delay, sleeping for 47ms
02.12.2021 17:25:17,074 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:17,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,098 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,099 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:17,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 10 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:17,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 18 iterations.
02.12.2021 17:25:17,122 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 0 records with 18 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:17,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:17,123 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1151324, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:17,123 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1151334, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:17,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:17,123 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-6, new queue size is 10
02.12.2021 17:25:17,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,123 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:17,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 18 iterations.
02.12.2021 17:25:17,125 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59954ms for 60000ms of delay, sleeping for 56ms
02.12.2021 17:25:17,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,141 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,141 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 109
02.12.2021 17:25:17,159 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:17,160 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:17,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,173 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,173 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 60
02.12.2021 17:25:17,183 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59202ms for 60000ms of delay, sleeping for 808ms
02.12.2021 17:25:17,233 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,233 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:17,233 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=654) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:17,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 440
02.12.2021 17:25:17,234 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=654): org.apache.kafka.common.requests.HeartbeatResponse@56d5835d
02.12.2021 17:25:17,234 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:17,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 439
02.12.2021 17:25:17,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 439
02.12.2021 17:25:17,242 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 8
02.12.2021 17:25:17,253 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,253 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:17,253 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:17,254 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=654) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:17,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 388
02.12.2021 17:25:17,259 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=654): org.apache.kafka.common.requests.HeartbeatResponse@22e0966a
02.12.2021 17:25:17,259 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:17,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 382
02.12.2021 17:25:17,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 382
02.12.2021 17:25:17,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:17,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,280 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:17,333 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,333 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,333 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 338
02.12.2021 17:25:17,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,336 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,360 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 281
02.12.2021 17:25:17,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,374 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,404 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239545ms delay out of 240000ms. Remaining 455ms. Executor queue at 0
02.12.2021 17:25:17,405 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239258ms for 240000ms of delay, sleeping for 752ms
02.12.2021 17:25:17,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 238
02.12.2021 17:25:17,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 181
02.12.2021 17:25:17,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 137
02.12.2021 17:25:17,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 79
02.12.2021 17:25:17,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,600 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,600 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 36
02.12.2021 17:25:17,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,642 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:17,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,677 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,677 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:17,755 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 393
02.12.2021 17:25:17,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:17,780 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,783 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,845 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,845 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,856 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:17,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,879 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:17,880 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,936 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119777ms delay out of 120000ms. Remaining 223ms. Executor queue at 0
02.12.2021 17:25:17,941 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119738ms for 120000ms of delay, sleeping for 272ms
02.12.2021 17:25:17,957 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:17,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:17,995 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59182ms for 60000ms of delay, sleeping for 828ms
02.12.2021 17:25:18,010 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:18,010 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 187 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:18,010 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1042) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null}
02.12.2021 17:25:18,057 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:18,084 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:18,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,101 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,101 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,102 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,110 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1042): org.apache.kafka.common.requests.HeartbeatResponse@2c017161
02.12.2021 17:25:18,111 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:18,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 517 ms and fetched 0 records
02.12.2021 17:25:18,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,160 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,163 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239858ms for 240000ms of delay, sleeping for 152ms
02.12.2021 17:25:18,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:18,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,177 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,177 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,215 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119453ms for 120000ms of delay, sleeping for 557ms
02.12.2021 17:25:18,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:18,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:18,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:18,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,292 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 10 records with 56 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:18,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 169319ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:18,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:18,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 57 iterations.
02.12.2021 17:25:18,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 0 records with 57 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:18,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 169319ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:18,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:18,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:18,317 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1280): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', members=[])
02.12.2021 17:25:18,318 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', members=[])
02.12.2021 17:25:18,318 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:18,318 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=56, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', protocol='stream'}
02.12.2021 17:25:18,318 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=56, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=56, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:18,318 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=971030, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:18,318 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1281) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null,assignments=[]}
02.12.2021 17:25:18,319 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=971040, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:18,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:18,319 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-6, new queue size is 10
02.12.2021 17:25:18,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,319 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:18,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 57 iterations.
02.12.2021 17:25:18,320 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239136ms for 240000ms of delay, sleeping for 874ms
02.12.2021 17:25:18,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:18,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,347 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:18,379 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:18,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:18,390 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,391 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,392 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,423 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1281): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:18,423 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=56, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', protocol='stream'}
02.12.2021 17:25:18,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:18,479 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:18,566 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:18,579 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:18,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,602 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,661 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,661 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,661 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,678 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,679 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,679 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,722 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:18,722 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:18,723 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=953) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:18,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:18,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:18,780 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119947ms for 120000ms of delay, sleeping for 63ms
02.12.2021 17:25:18,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,795 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,795 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,823 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=953): org.apache.kafka.common.requests.HeartbeatResponse@589fe9a9
02.12.2021 17:25:18,823 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:18,828 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59948ms for 60000ms of delay, sleeping for 62ms
02.12.2021 17:25:18,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:18,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,849 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,848 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119797ms for 120000ms of delay, sleeping for 213ms
02.12.2021 17:25:18,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,851 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:18,880 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:18,892 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59271ms for 60000ms of delay, sleeping for 739ms
02.12.2021 17:25:18,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,893 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,894 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,963 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:18,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:19,063 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:19,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 69 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:19,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 202905ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:19,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:19,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 70 iterations.
02.12.2021 17:25:19,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 70 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:19,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 202905ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:19,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:19,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:19,064 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:19,065 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:19,065 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:19,065 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 83, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 1])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:19,065 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1043) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:19,065 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024292, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:19,065 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024302, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:19,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:19,066 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:19,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,066 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:19,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 70 iterations.
02.12.2021 17:25:19,066 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119954ms for 120000ms of delay, sleeping for 56ms
02.12.2021 17:25:19,081 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:19,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,103 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,103 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,104 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,113 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:19,124 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119600ms for 120000ms of delay, sleeping for 410ms
02.12.2021 17:25:19,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,161 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,162 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,179 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,179 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,180 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,197 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239325ms for 240000ms of delay, sleeping for 685ms
02.12.2021 17:25:19,262 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:19,280 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:19,297 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:19,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,298 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,298 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:19,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,352 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:19,381 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:19,394 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,396 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,396 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,463 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:19,481 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:19,539 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119603ms for 120000ms of delay, sleeping for 407ms
02.12.2021 17:25:19,565 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:19,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:19,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,604 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,637 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59511ms for 60000ms of delay, sleeping for 499ms
02.12.2021 17:25:19,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,663 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,681 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,681 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:19,782 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:19,798 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,806 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,853 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,869 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:19,864 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,887 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239974ms for 240000ms of delay, sleeping for 36ms
02.12.2021 17:25:19,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:19,897 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,904 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,905 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,925 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239761ms for 240000ms of delay, sleeping for 249ms
02.12.2021 17:25:19,948 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119964ms for 120000ms of delay, sleeping for 46ms
02.12.2021 17:25:19,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:19,988 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:19,995 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119869ms for 120000ms of delay, sleeping for 141ms
02.12.2021 17:25:20,071 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:20,091 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:20,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,106 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,106 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 10 records with 18 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:20,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 19 iterations.
02.12.2021 17:25:20,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 0 records with 19 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:20,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:20,138 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1151334, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:20,138 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1151344, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:20,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:20,138 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-6, new queue size is 10
02.12.2021 17:25:20,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,138 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:20,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,139 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 19 iterations.
02.12.2021 17:25:20,139 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119388ms for 120000ms of delay, sleeping for 622ms
02.12.2021 17:25:20,139 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59395ms for 60000ms of delay, sleeping for 615ms
02.12.2021 17:25:20,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:20,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,165 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:20,175 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239343ms for 240000ms of delay, sleeping for 667ms
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,182 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 51
02.12.2021 17:25:20,233 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:20,233 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:20,234 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=655) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:20,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 449
02.12.2021 17:25:20,234 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=655): org.apache.kafka.common.requests.HeartbeatResponse@132bcf23
02.12.2021 17:25:20,234 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:20,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 448
02.12.2021 17:25:20,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 448
02.12.2021 17:25:20,253 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:20,253 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:20,253 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=655) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:20,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 413
02.12.2021 17:25:20,256 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=655): org.apache.kafka.common.requests.HeartbeatResponse@7acffa92
02.12.2021 17:25:20,257 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:20,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 409
02.12.2021 17:25:20,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 409
02.12.2021 17:25:20,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,307 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,308 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 347
02.12.2021 17:25:20,357 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 309
02.12.2021 17:25:20,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 523 ms and fetched 0 records
02.12.2021 17:25:20,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,376 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,405 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,406 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 247
02.12.2021 17:25:20,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 209
02.12.2021 17:25:20,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 146
02.12.2021 17:25:20,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 108
02.12.2021 17:25:20,608 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:20,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,611 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 45
02.12.2021 17:25:20,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 7
02.12.2021 17:25:20,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:20,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,667 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,667 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:20,682 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,683 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,685 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:20,762 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59921ms for 60000ms of delay, sleeping for 89ms
02.12.2021 17:25:20,765 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119629ms for 120000ms of delay, sleeping for 381ms
02.12.2021 17:25:20,768 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:20,785 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:20,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,809 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,809 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,809 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,809 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,809 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,809 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,809 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,853 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59879ms for 60000ms of delay, sleeping for 131ms
02.12.2021 17:25:20,854 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239913ms for 240000ms of delay, sleeping for 97ms
02.12.2021 17:25:20,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:20,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,877 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,885 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:20,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,907 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,907 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,957 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239838ms for 240000ms of delay, sleeping for 172ms
02.12.2021 17:25:20,968 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:20,985 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:20,986 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58825ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:21,069 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:21,086 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:21,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,112 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,112 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,131 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239731ms for 240000ms of delay, sleeping for 279ms
02.12.2021 17:25:21,149 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119203ms for 120000ms of delay, sleeping for 807ms
02.12.2021 17:25:21,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,167 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,168 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,185 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,185 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,268 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:21,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:21,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,310 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,310 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,331 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:21,332 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 56 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:21,332 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1282) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null}
02.12.2021 17:25:21,368 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:21,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,378 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,378 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,390 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:21,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:21,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,410 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,410 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 10 records with 57 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:21,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 172414ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:21,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:21,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 58 iterations.
02.12.2021 17:25:21,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 0 records with 58 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:21,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 172414ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:21,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:21,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:21,412 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1282): org.apache.kafka.common.requests.HeartbeatResponse@36a6a025
02.12.2021 17:25:21,412 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:21,412 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:21,412 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:21,413 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:21,413 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 98, -37, -94, -95, -98, 75, 74, -34, -67, -86, 25, 43, 40, 125, 10, 127, 0, 0, 0, 0, 0, 0, 0, 0, 34, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 6])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:21,413 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1283) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:21,413 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=971040, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:21,413 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=971050, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:21,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:21,414 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-6, new queue size is 10
02.12.2021 17:25:21,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,414 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:21,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 58 iterations.
02.12.2021 17:25:21,414 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239232ms for 240000ms of delay, sleeping for 778ms
02.12.2021 17:25:21,432 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:21,469 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:21,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:21,569 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:21,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:21,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,613 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,613 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:21,675 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,680 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,681 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,688 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,693 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,727 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:21,739 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:21,740 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=954) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:21,785 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:21,794 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:21,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:21,814 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,814 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,814 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,815 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,815 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,815 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,815 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,815 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,840 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=954): org.apache.kafka.common.requests.HeartbeatResponse@7f992d65
02.12.2021 17:25:21,844 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:21,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,883 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,884 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,894 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:21,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:21,905 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=662): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', members=[])
02.12.2021 17:25:21,907 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', members=[])
02.12.2021 17:25:21,907 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:21,907 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=57, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', protocol='stream'}
02.12.2021 17:25:21,907 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=57, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=57, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:21,907 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=663) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null,assignments=[]}
02.12.2021 17:25:21,907 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 3
02.12.2021 17:25:21,905 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=662): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', members=[])
02.12.2021 17:25:21,908 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', members=[])
02.12.2021 17:25:21,908 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:21,908 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=57, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', protocol='stream'}
02.12.2021 17:25:21,908 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=57, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=57, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:21,908 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=663) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null,assignments=[]}
02.12.2021 17:25:21,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:21,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,915 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,915 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,915 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 469
02.12.2021 17:25:21,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 70 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:21,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 205798ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:21,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:21,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 71 iterations.
02.12.2021 17:25:21,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 71 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:21,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 205799ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:21,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:21,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:21,958 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024302, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:21,958 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024312, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:21,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:21,967 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:21,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,967 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:21,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 71 iterations.
02.12.2021 17:25:21,968 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119867ms for 120000ms of delay, sleeping for 143ms
02.12.2021 17:25:21,987 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59826ms delay out of 60000ms. Remaining 174ms. Executor queue at 0
02.12.2021 17:25:21,995 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:21,995 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:22,001 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59823ms for 60000ms of delay, sleeping for 187ms
02.12.2021 17:25:22,039 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=663): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,039 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=663): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,039 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,040 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=57, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', protocol='stream'}
02.12.2021 17:25:22,039 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,040 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 57 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab
02.12.2021 17:25:22,041 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:22,040 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=57, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', protocol='stream'}
02.12.2021 17:25:22,042 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,042 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,042 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 57 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164
02.12.2021 17:25:22,042 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:22,043 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,043 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:22,043 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f] State transition from RUNNING to REBALANCING
02.12.2021 17:25:22,043 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:22,044 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 345
02.12.2021 17:25:22,043 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,044 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,045 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:22,045 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,045 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:22,046 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 376
02.12.2021 17:25:22,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 81
02.12.2021 17:25:22,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:22,114 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119914ms for 120000ms of delay, sleeping for 96ms
02.12.2021 17:25:22,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,114 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,114 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,144 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 240
02.12.2021 17:25:22,146 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 269
02.12.2021 17:25:22,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,181 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,181 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,181 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,190 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59215ms for 60000ms of delay, sleeping for 795ms
02.12.2021 17:25:22,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:22,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,193 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,194 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239339ms for 240000ms of delay, sleeping for 671ms
02.12.2021 17:25:22,213 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119102ms for 120000ms of delay, sleeping for 908ms
02.12.2021 17:25:22,246 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 169
02.12.2021 17:25:22,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 140
02.12.2021 17:25:22,282 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:22,294 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:22,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,316 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,316 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 69
02.12.2021 17:25:22,348 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 36
02.12.2021 17:25:22,383 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:22,385 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,385 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,385 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:22,385 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,385 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,385 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:22,385 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:22,385 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,385 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,386 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:22,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,386 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,386 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,394 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:22,397 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=670): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', members=[])
02.12.2021 17:25:22,397 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', members=[])
02.12.2021 17:25:22,397 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:22,397 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=188, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}
02.12.2021 17:25:22,397 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=188, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=188, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,398 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=671) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,398 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=690): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', members=[])
02.12.2021 17:25:22,398 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', members=[])
02.12.2021 17:25:22,398 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:22,398 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=188, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}
02.12.2021 17:25:22,398 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=188, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=188, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,398 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=691) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,398 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 418
02.12.2021 17:25:22,398 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 216
02.12.2021 17:25:22,416 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,416 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,416 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:22,416 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,416 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,416 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:22,416 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:22,416 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,416 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,416 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,416 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f] State transition from REBALANCING to RUNNING
02.12.2021 17:25:22,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:22,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,417 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,417 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=671): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,435 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=188, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}
02.12.2021 17:25:22,435 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 188 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2
02.12.2021 17:25:22,436 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:22,436 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,436 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,436 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:22,436 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,436 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3] State transition from RUNNING to REBALANCING
02.12.2021 17:25:22,436 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:22,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 179
02.12.2021 17:25:22,436 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=691): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,436 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,436 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=188, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}
02.12.2021 17:25:22,436 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 188 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e
02.12.2021 17:25:22,437 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:22,437 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,437 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,438 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:22,438 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,438 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:22,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 380
02.12.2021 17:25:22,483 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:22,486 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:22,495 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:22,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:22,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 78
02.12.2021 17:25:22,539 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 278
02.12.2021 17:25:22,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:22,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:22,599 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:22,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,615 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:22,615 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,615 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,615 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:22,615 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:22,615 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,615 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,615 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:22,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,616 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,616 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,618 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:22,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 177
02.12.2021 17:25:22,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:22,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,683 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,689 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:22,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:22,694 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,695 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,695 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,717 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:22,718 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:22,740 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 77
02.12.2021 17:25:22,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:22,789 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:22,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:22,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,818 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:22,817 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:22,818 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:22,819 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,821 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:22,823 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:22,823 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,823 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,823 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,823 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3] State transition from REBALANCING to RUNNING
02.12.2021 17:25:22,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:22,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,824 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,826 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,880 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238936ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:22,884 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:22,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:22,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,892 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,898 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:22,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,918 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,918 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:22,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:22,985 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:22,987 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59998ms for 60000ms of delay, sleeping for 12ms
02.12.2021 17:25:22,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:22,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:23,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 10 records with 19 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:23,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 20 iterations.
02.12.2021 17:25:23,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 0 records with 20 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:23,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:23,001 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1151344, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:23,001 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1151354, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:23,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:23,001 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-6, new queue size is 10
02.12.2021 17:25:23,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,001 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:23,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,001 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 20 iterations.
02.12.2021 17:25:23,001 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 57981ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:23,018 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:23,019 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:23,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:23,085 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:23,097 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:23,099 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:23,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,117 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,117 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,119 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:23,122 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119657ms for 120000ms of delay, sleeping for 353ms
02.12.2021 17:25:23,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 193
02.12.2021 17:25:23,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,184 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,184 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 69
02.12.2021 17:25:23,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,195 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 37
02.12.2021 17:25:23,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:23,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:23,219 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:23,233 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:23,233 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:23,233 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=656) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:23,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:23,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 463
02.12.2021 17:25:23,234 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=656): org.apache.kafka.common.requests.HeartbeatResponse@1b9cb493
02.12.2021 17:25:23,234 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:23,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 462
02.12.2021 17:25:23,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 462
02.12.2021 17:25:23,253 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:23,254 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:23,254 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=656) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:23,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 431
02.12.2021 17:25:23,255 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=656): org.apache.kafka.common.requests.HeartbeatResponse@37709cbc
02.12.2021 17:25:23,256 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:23,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 428
02.12.2021 17:25:23,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 428
02.12.2021 17:25:23,298 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:23,318 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:23,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:23,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:23,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,327 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,327 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 362
02.12.2021 17:25:23,357 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 327
02.12.2021 17:25:23,395 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:23,395 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,397 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,418 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:23,427 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:23,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 261
02.12.2021 17:25:23,459 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 225
02.12.2021 17:25:23,478 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119944ms for 120000ms of delay, sleeping for 66ms
02.12.2021 17:25:23,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:23,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:23,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:23,528 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:23,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 161
02.12.2021 17:25:23,547 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119333ms for 120000ms of delay, sleeping for 677ms
02.12.2021 17:25:23,560 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 124
02.12.2021 17:25:23,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:23,619 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:23,617 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,629 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:23,626 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,635 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 61
02.12.2021 17:25:23,660 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 24
02.12.2021 17:25:23,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,686 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,686 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:23,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:23,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,701 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,701 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,704 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:23,703 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:23,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:23,729 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:23,734 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:23,786 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:23,804 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:23,805 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:23,822 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:23,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:23,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,832 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:23,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,839 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:23,884 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239940ms delay out of 240000ms. Remaining 60ms. Executor queue at 0
02.12.2021 17:25:23,891 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239910ms for 240000ms of delay, sleeping for 100ms
02.12.2021 17:25:23,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:23,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,910 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,911 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,905 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:23,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,920 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:23,939 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:23,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:23,995 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239792ms for 240000ms of delay, sleeping for 218ms
02.12.2021 17:25:24,002 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 58982ms delay out of 60000ms. Remaining 1018ms. Executor queue at 0
02.12.2021 17:25:24,003 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59035ms for 60000ms of delay, sleeping for 975ms
02.12.2021 17:25:24,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:24,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:24,020 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:24,038 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:24,040 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:24,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:24,111 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:24,111 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:24,120 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:24,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:24,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,136 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,136 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,140 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:24,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,187 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:24,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,205 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,211 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 200
02.12.2021 17:25:24,216 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239729ms for 240000ms of delay, sleeping for 281ms
02.12.2021 17:25:24,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:24,226 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119995ms for 120000ms of delay, sleeping for 15ms
02.12.2021 17:25:24,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:24,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:24,244 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119898ms for 120000ms of delay, sleeping for 112ms
02.12.2021 17:25:24,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:24,307 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:24,312 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:24,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:24,337 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:24,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:24,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,341 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,342 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 71 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:24,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 208198ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:24,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:24,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 72 iterations.
02.12.2021 17:25:24,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 72 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:24,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 208198ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:24,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:24,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:24,358 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1043): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', members=[])
02.12.2021 17:25:24,358 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', members=[])
02.12.2021 17:25:24,358 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:24,358 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=188, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}
02.12.2021 17:25:24,358 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=188, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=188, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:24,358 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1044) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null,assignments=[]}
02.12.2021 17:25:24,358 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024312, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:24,358 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024322, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:24,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:24,359 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:24,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,359 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:24,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 72 iterations.
02.12.2021 17:25:24,362 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119289ms for 120000ms of delay, sleeping for 721ms
02.12.2021 17:25:24,391 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:24,407 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:24,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:24,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,416 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,416 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,416 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,417 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 491
02.12.2021 17:25:24,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,421 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,421 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 486
02.12.2021 17:25:24,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:24,445 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 397
02.12.2021 17:25:24,462 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1044): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:24,462 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=188, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}
02.12.2021 17:25:24,491 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:24,503 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239545ms for 240000ms of delay, sleeping for 465ms
02.12.2021 17:25:24,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:24,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 390
02.12.2021 17:25:24,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 385
02.12.2021 17:25:24,540 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:24,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:24,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:24,609 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:24,618 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 290
02.12.2021 17:25:24,622 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 285
02.12.2021 17:25:24,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,637 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,637 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,638 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,638 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,638 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,638 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,645 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:24,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,689 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,689 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,706 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,706 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,719 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 189
02.12.2021 17:25:24,722 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 185
02.12.2021 17:25:24,738 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:24,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:24,754 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:24,754 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:24,754 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=955) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:24,790 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:24,807 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:24,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 89
02.12.2021 17:25:24,823 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 84
02.12.2021 17:25:24,839 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:24,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:24,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,847 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,849 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,861 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=955): org.apache.kafka.common.requests.HeartbeatResponse@12526aef
02.12.2021 17:25:24,866 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:24,890 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:24,909 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:24,907 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:24,909 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 57 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:24,909 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=664) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null}
02.12.2021 17:25:24,907 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:24,909 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:24,910 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 57 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:24,910 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=664) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null}
02.12.2021 17:25:24,909 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:24,908 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:24,910 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 7
02.12.2021 17:25:24,911 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=664): org.apache.kafka.common.requests.HeartbeatResponse@6512f779
02.12.2021 17:25:24,911 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:24,911 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 57 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab
02.12.2021 17:25:24,911 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:24,911 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:24,912 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 98, -37, -94, -95, -98, 75, 74, -34, -67, -86, 25, 43, 40, 125, 10, 127, 0, 0, 0, 0, 0, 0, 0, 0, 35, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:24,910 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 11
02.12.2021 17:25:24,912 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=664): org.apache.kafka.common.requests.HeartbeatResponse@4157da67
02.12.2021 17:25:24,912 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:24,912 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 57 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164
02.12.2021 17:25:24,912 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:24,912 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:24,912 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=665) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:24,913 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 98, -37, -94, -95, -98, 75, 74, -34, -67, -86, 25, 43, 40, 125, 10, 127, 0, 0, 0, 0, 0, 0, 0, 0, 35, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:24,913 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=665) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:24,913 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 4
02.12.2021 17:25:24,913 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 8
02.12.2021 17:25:24,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:24,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,918 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:24,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:24,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,921 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:24,940 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:24,951 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:24,975 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239739ms for 240000ms of delay, sleeping for 271ms
02.12.2021 17:25:24,980 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59117ms for 60000ms of delay, sleeping for 893ms
02.12.2021 17:25:24,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:25,010 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:25,010 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:25,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:25,041 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:25,051 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:25,088 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119989ms for 120000ms of delay, sleeping for 21ms
02.12.2021 17:25:25,091 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:25,111 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119017ms for 120000ms of delay, sleeping for 993ms
02.12.2021 17:25:25,112 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:25,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,138 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 259
02.12.2021 17:25:25,152 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:25,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,189 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,206 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 158
02.12.2021 17:25:25,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 10 records with 58 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:25,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 176250ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:25,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:25,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 59 iterations.
02.12.2021 17:25:25,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 0 records with 59 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:25,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 176250ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:25,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:25,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:25,248 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1283): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', members=[])
02.12.2021 17:25:25,249 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', members=[])
02.12.2021 17:25:25,249 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:25,249 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=57, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', protocol='stream'}
02.12.2021 17:25:25,249 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=57, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=57, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:25,249 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1284) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null,assignments=[]}
02.12.2021 17:25:25,250 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=971050, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:25,250 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=971060, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:25,250 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1284): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:25,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:25,250 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-6, new queue size is 10
02.12.2021 17:25:25,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,250 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:25,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 59 iterations.
02.12.2021 17:25:25,251 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239127ms for 240000ms of delay, sleeping for 883ms
02.12.2021 17:25:25,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:25,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:25,307 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:25,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 58
02.12.2021 17:25:25,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:25,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,350 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 48
02.12.2021 17:25:25,350 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=57, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', protocol='stream'}
02.12.2021 17:25:25,390 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:25,397 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,397 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 188 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,397 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=672) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null}
02.12.2021 17:25:25,398 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,398 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 188 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,399 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=692) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null}
02.12.2021 17:25:25,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,399 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=672): org.apache.kafka.common.requests.HeartbeatResponse@49a2308
02.12.2021 17:25:25,399 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,399 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 188 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2
02.12.2021 17:25:25,399 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:25,399 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:25,400 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 84, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,400 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=673) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,400 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 238
02.12.2021 17:25:25,400 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 452
02.12.2021 17:25:25,404 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=692): org.apache.kafka.common.requests.HeartbeatResponse@7843003c
02.12.2021 17:25:25,405 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,405 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 188 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e
02.12.2021 17:25:25,406 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:25,406 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:25,406 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 84, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,407 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=693) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,407 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 443
02.12.2021 17:25:25,407 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:25,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,420 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,421 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,423 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,423 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:25,498 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:25,499 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:25,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:25,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:25,609 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:25,638 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,639 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,640 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,643 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:25,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,691 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,691 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,691 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,691 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,691 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,691 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,691 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,691 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,710 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,710 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,792 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:25,811 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:25,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,864 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,874 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:25,888 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59787ms for 60000ms of delay, sleeping for 223ms
02.12.2021 17:25:25,894 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:25,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,922 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,913 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:25,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,925 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:26,022 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 188
02.12.2021 17:25:26,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:26,106 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119956ms for 120000ms of delay, sleeping for 54ms
02.12.2021 17:25:26,113 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58247ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:26,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:26,136 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239895ms for 240000ms of delay, sleeping for 115ms
02.12.2021 17:25:26,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 512 ms and fetched 0 records
02.12.2021 17:25:26,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,152 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,152 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,162 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119823ms for 120000ms of delay, sleeping for 187ms
02.12.2021 17:25:26,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:26,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,191 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,191 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 62
02.12.2021 17:25:26,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,211 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,211 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 22
02.12.2021 17:25:26,234 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:26,234 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:26,235 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=657) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:26,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 477
02.12.2021 17:25:26,235 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=657): org.apache.kafka.common.requests.HeartbeatResponse@ee976d3
02.12.2021 17:25:26,235 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:26,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 476
02.12.2021 17:25:26,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 476
02.12.2021 17:25:26,253 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239408ms for 240000ms of delay, sleeping for 602ms
02.12.2021 17:25:26,254 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:26,255 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:26,259 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=657) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:26,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 438
02.12.2021 17:25:26,267 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=657): org.apache.kafka.common.requests.HeartbeatResponse@2013f774
02.12.2021 17:25:26,267 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:26,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 424
02.12.2021 17:25:26,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 421
02.12.2021 17:25:26,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 376
02.12.2021 17:25:26,350 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118992ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:26,371 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 321
02.12.2021 17:25:26,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 518 ms and fetched 0 records
02.12.2021 17:25:26,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,383 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,383 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:26,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,425 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,427 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,430 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:26,430 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,431 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,432 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 275
02.12.2021 17:25:26,471 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 220
02.12.2021 17:25:26,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 175
02.12.2021 17:25:26,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 120
02.12.2021 17:25:26,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 74
02.12.2021 17:25:26,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,653 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,653 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,672 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 19
02.12.2021 17:25:26,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:26,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,695 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,695 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:26,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:26,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,711 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,711 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:26,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:26,811 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:26,857 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239997ms for 240000ms of delay, sleeping for 13ms
02.12.2021 17:25:26,873 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239661ms for 240000ms of delay, sleeping for 349ms
02.12.2021 17:25:26,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:26,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,885 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,897 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:26,913 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:26,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:26,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,928 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,928 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,934 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:27,013 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:27,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:27,113 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59247ms delay out of 60000ms. Remaining 753ms. Executor queue at 0
02.12.2021 17:25:27,113 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58858ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:27,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:27,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,154 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,155 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,195 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,195 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,212 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,212 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,225 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239027ms for 240000ms of delay, sleeping for 983ms
02.12.2021 17:25:27,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:27,313 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:27,351 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119993ms delay out of 120000ms. Remaining 7ms. Executor queue at 1
02.12.2021 17:25:27,351 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119920ms for 120000ms of delay, sleeping for 90ms
02.12.2021 17:25:27,377 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:27,378 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 188 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:27,378 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1045) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null}
02.12.2021 17:25:27,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,388 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,388 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,396 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:27,416 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:27,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,429 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,430 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,430 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:27,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,436 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:27,446 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119995ms for 120000ms of delay, sleeping for 15ms
02.12.2021 17:25:27,465 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119394ms for 120000ms of delay, sleeping for 616ms
02.12.2021 17:25:27,478 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1045): org.apache.kafka.common.requests.HeartbeatResponse@3f895776
02.12.2021 17:25:27,478 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:27,496 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:27,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:27,597 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:27,618 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:27,656 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:27,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,660 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,660 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,695 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,695 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:27,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,716 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,716 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,785 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:27,785 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:27,785 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=956) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:27,796 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:27,818 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:27,885 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=956): org.apache.kafka.common.requests.HeartbeatResponse@7f0322c5
02.12.2021 17:25:27,887 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:27,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,889 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,904 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:27,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:27,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,934 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,936 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,936 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,009 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:28,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:28,082 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119138ms for 120000ms of delay, sleeping for 872ms
02.12.2021 17:25:28,110 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 85
02.12.2021 17:25:28,114 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59859ms delay out of 60000ms. Remaining 141ms. Executor queue at 0
02.12.2021 17:25:28,116 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59956ms for 60000ms of delay, sleeping for 54ms
02.12.2021 17:25:28,125 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:28,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,161 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,162 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,171 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59188ms for 60000ms of delay, sleeping for 822ms
02.12.2021 17:25:28,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:28,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,195 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30126ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,195 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 10 records with 59 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:28,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 179211ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 60 iterations.
02.12.2021 17:25:28,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 0 records with 60 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:28,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 179211ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:28,209 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:28,210 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:28,210 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:28,210 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 98, -37, -94, -95, -98, 75, 74, -34, -67, -86, 25, 43, 40, 125, 10, 127, 0, 0, 0, 0, 0, 0, 0, 0, 35, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 6])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:28,210 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1285) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:28,210 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=971060, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:28,210 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=971070, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:28,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:28,211 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-6, new queue size is 10
02.12.2021 17:25:28,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,211 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:28,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,211 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 60 iterations.
02.12.2021 17:25:28,211 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239866ms for 240000ms of delay, sleeping for 144ms
02.12.2021 17:25:28,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:28,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,216 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,216 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,256 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:28,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:28,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:28,356 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239890ms for 240000ms of delay, sleeping for 120ms
02.12.2021 17:25:28,396 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:28,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 515 ms and fetched 0 records
02.12.2021 17:25:28,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,406 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,407 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:28,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,436 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:28,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,439 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,480 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239709ms for 240000ms of delay, sleeping for 301ms
02.12.2021 17:25:28,498 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:28,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:28,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:28,619 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:28,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,663 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,663 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:28,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,696 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,719 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:28,719 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,719 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,719 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,719 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,719 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,719 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,719 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30123ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,719 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,788 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239676ms for 240000ms of delay, sleeping for 334ms
02.12.2021 17:25:28,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:28,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:28,897 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:28,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:28,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,908 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,908 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:28,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:28,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,938 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,940 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,940 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 72 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:28,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 212796ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 73 iterations.
02.12.2021 17:25:28,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 73 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:28,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 212797ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:28,956 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:28,956 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:28,956 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:28,956 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 84, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 1])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:28,956 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1046) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:28,956 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024322, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:28,957 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024332, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:28,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:28,957 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:28,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,958 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:28,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 73 iterations.
02.12.2021 17:25:28,958 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119983ms for 120000ms of delay, sleeping for 27ms
02.12.2021 17:25:28,982 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:28,988 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119445ms for 120000ms of delay, sleeping for 565ms
02.12.2021 17:25:28,994 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 10 records with 20 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,994 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:28,994 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 34924ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,994 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Flushing record collector
02.12.2021 17:25:28,994 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Prepared RUNNING task for committing
02.12.2021 17:25:28,994 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry1-6=OffsetAndMetadata{offset=1151354, leaderEpoch=null, metadata='AQAAAX179iY4'}} to coordinator kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:28,994 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=957) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry1,partitions=[{partition_index=6,committed_offset=1151354,committed_leader_epoch=-1,committed_metadata=AQAAAX179iY4}]}]}
02.12.2021 17:25:28,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:29,009 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received OFFSET_COMMIT response from node 2147483644 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=957): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry1', partitions=[OffsetCommitResponsePartition(partitionIndex=6, errorCode=0)])])
02.12.2021 17:25:29,009 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Committed offset 1151354 for partition redacted.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:29,009 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry1-6=1151353}
02.12.2021 17:25:29,009 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Finalized commit for RUNNING task with eos false enforce checkpoint false
02.12.2021 17:25:29,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:684] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Committed all active tasks [0_6] and standby tasks [] in 0ms
02.12.2021 17:25:29,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 10 iterations.
02.12.2021 17:25:29,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 0 records with 10 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:29,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:29,010 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1151354, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:29,010 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1151364, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:29,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:29,010 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-6, new queue size is 10
02.12.2021 17:25:29,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,010 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:29,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 10 iterations.
02.12.2021 17:25:29,012 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59930ms for 60000ms of delay, sleeping for 80ms
02.12.2021 17:25:29,023 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:29,095 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58894ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:29,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:29,124 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:29,127 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239002ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:29,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,165 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,165 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,199 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,199 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 55
02.12.2021 17:25:29,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,219 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 14
02.12.2021 17:25:29,234 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:29,234 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:29,234 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=658) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:29,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 486
02.12.2021 17:25:29,235 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=658): org.apache.kafka.common.requests.HeartbeatResponse@745cc338
02.12.2021 17:25:29,235 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:29,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 485
02.12.2021 17:25:29,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 485
02.12.2021 17:25:29,255 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:29,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:29,256 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:29,256 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=658) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:29,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 443
02.12.2021 17:25:29,257 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=658): org.apache.kafka.common.requests.HeartbeatResponse@6e666da
02.12.2021 17:25:29,258 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:29,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 441
02.12.2021 17:25:29,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 438
02.12.2021 17:25:29,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 385
02.12.2021 17:25:29,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 337
02.12.2021 17:25:29,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,409 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,428 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=673): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', members=[])
02.12.2021 17:25:29,428 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', members=[])
02.12.2021 17:25:29,428 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:29,428 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=189, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}
02.12.2021 17:25:29,428 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=189, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=189, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:29,428 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=674) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null,assignments=[]}
02.12.2021 17:25:29,428 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 237
02.12.2021 17:25:29,428 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=693): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', members=[])
02.12.2021 17:25:29,429 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', members=[])
02.12.2021 17:25:29,429 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:29,429 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=189, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}
02.12.2021 17:25:29,429 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=189, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=189, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:29,429 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=694) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:29,429 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 480
02.12.2021 17:25:29,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,439 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 285
02.12.2021 17:25:29,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,441 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,441 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 237
02.12.2021 17:25:29,489 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=694): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,489 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,489 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=189, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}
02.12.2021 17:25:29,488 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=674): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,490 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 189 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e
02.12.2021 17:25:29,490 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:29,490 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:29,490 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,490 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:29,491 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:29,491 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:29,491 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=189, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}
02.12.2021 17:25:29,491 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 189 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2
02.12.2021 17:25:29,491 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3] State transition from RUNNING to REBALANCING
02.12.2021 17:25:29,492 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:29,491 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:29,492 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:29,492 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:29,492 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:29,492 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:29,492 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:29,492 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 420
02.12.2021 17:25:29,492 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 175
02.12.2021 17:25:29,540 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 180
02.12.2021 17:25:29,555 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118501ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:29,564 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 135
02.12.2021 17:25:29,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 317
02.12.2021 17:25:29,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 70
02.12.2021 17:25:29,641 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 80
02.12.2021 17:25:29,665 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 34
02.12.2021 17:25:29,665 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:29,666 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:29,667 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:29,669 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:29,669 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:29,669 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:29,669 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:29,670 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:29,670 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:29,671 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:29,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,672 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,674 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,695 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 214
02.12.2021 17:25:29,699 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,707 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,708 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:29,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,721 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,722 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,725 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:29,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 395
02.12.2021 17:25:29,802 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 107
02.12.2021 17:25:29,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:29,825 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:29,880 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:29,903 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 7
02.12.2021 17:25:29,909 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:29,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:29,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:29,914 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:29,914 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:29,914 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:29,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:29,914 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:29,932 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:29,933 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:29,935 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:29,935 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:29,936 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3] State transition from REBALANCING to RUNNING
02.12.2021 17:25:29,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:29,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,939 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,940 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,940 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,948 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,951 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,992 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 182
02.12.2021 17:25:30,009 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:30,026 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:30,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:30,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 82
02.12.2021 17:25:30,095 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59894ms delay out of 60000ms. Remaining 106ms. Executor queue at 0
02.12.2021 17:25:30,096 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59863ms for 60000ms of delay, sleeping for 147ms
02.12.2021 17:25:30,110 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:30,127 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:30,128 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239100ms for 240000ms of delay, sleeping for 910ms
02.12.2021 17:25:30,131 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=665): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', members=[])
02.12.2021 17:25:30,130 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=665): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', members=[])
02.12.2021 17:25:30,131 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', members=[])
02.12.2021 17:25:30,131 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:30,131 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', members=[])
02.12.2021 17:25:30,132 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:30,132 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=58, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', protocol='stream'}
02.12.2021 17:25:30,132 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=58, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=58, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:30,132 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=666) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null,assignments=[]}
02.12.2021 17:25:30,132 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 318
02.12.2021 17:25:30,131 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=58, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', protocol='stream'}
02.12.2021 17:25:30,132 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=58, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=58, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:30,132 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=666) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null,assignments=[]}
02.12.2021 17:25:30,132 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 308
02.12.2021 17:25:30,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:30,168 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=666): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,169 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,169 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=666): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,169 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,169 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=58, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', protocol='stream'}
02.12.2021 17:25:30,169 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=58, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', protocol='stream'}
02.12.2021 17:25:30,169 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 58 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab
02.12.2021 17:25:30,169 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 58 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164
02.12.2021 17:25:30,170 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:30,170 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:30,169 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:30,170 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:30,170 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:30,170 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:30,170 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:30,170 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:30,170 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:30,170 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f] State transition from RUNNING to REBALANCING
02.12.2021 17:25:30,171 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:30,170 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:30,171 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:30,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 271
02.12.2021 17:25:30,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 281
02.12.2021 17:25:30,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:30,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,175 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:30,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,208 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,208 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,226 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,245 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59206ms for 60000ms of delay, sleeping for 804ms
02.12.2021 17:25:30,251 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:30,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 169
02.12.2021 17:25:30,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 179
02.12.2021 17:25:30,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:30,309 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:30,326 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:30,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:30,372 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 78
02.12.2021 17:25:30,372 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 69
02.12.2021 17:25:30,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:30,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:30,427 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:30,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:30,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,444 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:30,444 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,444 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,444 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:30,444 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:30,444 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,444 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,444 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:30,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,444 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,448 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,448 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,446 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:30,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,453 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:30,453 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,454 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,454 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:30,454 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:30,454 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,454 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,454 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,454 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f] State transition from REBALANCING to RUNNING
02.12.2021 17:25:30,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:30,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,454 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,454 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,483 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 193
02.12.2021 17:25:30,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:30,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:30,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 396
02.12.2021 17:25:30,551 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 397
02.12.2021 17:25:30,555 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:30,555 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119501ms delay out of 120000ms. Remaining 499ms. Executor queue at 0
02.12.2021 17:25:30,559 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119429ms for 120000ms of delay, sleeping for 581ms
02.12.2021 17:25:30,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:30,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:30,631 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:30,651 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 295
02.12.2021 17:25:30,651 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:30,655 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:30,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:30,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,676 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,676 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,709 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,727 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,752 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:30,752 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:30,756 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:30,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:30,795 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:30,795 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:30,795 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=958) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:30,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:30,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:30,852 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:30,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:30,856 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:30,880 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:30,896 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=958): org.apache.kafka.common.requests.HeartbeatResponse@58765e2d
02.12.2021 17:25:30,897 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:30,910 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:30,928 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:30,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:30,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,946 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:30,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,949 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:30,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,955 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,955 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:31,010 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:31,029 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:31,041 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239192ms for 240000ms of delay, sleeping for 818ms
02.12.2021 17:25:31,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:31,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:31,050 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59208ms for 60000ms of delay, sleeping for 802ms
02.12.2021 17:25:31,055 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:31,082 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:31,110 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:31,129 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:31,142 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119975ms for 120000ms of delay, sleeping for 35ms
02.12.2021 17:25:31,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:31,150 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:31,156 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:31,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,177 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,177 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,179 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119245ms for 120000ms of delay, sleeping for 765ms
02.12.2021 17:25:31,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,210 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,210 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,228 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,250 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:31,251 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:31,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:31,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:31,310 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:31,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:31,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:31,353 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:31,360 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:31,378 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:31,411 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:31,429 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:31,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,447 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,447 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,451 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,451 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,456 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,456 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,479 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:31,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:31,530 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:31,548 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:31,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 394
02.12.2021 17:25:31,563 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 388
02.12.2021 17:25:31,579 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:31,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:31,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:31,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:31,665 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 286
02.12.2021 17:25:31,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 293
02.12.2021 17:25:31,682 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:31,682 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,682 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,682 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,682 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,682 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,682 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,682 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:31,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,727 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,729 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,729 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,749 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:31,768 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 188
02.12.2021 17:25:31,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 185
02.12.2021 17:25:31,782 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:31,828 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:31,830 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:31,849 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:31,860 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239903ms for 240000ms of delay, sleeping for 107ms
02.12.2021 17:25:31,855 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59710ms for 60000ms of delay, sleeping for 300ms
02.12.2021 17:25:31,875 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 81
02.12.2021 17:25:31,876 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 75
02.12.2021 17:25:31,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:31,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:31,936 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:31,946 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118917ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:31,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,947 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,958 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,958 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:31,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,962 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 450
02.12.2021 17:25:31,983 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239766ms for 240000ms of delay, sleeping for 244ms
02.12.2021 17:25:31,987 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 195
02.12.2021 17:25:32,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:32,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 184
02.12.2021 17:25:32,051 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:32,058 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:32,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 350
02.12.2021 17:25:32,090 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 92
02.12.2021 17:25:32,131 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:32,146 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:32,151 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:32,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:32,169 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58975ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:32,180 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 249
02.12.2021 17:25:32,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,183 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,183 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 245
02.12.2021 17:25:32,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,227 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 27
02.12.2021 17:25:32,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 10 records with 60 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:32,228 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 183230ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:32,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:32,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 61 iterations.
02.12.2021 17:25:32,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 0 records with 61 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:32,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 183231ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:32,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:32,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:32,229 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,229 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1285): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', members=[])
02.12.2021 17:25:32,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,230 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', members=[])
02.12.2021 17:25:32,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 4
02.12.2021 17:25:32,230 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:32,230 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=58, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', protocol='stream'}
02.12.2021 17:25:32,230 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=58, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=58, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:32,230 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1286) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null,assignments=[]}
02.12.2021 17:25:32,230 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=971070, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:32,231 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=971080, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:32,231 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1286): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:32,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:32,231 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-6, new queue size is 10
02.12.2021 17:25:32,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,232 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:32,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 61 iterations.
02.12.2021 17:25:32,234 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239332ms for 240000ms of delay, sleeping for 678ms
02.12.2021 17:25:32,234 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,236 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:32,236 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=659) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:32,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 493
02.12.2021 17:25:32,242 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=659): org.apache.kafka.common.requests.HeartbeatResponse@39435847
02.12.2021 17:25:32,244 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:32,247 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 486
02.12.2021 17:25:32,247 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 483
02.12.2021 17:25:32,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:32,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:32,255 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,261 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:32,263 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=659) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:32,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 473
02.12.2021 17:25:32,267 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=659): org.apache.kafka.common.requests.HeartbeatResponse@3f807fe
02.12.2021 17:25:32,267 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:32,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 461
02.12.2021 17:25:32,268 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 460
02.12.2021 17:25:32,280 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 149
02.12.2021 17:25:32,283 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 145
02.12.2021 17:25:32,331 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=58, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', protocol='stream'}
02.12.2021 17:25:32,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 383
02.12.2021 17:25:32,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:32,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:32,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 359
02.12.2021 17:25:32,381 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 49
02.12.2021 17:25:32,388 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 40
02.12.2021 17:25:32,434 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,434 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,434 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,434 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,430 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,434 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 189 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,434 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=675) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null}
02.12.2021 17:25:32,434 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,434 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 189 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,430 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,435 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=675): org.apache.kafka.common.requests.HeartbeatResponse@57886a3f
02.12.2021 17:25:32,435 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:32,435 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 189 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2
02.12.2021 17:25:32,435 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:32,435 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:32,435 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 85, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,435 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=676) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:32,435 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=695) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null}
02.12.2021 17:25:32,434 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 43
02.12.2021 17:25:32,436 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=695): org.apache.kafka.common.requests.HeartbeatResponse@5f7042b7
02.12.2021 17:25:32,444 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:32,444 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 189 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e
02.12.2021 17:25:32,444 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:32,444 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:32,444 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 85, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,444 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=696) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:32,445 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 34
02.12.2021 17:25:32,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 247
02.12.2021 17:25:32,448 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 282
02.12.2021 17:25:32,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,449 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,450 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,458 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,459 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 258
02.12.2021 17:25:32,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 517 ms and fetched 0 records
02.12.2021 17:25:32,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,479 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,479 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:32,534 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:32,537 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:32,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 182
02.12.2021 17:25:32,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:32,559 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:32,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 158
02.12.2021 17:25:32,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 81
02.12.2021 17:25:32,651 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:32,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:32,671 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 57
02.12.2021 17:25:32,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 510 ms and fetched 0 records
02.12.2021 17:25:32,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,693 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,693 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:32,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,728 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,729 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:32,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,731 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:32,751 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:32,760 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:32,829 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:32,832 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:32,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 90
02.12.2021 17:25:32,867 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:32,915 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239760ms for 240000ms of delay, sleeping for 250ms
02.12.2021 17:25:32,931 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:32,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:32,946 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119917ms delay out of 120000ms. Remaining 83ms. Executor queue at 0
02.12.2021 17:25:32,947 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119380ms for 120000ms of delay, sleeping for 630ms
02.12.2021 17:25:32,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:32,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,956 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,956 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 175
02.12.2021 17:25:32,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,959 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 173
02.12.2021 17:25:32,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,980 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:33,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:33,056 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 75
02.12.2021 17:25:33,060 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 72
02.12.2021 17:25:33,131 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,132 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,132 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,132 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:33,132 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 58 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,132 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:33,132 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:33,132 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 58 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,133 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=667) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null}
02.12.2021 17:25:33,132 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=667) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null}
02.12.2021 17:25:33,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 324
02.12.2021 17:25:33,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:33,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 327
02.12.2021 17:25:33,133 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=667): org.apache.kafka.common.requests.HeartbeatResponse@b1a77db
02.12.2021 17:25:33,133 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:33,134 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 58 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab
02.12.2021 17:25:33,134 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:33,134 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:33,134 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=667): org.apache.kafka.common.requests.HeartbeatResponse@6fc23fe5
02.12.2021 17:25:33,134 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:33,134 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 58 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164
02.12.2021 17:25:33,134 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 98, -37, -94, -95, -98, 75, 74, -34, -67, -86, 25, 43, 40, 125, 10, 127, 0, 0, 0, 0, 0, 0, 0, 0, 36, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,134 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:33,135 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:33,135 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 98, -37, -94, -95, -98, 75, 74, -34, -67, -86, 25, 43, 40, 125, 10, 127, 0, 0, 0, 0, 0, 0, 0, 0, 36, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,135 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=668) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:33,135 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=668) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:33,135 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 324
02.12.2021 17:25:33,136 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 320
02.12.2021 17:25:33,168 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239973ms for 240000ms of delay, sleeping for 37ms
02.12.2021 17:25:33,169 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59975ms delay out of 60000ms. Remaining 25ms. Executor queue at 0
02.12.2021 17:25:33,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 10 records with 10 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:33,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:33,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 0 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:33,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:33,171 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1151364, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:33,171 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1151374, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:33,171 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:33,171 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-6, new queue size is 10
02.12.2021 17:25:33,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,172 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:33,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,172 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:33,173 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59033ms for 60000ms of delay, sleeping for 977ms
02.12.2021 17:25:33,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,194 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,212 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239330ms for 240000ms of delay, sleeping for 680ms
02.12.2021 17:25:33,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,231 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,232 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,233 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:33,233 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:33,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:33,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:33,432 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:33,433 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:33,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,457 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,458 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,460 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,460 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,493 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,498 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:33,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:33,583 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119998ms for 120000ms of delay, sleeping for 12ms
02.12.2021 17:25:33,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 73 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,596 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:33,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 217437ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:33,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:33,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 74 iterations.
02.12.2021 17:25:33,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 74 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:33,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 217442ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:33,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:33,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:33,604 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1046): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', members=[])
02.12.2021 17:25:33,615 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', members=[])
02.12.2021 17:25:33,615 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:33,615 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=189, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}
02.12.2021 17:25:33,615 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=189, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=189, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:33,616 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024332, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:33,616 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024342, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:33,616 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1047) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null,assignments=[]}
02.12.2021 17:25:33,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 15 ms and fetched 10 records
02.12.2021 17:25:33,617 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1047): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:33,617 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=189, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}
02.12.2021 17:25:33,626 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:33,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,626 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:33,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 74 iterations.
02.12.2021 17:25:33,627 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119997ms for 120000ms of delay, sleeping for 13ms
02.12.2021 17:25:33,635 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:33,632 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:33,648 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119684ms for 120000ms of delay, sleeping for 326ms
02.12.2021 17:25:33,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,696 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,697 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,699 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,732 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,733 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,734 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:33,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,742 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,742 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,733 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,744 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,801 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:33,805 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:33,805 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=959) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:33,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:33,843 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:33,905 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=959): org.apache.kafka.common.requests.HeartbeatResponse@6e32b243
02.12.2021 17:25:33,907 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:33,906 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239620ms for 240000ms of delay, sleeping for 390ms
02.12.2021 17:25:33,948 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:33,954 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 288
02.12.2021 17:25:33,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:33,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:33,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,968 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,969 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,967 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,989 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119612ms for 120000ms of delay, sleeping for 398ms
02.12.2021 17:25:33,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:33,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,999 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,048 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:34,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 188
02.12.2021 17:25:34,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:34,153 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59349ms for 60000ms of delay, sleeping for 661ms
02.12.2021 17:25:34,155 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:34,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:34,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,203 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,243 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:34,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,247 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,247 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 10 records with 61 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:34,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 185309ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:34,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:34,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 62 iterations.
02.12.2021 17:25:34,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 0 records with 62 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:34,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 185309ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:34,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:34,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:34,307 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:34,307 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:34,307 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:34,307 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 98, -37, -94, -95, -98, 75, 74, -34, -67, -86, 25, 43, 40, 125, 10, 127, 0, 0, 0, 0, 0, 0, 0, 0, 36, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 6])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:34,308 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1287) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:34,308 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=971080, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:34,308 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=971090, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:34,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:34,308 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-6, new queue size is 10
02.12.2021 17:25:34,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,308 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:34,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 62 iterations.
02.12.2021 17:25:34,309 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239767ms for 240000ms of delay, sleeping for 243ms
02.12.2021 17:25:34,334 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:34,343 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:34,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:34,389 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119738ms for 120000ms of delay, sleeping for 272ms
02.12.2021 17:25:34,446 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:34,448 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:34,469 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:34,469 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,469 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,469 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,469 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,469 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,470 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,470 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:34,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,476 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:34,503 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:34,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,504 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:34,548 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:34,553 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239817ms for 240000ms of delay, sleeping for 193ms
02.12.2021 17:25:34,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:34,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:34,662 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119939ms for 120000ms of delay, sleeping for 71ms
02.12.2021 17:25:34,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,704 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,706 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,734 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119576ms for 120000ms of delay, sleeping for 434ms
02.12.2021 17:25:34,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,744 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,751 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,759 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239530ms for 240000ms of delay, sleeping for 480ms
02.12.2021 17:25:34,752 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,751 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 483
02.12.2021 17:25:34,820 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59979ms for 60000ms of delay, sleeping for 31ms
02.12.2021 17:25:34,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 374
02.12.2021 17:25:34,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 392
02.12.2021 17:25:34,868 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59437ms for 60000ms of delay, sleeping for 573ms
02.12.2021 17:25:34,968 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 266
02.12.2021 17:25:34,969 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 284
02.12.2021 17:25:34,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,971 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:34,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,976 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,005 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,005 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,069 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 166
02.12.2021 17:25:35,069 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 183
02.12.2021 17:25:35,169 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 65
02.12.2021 17:25:35,169 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:35,170 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119962ms for 120000ms of delay, sleeping for 48ms
02.12.2021 17:25:35,207 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:35,207 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,207 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,207 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,213 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,213 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,219 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119939ms for 120000ms of delay, sleeping for 71ms
02.12.2021 17:25:35,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,234 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:35,235 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:35,235 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=660) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:35,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 17
02.12.2021 17:25:35,236 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=660): org.apache.kafka.common.requests.HeartbeatResponse@47055bd0
02.12.2021 17:25:35,236 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:35,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 15
02.12.2021 17:25:35,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 15
02.12.2021 17:25:35,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:35,252 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,263 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:35,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,264 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,265 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:35,266 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:35,266 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=660) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:35,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,267 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239855ms for 240000ms of delay, sleeping for 155ms
02.12.2021 17:25:35,266 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=660): org.apache.kafka.common.requests.HeartbeatResponse@30defe41
02.12.2021 17:25:35,267 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:35,268 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 498
02.12.2021 17:25:35,269 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 496
02.12.2021 17:25:35,292 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119851ms for 120000ms of delay, sleeping for 159ms
02.12.2021 17:25:35,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:35,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:35,423 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239901ms for 240000ms of delay, sleeping for 109ms
02.12.2021 17:25:35,445 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59596ms for 60000ms of delay, sleeping for 414ms
02.12.2021 17:25:35,452 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119898ms for 120000ms of delay, sleeping for 112ms
02.12.2021 17:25:35,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:35,470 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:35,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,473 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,474 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:35,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,477 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,506 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,544 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239711ms for 240000ms of delay, sleeping for 299ms
02.12.2021 17:25:35,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 74 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:35,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 219406ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:35,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:35,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 75 iterations.
02.12.2021 17:25:35,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 75 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:35,565 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:35,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 219408ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:35,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:35,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:35,569 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:35,569 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:35,569 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:35,569 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 85, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 1])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:35,569 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1048) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:35,570 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024342, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:35,570 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024352, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:35,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:35,570 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:35,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,570 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:35,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 75 iterations.
02.12.2021 17:25:35,570 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118937ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:35,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:35,621 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:35,671 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:35,668 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:35,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,714 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,715 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:35,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,769 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,770 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:35,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,771 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,771 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:35,830 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=676): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', members=[])
02.12.2021 17:25:35,830 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=696): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', members=[])
02.12.2021 17:25:35,832 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', members=[])
02.12.2021 17:25:35,832 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:35,832 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=190, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}
02.12.2021 17:25:35,832 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=190, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=190, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:35,832 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=697) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:35,832 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 174
02.12.2021 17:25:35,830 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', members=[])
02.12.2021 17:25:35,832 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:35,832 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=190, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}
02.12.2021 17:25:35,832 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=190, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=190, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:35,835 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=677) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null,assignments=[]}
02.12.2021 17:25:35,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 378
02.12.2021 17:25:35,850 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239625ms for 240000ms of delay, sleeping for 385ms
02.12.2021 17:25:35,869 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59737ms for 60000ms of delay, sleeping for 273ms
02.12.2021 17:25:35,870 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:35,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:35,932 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=697): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:35,932 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:35,933 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=677): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:35,933 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:35,933 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=190, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}
02.12.2021 17:25:35,933 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 190 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2
02.12.2021 17:25:35,933 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:35,933 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:35,933 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:35,933 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:35,933 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:35,933 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3] State transition from RUNNING to REBALANCING
02.12.2021 17:25:35,933 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:35,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 282
02.12.2021 17:25:35,934 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=190, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}
02.12.2021 17:25:35,934 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 190 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e
02.12.2021 17:25:35,934 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:35,934 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:35,934 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:35,934 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:35,934 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:35,934 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:35,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 74
02.12.2021 17:25:35,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:35,972 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:35,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,974 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,974 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,978 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:36,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:36,008 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:36,008 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:36,008 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:36,009 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:36,009 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:36,009 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:36,009 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:36,009 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:36,009 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:36,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,010 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,010 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 181
02.12.2021 17:25:36,071 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:36,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:36,110 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:36,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 81
02.12.2021 17:25:36,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 10 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:36,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:36,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 0 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:36,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:36,144 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1151374, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:36,144 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1151384, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:36,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:36,144 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-6, new queue size is 10
02.12.2021 17:25:36,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,144 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:36,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:36,145 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59165ms for 60000ms of delay, sleeping for 845ms
02.12.2021 17:25:36,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:36,172 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:36,211 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:36,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:36,218 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:36,218 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:36,218 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:36,218 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:36,218 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:36,219 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:36,219 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:36,219 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:36,219 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3] State transition from REBALANCING to RUNNING
02.12.2021 17:25:36,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:36,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,219 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,237 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239823ms for 240000ms of delay, sleeping for 187ms
02.12.2021 17:25:36,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,271 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,272 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,311 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:36,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:36,371 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:36,373 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:36,411 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:36,422 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:36,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 10 records with 62 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:36,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 187427ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:36,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:36,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 63 iterations.
02.12.2021 17:25:36,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 0 records with 63 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:36,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 187427ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:36,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:36,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:36,425 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=971090, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:36,425 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=971100, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:36,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:36,426 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-6, new queue size is 10
02.12.2021 17:25:36,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,426 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:36,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 63 iterations.
02.12.2021 17:25:36,426 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239404ms for 240000ms of delay, sleeping for 606ms
02.12.2021 17:25:36,471 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:36,474 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:36,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,475 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,480 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,480 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,511 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:36,571 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119938ms delay out of 120000ms. Remaining 62ms. Executor queue at 0
02.12.2021 17:25:36,571 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119627ms for 120000ms of delay, sleeping for 383ms
02.12.2021 17:25:36,572 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:36,575 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:36,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:36,625 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:36,672 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:36,676 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:36,712 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:36,720 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,721 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,777 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,781 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,781 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,782 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,786 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,812 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:36,822 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:36,849 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:36,860 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:36,860 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=960) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:36,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:36,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 395
02.12.2021 17:25:36,917 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:36,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:36,956 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119708ms for 120000ms of delay, sleeping for 302ms
02.12.2021 17:25:36,966 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=960): org.apache.kafka.common.requests.HeartbeatResponse@6fb6a878
02.12.2021 17:25:36,966 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:36,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,976 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,981 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,987 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:36,992 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59975ms for 60000ms of delay, sleeping for 35ms
02.12.2021 17:25:36,998 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 285
02.12.2021 17:25:37,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,011 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,012 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:37,030 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58839ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:37,034 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239843ms for 240000ms of delay, sleeping for 167ms
02.12.2021 17:25:37,087 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:37,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 184
02.12.2021 17:25:37,112 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:37,124 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:37,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:37,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:37,202 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239882ms for 240000ms of delay, sleeping for 128ms
02.12.2021 17:25:37,212 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:37,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,221 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,222 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,260 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119880ms for 120000ms of delay, sleeping for 130ms
02.12.2021 17:25:37,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:37,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,283 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,284 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:37,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,286 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,286 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,315 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:37,322 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:37,332 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239183ms for 240000ms of delay, sleeping for 827ms
02.12.2021 17:25:37,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:37,387 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:37,396 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119393ms for 120000ms of delay, sleeping for 617ms
02.12.2021 17:25:37,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:37,423 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:37,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,477 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,482 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,482 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,486 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:37,487 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:37,492 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=668): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', members=[])
02.12.2021 17:25:37,492 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=668): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', members=[])
02.12.2021 17:25:37,492 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', members=[])
02.12.2021 17:25:37,492 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:37,492 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', members=[])
02.12.2021 17:25:37,492 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:37,492 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=59, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', protocol='stream'}
02.12.2021 17:25:37,492 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=59, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', protocol='stream'}
02.12.2021 17:25:37,492 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=59, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=59, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:37,493 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=59, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=59, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:37,493 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=669) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null,assignments=[]}
02.12.2021 17:25:37,493 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=669) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null,assignments=[]}
02.12.2021 17:25:37,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 489
02.12.2021 17:25:37,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 485
02.12.2021 17:25:37,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,514 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:37,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:37,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:37,616 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:37,625 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:37,690 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:37,690 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:37,719 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:37,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:37,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,726 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,729 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:37,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,791 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,791 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 443
02.12.2021 17:25:37,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:37,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,799 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,799 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 466
02.12.2021 17:25:37,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:37,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 395
02.12.2021 17:25:37,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 339
02.12.2021 17:25:37,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 366
02.12.2021 17:25:37,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:37,940 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 289
02.12.2021 17:25:37,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:37,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,981 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,983 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,983 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,984 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,984 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,984 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,984 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,984 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,984 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,984 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 235
02.12.2021 17:25:37,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 266
02.12.2021 17:25:38,017 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119771ms for 120000ms of delay, sleeping for 239ms
02.12.2021 17:25:38,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:38,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,017 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,018 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:38,030 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59839ms delay out of 60000ms. Remaining 161ms. Executor queue at 0
02.12.2021 17:25:38,032 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59287ms for 60000ms of delay, sleeping for 723ms
02.12.2021 17:25:38,040 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 189
02.12.2021 17:25:38,099 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 135
02.12.2021 17:25:38,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 165
02.12.2021 17:25:38,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:38,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 88
02.12.2021 17:25:38,163 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239057ms for 240000ms of delay, sleeping for 953ms
02.12.2021 17:25:38,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 34
02.12.2021 17:25:38,201 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 64
02.12.2021 17:25:38,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:38,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:38,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,229 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:38,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,235 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:38,235 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:38,235 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=661) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:38,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 56
02.12.2021 17:25:38,236 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=661): org.apache.kafka.common.requests.HeartbeatResponse@29ff20d
02.12.2021 17:25:38,236 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:38,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 55
02.12.2021 17:25:38,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 54
02.12.2021 17:25:38,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 75 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,265 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:38,269 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:38,270 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=661) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:38,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 29
02.12.2021 17:25:38,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:38,270 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=661): org.apache.kafka.common.requests.HeartbeatResponse@fc90779
02.12.2021 17:25:38,271 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:38,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 28
02.12.2021 17:25:38,270 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 222106ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:38,275 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:38,275 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 76 iterations.
02.12.2021 17:25:38,275 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 76 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,275 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:38,275 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 222116ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:38,275 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:38,275 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:38,275 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1048): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', members=[])
02.12.2021 17:25:38,275 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', members=[])
02.12.2021 17:25:38,275 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:38,275 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=190, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}
02.12.2021 17:25:38,275 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=190, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=190, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:38,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 25
02.12.2021 17:25:38,276 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024352, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:38,276 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1049) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null,assignments=[]}
02.12.2021 17:25:38,280 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024362, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:38,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 5 ms and fetched 10 records
02.12.2021 17:25:38,281 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:38,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,282 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:38,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 76 iterations.
02.12.2021 17:25:38,282 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119423ms for 120000ms of delay, sleeping for 587ms
02.12.2021 17:25:38,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:38,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,291 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:38,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:38,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,302 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,304 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:38,319 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:38,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:38,380 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1049): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:38,380 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=190, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}
02.12.2021 17:25:38,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:38,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:38,419 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:38,430 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:38,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:38,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,485 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,486 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:38,486 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,486 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,486 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,486 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,486 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,486 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,487 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:38,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:38,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:38,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,519 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 312
02.12.2021 17:25:38,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:38,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:38,604 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:38,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 212
02.12.2021 17:25:38,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:38,697 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:38,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:38,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 111
02.12.2021 17:25:38,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,730 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,730 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 102
02.12.2021 17:25:38,756 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59681ms for 60000ms of delay, sleeping for 329ms
02.12.2021 17:25:38,792 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:38,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,793 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:38,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:38,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,807 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,821 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:38,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 5
02.12.2021 17:25:38,830 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 2
02.12.2021 17:25:38,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:38,833 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:38,834 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 190 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:38,835 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=698) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null}
02.12.2021 17:25:38,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:38,833 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:38,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:38,835 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 190 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:38,836 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=678) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null}
02.12.2021 17:25:38,836 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 395
02.12.2021 17:25:38,836 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=678): org.apache.kafka.common.requests.HeartbeatResponse@6822dc13
02.12.2021 17:25:38,836 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:38,836 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 190 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2
02.12.2021 17:25:38,836 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:38,836 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:38,837 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 86, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:38,837 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=679) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:38,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 393
02.12.2021 17:25:38,835 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=698): org.apache.kafka.common.requests.HeartbeatResponse@48952959
02.12.2021 17:25:38,837 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:38,837 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 190 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e
02.12.2021 17:25:38,837 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:38,837 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:38,837 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 86, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:38,837 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=699) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:38,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 183
02.12.2021 17:25:38,871 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119959ms for 120000ms of delay, sleeping for 51ms
02.12.2021 17:25:38,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:38,924 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119776ms for 120000ms of delay, sleeping for 234ms
02.12.2021 17:25:38,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:38,935 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:38,936 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:38,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,986 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,986 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:38,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,987 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,988 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,000 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:39,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,021 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,021 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,026 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:39,087 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59695ms for 60000ms of delay, sleeping for 315ms
02.12.2021 17:25:39,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:39,119 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239890ms for 240000ms of delay, sleeping for 120ms
02.12.2021 17:25:39,126 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:39,160 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119235ms for 120000ms of delay, sleeping for 775ms
02.12.2021 17:25:39,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:39,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:39,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,230 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,231 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,240 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239996ms for 240000ms of delay, sleeping for 14ms
02.12.2021 17:25:39,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 10 records with 63 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:39,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 190257ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:39,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:39,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 64 iterations.
02.12.2021 17:25:39,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 0 records with 64 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:39,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 190259ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:39,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:39,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:39,259 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1287): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', members=[])
02.12.2021 17:25:39,259 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', members=[])
02.12.2021 17:25:39,260 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:39,260 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=59, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', protocol='stream'}
02.12.2021 17:25:39,260 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=59, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=59, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:39,261 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=971100, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:39,261 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=971110, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:39,261 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1288) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null,assignments=[]}
02.12.2021 17:25:39,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Main Consumer poll completed in 4 ms and fetched 10 records
02.12.2021 17:25:39,263 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-6, new queue size is 10
02.12.2021 17:25:39,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,263 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:39,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 64 iterations.
02.12.2021 17:25:39,264 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239335ms for 240000ms of delay, sleeping for 675ms
02.12.2021 17:25:39,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:39,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,296 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:39,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,321 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:39,404 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59838ms for 60000ms of delay, sleeping for 172ms
02.12.2021 17:25:39,422 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:39,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,487 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,488 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,488 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,488 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,488 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,488 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,489 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:39,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,522 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:39,578 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59912ms for 60000ms of delay, sleeping for 98ms
02.12.2021 17:25:39,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:39,626 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:39,681 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59653ms for 60000ms of delay, sleeping for 357ms
02.12.2021 17:25:39,704 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:39,728 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:39,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,736 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,737 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,737 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,796 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,796 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,821 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,822 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,870 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:39,871 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:39,871 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=961) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:39,898 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:39,928 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 394
02.12.2021 17:25:39,952 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239885ms for 240000ms of delay, sleeping for 125ms
02.12.2021 17:25:39,957 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119995ms for 120000ms of delay, sleeping for 15ms
02.12.2021 17:25:39,973 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=961): org.apache.kafka.common.requests.HeartbeatResponse@9c5aa41
02.12.2021 17:25:39,973 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:39,982 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119971ms for 120000ms of delay, sleeping for 39ms
02.12.2021 17:25:39,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,989 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,989 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,990 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,990 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,998 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:40,022 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119841ms for 120000ms of delay, sleeping for 169ms
02.12.2021 17:25:40,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,023 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,023 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,028 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:40,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 10 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:40,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:40,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 0 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:40,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:40,041 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1151384, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:40,041 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1151394, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:40,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:40,041 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-6, new queue size is 10
02.12.2021 17:25:40,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,041 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:40,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:40,041 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59978ms for 60000ms of delay, sleeping for 32ms
02.12.2021 17:25:40,076 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59921ms for 60000ms of delay, sleeping for 89ms
02.12.2021 17:25:40,078 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239805ms for 240000ms of delay, sleeping for 205ms
02.12.2021 17:25:40,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:40,128 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:40,166 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59369ms for 60000ms of delay, sleeping for 641ms
02.12.2021 17:25:40,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 76 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:40,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 224033ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:40,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:40,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 77 iterations.
02.12.2021 17:25:40,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 77 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:40,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 224033ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:40,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:40,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:40,192 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:40,193 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:40,193 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:40,193 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 86, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 1])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:40,193 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1050) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:40,193 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024362, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:40,193 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024372, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:40,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:40,193 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:40,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,193 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:40,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 77 iterations.
02.12.2021 17:25:40,194 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119624ms for 120000ms of delay, sleeping for 386ms
02.12.2021 17:25:40,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:40,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:40,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,238 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,238 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,283 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:40,284 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239299ms for 240000ms of delay, sleeping for 711ms
02.12.2021 17:25:40,297 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,299 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,303 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,325 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,325 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:40,425 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:40,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,490 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 2
02.12.2021 17:25:40,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,491 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,491 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 1
02.12.2021 17:25:40,492 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:40,492 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:40,492 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:40,492 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:40,492 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:40,492 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:40,493 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=670) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null}
02.12.2021 17:25:40,493 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=670) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null}
02.12.2021 17:25:40,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 497
02.12.2021 17:25:40,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 498
02.12.2021 17:25:40,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:40,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,524 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:40,583 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119939ms for 120000ms of delay, sleeping for 71ms
02.12.2021 17:25:40,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:40,627 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:40,659 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119604ms for 120000ms of delay, sleeping for 406ms
02.12.2021 17:25:40,706 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:40,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:40,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,739 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,741 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,812 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59542ms for 60000ms of delay, sleeping for 468ms
02.12.2021 17:25:40,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,812 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,812 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,813 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 422
02.12.2021 17:25:40,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,828 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,832 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 433
02.12.2021 17:25:40,915 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 320
02.12.2021 17:25:40,936 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 329
02.12.2021 17:25:40,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,991 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:40,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,992 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,992 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:40,997 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239676ms for 240000ms of delay, sleeping for 334ms
02.12.2021 17:25:41,016 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 220
02.12.2021 17:25:41,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:41,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,027 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,027 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 229
02.12.2021 17:25:41,067 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119911ms for 120000ms of delay, sleeping for 99ms
02.12.2021 17:25:41,116 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 119
02.12.2021 17:25:41,137 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 128
02.12.2021 17:25:41,168 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119223ms for 120000ms of delay, sleeping for 787ms
02.12.2021 17:25:41,216 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 19
02.12.2021 17:25:41,220 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=679): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', members=[])
02.12.2021 17:25:41,220 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', members=[])
02.12.2021 17:25:41,220 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:41,220 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=191, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}
02.12.2021 17:25:41,221 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=191, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=191, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:41,220 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=699): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', members=[])
02.12.2021 17:25:41,223 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', members=[])
02.12.2021 17:25:41,223 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:41,224 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=191, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}
02.12.2021 17:25:41,224 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=191, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=191, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:41,224 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=700) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:41,221 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=680) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null,assignments=[]}
02.12.2021 17:25:41,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 303
02.12.2021 17:25:41,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 17
02.12.2021 17:25:41,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,236 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:41,236 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:41,236 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=662) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:41,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 77
02.12.2021 17:25:41,236 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=662): org.apache.kafka.common.requests.HeartbeatResponse@10c8b465
02.12.2021 17:25:41,237 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:41,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 76
02.12.2021 17:25:41,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 76
02.12.2021 17:25:41,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 28
02.12.2021 17:25:41,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:41,243 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,248 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,249 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=700): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,251 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,252 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=191, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}
02.12.2021 17:25:41,255 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 191 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e
02.12.2021 17:25:41,255 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:41,255 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,255 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,255 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:41,256 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,256 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3] State transition from RUNNING to REBALANCING
02.12.2021 17:25:41,256 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:41,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 276
02.12.2021 17:25:41,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,266 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=680): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,266 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,271 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=191, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}
02.12.2021 17:25:41,265 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:41,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,272 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 191 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2
02.12.2021 17:25:41,272 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:41,272 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:41,272 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,272 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=662) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:41,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 60
02.12.2021 17:25:41,276 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=662): org.apache.kafka.common.requests.HeartbeatResponse@3aac70ec
02.12.2021 17:25:41,276 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:41,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 56
02.12.2021 17:25:41,277 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,278 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:41,278 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,278 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:41,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 487
02.12.2021 17:25:41,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 55
02.12.2021 17:25:41,284 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59224ms for 60000ms of delay, sleeping for 786ms
02.12.2021 17:25:41,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,313 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,314 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,314 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:41,332 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239910ms for 240000ms of delay, sleeping for 100ms
02.12.2021 17:25:41,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:41,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,334 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:41,356 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 171
02.12.2021 17:25:41,379 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 386
02.12.2021 17:25:41,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:41,433 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239427ms for 240000ms of delay, sleeping for 583ms
02.12.2021 17:25:41,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:41,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 71
02.12.2021 17:25:41,479 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 286
02.12.2021 17:25:41,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,492 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,493 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,493 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,492 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:41,519 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=669): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,519 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=669): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,520 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,520 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=59, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', protocol='stream'}
02.12.2021 17:25:41,520 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=670): org.apache.kafka.common.requests.HeartbeatResponse@987a800
02.12.2021 17:25:41,520 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:41,520 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 59 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164
02.12.2021 17:25:41,521 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:41,521 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,521 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,521 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:41,521 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,521 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f] State transition from RUNNING to REBALANCING
02.12.2021 17:25:41,521 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:41,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 473
02.12.2021 17:25:41,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 472
02.12.2021 17:25:41,520 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,521 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=59, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', protocol='stream'}
02.12.2021 17:25:41,521 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=670): org.apache.kafka.common.requests.HeartbeatResponse@67fe3c88
02.12.2021 17:25:41,522 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:41,522 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 59 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab
02.12.2021 17:25:41,522 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:41,522 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,523 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,523 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:41,527 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:41,528 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:41,529 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:41,529 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:41,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:41,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,530 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 472
02.12.2021 17:25:41,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 461
02.12.2021 17:25:41,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:41,565 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1288): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 6, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,566 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 6, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,566 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=59, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', protocol='stream'}
02.12.2021 17:25:41,579 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 186
02.12.2021 17:25:41,622 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 371
02.12.2021 17:25:41,619 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:41,634 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 358
02.12.2021 17:25:41,632 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:41,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:41,685 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 80
02.12.2021 17:25:41,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:41,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 269
02.12.2021 17:25:41,737 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 255
02.12.2021 17:25:41,737 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:41,738 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:41,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:41,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,765 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:41,765 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,765 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,765 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:41,766 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:41,766 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:41,766 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:41,766 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:41,766 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3] State transition from REBALANCING to RUNNING
02.12.2021 17:25:41,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:41,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,766 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,814 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,821 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,821 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:41,826 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 167
02.12.2021 17:25:41,839 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 192
02.12.2021 17:25:41,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:41,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,842 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,842 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:41,839 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 153
02.12.2021 17:25:41,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:41,921 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:41,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 67
02.12.2021 17:25:41,942 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:41,939 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 92
02.12.2021 17:25:41,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 43
02.12.2021 17:25:41,956 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119575ms for 120000ms of delay, sleeping for 435ms
02.12.2021 17:25:41,969 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:41,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,992 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:41,992 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,994 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,994 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:41,995 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:41,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:41,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,995 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:41,995 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,995 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,995 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:41,995 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:41,996 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:41,996 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:41,996 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:41,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:41,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,996 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,995 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:42,002 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:42,002 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:42,002 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f] State transition from REBALANCING to RUNNING
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,018 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238603ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:42,022 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:42,003 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:42,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,036 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,040 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,043 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:42,070 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:42,074 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59011ms for 60000ms of delay, sleeping for 999ms
02.12.2021 17:25:42,096 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:42,122 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:42,137 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:42,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:42,144 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:42,170 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:42,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:42,223 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:42,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:42,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:42,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:42,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,267 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,268 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:42,268 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:42,269 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1289) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null}
02.12.2021 17:25:42,267 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,271 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,297 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:42,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:42,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,323 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,324 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,338 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:42,341 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:42,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,342 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,342 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,369 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1289): org.apache.kafka.common.requests.HeartbeatResponse@5b64a008
02.12.2021 17:25:42,369 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:42,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:42,393 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119294ms for 120000ms of delay, sleeping for 716ms
02.12.2021 17:25:42,398 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:42,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:42,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:42,442 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:42,443 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:42,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:42,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,497 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:42,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:42,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,538 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:42,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,541 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,541 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,543 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:42,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 195
02.12.2021 17:25:42,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:42,625 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:42,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:42,641 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:42,647 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:42,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:42,698 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:42,725 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:42,740 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:42,743 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:42,750 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:42,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,777 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,781 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,799 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:42,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:42,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,833 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,835 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,840 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:42,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:42,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,848 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,848 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 193
02.12.2021 17:25:42,851 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:42,886 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:42,886 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:42,886 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=962) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:42,900 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:42,936 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:42,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:42,952 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 89
02.12.2021 17:25:42,952 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:42,983 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:42,987 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=962): org.apache.kafka.common.requests.HeartbeatResponse@63280a62
02.12.2021 17:25:42,987 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:42,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,997 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,998 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 494
02.12.2021 17:25:43,018 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239603ms delay out of 240000ms. Remaining 397ms. Executor queue at 0
02.12.2021 17:25:43,020 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238874ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:43,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:43,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,038 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,039 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,039 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 453
02.12.2021 17:25:43,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:43,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,044 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,044 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,055 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:43,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 10 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:43,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:43,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 0 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:43,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:43,076 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1151394, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:43,076 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1151404, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:43,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:43,077 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-6, new queue size is 10
02.12.2021 17:25:43,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,077 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:43,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:43,077 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59036ms for 60000ms of delay, sleeping for 974ms
02.12.2021 17:25:43,083 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:43,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 394
02.12.2021 17:25:43,110 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119517ms for 120000ms of delay, sleeping for 493ms
02.12.2021 17:25:43,136 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:43,139 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 353
02.12.2021 17:25:43,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:43,156 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:43,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:43,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 294
02.12.2021 17:25:43,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:43,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 252
02.12.2021 17:25:43,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:43,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:43,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:43,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,281 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,282 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,299 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 193
02.12.2021 17:25:43,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:43,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,335 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,340 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 152
02.12.2021 17:25:43,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:43,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:43,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,352 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:43,399 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:43,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:43,444 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 48
02.12.2021 17:25:43,447 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:43,453 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:43,483 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:43,492 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:43,492 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,492 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=671) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null}
02.12.2021 17:25:43,492 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:43,493 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,492 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,493 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=671): org.apache.kafka.common.requests.HeartbeatResponse@5c0e24c0
02.12.2021 17:25:43,493 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:43,493 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 59 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab
02.12.2021 17:25:43,493 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:43,493 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:43,493 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 98, -37, -94, -95, -98, 75, 74, -34, -67, -86, 25, 43, 40, 125, 10, 127, 0, 0, 0, 0, 0, 0, 0, 0, 37, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,493 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=672) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:43,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 46
02.12.2021 17:25:43,493 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=671) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null}
02.12.2021 17:25:43,492 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,499 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:43,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,500 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:43,513 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=671): org.apache.kafka.common.requests.HeartbeatResponse@632969
02.12.2021 17:25:43,513 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:43,513 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 59 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164
02.12.2021 17:25:43,513 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:43,513 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:43,513 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 98, -37, -94, -95, -98, 75, 74, -34, -67, -86, 25, 43, 40, 125, 10, 127, 0, 0, 0, 0, 0, 0, 0, 0, 37, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,514 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=672) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:43,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:43,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:43,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,540 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,540 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:43,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,544 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,554 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:43,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:43,593 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:43,604 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119160ms for 120000ms of delay, sleeping for 850ms
02.12.2021 17:25:43,599 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:43,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:43,645 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:43,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:43,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:43,739 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:43,745 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:43,756 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:43,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,787 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,802 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 418
02.12.2021 17:25:43,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:43,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,837 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,838 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:43,846 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:43,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,867 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,875 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 390
02.12.2021 17:25:43,902 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 318
02.12.2021 17:25:43,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:43,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:43,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 289
02.12.2021 17:25:44,004 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 216
02.12.2021 17:25:44,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:44,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,014 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,014 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,020 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239874ms delay out of 240000ms. Remaining 126ms. Executor queue at 0
02.12.2021 17:25:44,020 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239198ms for 240000ms of delay, sleeping for 812ms
02.12.2021 17:25:44,041 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:44,042 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:44,042 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,042 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,042 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,042 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,042 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,042 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,042 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,042 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,045 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 179
02.12.2021 17:25:44,053 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59957ms for 60000ms of delay, sleeping for 53ms
02.12.2021 17:25:44,076 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:44,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 116
02.12.2021 17:25:44,109 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59019ms for 60000ms of delay, sleeping for 991ms
02.12.2021 17:25:44,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:44,146 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 78
02.12.2021 17:25:44,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:44,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 15
02.12.2021 17:25:44,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,222 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,222 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,222 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,222 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,222 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 191 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,222 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=681) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null}
02.12.2021 17:25:44,222 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 80
02.12.2021 17:25:44,222 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=681): org.apache.kafka.common.requests.HeartbeatResponse@3793d9fe
02.12.2021 17:25:44,222 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:44,222 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 191 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2
02.12.2021 17:25:44,223 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:44,223 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:44,223 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 87, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,223 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=682) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:44,223 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 79
02.12.2021 17:25:44,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,226 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,227 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,227 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 191 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,227 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=701) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null}
02.12.2021 17:25:44,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 318
02.12.2021 17:25:44,227 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=701): org.apache.kafka.common.requests.HeartbeatResponse@3bbfbdee
02.12.2021 17:25:44,227 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:44,228 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 191 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e
02.12.2021 17:25:44,228 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:44,228 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:44,228 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 87, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,228 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=702) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:44,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 317
02.12.2021 17:25:44,237 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,237 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:44,237 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=663) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:44,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 101
02.12.2021 17:25:44,237 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=663): org.apache.kafka.common.requests.HeartbeatResponse@33ea575b
02.12.2021 17:25:44,238 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:44,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 100
02.12.2021 17:25:44,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 100
02.12.2021 17:25:44,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,267 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,267 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:44,267 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=663) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:44,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,268 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 107
02.12.2021 17:25:44,268 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=663): org.apache.kafka.common.requests.HeartbeatResponse@792847b0
02.12.2021 17:25:44,268 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:44,268 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 107
02.12.2021 17:25:44,268 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 107
02.12.2021 17:25:44,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,303 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30222ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,303 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,303 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:44,322 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:44,327 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:44,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,338 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,338 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:44,368 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 7
02.12.2021 17:25:44,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,376 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,376 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:44,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:44,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 77 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:44,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 228296ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 78 iterations.
02.12.2021 17:25:44,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 78 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:44,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 228297ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:44,456 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1050): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', members=[])
02.12.2021 17:25:44,456 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', members=[])
02.12.2021 17:25:44,456 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:44,457 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=191, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}
02.12.2021 17:25:44,457 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=191, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=191, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:44,457 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1051) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null,assignments=[]}
02.12.2021 17:25:44,457 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024372, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:44,457 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024382, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:44,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:44,457 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:44,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,458 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:44,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 78 iterations.
02.12.2021 17:25:44,458 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119653ms for 120000ms of delay, sleeping for 357ms
02.12.2021 17:25:44,476 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:44,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,515 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30171ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,539 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:44,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,543 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30234ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,543 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,546 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30320ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,548 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:44,557 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1051): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:44,557 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=191, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}
02.12.2021 17:25:44,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:44,639 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:44,679 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:44,740 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:44,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:44,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,804 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30725ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:44,824 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119489ms for 120000ms of delay, sleeping for 521ms
02.12.2021 17:25:44,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 10 records with 64 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:44,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 195836ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 65 iterations.
02.12.2021 17:25:44,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 0 records with 65 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:44,835 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 195837ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:44,838 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 59 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452
02.12.2021 17:25:44,839 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,843 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,839 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:44,843 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[redacted.Cloud.Message.Callback.Retry3-6], userDataSize=48)
02.12.2021 17:25:44,843 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:44,844 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:44,851 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:330] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Skip resuming since state is RUNNING
02.12.2021 17:25:44,853 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:44,853 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:44,854 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f] State transition from RUNNING to REBALANCING
02.12.2021 17:25:44,854 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Pausing partitions [redacted.Cloud.Message.Callback.Retry3-6]
02.12.2021 17:25:44,857 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 59 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452
02.12.2021 17:25:44,858 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:44,860 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:44,861 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 98, -37, -94, -95, -98, 75, 74, -34, -67, -86, 25, 43, 40, 125, 10, 127, 0, 0, 0, 0, 0, 0, 0, 0, 37, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 6])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:44,861 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1290) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:44,863 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-6 because it is paused
02.12.2021 17:25:44,863 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 475
02.12.2021 17:25:44,875 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:44,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:44,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,883 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,883 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:44,944 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:44,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:45,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,017 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30673ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,017 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,044 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30735ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:45,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:45,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,049 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30823ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,084 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:45,101 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59093ms for 60000ms of delay, sleeping for 917ms
02.12.2021 17:25:45,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:45,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:45,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:45,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:45,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:45,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,312 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31232ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,313 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,339 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-6 because it is paused
02.12.2021 17:25:45,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:45,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:45,340 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:45,340 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:45,340 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:45,340 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Resuming partitions [redacted.Cloud.Message.Callback.Retry3-6]
02.12.2021 17:25:45,340 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:45,340 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:45,340 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:45,340 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:45,341 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f] State transition from REBALANCING to RUNNING
02.12.2021 17:25:45,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:45,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,341 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:45,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 65 iterations.
02.12.2021 17:25:45,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 0 records with 65 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:45,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 196343ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,341 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:45,341 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=971110, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:45,342 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=971120, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:45,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:45,342 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-6, new queue size is 10
02.12.2021 17:25:45,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,342 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:45,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 65 iterations.
02.12.2021 17:25:45,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:45,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,346 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,351 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119941ms for 120000ms of delay, sleeping for 69ms
02.12.2021 17:25:45,359 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239382ms for 240000ms of delay, sleeping for 628ms
02.12.2021 17:25:45,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,383 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,421 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119469ms for 120000ms of delay, sleeping for 541ms
02.12.2021 17:25:45,446 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:45,484 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:45,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,527 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31183ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,535 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,535 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,540 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,547 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,547 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:45,547 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31239ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:45,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,551 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31329ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:45,642 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=672): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', members=[])
02.12.2021 17:25:45,642 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=672): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', members=[])
02.12.2021 17:25:45,643 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', members=[])
02.12.2021 17:25:45,643 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:45,644 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=60, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', protocol='stream'}
02.12.2021 17:25:45,644 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=60, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=60, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:45,645 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=673) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null,assignments=[]}
02.12.2021 17:25:45,643 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', members=[])
02.12.2021 17:25:45,645 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:45,645 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=60, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', protocol='stream'}
02.12.2021 17:25:45,645 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 404
02.12.2021 17:25:45,646 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=60, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=60, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:45,647 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=673) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null,assignments=[]}
02.12.2021 17:25:45,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:45,651 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 389
02.12.2021 17:25:45,698 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 185
02.12.2021 17:25:45,755 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:45,799 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:45,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,816 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31738ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,825 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,848 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,848 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:45,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,897 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:45,897 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:45,897 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=963) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:45,892 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,901 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:45,964 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119597ms for 120000ms of delay, sleeping for 413ms
02.12.2021 17:25:45,998 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239804ms for 240000ms of delay, sleeping for 206ms
02.12.2021 17:25:45,997 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=963): org.apache.kafka.common.requests.HeartbeatResponse@18731cee
02.12.2021 17:25:45,999 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:46,003 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:46,025 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59886ms for 60000ms of delay, sleeping for 124ms
02.12.2021 17:25:46,046 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:46,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,047 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31703ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:46,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:46,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,050 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31741ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:46,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:46,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,050 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,052 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:46,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:46,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,063 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31837ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:46,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:46,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,064 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,107 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:46,150 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59762ms for 60000ms of delay, sleeping for 248ms
02.12.2021 17:25:46,153 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:46,205 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238248ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:46,207 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:46,253 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:46,308 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:46,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:46,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,327 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32246ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:46,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:46,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:46,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,350 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,380 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119244ms for 120000ms of delay, sleeping for 766ms
02.12.2021 17:25:46,400 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59390ms for 60000ms of delay, sleeping for 620ms
02.12.2021 17:25:46,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:46,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,401 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:46,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:46,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,548 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32205ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:46,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:46,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,551 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32242ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:46,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:46,551 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,551 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:46,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,564 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32338ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:46,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:46,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,565 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:46,652 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:46,703 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:46,753 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:46,803 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:46,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:46,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,829 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32748ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:46,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:46,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,829 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,852 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,856 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 381
02.12.2021 17:25:46,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,902 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,903 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 364
02.12.2021 17:25:46,957 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 280
02.12.2021 17:25:47,004 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 263
02.12.2021 17:25:47,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 10 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:47,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 0 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:47,021 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1151404, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:47,021 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1151414, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:47,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:47,021 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-6, new queue size is 10
02.12.2021 17:25:47,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,022 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:47,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:47,023 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59018ms for 60000ms of delay, sleeping for 992ms
02.12.2021 17:25:47,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,051 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32707ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:47,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:47,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,051 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,052 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32743ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:47,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:47,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,052 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,058 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 179
02.12.2021 17:25:47,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,065 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32839ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:47,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:47,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,066 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,105 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 162
02.12.2021 17:25:47,147 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119968ms for 120000ms of delay, sleeping for 42ms
02.12.2021 17:25:47,158 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 79
02.12.2021 17:25:47,191 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119871ms for 120000ms of delay, sleeping for 139ms
02.12.2021 17:25:47,191 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=673): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,191 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=673): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,191 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,191 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=60, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab', protocol='stream'}
02.12.2021 17:25:47,191 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,192 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=60, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164', protocol='stream'}
02.12.2021 17:25:47,191 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 60 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab
02.12.2021 17:25:47,192 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 60 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164
02.12.2021 17:25:47,192 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:47,192 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:47,192 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:47,192 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:47,192 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:47,192 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:47,192 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:47,192 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:47,192 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:47,192 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:47,192 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f] State transition from RUNNING to REBALANCING
02.12.2021 17:25:47,193 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:47,193 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:47,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 361
02.12.2021 17:25:47,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 360
02.12.2021 17:25:47,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 62
02.12.2021 17:25:47,206 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239249ms delay out of 240000ms. Remaining 751ms. Executor queue at 0
02.12.2021 17:25:47,206 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239017ms for 240000ms of delay, sleeping for 993ms
02.12.2021 17:25:47,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:47,237 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:47,237 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:47,238 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=664) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:47,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 119
02.12.2021 17:25:47,238 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=664): org.apache.kafka.common.requests.HeartbeatResponse@5edc412d
02.12.2021 17:25:47,238 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:47,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 118
02.12.2021 17:25:47,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 118
02.12.2021 17:25:47,267 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:47,268 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:47,268 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=664) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:47,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:47,268 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 135
02.12.2021 17:25:47,269 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=664): org.apache.kafka.common.requests.HeartbeatResponse@3ec39222
02.12.2021 17:25:47,270 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:47,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 133
02.12.2021 17:25:47,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 132
02.12.2021 17:25:47,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 259
02.12.2021 17:25:47,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 258
02.12.2021 17:25:47,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,330 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 33249ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:47,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:47,331 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119214ms for 120000ms of delay, sleeping for 796ms
02.12.2021 17:25:47,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 17
02.12.2021 17:25:47,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:47,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,356 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,357 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:47,372 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 31
02.12.2021 17:25:47,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 158
02.12.2021 17:25:47,394 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 158
02.12.2021 17:25:47,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:47,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,404 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:47,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:47,462 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:47,462 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 191 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:47,463 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1052) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null}
02.12.2021 17:25:47,494 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 58
02.12.2021 17:25:47,494 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 57
02.12.2021 17:25:47,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:47,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,552 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:47,552 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:47,552 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:47,552 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:47,552 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:47,552 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:47,552 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:47,552 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:47,552 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:47,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:47,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,553 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Committing all active tasks [] and standby tasks [] since 33209ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:47,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,553 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:47,553 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:47,553 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:47,554 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:47,554 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:47,554 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:47,554 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:47,555 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:47,555 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:47,555 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f] State transition from REBALANCING to RUNNING
02.12.2021 17:25:47,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:47,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,555 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Committing all active tasks [] and standby tasks [] since 33246ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:47,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,555 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:47,563 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1052): org.apache.kafka.common.requests.HeartbeatResponse@398f6e95
02.12.2021 17:25:47,566 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:47,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,569 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 33343ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:47,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:47,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,570 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:47,656 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:47,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:47,658 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:47,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:47,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 294
02.12.2021 17:25:47,756 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:47,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:47,810 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:47,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:47,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,833 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 33752ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:47,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:47,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,845 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 193
02.12.2021 17:25:47,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:47,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 194
02.12.2021 17:25:47,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,874 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,874 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:47,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,912 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,912 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:47,960 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:47,962 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:47,988 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 386
02.12.2021 17:25:48,016 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:48,016 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59853ms for 60000ms of delay, sleeping for 157ms
02.12.2021 17:25:48,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,054 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,055 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:48,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,055 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,056 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:48,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,070 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 33845ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:48,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:48,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,071 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,089 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 286
02.12.2021 17:25:48,116 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:48,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 78 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 231970ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:48,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:48,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 79 iterations.
02.12.2021 17:25:48,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 79 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 231970ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:48,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:48,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:48,129 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:48,129 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:48,129 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:48,129 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 87, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 1])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:48,130 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1053) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:48,130 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024382, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:48,130 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024392, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:48,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:48,130 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:48,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,130 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,130 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 79 iterations.
02.12.2021 17:25:48,131 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119924ms for 120000ms of delay, sleeping for 86ms
02.12.2021 17:25:48,155 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:48,157 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:48,167 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:48,174 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59890ms for 60000ms of delay, sleeping for 120ms
02.12.2021 17:25:48,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 185
02.12.2021 17:25:48,201 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239364ms for 240000ms of delay, sleeping for 646ms
02.12.2021 17:25:48,216 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:48,218 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118644ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:48,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:48,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:48,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 85
02.12.2021 17:25:48,295 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59326ms for 60000ms of delay, sleeping for 684ms
02.12.2021 17:25:48,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:48,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:48,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,346 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 34265ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:48,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:48,346 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,356 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:48,358 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:48,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,374 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,375 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,375 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,413 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,413 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,456 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:48,458 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:48,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:48,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:48,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,556 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,557 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 87
02.12.2021 17:25:48,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,559 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 86
02.12.2021 17:25:48,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,572 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 34346ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:48,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:48,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,572 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,575 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:48,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:48,646 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,646 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:48,645 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,647 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:48,647 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=674) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null}
02.12.2021 17:25:48,645 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,647 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=674): org.apache.kafka.common.requests.HeartbeatResponse@7f985fe0
02.12.2021 17:25:48,646 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=674) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null}
02.12.2021 17:25:48,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,647 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:48,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 409
02.12.2021 17:25:48,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 412
02.12.2021 17:25:48,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 410
02.12.2021 17:25:48,648 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=674): org.apache.kafka.common.requests.HeartbeatResponse@2e55a907
02.12.2021 17:25:48,649 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:48,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 408
02.12.2021 17:25:48,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 408
02.12.2021 17:25:48,677 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:48,719 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:48,749 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 310
02.12.2021 17:25:48,750 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 307
02.12.2021 17:25:48,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:48,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:48,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,847 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 34766ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:48,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:48,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,848 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239657ms for 240000ms of delay, sleeping for 353ms
02.12.2021 17:25:48,849 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 210
02.12.2021 17:25:48,851 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 206
02.12.2021 17:25:48,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:48,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,879 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,880 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,907 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,907 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:48,907 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=964) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:48,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:48,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,916 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,916 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,950 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 109
02.12.2021 17:25:48,952 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 105
02.12.2021 17:25:48,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:48,981 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59942ms for 60000ms of delay, sleeping for 68ms
02.12.2021 17:25:49,008 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=964): org.apache.kafka.common.requests.HeartbeatResponse@42dc82f0
02.12.2021 17:25:49,008 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:49,016 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:49,050 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59697ms for 60000ms of delay, sleeping for 313ms
02.12.2021 17:25:49,051 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 8
02.12.2021 17:25:49,052 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 5
02.12.2021 17:25:49,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,058 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,058 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:49,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,059 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,073 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 34847ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:49,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:49,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,074 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,080 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:49,117 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:49,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:49,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:49,181 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:49,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 10 records with 65 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 200206ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:49,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:49,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 66 iterations.
02.12.2021 17:25:49,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 0 records with 66 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 200206ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:49,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:49,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,204 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1290): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', members=[])
02.12.2021 17:25:49,204 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', members=[])
02.12.2021 17:25:49,204 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:49,204 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=60, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', protocol='stream'}
02.12.2021 17:25:49,205 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=60, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=60, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:49,205 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=971120, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:49,205 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=971130, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:49,205 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1291) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null,assignments=[]}
02.12.2021 17:25:49,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:49,205 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-6, new queue size is 10
02.12.2021 17:25:49,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,205 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,205 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 66 iterations.
02.12.2021 17:25:49,206 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239687ms for 240000ms of delay, sleeping for 323ms
02.12.2021 17:25:49,206 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1291): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 6, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:49,206 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 6, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 6, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:49,206 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=60, memberId='staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452', protocol='stream'}
02.12.2021 17:25:49,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:49,218 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119644ms delay out of 120000ms. Remaining 356ms. Executor queue at 0
02.12.2021 17:25:49,219 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118949ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:49,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:49,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:49,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:49,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:49,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,348 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 35267ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:49,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:49,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,348 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:49,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:49,365 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59583ms for 60000ms of delay, sleeping for 427ms
02.12.2021 17:25:49,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:49,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,380 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,380 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,416 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:49,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,417 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,417 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:49,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:49,481 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:49,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:49,530 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239425ms for 240000ms of delay, sleeping for 585ms
02.12.2021 17:25:49,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,561 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:49,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,562 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,563 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,575 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 35349ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:49,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:49,577 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:49,618 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:49,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:49,663 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:49,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:49,718 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:49,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:49,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:49,783 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:49,806 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59986ms for 60000ms of delay, sleeping for 24ms
02.12.2021 17:25:49,821 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:49,840 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59611ms for 60000ms of delay, sleeping for 399ms
02.12.2021 17:25:49,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,864 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:49,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:49,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 35783ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:49,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:49,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,872 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:49,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,890 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,904 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 333
02.12.2021 17:25:49,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:49,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,920 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,921 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 346
02.12.2021 17:25:49,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:49,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:50,004 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 233
02.12.2021 17:25:50,006 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=702): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', members=[])
02.12.2021 17:25:50,006 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=682): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', members=[])
02.12.2021 17:25:50,007 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', members=[])
02.12.2021 17:25:50,006 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', members=[])
02.12.2021 17:25:50,007 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:50,007 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=192, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}
02.12.2021 17:25:50,007 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=192, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=192, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:50,007 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=703) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:50,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 69
02.12.2021 17:25:50,007 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:50,008 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=192, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}
02.12.2021 17:25:50,008 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=192, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=192, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:50,008 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=683) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null,assignments=[]}
02.12.2021 17:25:50,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 364
02.12.2021 17:25:50,023 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 244
02.12.2021 17:25:50,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,063 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,064 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:50,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,065 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,065 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,077 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 35851ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:50,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:50,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,077 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,104 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 133
02.12.2021 17:25:50,110 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=683): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,111 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,111 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=192, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}
02.12.2021 17:25:50,111 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 192 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2
02.12.2021 17:25:50,111 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:50,111 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:50,111 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:50,111 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:50,111 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:50,111 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3] State transition from RUNNING to REBALANCING
02.12.2021 17:25:50,111 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:50,111 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 261
02.12.2021 17:25:50,110 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=703): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,112 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,112 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=192, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}
02.12.2021 17:25:50,112 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 192 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e
02.12.2021 17:25:50,112 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:50,112 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:50,112 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:50,113 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:50,113 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:50,113 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:50,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 465
02.12.2021 17:25:50,119 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239866ms for 240000ms of delay, sleeping for 144ms
02.12.2021 17:25:50,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 144
02.12.2021 17:25:50,164 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:50,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:50,205 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 32
02.12.2021 17:25:50,212 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 160
02.12.2021 17:25:50,214 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 363
02.12.2021 17:25:50,219 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119949ms delay out of 120000ms. Remaining 51ms. Executor queue at 0
02.12.2021 17:25:50,220 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119781ms for 120000ms of delay, sleeping for 229ms
02.12.2021 17:25:50,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 43
02.12.2021 17:25:50,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,238 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:50,239 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:50,239 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=665) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:50,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 166
02.12.2021 17:25:50,239 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=665): org.apache.kafka.common.requests.HeartbeatResponse@232edf61
02.12.2021 17:25:50,240 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:50,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 164
02.12.2021 17:25:50,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 164
02.12.2021 17:25:50,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 10 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:50,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 0 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:50,248 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1151414, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:50,248 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1151424, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:50,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:50,248 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-6, new queue size is 10
02.12.2021 17:25:50,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,249 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:50,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,249 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:50,249 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59578ms for 60000ms of delay, sleeping for 432ms
02.12.2021 17:25:50,265 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239390ms for 240000ms of delay, sleeping for 620ms
02.12.2021 17:25:50,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:50,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:50,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,267 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:50,267 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:50,267 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=665) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:50,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,268 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 153
02.12.2021 17:25:50,268 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=665): org.apache.kafka.common.requests.HeartbeatResponse@79f6b84c
02.12.2021 17:25:50,268 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:50,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 153
02.12.2021 17:25:50,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 150
02.12.2021 17:25:50,313 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 60
02.12.2021 17:25:50,314 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 263
02.12.2021 17:25:50,341 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 63
02.12.2021 17:25:50,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:50,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:50,371 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 50
02.12.2021 17:25:50,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:50,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:50,373 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:50,373 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:50,373 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:50,373 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:50,373 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:50,373 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:50,373 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:50,373 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:50,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:50,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,374 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Committing all active tasks [] and standby tasks [] since 36293ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:50,374 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,406 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,406 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:50,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 162
02.12.2021 17:25:50,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,422 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,422 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:50,451 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119908ms for 120000ms of delay, sleeping for 102ms
02.12.2021 17:25:50,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:50,467 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:50,474 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:50,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:50,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 62
02.12.2021 17:25:50,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:50,554 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119947ms for 120000ms of delay, sleeping for 63ms
02.12.2021 17:25:50,564 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,565 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,565 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,566 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,566 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,575 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:50,578 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,578 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:50,578 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:50,578 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:50,578 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:50,578 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:50,578 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:50,578 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:50,578 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:50,578 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:50,578 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3] State transition from REBALANCING to RUNNING
02.12.2021 17:25:50,578 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:50,578 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,578 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,578 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,578 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,578 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,578 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,578 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Committing all active tasks [] and standby tasks [] since 36352ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:50,578 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,578 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:50,622 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119676ms for 120000ms of delay, sleeping for 334ms
02.12.2021 17:25:50,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:50,666 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:50,667 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:50,675 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:50,679 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:50,682 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59924ms for 60000ms of delay, sleeping for 86ms
02.12.2021 17:25:50,708 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:50,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:50,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:50,767 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:50,769 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59671ms for 60000ms of delay, sleeping for 339ms
02.12.2021 17:25:50,776 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:50,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:50,812 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:50,825 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:50,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:50,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:50,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:50,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,876 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:50,886 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239966ms for 240000ms of delay, sleeping for 44ms
02.12.2021 17:25:50,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,907 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,907 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:50,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:50,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,924 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:50,932 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239728ms for 240000ms of delay, sleeping for 282ms
02.12.2021 17:25:50,959 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119356ms for 120000ms of delay, sleeping for 654ms
02.12.2021 17:25:50,967 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:50,968 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:50,977 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:50,983 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:51,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:51,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:51,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,065 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,065 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:51,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,067 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,067 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:51,077 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:51,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,079 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,108 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:51,111 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59046ms for 60000ms of delay, sleeping for 964ms
02.12.2021 17:25:51,125 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:51,166 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:51,168 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:51,178 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 200
02.12.2021 17:25:51,179 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:51,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:51,215 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239388ms for 240000ms of delay, sleeping for 622ms
02.12.2021 17:25:51,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:51,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:51,268 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:51,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:51,280 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:51,309 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:51,326 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:51,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:51,368 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:51,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,378 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,378 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,380 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:51,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,409 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,411 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,426 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,426 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,467 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:51,469 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:51,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:51,480 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:51,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:51,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:51,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,566 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,566 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 79
02.12.2021 17:25:51,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,568 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,568 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 78
02.12.2021 17:25:51,580 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:51,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:51,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,585 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 79 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 235456ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:51,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:51,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 80 iterations.
02.12.2021 17:25:51,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 80 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 235456ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:51,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:51,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,616 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1053): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', members=[])
02.12.2021 17:25:51,616 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', members=[])
02.12.2021 17:25:51,616 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:51,616 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=192, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}
02.12.2021 17:25:51,616 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=192, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=192, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:51,616 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1054) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null,assignments=[]}
02.12.2021 17:25:51,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:51,616 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024392, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:51,617 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024402, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:51,617 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1054): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:51,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 4 ms and fetched 10 records
02.12.2021 17:25:51,621 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:51,621 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,622 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 80 iterations.
02.12.2021 17:25:51,624 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119513ms for 120000ms of delay, sleeping for 497ms
02.12.2021 17:25:51,627 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:51,645 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,646 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:51,647 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=675) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null}
02.12.2021 17:25:51,646 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,647 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:51,647 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=675) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null}
02.12.2021 17:25:51,647 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 421
02.12.2021 17:25:51,648 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=675): org.apache.kafka.common.requests.HeartbeatResponse@1db6ae1
02.12.2021 17:25:51,649 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:51,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 422
02.12.2021 17:25:51,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 417
02.12.2021 17:25:51,652 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 414
02.12.2021 17:25:51,650 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=675): org.apache.kafka.common.requests.HeartbeatResponse@76a9a7b9
02.12.2021 17:25:51,653 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:51,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 415
02.12.2021 17:25:51,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 415
02.12.2021 17:25:51,680 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:51,688 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:51,717 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:51,716 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=192, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', protocol='stream'}
02.12.2021 17:25:51,728 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:51,754 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 314
02.12.2021 17:25:51,752 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 314
02.12.2021 17:25:51,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:51,794 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:51,817 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:51,829 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:51,851 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239641ms for 240000ms of delay, sleeping for 369ms
02.12.2021 17:25:51,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 208
02.12.2021 17:25:51,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 204
02.12.2021 17:25:51,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:51,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,891 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 189
02.12.2021 17:25:51,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,900 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:51,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,914 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,916 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,917 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:51,917 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=965) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:51,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:51,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,931 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,932 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,963 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 105
02.12.2021 17:25:51,968 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:51,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 89
02.12.2021 17:25:52,000 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:52,017 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=965): org.apache.kafka.common.requests.HeartbeatResponse@66efbf48
02.12.2021 17:25:52,018 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:52,019 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:52,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:52,064 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 4
02.12.2021 17:25:52,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:52,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,066 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,066 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,069 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,069 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,076 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59992ms for 60000ms of delay, sleeping for 18ms
02.12.2021 17:25:52,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,089 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,089 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:52,098 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59945ms for 60000ms of delay, sleeping for 65ms
02.12.2021 17:25:52,106 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:52,120 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:52,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:52,136 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119778ms for 120000ms of delay, sleeping for 232ms
02.12.2021 17:25:52,164 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59232ms for 60000ms of delay, sleeping for 778ms
02.12.2021 17:25:52,167 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:52,170 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:52,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:52,210 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 191
02.12.2021 17:25:52,211 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:52,213 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:52,213 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1292) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null}
02.12.2021 17:25:52,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:52,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 10 records with 66 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 203228ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:52,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:52,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 67 iterations.
02.12.2021 17:25:52,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 0 records with 67 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 203228ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:52,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:52,227 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:52,227 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1292): org.apache.kafka.common.requests.HeartbeatResponse@5665b3c2
02.12.2021 17:25:52,228 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:52,231 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 60 and memberId staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452
02.12.2021 17:25:52,231 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:52,231 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[redacted.Cloud.Message.Callback.Retry3-6], userDataSize=48)
02.12.2021 17:25:52,232 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:52,232 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:330] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Skip resuming since state is RUNNING
02.12.2021 17:25:52,233 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:52,233 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:52,234 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f] State transition from RUNNING to REBALANCING
02.12.2021 17:25:52,234 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Pausing partitions [redacted.Cloud.Message.Callback.Retry3-6]
02.12.2021 17:25:52,234 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-6 because it is paused
02.12.2021 17:25:52,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,235 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-6 because it is paused
02.12.2021 17:25:52,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:52,235 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-6 because it is paused
02.12.2021 17:25:52,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 492
02.12.2021 17:25:52,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 295
02.12.2021 17:25:52,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:52,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:52,313 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 87
02.12.2021 17:25:52,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:52,335 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-6 because it is paused
02.12.2021 17:25:52,336 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-6 because it is paused
02.12.2021 17:25:52,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 392
02.12.2021 17:25:52,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:52,373 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:52,371 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:52,375 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119907ms for 120000ms of delay, sleeping for 103ms
02.12.2021 17:25:52,390 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:52,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:52,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,400 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,402 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:52,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:52,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,419 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,419 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:52,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,435 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,436 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,436 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-6 because it is paused
02.12.2021 17:25:52,436 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-6 because it is paused
02.12.2021 17:25:52,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 291
02.12.2021 17:25:52,473 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:52,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:52,480 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119699ms for 120000ms of delay, sleeping for 311ms
02.12.2021 17:25:52,491 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:52,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:52,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:52,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:52,537 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-6 because it is paused
02.12.2021 17:25:52,537 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-6 because it is paused
02.12.2021 17:25:52,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 190
02.12.2021 17:25:52,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:52,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,566 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,566 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,570 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,570 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,590 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,591 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,591 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 415
02.12.2021 17:25:52,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:52,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:52,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:52,637 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-6 because it is paused
02.12.2021 17:25:52,637 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-6 because it is paused
02.12.2021 17:25:52,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 90
02.12.2021 17:25:52,667 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:52,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:52,693 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 314
02.12.2021 17:25:52,703 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:52,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:52,728 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:634] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetching records for assigned partition redacted.Cloud.Message.Callback.Retry3-6 because it is paused
02.12.2021 17:25:52,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:52,728 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:52,728 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:52,728 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:52,728 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Resuming partitions [redacted.Cloud.Message.Callback.Retry3-6]
02.12.2021 17:25:52,728 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:52,728 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:52,728 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:52,728 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:52,728 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f] State transition from REBALANCING to RUNNING
02.12.2021 17:25:52,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:52,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,729 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 67 iterations.
02.12.2021 17:25:52,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 0 records with 67 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 203732ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:52,730 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Flushing record collector
02.12.2021 17:25:52,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Prepared RUNNING task for committing
02.12.2021 17:25:52,731 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry3-6=OffsetAndMetadata{offset=971130, leaderEpoch=null, metadata='AQAAAX1788HX'}} to coordinator kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:52,731 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1293) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry3,partitions=[{partition_index=6,committed_offset=971130,committed_leader_epoch=-1,committed_metadata=AQAAAX1788HX}]}]}
02.12.2021 17:25:52,736 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:52,750 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received OFFSET_COMMIT response from node 2147483643 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1293): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry3', partitions=[OffsetCommitResponsePartition(partitionIndex=6, errorCode=0)])])
02.12.2021 17:25:52,750 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Committed offset 971130 for partition redacted.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:52,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry3-6=971129}
02.12.2021 17:25:52,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Finalized commit for RUNNING task with eos false enforce checkpoint false
02.12.2021 17:25:52,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:684] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Committed all active tasks [0_6] and standby tasks [] in 0ms
02.12.2021 17:25:52,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:52,755 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=971130, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:52,755 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=971140, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:52,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:52,760 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-6, new queue size is 10
02.12.2021 17:25:52,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,760 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 67 iterations.
02.12.2021 17:25:52,761 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238863ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:52,768 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:52,771 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:52,794 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 213
02.12.2021 17:25:52,796 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119669ms for 120000ms of delay, sleeping for 341ms
02.12.2021 17:25:52,803 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:52,823 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:52,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:52,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:52,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:52,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 112
02.12.2021 17:25:52,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:52,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,906 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,908 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 100
02.12.2021 17:25:52,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,920 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 318
02.12.2021 17:25:52,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:52,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,938 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 329
02.12.2021 17:25:52,944 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58917ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:52,969 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:52,972 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:52,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 11
02.12.2021 17:25:53,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,009 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 192 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,009 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=684) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null}
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,009 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 192 and member id staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,009 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:53,010 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=684): org.apache.kafka.common.requests.HeartbeatResponse@62c43e67
02.12.2021 17:25:53,010 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:53,010 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 192 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2
02.12.2021 17:25:53,011 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:53,011 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:53,010 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=704) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null}
02.12.2021 17:25:53,011 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 88, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,011 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=685) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:53,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 83
02.12.2021 17:25:53,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 397
02.12.2021 17:25:53,012 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=704): org.apache.kafka.common.requests.HeartbeatResponse@5b1d0845
02.12.2021 17:25:53,012 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:53,012 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 192 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e
02.12.2021 17:25:53,013 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:53,013 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:53,013 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 88, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,013 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=705) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:53,013 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 79
02.12.2021 17:25:53,021 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 217
02.12.2021 17:25:53,039 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 228
02.12.2021 17:25:53,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,066 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,066 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,071 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,071 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,092 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,093 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,093 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,109 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:53,111 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:53,122 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 116
02.12.2021 17:25:53,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 126
02.12.2021 17:25:53,144 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119084ms for 120000ms of delay, sleeping for 926ms
02.12.2021 17:25:53,167 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:53,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:53,222 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 16
02.12.2021 17:25:53,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,239 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,239 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:53,240 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=666) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:53,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 180
02.12.2021 17:25:53,240 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=666): org.apache.kafka.common.requests.HeartbeatResponse@76103cfd
02.12.2021 17:25:53,240 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:53,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 180
02.12.2021 17:25:53,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 180
02.12.2021 17:25:53,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 26
02.12.2021 17:25:53,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:53,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,270 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,271 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:53,271 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=666) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:53,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 168
02.12.2021 17:25:53,272 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=666): org.apache.kafka.common.requests.HeartbeatResponse@20848c8e
02.12.2021 17:25:53,272 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:53,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 166
02.12.2021 17:25:53,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 166
02.12.2021 17:25:53,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:53,341 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 79
02.12.2021 17:25:53,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:53,373 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 65
02.12.2021 17:25:53,373 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:53,409 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:53,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,411 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,411 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,420 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,421 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:53,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,439 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,440 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:53,468 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:53,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:53,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:53,540 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:53,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,567 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,568 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,572 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,572 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,594 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,621 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:53,643 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:53,668 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:53,672 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:53,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:53,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:53,767 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239869ms delay out of 240000ms. Remaining 131ms. Executor queue at 0
02.12.2021 17:25:53,769 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:53,768 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239590ms for 240000ms of delay, sleeping for 420ms
02.12.2021 17:25:53,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:53,832 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:53,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:53,872 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:53,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:53,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:53,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,915 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,917 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,917 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,932 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:53,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,938 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:53,944 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59917ms delay out of 60000ms. Remaining 83ms. Executor queue at 0
02.12.2021 17:25:53,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:53,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,945 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 10 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:53,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:53,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 0 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:53,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:53,946 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:53,952 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 8 fetched records at offset FetchPosition{offset=1151424, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:53,952 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1151432, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:53,952 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:1199] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Added READ_UNCOMMITTED fetch request for partition redacted.Cloud.Message.Callback.Retry1-6 at position FetchPosition{offset=1151432, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)], epoch=absent}} to node kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)
02.12.2021 17:25:53,953 DEBUG [org.apache.kafka.clients.FetchSessionHandler:259] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Built incremental fetch (sessionId=946810555, epoch=217) for node 4. Added (), altered (redacted.Cloud.Message.Callback.Retry1-6), removed () out of (OSS.STAGING.Cloud.Message.Callback.Retry1-6)
02.12.2021 17:25:53,953 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:266] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(redacted.Cloud.Message.Callback.Retry1-6), toForget=(), implied=()) to broker kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)
02.12.2021 17:25:53,953 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending FETCH request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=966) and timeout 30000 to node 4: {replica_id=-1,max_wait_ms=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=946810555,session_epoch=217,topics=[{topic=redacted.Cloud.Message.Callback.Retry1,partitions=[{partition=6,current_leader_epoch=-1,fetch_offset=1151432,log_start_offset=-1,partition_max_bytes=1048576}]}],forgotten_topics_data=[],rack_id=}
02.12.2021 17:25:53,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Main Consumer poll completed in 8 ms and fetched 8 records
02.12.2021 17:25:53,955 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-6, new queue size is 8
02.12.2021 17:25:53,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,955 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:53,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:53,957 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59891ms for 60000ms of delay, sleeping for 119ms
02.12.2021 17:25:53,972 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:53,978 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:54,022 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received FETCH response from node 4 for request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=966): org.apache.kafka.common.requests.FetchResponse@4537c2ed
02.12.2021 17:25:54,023 DEBUG [org.apache.kafka.clients.FetchSessionHandler:463] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Node 4 sent an incremental fetch response with throttleTimeMs = 0 for session 946810555 with response=(redacted.Cloud.Message.Callback.Retry1-6)
02.12.2021 17:25:54,023 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:315] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Fetch READ_UNCOMMITTED at offset 1151432 for partition redacted.Cloud.Message.Callback.Retry1-6 returned fetch data (error=NONE, highWaterMark=1151607, lastStableOffset = 1151607, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, divergingEpoch =Optional.empty, recordsSizeInBytes=79025)
02.12.2021 17:25:54,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:54,052 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 393
02.12.2021 17:25:54,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,069 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,070 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:54,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,073 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,073 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:54,071 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119992ms for 120000ms of delay, sleeping for 18ms
02.12.2021 17:25:54,080 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59512ms for 60000ms of delay, sleeping for 498ms
02.12.2021 17:25:54,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 80 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:54,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 237935ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:54,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:54,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 81 iterations.
02.12.2021 17:25:54,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 81 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:54,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 237936ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:54,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:54,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:54,095 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:54,095 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:54,095 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:54,095 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -52, -31, -126, -65, 80, 51, 74, -95, -68, 73, 80, 35, 92, 122, 62, -13, 0, 0, 0, 0, 0, 0, 0, 0, 88, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 1])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:54,095 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, correlationId=1055) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer-b3db5b45-b22e-4ca1-8c2b-f83c787140e4,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:54,096 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024402, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:54,096 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024412, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:54,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:54,096 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:54,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,096 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:54,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,096 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 81 iterations.
02.12.2021 17:25:54,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,097 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:54,098 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119764ms for 120000ms of delay, sleeping for 246ms
02.12.2021 17:25:54,123 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:54,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:54,152 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:54,170 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:54,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:54,193 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239034ms for 240000ms of delay, sleeping for 976ms
02.12.2021 17:25:54,247 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:54,254 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:54,276 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:54,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:54,347 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119978ms for 120000ms of delay, sleeping for 32ms
02.12.2021 17:25:54,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:54,355 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:54,380 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 191
02.12.2021 17:25:54,379 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 194
02.12.2021 17:25:54,385 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119270ms for 120000ms of delay, sleeping for 740ms
02.12.2021 17:25:54,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,418 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:54,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,445 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,445 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,445 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,445 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,486 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 84
02.12.2021 17:25:54,487 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 86
02.12.2021 17:25:54,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:54,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:54,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,571 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,574 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 71
02.12.2021 17:25:54,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:54,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,576 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 69
02.12.2021 17:25:54,579 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59787ms for 60000ms of delay, sleeping for 223ms
02.12.2021 17:25:54,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,597 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:54,645 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,646 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:54,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:54,646 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=676) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null}
02.12.2021 17:25:54,646 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 429
02.12.2021 17:25:54,647 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:54,646 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=676): org.apache.kafka.common.requests.HeartbeatResponse@35a81572
02.12.2021 17:25:54,647 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:54,647 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 427
02.12.2021 17:25:54,647 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 427
02.12.2021 17:25:54,646 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:54,649 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=676) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null}
02.12.2021 17:25:54,651 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 431
02.12.2021 17:25:54,652 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=676): org.apache.kafka.common.requests.HeartbeatResponse@60a5cf98
02.12.2021 17:25:54,659 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:54,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 418
02.12.2021 17:25:54,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 418
02.12.2021 17:25:54,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:54,747 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:54,747 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 327
02.12.2021 17:25:54,762 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 315
02.12.2021 17:25:54,808 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59929ms for 60000ms of delay, sleeping for 81ms
02.12.2021 17:25:54,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:54,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:54,848 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 226
02.12.2021 17:25:54,867 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 210
02.12.2021 17:25:54,891 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59341ms for 60000ms of delay, sleeping for 669ms
02.12.2021 17:25:54,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,919 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,921 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,921 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,925 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,925 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:54,925 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=967) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:54,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,946 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,946 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,946 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,946 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 125
02.12.2021 17:25:54,968 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 110
02.12.2021 17:25:55,026 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=967): org.apache.kafka.common.requests.HeartbeatResponse@452332c9
02.12.2021 17:25:55,026 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:55,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:55,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:55,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 25
02.12.2021 17:25:55,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 9
02.12.2021 17:25:55,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:55,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,075 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,075 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,077 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,078 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,078 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,097 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,098 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,129 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119827ms for 120000ms of delay, sleeping for 183ms
02.12.2021 17:25:55,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:55,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:55,172 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239977ms for 240000ms of delay, sleeping for 33ms
02.12.2021 17:25:55,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:55,178 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:55,207 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239102ms for 240000ms of delay, sleeping for 908ms
02.12.2021 17:25:55,247 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:55,248 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:55,253 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:55,254 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:55,254 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1294) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null}
02.12.2021 17:25:55,276 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:55,279 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:55,320 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119514ms for 120000ms of delay, sleeping for 496ms
02.12.2021 17:25:55,348 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:55,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:55,357 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1294): org.apache.kafka.common.requests.HeartbeatResponse@25ad0303
02.12.2021 17:25:55,358 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:55,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:55,381 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:55,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,422 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,422 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,449 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,450 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,450 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:55,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:55,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:55,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:55,564 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59694ms for 60000ms of delay, sleeping for 316ms
02.12.2021 17:25:55,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,576 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,579 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,583 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,599 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,599 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,599 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,599 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,599 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,599 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,600 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,651 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:55,650 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:55,677 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:55,688 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 397
02.12.2021 17:25:55,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:55,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 188
02.12.2021 17:25:55,781 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:55,788 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:55,817 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119627ms for 120000ms of delay, sleeping for 383ms
02.12.2021 17:25:55,870 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 79
02.12.2021 17:25:55,870 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 80
02.12.2021 17:25:55,881 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:55,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 8 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:55,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 18 iterations.
02.12.2021 17:25:55,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 0 records with 18 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:55,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:55,888 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1251] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Preparing to read 79025 bytes of data for partition redacted.Cloud.Message.Callback.Retry1-6 with offset FetchPosition{offset=1151432, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 4 rack: null)], epoch=absent}}
02.12.2021 17:25:55,888 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1275] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Updating high watermark for partition redacted.Cloud.Message.Callback.Retry1-6 to 1151607
02.12.2021 17:25:55,888 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1280] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Updating log start offset for partition redacted.Cloud.Message.Callback.Retry1-6 to 0
02.12.2021 17:25:55,888 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1285] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Updating last stable offset for partition redacted.Cloud.Message.Callback.Retry1-6 to 1151607
02.12.2021 17:25:55,888 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1151432, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:55,888 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1151442, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:55,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:55,888 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-6, new queue size is 10
02.12.2021 17:25:55,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,888 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:55,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 18 iterations.
02.12.2021 17:25:55,889 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58866ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:55,889 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:55,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,930 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,931 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,950 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,950 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 289
02.12.2021 17:25:55,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,969 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,975 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:55,985 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:55,990 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:56,051 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:56,075 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:56,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:56,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,079 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:56,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,091 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,091 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:56,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,107 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,107 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,118 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239798ms for 240000ms of delay, sleeping for 212ms
02.12.2021 17:25:56,151 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:56,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:56,180 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:56,191 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:56,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 81 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:56,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 240042ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:56,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:56,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 82 iterations.
02.12.2021 17:25:56,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 82 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:56,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 240042ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:56,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:56,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:56,202 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024412, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:56,202 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024422, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:56,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:56,202 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:56,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,202 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:56,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 82 iterations.
02.12.2021 17:25:56,203 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119818ms for 120000ms of delay, sleeping for 192ms
02.12.2021 17:25:56,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,241 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:56,245 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:56,245 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=667) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:56,246 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 209
02.12.2021 17:25:56,246 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=667): org.apache.kafka.common.requests.HeartbeatResponse@17a1fdeb
02.12.2021 17:25:56,247 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:56,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 203
02.12.2021 17:25:56,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:56,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,271 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:56,271 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:56,272 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=667) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:56,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 204
02.12.2021 17:25:56,275 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=667): org.apache.kafka.common.requests.HeartbeatResponse@1baa5ae9
02.12.2021 17:25:56,278 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:56,279 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:56,280 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:56,280 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:56,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:56,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 10 records with 67 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:56,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 68 iterations.
02.12.2021 17:25:56,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 0 records with 68 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:56,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:56,335 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=971140, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:56,335 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=971150, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:56,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:56,336 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-6, new queue size is 10
02.12.2021 17:25:56,336 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,336 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:56,336 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,336 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 68 iterations.
02.12.2021 17:25:56,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:56,357 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239920ms for 240000ms of delay, sleeping for 90ms
02.12.2021 17:25:56,380 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:56,381 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:56,392 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:56,396 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119324ms for 120000ms of delay, sleeping for 686ms
02.12.2021 17:25:56,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,431 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,448 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239457ms for 240000ms of delay, sleeping for 553ms
02.12.2021 17:25:56,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:56,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,453 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,453 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:56,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,475 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:56,481 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:56,492 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:56,554 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:56,576 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:56,580 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,580 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,580 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,580 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,580 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,580 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,580 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,580 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,580 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,592 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,608 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,608 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,608 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,608 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,608 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,608 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,608 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,608 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:56,677 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:56,680 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:56,694 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:56,756 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:56,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:56,781 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:56,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:56,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 82
02.12.2021 17:25:56,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:56,881 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:56,889 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59866ms delay out of 60000ms. Remaining 134ms. Executor queue at 0
02.12.2021 17:25:56,890 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59870ms for 60000ms of delay, sleeping for 140ms
02.12.2021 17:25:56,896 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:56,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:56,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,938 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,953 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,953 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:56,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,977 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:56,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:56,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:57,004 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238857ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:57,031 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59977ms for 60000ms of delay, sleeping for 33ms
02.12.2021 17:25:57,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:57,066 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59867ms for 60000ms of delay, sleeping for 143ms
02.12.2021 17:25:57,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:57,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,080 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,080 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:57,084 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119985ms for 120000ms of delay, sleeping for 25ms
02.12.2021 17:25:57,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,094 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,095 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,095 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:57,109 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,109 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,109 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,109 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,109 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,109 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,109 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,109 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,109 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,112 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119578ms for 120000ms of delay, sleeping for 432ms
02.12.2021 17:25:57,154 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:57,180 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:57,180 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:57,195 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:57,211 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59163ms for 60000ms of delay, sleeping for 847ms
02.12.2021 17:25:57,254 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:57,280 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:57,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:57,295 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:57,356 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:57,381 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:57,381 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:57,395 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 200
02.12.2021 17:25:57,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,439 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,453 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,454 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:57,481 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,481 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,481 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,482 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,482 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:57,496 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:57,545 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119378ms for 120000ms of delay, sleeping for 632ms
02.12.2021 17:25:57,554 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:57,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:57,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,582 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,582 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 61
02.12.2021 17:25:57,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:57,595 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,600 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,601 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 44
02.12.2021 17:25:57,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,611 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,645 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,645 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:57,646 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=677) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer-3caf9825-5daf-4896-962d-7244548e6164,group_instance_id=null}
02.12.2021 17:25:57,645 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:57,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 438
02.12.2021 17:25:57,646 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, correlationId=677): org.apache.kafka.common.requests.HeartbeatResponse@2c195acf
02.12.2021 17:25:57,647 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,647 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:57,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:57,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 437
02.12.2021 17:25:57,648 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:57,648 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=677) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer-a3465277-c427-47b7-a9f0-3cc77aa4baab,group_instance_id=null}
02.12.2021 17:25:57,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 436
02.12.2021 17:25:57,651 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 454
02.12.2021 17:25:57,652 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, correlationId=677): org.apache.kafka.common.requests.HeartbeatResponse@4d20cf68
02.12.2021 17:25:57,653 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:57,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 449
02.12.2021 17:25:57,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:57,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 443
02.12.2021 17:25:57,687 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:57,752 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 332
02.12.2021 17:25:57,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:57,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 337
02.12.2021 17:25:57,787 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:57,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 219
02.12.2021 17:25:57,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:57,874 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 228
02.12.2021 17:25:57,888 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:57,930 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,930 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:57,931 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=968) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null}
02.12.2021 17:25:57,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,943 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,948 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:57,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,961 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,961 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,961 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,965 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 119
02.12.2021 17:25:57,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 122
02.12.2021 17:25:57,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:57,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,985 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,986 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,005 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239858ms delay out of 240000ms. Remaining 142ms. Executor queue at 0
02.12.2021 17:25:58,008 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239760ms for 240000ms of delay, sleeping for 250ms
02.12.2021 17:25:58,032 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=968): org.apache.kafka.common.requests.HeartbeatResponse@634ee39f
02.12.2021 17:25:58,032 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:58,059 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59978ms for 60000ms of delay, sleeping for 32ms
02.12.2021 17:25:58,062 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:58,065 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 19
02.12.2021 17:25:58,081 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 21
02.12.2021 17:25:58,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,084 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,084 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,085 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,086 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:58,093 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59886ms for 60000ms of delay, sleeping for 124ms
02.12.2021 17:25:58,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,102 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,103 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,112 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,113 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:58,178 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119979ms for 120000ms of delay, sleeping for 31ms
02.12.2021 17:25:58,185 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:58,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:58,203 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:58,212 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119920ms for 120000ms of delay, sleeping for 90ms
02.12.2021 17:25:58,219 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59965ms for 60000ms of delay, sleeping for 45ms
02.12.2021 17:25:58,261 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239502ms for 240000ms of delay, sleeping for 508ms
02.12.2021 17:25:58,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:58,264 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:58,265 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:58,265 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1295) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer-70cc5830-9c35-4912-a371-6875ad664452,group_instance_id=null}
02.12.2021 17:25:58,266 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59089ms for 60000ms of delay, sleeping for 921ms
02.12.2021 17:25:58,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:58,286 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:58,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 10 records with 82 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:58,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 242145ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:58,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:58,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 83 iterations.
02.12.2021 17:25:58,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processed 0 records with 83 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:58,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Committing all active tasks [0_1] and standby tasks [] since 242145ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:58,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:58,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:58,304 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1024422, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:58,304 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1024432, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-1
02.12.2021 17:25:58,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:58,305 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] task [0_1] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-1, new queue size is 10
02.12.2021 17:25:58,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,305 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:58,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-1] Processing tasks with 83 iterations.
02.12.2021 17:25:58,305 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119160ms for 120000ms of delay, sleeping for 850ms
02.12.2021 17:25:58,306 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:58,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:58,367 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, correlationId=1295): org.apache.kafka.common.requests.HeartbeatResponse@6ba38642
02.12.2021 17:25:58,369 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:58,386 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 200
02.12.2021 17:25:58,387 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:58,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 194
02.12.2021 17:25:58,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:58,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,452 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:58,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,463 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,486 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:58,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:58,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,487 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30292ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:58,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,487 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:58,564 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:58,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,585 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,586 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,586 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,586 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:58,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,604 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,604 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,615 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,615 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:58,686 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:58,688 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:58,704 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:58,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:58,772 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239877ms for 240000ms of delay, sleeping for 133ms
02.12.2021 17:25:58,787 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:58,788 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:58,805 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:58,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:58,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:58,888 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:58,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:58,906 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239977ms for 240000ms of delay, sleeping for 33ms
02.12.2021 17:25:58,940 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239869ms for 240000ms of delay, sleeping for 141ms
02.12.2021 17:25:58,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,953 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,953 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,964 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30246ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:58,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,965 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 276
02.12.2021 17:25:58,987 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:58,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,988 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,988 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 283
02.12.2021 17:25:59,006 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:59,065 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 176
02.12.2021 17:25:59,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 10 records with 68 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:59,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 69 iterations.
02.12.2021 17:25:59,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processed 0 records with 69 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:59,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:59,083 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=971150, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:59,083 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=971160, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-6
02.12.2021 17:25:59,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:59,083 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-6, new queue size is 10
02.12.2021 17:25:59,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,083 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:59,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,083 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-1] Processing tasks with 69 iterations.
02.12.2021 17:25:59,084 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239110ms for 240000ms of delay, sleeping for 900ms
02.12.2021 17:25:59,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,087 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,087 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,089 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 182
02.12.2021 17:25:59,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,105 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,106 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,116 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,116 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,156 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119955ms for 120000ms of delay, sleeping for 55ms
02.12.2021 17:25:59,165 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 76
02.12.2021 17:25:59,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:59,188 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59465ms for 60000ms of delay, sleeping for 545ms
02.12.2021 17:25:59,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 81
02.12.2021 17:25:59,206 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:59,213 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119583ms for 120000ms of delay, sleeping for 427ms
02.12.2021 17:25:59,231 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=705): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', members=[])
02.12.2021 17:25:59,231 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=685): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', members=[])
02.12.2021 17:25:59,232 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', members=[])
02.12.2021 17:25:59,232 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:59,232 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=193, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}
02.12.2021 17:25:59,232 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=193, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=193, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:59,232 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', members=[])
02.12.2021 17:25:59,232 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:59,232 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=193, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}
02.12.2021 17:25:59,232 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=706) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=193,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e,group_instance_id=null,assignments=[]}
02.12.2021 17:25:59,232 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=193, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=193, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:59,233 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=686) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=193,member_id=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2,group_instance_id=null,assignments=[]}
02.12.2021 17:25:59,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 383
02.12.2021 17:25:59,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 220
02.12.2021 17:25:59,243 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:59,244 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:59,244 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=668) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer-64f9688e-ef42-471f-a9d6-a08217a854de,group_instance_id=null}
02.12.2021 17:25:59,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 221
02.12.2021 17:25:59,244 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, correlationId=668): org.apache.kafka.common.requests.HeartbeatResponse@2bc8031b
02.12.2021 17:25:59,246 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:59,247 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 219
02.12.2021 17:25:59,248 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 217
02.12.2021 17:25:59,264 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, correlationId=706): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,264 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, correlationId=686): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,264 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,264 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=193, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e', protocol='stream'}
02.12.2021 17:25:59,264 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,264 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 193 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer-1959a070-2423-45c3-a3c8-9fba796e2d3e
02.12.2021 17:25:59,265 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=193, memberId='staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2', protocol='stream'}
02.12.2021 17:25:59,265 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:59,265 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:59,265 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 193 and memberId staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer-53ac5ce0-181a-4597-b343-4224d37d3bd2
02.12.2021 17:25:59,265 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:59,265 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:59,265 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:59,265 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:59,266 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:59,266 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:59,266 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:59,266 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3] State transition from RUNNING to REBALANCING
02.12.2021 17:25:59,266 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:59,266 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:59,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 352
02.12.2021 17:25:59,266 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:59,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 189
02.12.2021 17:25:59,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,275 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:59,275 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:59,275 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=668) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer-1c64790a-c093-46e7-890e-e000d36d71fd,group_instance_id=null}
02.12.2021 17:25:59,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 213
02.12.2021 17:25:59,275 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, correlationId=668): org.apache.kafka.common.requests.HeartbeatResponse@395a893c
02.12.2021 17:25:59,275 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:59,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 213
02.12.2021 17:25:59,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 213
02.12.2021 17:25:59,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:59,306 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:59,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 114
02.12.2021 17:25:59,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 249
02.12.2021 17:25:59,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 86
02.12.2021 17:25:59,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 112
02.12.2021 17:25:59,391 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:59,407 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:59,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 13
02.12.2021 17:25:59,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:59,453 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:59,453 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:59,453 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:59,453 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:59,454 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:59,454 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:59,454 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:59,454 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:59,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:59,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,454 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,455 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,465 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,465 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,465 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:59,467 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 149
02.12.2021 17:25:59,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 11
02.12.2021 17:25:59,488 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,488 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,488 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,488 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,488 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:59,499 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 88
02.12.2021 17:25:59,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:59,555 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:59,567 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:59,567 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 49
02.12.2021 17:25:59,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,592 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:59,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,607 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,617 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,619 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:59,619 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:59,619 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:59,623 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:59,623 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:59,624 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:59,624 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:59,625 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:59,625 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:59,625 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3] State transition from REBALANCING to RUNNING
02.12.2021 17:25:59,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:59,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,625 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,626 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,658 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:59,651 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119584ms for 120000ms of delay, sleeping for 426ms
02.12.2021 17:25:59,668 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:59,702 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 289
02.12.2021 17:25:59,707 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 395
02.12.2021 17:25:59,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 391
02.12.2021 17:25:59,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:59,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 10 records with 18 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:59,740 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Committing all active tasks [0_6] and standby tasks [] since 30730ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:59,740 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Flushing record collector
02.12.2021 17:25:59,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Prepared RUNNING task for committing
02.12.2021 17:25:59,741 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry1-6=OffsetAndMetadata{offset=1151442, leaderEpoch=null, metadata='AQAAAX179p5L'}} to coordinator kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:59,741 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=969) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer-f76c6b87-0798-4078-bfb0-3ec70d637ec7,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry1,partitions=[{partition_index=6,committed_offset=1151442,committed_leader_epoch=-1,committed_metadata=AQAAAX179p5L}]}]}
02.12.2021 17:25:59,761 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received OFFSET_COMMIT response from node 2147483644 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, correlationId=969): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry1', partitions=[OffsetCommitResponsePartition(partitionIndex=6, errorCode=0)])])
02.12.2021 17:25:59,762 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Committed offset 1151442 for partition redacted.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:59,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry1-6=1151441}
02.12.2021 17:25:59,759 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:59,768 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:59,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Finalized commit for RUNNING task with eos false enforce checkpoint false
02.12.2021 17:25:59,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:684] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Committed all active tasks [0_6] and standby tasks [] in 0ms
02.12.2021 17:25:59,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 9 iterations.
02.12.2021 17:25:59,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processed 0 records with 9 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:59,773 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:59,782 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1151442, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:59,782 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1151452, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-5.data.sta.redacted:9093 (id: 4 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-6
02.12.2021 17:25:59,782 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Main Consumer poll completed in 9 ms and fetched 10 records
02.12.2021 17:25:59,792 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] task [0_6] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-6, new queue size is 10
02.12.2021 17:25:59,803 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 187
02.12.2021 17:25:59,800 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,804 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:59,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,804 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-1] Processing tasks with 9 iterations.
02.12.2021 17:25:59,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 294
02.12.2021 17:25:59,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 289
02.12.2021 17:25:59,819 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59808ms for 60000ms of delay, sleeping for 202ms
02.12.2021 17:25:59,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:59,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:59,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:59,904 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:59,909 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 193
02.12.2021 17:25:59,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-62dba2a1-9e4b-4ade-bdaa-192b287d0a7f-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 188
02.12.2021 17:25:59,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:59,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:59,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,958 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,958 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-cce182bf-5033-4aa1-bc49-50235c7a3ef3-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:59,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,975 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,975 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:59,988 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239980ms for 240000ms of delay, sleeping for 30ms
02.12.2021 17:25:59,993 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:59,993 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,993 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,993 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,993 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,993 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,993 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,993 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,993 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-3c0dbbd9-ed9b-4d8d-b276-9308e6d11648-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500