Kupo tip does not stay most recent with nodes under heavy load #149

nielstron · 2023-12-04T12:41:36Z

nielstron
Dec 4, 2023

Making this a discussion to just provide more data points how kupo behaves on a system with heavy load. I am not sure if this is a bug or just a side effect of how kupo works - specifically I am assuming the the "most recent node tip" is not actively fetched from the node but rather retrieved on the side when asking where to roll forward to. If there is a large batch of transactions to be applied, it seems that the "most recent node tip" is not updated until all transaction are applied - which may take minutes to hours on heavy load / large size of roll forwards.

Note that while the node is being used by other processes, the kupo instance in question is not being used / accessed at all.

What Git revision / release tag are you using?

2.7.1 - 5c0c7aa

Describe what the problem is?

Kupo starts, seems to sync a single batch of transactions from the node, then gets stuck. Related to #142 the most recent tip of the node as returned by /health is not updated. I observe kupo.sqlite3-journal is growing, so something is happening.

This time this seems to be related to non-incremental roll-forward? Just want to point out that yes, the node is under heavy load and it might be that returning the next batch of blocks to roll forward is the bottleneck.

While the rollforward is happening, this discrepancy of actual latest tip and kupo latest tip can be observed.

$ cardano-cli query tip --mainnet
{
    "block": 9630230,
    "epoch": 452,
    "era": "Babbage",
    "hash": "e343d92934933c014b37d03743998b5256e0c874e022e724a18f6f419d91f3f7",
    "slot": 110126988,
    "syncProgress": "100.00"
}
$ curl localhost:1442/health
# TYPE kupo_connection_status gauge
kupo_connection_status  1.0
# TYPE kupo_most_recent_checkpoint counter
kupo_most_recent_checkpoint  110123263
# TYPE kupo_most_recent_node_tip counter
kupo_most_recent_node_tip  110126099

What should be the expected behavior?

The most recent node tip should stay up to date.

If applicable, what are the logs from the server around the occurence of the problem?

<kupo startup>
Dec 04 12:20:00 ns366159 bash[2602850]: {"severity":"Info","timestamp":"2023-12-04T12:20:00.904025479Z","thread":"15","message":{"Configuration":{"tag":"ConfigurationCheckpointsForIntersection","slots":[1101155>
Dec 04 12:20:01 ns366159 bash[2602850]: {"severity":"Notice","timestamp":"2023-12-04T12:20:01.100294357Z","thread":"12","message":{"Consumer":{"tag":"ConsumerRollBackward","point":110115565}},"version":"v2.7.1+>
Dec 04 12:20:01 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:20:01.100510107Z","thread":"12","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"}
Dec 04 12:20:02 ns366159 bash[2602850]: {"severity":"Info","timestamp":"2023-12-04T12:20:02.444683163Z","thread":"12","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110115570,"inputs":5,"binaryData>
Dec 04 12:20:02 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:20:02.444771262Z","thread":"12","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"}
Dec 04 12:20:22 ns366159 bash[2602850]: {"severity":"Info","timestamp":"2023-12-04T12:20:22.604006154Z","thread":"28","message":{"Http":{"tag":"HttpRequest","path":["health"],"method":"GET"}},"version":"v2.7.1+>
Dec 04 12:20:22 ns366159 bash[2602850]: {"severity":"Info","timestamp":"2023-12-04T12:20:22.60423849Z","thread":"28","message":{"Http":{"tag":"HttpResponse","status":{"statusCode":200,"statusMessage":"OK"},"tim>
Dec 04 12:20:56 ns366159 bash[2602850]: {"severity":"Info","timestamp":"2023-12-04T12:20:56.902773544Z","thread":"31","message":{"Http":{"tag":"HttpRequest","path":["health"],"method":"GET"}},"version":"v2.7.1+>
Dec 04 12:20:56 ns366159 bash[2602850]: {"severity":"Info","timestamp":"2023-12-04T12:20:56.902930368Z","thread":"31","message":{"Http":{"tag":"HttpResponse","status":{"statusCode":200,"statusMessage":"OK"},"ti>
Dec 04 12:21:00 ns366159 bash[2602850]: {"severity":"Notice","timestamp":"2023-12-04T12:21:00.819555029Z","thread":"14","message":{"Gardener":{"tag":"GardenerBeginGarbageCollection","pruning":"inputs"}},"versio>
Dec 04 12:21:00 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:00.819611127Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionCreateShortLi>
Dec 04 12:21:00 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:00.819894814Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:01 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:01.070289549Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:01 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:01.320753086Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:01 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:01.571965444Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:01 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:01.822552673Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:02 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:02.073026339Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:02 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:02.323465115Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:02 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:02.574771802Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:02 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:02.825264723Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:03 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:03.075724109Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:03 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:03.326166684Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:03 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:03.577491616Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:03 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:03.827969496Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:04 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:04.078596991Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:04 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:04.329053931Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:04 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:04.580366587Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:04 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:04.830838551Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:05 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:05.081260117Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:05 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:05.331698321Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
Dec 04 12:21:05 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:21:05.583003235Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attemp>
-------------------------------------------------------------------------------------------------
<several minutes pass>
------------------------------------------------------------------------------------------------
Dec 04 12:27:14 ns366159 bash[2602850]: {"severity":"Warning","timestamp":"2023-12-04T12:27:14.644720044Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attempts":1493,"retryingIn":0.25}}},"version":"v2.7.1+5c0c7a"}
Dec 04 12:27:14 ns366159 bash[2602850]: {"severity":"Warning","timestamp":"2023-12-04T12:27:14.89598313Z","thread":"14","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBusy","attempts":1494,"retryingIn":0.25}}},"version":"v2.7.1+5c0c7a"}
Dec 04 12:27:14 ns366159 bash[2602850]: {"severity":"Info","timestamp":"2023-12-04T12:27:14.955192379Z","thread":"12","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110119163,"inputs":7777,"binaryData":1616,"scripts":913}},"version":"v2.7.1+5c0c7a"}
Dec 04 12:27:14 ns366159 bash[2602850]: {"severity":"Debug","timestamp":"2023-12-04T12:27:14.955653348Z","thread":"12","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"}

Run via

kupo-2.7.1 \
  --node-socket $CARDANO_NODE_SOCKET_PATH \
  --node-config $CARDANO_NODE_CONFIG_PATH \
  --since origin \
  --match \* \
  --workdir ./kupo_db \
  --prune-utxo \
  --log-level Debug \
  --gc-interval 60 \
  $@

KtorZ · 2023-12-04T18:06:58Z

KtorZ
Dec 4, 2023
Maintainer

specifically I am assuming the the "most recent node tip" is not actively fetched from the node but rather retrieved on the side when asking where to roll forward to.

The most recent node tip correspond to the tip given by the node itself for each block received from the local chain sync. Each message contains actually a block, and a tip. For the node, the tip corresponds to the most recent state known of the ledger (but not necessarily of the network layer).

Unlike the checkpoint tip which must be updated as part of that transaction, the node tip could actually updated on-the-side; true.

If there is a large batch of transactions to be applied, it seems that the "most recent node tip" is not updated until all transaction are applied

That's correct, the tip is updated as part of the same db transaction that is applying inputs.

which may take minutes to hours on heavy load / large size of roll forwards.

Hours? Are you exaggerating or is this for real? I have never seen a roll forward longer than a minute on a simple dev machine. Though I haven't run in non pruned mode for a while. Given that you are also reporting issues with the internal GC, I am assuming that you do run with --prune-utxo enabled. In which case a roll forward of several minutes is already suspicious / sign that something is wrong with your setup somehow.

Can you share:

Your hardware specifications
The result of sqlite3 your/working/dir/kupo.sqlite3 ".indexes"
The result of kupo +RTS --info

Just want to point out that yes, the node is under heavy load and it might be that returning the next batch of blocks to roll forward is the bottleneck.

Unlikely, Kupo will consume whatever the node was able to stream since the last batch. And even a single block isn't that expensive to fetch.

2 replies

nielstron Dec 5, 2023
Author

I have patched in the missing index discussed in #150 and let kupo run again without any external accesses. It still got stuck at some point. I am unsure if the roll forward takes so long or what exactly is causing the hold up in the log.

Node

I do hope that this is unrelated but who knows.

$ cardano-node --version
cardano-node 1.35.5 - linux-x86_64 - ghc-8.10
git rev 8762a10efe3f9f97939e3cb05edaf04250456702

Call

kupo-2.7.1 \
  --node-socket $CARDANO_NODE_SOCKET_PATH \
  --node-config $CARDANO_NODE_CONFIG_PATH \
  --since origin \
  --match \* \
  --workdir ./kupo_db \
  --prune-utxo \
  --port 6667 \
  --log-level Debug \
  $@

Hardware specs

8 Core, Intel x86 64bits, 32GB RAM, Ubuntu 22 LTS

Indexes

$ sqlite3 kupo_db/kupo.sqlite3 ".indexes"
inputsByAddress                 policiesByPolicyId            
inputsByCreatedAt               sqlite_autoindex_binary_data_1
inputsByDatumHash               sqlite_autoindex_inputs_1     
inputsByOutputReference         sqlite_autoindex_patterns_1   
inputsByPaymentCredential       sqlite_autoindex_policies_1   
inputsBySpentAt                 sqlite_autoindex_scripts_1

Kupo details

$ kupo-2.7.1 +RTS --info
 [("GHC RTS", "YES")
 ,("GHC version", "8.10.7")
 ,("RTS way", "rts_thr")
 ,("Build platform", "x86_64-unknown-linux")
 ,("Build architecture", "x86_64")
 ,("Build OS", "linux")
 ,("Build vendor", "unknown")
 ,("Host platform", "x86_64-unknown-linux")
 ,("Host architecture", "x86_64")
 ,("Host OS", "linux")
 ,("Host vendor", "unknown")
 ,("Target platform", "x86_64-unknown-linux")
 ,("Target architecture", "x86_64")
 ,("Target OS", "linux")
 ,("Target vendor", "unknown")
 ,("Word size", "64")
 ,("Compiler unregisterised", "NO")
 ,("Tables next to code", "YES")
 ,("Flag -with-rtsopts", "")
 ]

More logs

A bit more logs (in debug) from kupo start until kupo got stuck, including a followup restart after which kupo quickly catches up again

Logs

``` <<<<<< system startup>>>>>>> Dec 05 10:59:39 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T10:59:39.087072113Z","thread":"4","message":{"Configuration":{"tag":"ConfigurationMaxConcurrency","maxConcurrentReaders":4,"maxConcurrentWriters":1}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:39 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T10:59:39.088036226Z","thread":"4","message":{"Database":{"tag":"DatabaseCurrentVersion","currentVersion":9}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:39 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T10:59:39.088075511Z","thread":"4","message":{"Database":{"tag":"DatabaseNoMigrationNeeded"}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:39 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T10:59:39.088173556Z","thread":"4","message":{"Database":{"tag":"DatabaseIndexAlreadyExists","index":"inputsByAddress"}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:39 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T10:59:39.088220675Z","thread":"4","message":{"Database":{"tag":"DatabaseIndexAlreadyExists","index":"inputsByPaymentCredential"}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:39 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T10:59:39.088257791Z","thread":"4","message":{"Database":{"tag":"DatabaseIndexAlreadyExists","index":"inputsByCreatedAt"}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:39 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T10:59:39.088295545Z","thread":"4","message":{"Database":{"tag":"DatabaseIndexAlreadyExists","index":"inputsBySpentAt"}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:39 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T10:59:39.088330918Z","thread":"4","message":{"Database":{"tag":"DatabaseIndexAlreadyExists","index":"policiesByPolicyId"}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:39 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T10:59:39.088421539Z","thread":"4","message":{"Configuration":{"tag":"ConfigurationPatterns","patterns":["*"]}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:39 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T10:59:39.088460418Z","thread":"4","message":{"Configuration":{"tag":"ConfigurationCardanoNode","nodeSocket":"/home/cardano/cardano-node/db/socket","nodeConfig":"/home/cardano/cardano-node/configuration/cardano/config.json"}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:39 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T10:59:39.203561743Z","thread":"4","message":{"Configuration":{"tag":"ConfigurationNetwork","networkParameters":{"networkMagic":764824073,"slotsPerEpoch":21600,"systemStart":"2017-09-23T21:44:51Z"}}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:39 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T10:59:39.292462753Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:39 ns366159 bash[3092625]: {"severity":"Notice","timestamp":"2023-12-05T10:59:39.292596409Z","thread":"9","message":{"Http":{"tag":"HttpServerListening","host":"127.0.0.1","port":6667}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:39 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T10:59:39.293359711Z","thread":"14","message":{"Configuration":{"tag":"ConfigurationCheckpointsForIntersection","slots":[110207612,110207597,110207557,110207506,110207387,110207118,110206607,110205587,110203572,110199572,110191422,110175287,110142815,110078056]}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:39 ns366159 bash[3092625]: {"severity":"Notice","timestamp":"2023-12-05T10:59:39.29402177Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollBackward","point":110207612}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:39 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T10:59:39.294145295Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:41 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T10:59:41.766357147Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110207657,"inputs":122,"binaryData":8,"scripts":4}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:41 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T10:59:41.766427973Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:42 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T10:59:42.566621888Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110207678,"inputs":15,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 10:59:42 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T10:59:42.566681398Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:00:52 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:00:52.777992999Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110207757,"inputs":90,"binaryData":15,"scripts":9}},"version":"v2.7.1+5c0c7a"} Dec 05 11:00:52 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:00:52.778085126Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:01:06 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:01:06.304676738Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110207774,"inputs":22,"binaryData":2,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:01:06 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:01:06.304751846Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:02:00 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:02:00.99475997Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110207826,"inputs":69,"binaryData":21,"scripts":13}},"version":"v2.7.1+5c0c7a"} Dec 05 11:02:00 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:02:00.994840536Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:02:01 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:02:01.084824246Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110207827,"inputs":0,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:02:01 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:02:01.084904288Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:02:03 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:02:03.453484395Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110207832,"inputs":6,"binaryData":0,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:02:03 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:02:03.453580155Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:02:05 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:02:05.214385949Z","thread":"28","message":{"Http":{"tag":"HttpRequest","path":["health"],"method":"GET"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:02:05 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:02:05.21459767Z","thread":"28","message":{"Http":{"tag":"HttpResponse","status":{"statusCode":200,"statusMessage":"OK"},"time":{"milliseconds":0}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:02:42 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:02:42.783862222Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110207869,"inputs":56,"binaryData":15,"scripts":7}},"version":"v2.7.1+5c0c7a"} Dec 05 11:02:42 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:02:42.783953185Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:02:49 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:02:49.165397039Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110207877,"inputs":18,"binaryData":5,"scripts":3}},"version":"v2.7.1+5c0c7a"} Dec 05 11:02:49 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:02:49.165484193Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:03:06 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:03:06.549466414Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110207894,"inputs":63,"binaryData":9,"scripts":4}},"version":"v2.7.1+5c0c7a"} Dec 05 11:03:06 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:03:06.549528063Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:03:06 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:03:06.83528032Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110207895,"inputs":0,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:03:06 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:03:06.835362285Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:03:35 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:03:35.192803757Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110207922,"inputs":92,"binaryData":10,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:03:35 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:03:35.1928754Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:03:55 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:03:55.222412376Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110207943,"inputs":13,"binaryData":1,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:03:55 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:03:55.222518873Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:04:11 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:04:11.708967116Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110207958,"inputs":61,"binaryData":13,"scripts":23}},"version":"v2.7.1+5c0c7a"} Dec 05 11:04:11 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:04:11.709029596Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:04:25 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:04:25.08838323Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110207973,"inputs":45,"binaryData":1,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:04:25 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:04:25.088454566Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:04:30 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:04:30.04778512Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110207978,"inputs":15,"binaryData":4,"scripts":3}},"version":"v2.7.1+5c0c7a"} Dec 05 11:04:30 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:04:30.047864904Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:04:36 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:04:36.824972084Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110207985,"inputs":76,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:04:36 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:04:36.825061592Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:04:49 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:04:49.940935995Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110207998,"inputs":44,"binaryData":6,"scripts":6}},"version":"v2.7.1+5c0c7a"} Dec 05 11:04:49 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:04:49.941022595Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:04:59 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:04:59.709431287Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208007,"inputs":24,"binaryData":3,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:04:59 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:04:59.709515176Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:05:03 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:05:03.516360876Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208012,"inputs":5,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:05:03 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:05:03.516421473Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:05:20 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:05:20.010779829Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208028,"inputs":12,"binaryData":1,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:05:20 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:05:20.01083469Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:05:22 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:05:22.572631098Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208031,"inputs":2,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:05:22 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:05:22.5727002Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:05:41 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:05:41.19912462Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208049,"inputs":24,"binaryData":3,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:05:41 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:05:41.199184501Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:05:46 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:05:46.760432265Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208055,"inputs":13,"binaryData":4,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:05:46 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:05:46.760495347Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:06:08 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:06:08.272053362Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208076,"inputs":29,"binaryData":10,"scripts":3}},"version":"v2.7.1+5c0c7a"} Dec 05 11:06:08 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:06:08.272169255Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:06:51 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:06:51.762755025Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208118,"inputs":47,"binaryData":10,"scripts":5}},"version":"v2.7.1+5c0c7a"} Dec 05 11:06:51 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:06:51.762809751Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:07:02 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:07:02.398770951Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208130,"inputs":17,"binaryData":4,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:07:02 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:07:02.398877086Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:07:30 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:07:30.92145217Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208158,"inputs":114,"binaryData":12,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:07:30 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:07:30.921533101Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:08:55 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:08:55.44710942Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208241,"inputs":116,"binaryData":15,"scripts":4}},"version":"v2.7.1+5c0c7a"} Dec 05 11:08:55 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:08:55.447198026Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:08:55 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:08:55.599865392Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208242,"inputs":2,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:08:55 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:08:55.599951659Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:09:27 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:09:27.179348567Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208274,"inputs":52,"binaryData":23,"scripts":11}},"version":"v2.7.1+5c0c7a"} Dec 05 11:09:27 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:09:27.17942678Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:09:40 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:09:40.959686957Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208289,"inputs":17,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:09:40 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:09:40.959744798Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:10:01 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:10:01.275556649Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208309,"inputs":21,"binaryData":7,"scripts":4}},"version":"v2.7.1+5c0c7a"} Dec 05 11:10:01 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:10:01.275623233Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:10:21 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:10:21.529062607Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208329,"inputs":18,"binaryData":6,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:10:21 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:10:21.529114414Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:11:05 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:11:05.277385341Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208372,"inputs":82,"binaryData":10,"scripts":4}},"version":"v2.7.1+5c0c7a"} Dec 05 11:11:05 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:11:05.277489884Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:11:11 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:11:11.15613804Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208379,"inputs":6,"binaryData":3,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:11:11 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:11:11.156193708Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:11:12 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:11:12.271585021Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208381,"inputs":2,"binaryData":1,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:11:12 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:11:12.271636585Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:11:42 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:11:42.894825048Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208410,"inputs":43,"binaryData":5,"scripts":13}},"version":"v2.7.1+5c0c7a"} Dec 05 11:11:42 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:11:42.894885306Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:13:27 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:13:27.353188002Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208512,"inputs":98,"binaryData":19,"scripts":15}},"version":"v2.7.1+5c0c7a"} Dec 05 11:13:27 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:13:27.353261021Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:13:37 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:13:37.000077218Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208524,"inputs":49,"binaryData":12,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:13:37 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:13:37.000147765Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:14:13 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:14:13.598734936Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208560,"inputs":116,"binaryData":16,"scripts":5}},"version":"v2.7.1+5c0c7a"} Dec 05 11:14:13 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:14:13.598816081Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:14:22 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:14:22.891881264Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208571,"inputs":4,"binaryData":2,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:14:22 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:14:22.891940997Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:15:06 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:15:06.446758202Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208612,"inputs":80,"binaryData":21,"scripts":9}},"version":"v2.7.1+5c0c7a"} Dec 05 11:15:06 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:15:06.446856533Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:15:09 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:15:09.896334775Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208618,"inputs":4,"binaryData":2,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:15:09 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:15:09.896415525Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:15:12 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:15:12.497588019Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208621,"inputs":3,"binaryData":2,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:15:12 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:15:12.49765134Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:15:13 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:15:13.845743767Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208622,"inputs":7,"binaryData":3,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:15:13 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:15:13.84582473Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:15:50 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:15:50.697628092Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208657,"inputs":48,"binaryData":14,"scripts":11}},"version":"v2.7.1+5c0c7a"} Dec 05 11:15:50 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:15:50.697697825Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:16:09 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:16:09.330438817Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208677,"inputs":16,"binaryData":3,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:16:09 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:16:09.330485189Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:16:09 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:16:09.68981138Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208678,"inputs":3,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:16:09 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:16:09.689875621Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:16:29 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:16:29.873728316Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208698,"inputs":16,"binaryData":4,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:16:29 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:16:29.873827163Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:17:35 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:17:35.107997381Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208760,"inputs":108,"binaryData":10,"scripts":11}},"version":"v2.7.1+5c0c7a"} Dec 05 11:17:35 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:17:35.108098195Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:17:39 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:17:39.696749132Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208768,"inputs":2,"binaryData":1,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:17:39 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:17:39.696823771Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:17:57 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:17:57.211812174Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208783,"inputs":69,"binaryData":15,"scripts":10}},"version":"v2.7.1+5c0c7a"} Dec 05 11:17:57 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:17:57.211909479Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:18:39 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:18:39.954396686Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208825,"inputs":145,"binaryData":14,"scripts":7}},"version":"v2.7.1+5c0c7a"} Dec 05 11:18:39 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:18:39.954526282Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:18:39 ns366159 bash[3092625]: {"severity":"Notice","timestamp":"2023-12-05T11:18:39.954585763Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollBackward","point":110208783}},"version":"v2.7.1+5c0c7a"} Dec 05 11:18:39 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:18:39.954943132Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":"DELETE FROM inputs WHERE rowid IN (SELECT rowid FROM inputs WHERE created_at > ? LIMIT 50000)"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:18:40 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:18:40.297223838Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":"DELETE FROM inputs WHERE rowid IN (SELECT rowid FROM inputs WHERE created_at > ? LIMIT 50000)"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:18:40 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:18:40.297286593Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":"UPDATE inputs SET spent_at = NULL WHERE spent_at > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:18:40 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:18:40.302745803Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":"UPDATE inputs SET spent_at = NULL WHERE spent_at > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:18:40 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:18:40.302820064Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":"DELETE FROM checkpoints WHERE slot_no > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:18:40 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:18:40.302939273Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":"DELETE FROM checkpoints WHERE slot_no > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:18:40 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:18:40.955504285Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:18:41 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:18:41.8236123Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208827,"inputs":146,"binaryData":14,"scripts":7}},"version":"v2.7.1+5c0c7a"} Dec 05 11:18:41 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:18:41.823682257Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:19:21 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:19:21.824827398Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208869,"inputs":73,"binaryData":13,"scripts":8}},"version":"v2.7.1+5c0c7a"} Dec 05 11:19:21 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:19:21.824899971Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:19:38 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:19:38.972930072Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208887,"inputs":13,"binaryData":4,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:19:38 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:19:38.972999472Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:20:26 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:20:26.311394765Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208932,"inputs":136,"binaryData":16,"scripts":10}},"version":"v2.7.1+5c0c7a"} Dec 05 11:20:26 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:20:26.311468897Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:20:28 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:20:28.349165404Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208937,"inputs":5,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:20:28 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:20:28.349244866Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:20:42 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:20:42.31193971Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208950,"inputs":39,"binaryData":3,"scripts":12}},"version":"v2.7.1+5c0c7a"} Dec 05 11:20:42 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:20:42.311996616Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:20:42 ns366159 bash[3092625]: {"severity":"Notice","timestamp":"2023-12-05T11:20:42.31203022Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollBackward","point":110208937}},"version":"v2.7.1+5c0c7a"} Dec 05 11:20:42 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:20:42.312330946Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":"DELETE FROM inputs WHERE rowid IN (SELECT rowid FROM inputs WHERE created_at > ? LIMIT 50000)"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:20:42 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:20:42.596516199Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":"DELETE FROM inputs WHERE rowid IN (SELECT rowid FROM inputs WHERE created_at > ? LIMIT 50000)"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:20:42 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:20:42.596564505Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":"UPDATE inputs SET spent_at = NULL WHERE spent_at > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:20:42 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:20:42.599165574Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":"UPDATE inputs SET spent_at = NULL WHERE spent_at > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:20:42 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:20:42.599200151Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":"DELETE FROM checkpoints WHERE slot_no > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:20:42 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:20:42.599336544Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":"DELETE FROM checkpoints WHERE slot_no > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:20:43 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:20:43.012538015Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:20:43 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:20:43.388187092Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208950,"inputs":39,"binaryData":3,"scripts":12}},"version":"v2.7.1+5c0c7a"} Dec 05 11:20:43 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:20:43.388269433Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:20:43 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:20:43.488664326Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208952,"inputs":0,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:20:43 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:20:43.488746299Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:21:08 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:21:08.426805245Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208976,"inputs":40,"binaryData":4,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:21:08 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:21:08.426873901Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:21:27 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:21:27.760248132Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208994,"inputs":36,"binaryData":10,"scripts":3}},"version":"v2.7.1+5c0c7a"} Dec 05 11:21:27 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:21:27.760343973Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:21:32 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:21:32.273657833Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110208999,"inputs":94,"binaryData":4,"scripts":50}},"version":"v2.7.1+5c0c7a"} Dec 05 11:21:32 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:21:32.273748294Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:21:49 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:21:49.649323596Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209017,"inputs":69,"binaryData":5,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:21:49 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:21:49.649386858Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:22:10 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:22:10.845424235Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209038,"inputs":24,"binaryData":7,"scripts":4}},"version":"v2.7.1+5c0c7a"} Dec 05 11:22:10 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:22:10.845520166Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:22:13 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:22:13.044385692Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209041,"inputs":9,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:22:13 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:22:13.044446912Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:22:20 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:22:20.442466497Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209048,"inputs":4,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:22:20 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:22:20.442523599Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:00 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:23:00.946345015Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209088,"inputs":52,"binaryData":15,"scripts":9}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:00 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:23:00.946406851Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:02 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:23:02.241191419Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209090,"inputs":53,"binaryData":0,"scripts":35}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:02 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:23:02.241283916Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:02 ns366159 bash[3092625]: {"severity":"Notice","timestamp":"2023-12-05T11:23:02.241314745Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollBackward","point":110209088}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:02 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:23:02.241542709Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":"DELETE FROM inputs WHERE rowid IN (SELECT rowid FROM inputs WHERE created_at > ? LIMIT 50000)"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:02 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:23:02.246454714Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":"DELETE FROM inputs WHERE rowid IN (SELECT rowid FROM inputs WHERE created_at > ? LIMIT 50000)"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:02 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:23:02.246532264Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":"UPDATE inputs SET spent_at = NULL WHERE spent_at > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:02 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:23:02.248314523Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":"UPDATE inputs SET spent_at = NULL WHERE spent_at > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:02 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:23:02.248377053Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":"DELETE FROM checkpoints WHERE slot_no > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:02 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:23:02.248459935Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":"DELETE FROM checkpoints WHERE slot_no > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:02 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:23:02.558908469Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:02 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:23:02.858706874Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209090,"inputs":37,"binaryData":0,"scripts":25}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:02 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:23:02.858761758Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:04 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:23:04.405484319Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209092,"inputs":50,"binaryData":0,"scripts":30}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:04 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:23:04.405550089Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:39 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:23:39.498818122Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209127,"inputs":30,"binaryData":8,"scripts":4}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:39 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:23:39.498879466Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:44 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:23:44.731709913Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209133,"inputs":8,"binaryData":3,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:23:44 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:23:44.731773483Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:24:16 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:24:16.342868321Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209162,"inputs":47,"binaryData":11,"scripts":5}},"version":"v2.7.1+5c0c7a"} Dec 05 11:24:16 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:24:16.342924122Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:24:58 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:24:58.475569513Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209204,"inputs":82,"binaryData":15,"scripts":7}},"version":"v2.7.1+5c0c7a"} Dec 05 11:24:58 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:24:58.475650118Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:25:03 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:25:03.142247313Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209211,"inputs":8,"binaryData":7,"scripts":3}},"version":"v2.7.1+5c0c7a"} Dec 05 11:25:03 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:25:03.142326993Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:25:09 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:25:09.187387352Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209216,"inputs":36,"binaryData":1,"scripts":17}},"version":"v2.7.1+5c0c7a"} Dec 05 11:25:09 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:25:09.187483381Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:26:25 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:26:25.066236134Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209290,"inputs":78,"binaryData":18,"scripts":8}},"version":"v2.7.1+5c0c7a"} Dec 05 11:26:25 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:26:25.066321044Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:26:26 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:26:26.634535411Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209295,"inputs":7,"binaryData":4,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:26:26 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:26:26.634613731Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:26:28 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:26:28.686524848Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209297,"inputs":4,"binaryData":3,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:26:28 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:26:28.68659723Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:27:26 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:27:26.156517371Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209353,"inputs":56,"binaryData":20,"scripts":16}},"version":"v2.7.1+5c0c7a"} Dec 05 11:27:26 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:27:26.156586469Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:27:32 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:27:32.566154239Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209361,"inputs":7,"binaryData":1,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:27:32 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:27:32.566240005Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:28:03 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:28:03.33923053Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209390,"inputs":48,"binaryData":8,"scripts":7}},"version":"v2.7.1+5c0c7a"} Dec 05 11:28:03 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:28:03.339322577Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:28:50 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:28:50.047188667Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209437,"inputs":72,"binaryData":8,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:28:50 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:28:50.047251936Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:29:01 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:29:01.791635888Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209450,"inputs":10,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:29:01 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:29:01.791707849Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:29:18 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:29:18.082801285Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209466,"inputs":16,"binaryData":2,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:29:18 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:29:18.082868808Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:29:41 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:29:41.389492037Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209486,"inputs":26,"binaryData":14,"scripts":6}},"version":"v2.7.1+5c0c7a"} Dec 05 11:29:41 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:29:41.389599258Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:30:05 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:30:05.946453552Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209512,"inputs":91,"binaryData":17,"scripts":7}},"version":"v2.7.1+5c0c7a"} Dec 05 11:30:05 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:30:05.946514326Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:30:34 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:30:34.487502848Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209541,"inputs":50,"binaryData":18,"scripts":13}},"version":"v2.7.1+5c0c7a"} Dec 05 11:30:34 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:30:34.48757378Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:30:52 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:30:52.331300027Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209560,"inputs":26,"binaryData":1,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:30:52 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:30:52.331371534Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:31:24 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:31:24.344854807Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209592,"inputs":23,"binaryData":4,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:31:24 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:31:24.344921217Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:32:48 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:32:48.07934183Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209672,"inputs":145,"binaryData":30,"scripts":11}},"version":"v2.7.1+5c0c7a"} Dec 05 11:32:48 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:32:48.079415012Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:32:53 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:32:53.06629811Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209681,"inputs":19,"binaryData":4,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:32:53 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:32:53.066424439Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:32:54 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:32:54.628176773Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209683,"inputs":39,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:32:54 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:32:54.628256124Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:33:14 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:33:14.249232761Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209701,"inputs":51,"binaryData":17,"scripts":15}},"version":"v2.7.1+5c0c7a"} Dec 05 11:33:14 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:33:14.249294598Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:33:22 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:33:22.266376426Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209710,"inputs":17,"binaryData":8,"scripts":6}},"version":"v2.7.1+5c0c7a"} Dec 05 11:33:22 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:33:22.266438884Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:34:01 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:34:01.306215617Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209747,"inputs":156,"binaryData":14,"scripts":7}},"version":"v2.7.1+5c0c7a"} Dec 05 11:34:01 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:34:01.306275291Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:34:31 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:34:31.236692637Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209777,"inputs":122,"binaryData":8,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:34:31 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:34:31.236755502Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:35:45 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:35:45.245049364Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209851,"inputs":68,"binaryData":17,"scripts":10}},"version":"v2.7.1+5c0c7a"} Dec 05 11:35:45 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:35:45.24514128Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:35:45 ns366159 bash[3092625]: {"severity":"Notice","timestamp":"2023-12-05T11:35:45.245172975Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollBackward","point":110209777}},"version":"v2.7.1+5c0c7a"} Dec 05 11:35:45 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:35:45.24555274Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":"DELETE FROM inputs WHERE rowid IN (SELECT rowid FROM inputs WHERE created_at > ? LIMIT 50000)"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:35:45 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:35:45.840068113Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":"DELETE FROM inputs WHERE rowid IN (SELECT rowid FROM inputs WHERE created_at > ? LIMIT 50000)"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:35:45 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:35:45.84017723Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":"UPDATE inputs SET spent_at = NULL WHERE spent_at > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:35:45 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:35:45.847308735Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":"UPDATE inputs SET spent_at = NULL WHERE spent_at > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:35:45 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:35:45.847364769Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":"DELETE FROM checkpoints WHERE slot_no > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:35:45 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:35:45.847499544Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":"DELETE FROM checkpoints WHERE slot_no > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:35:46 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:35:46.691976313Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:35:49 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:35:49.024744821Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209851,"inputs":102,"binaryData":25,"scripts":12}},"version":"v2.7.1+5c0c7a"} Dec 05 11:35:49 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:35:49.024843613Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:35:49 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:35:49.476505204Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209856,"inputs":10,"binaryData":1,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:35:49 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:35:49.47656034Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:36:15 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:36:15.218960291Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209881,"inputs":90,"binaryData":10,"scripts":15}},"version":"v2.7.1+5c0c7a"} Dec 05 11:36:15 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:36:15.219052746Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:36:37 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:36:37.104571604Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209903,"inputs":78,"binaryData":10,"scripts":8}},"version":"v2.7.1+5c0c7a"} Dec 05 11:36:37 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:36:37.104655595Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:37:03 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:37:03.988140543Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209931,"inputs":44,"binaryData":17,"scripts":10}},"version":"v2.7.1+5c0c7a"} Dec 05 11:37:03 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:37:03.988227653Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:37:20 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:37:20.572501711Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209948,"inputs":23,"binaryData":4,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:37:20 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:37:20.572558635Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:37:58 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:37:58.324575668Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209985,"inputs":66,"binaryData":20,"scripts":17}},"version":"v2.7.1+5c0c7a"} Dec 05 11:37:58 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:37:58.324649576Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:38:00 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:38:00.551550661Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209989,"inputs":5,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:38:00 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:38:00.551618787Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:38:09 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:38:09.244971453Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110209997,"inputs":22,"binaryData":3,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:38:09 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:38:09.245046581Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:38:39 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:38:39.535130614Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210026,"inputs":89,"binaryData":12,"scripts":19}},"version":"v2.7.1+5c0c7a"} Dec 05 11:38:39 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:38:39.535211392Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:38:39 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:38:39.851173444Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210027,"inputs":3,"binaryData":2,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:38:39 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:38:39.851250531Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:38:42 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:38:42.467466854Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210031,"inputs":1,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:38:42 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:38:42.467527179Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:38:48 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:38:48.871683189Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210037,"inputs":9,"binaryData":5,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:38:48 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:38:48.871737718Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:39:13 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:39:13.402428481Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210061,"inputs":29,"binaryData":8,"scripts":5}},"version":"v2.7.1+5c0c7a"} Dec 05 11:39:13 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:39:13.402539856Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:39:23 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:39:23.021165762Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210071,"inputs":41,"binaryData":4,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:39:23 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:39:23.021269874Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:39:32 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:39:32.847310634Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210081,"inputs":16,"binaryData":4,"scripts":3}},"version":"v2.7.1+5c0c7a"} Dec 05 11:39:32 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:39:32.847381715Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:39:36 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:39:36.772910574Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210085,"inputs":7,"binaryData":4,"scripts":4}},"version":"v2.7.1+5c0c7a"} Dec 05 11:39:36 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:39:36.77297523Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:39:45 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:39:45.591550143Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210094,"inputs":3,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:39:45 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:39:45.591613952Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:40:16 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:40:16.556768465Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210123,"inputs":32,"binaryData":1,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:40:16 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:40:16.556818574Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:40:22 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:40:22.432917179Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210131,"inputs":5,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:40:22 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:40:22.43300311Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:40:41 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:40:41.179779142Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210149,"inputs":13,"binaryData":6,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:40:41 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:40:41.179844987Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:41:06 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:41:06.267522965Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210174,"inputs":44,"binaryData":6,"scripts":4}},"version":"v2.7.1+5c0c7a"} Dec 05 11:41:06 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:41:06.267587021Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:42:31 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:42:31.843294155Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210256,"inputs":113,"binaryData":21,"scripts":11}},"version":"v2.7.1+5c0c7a"} Dec 05 11:42:31 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:42:31.843393623Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:42:31 ns366159 bash[3092625]: {"severity":"Notice","timestamp":"2023-12-05T11:42:31.843413396Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollBackward","point":110210174}},"version":"v2.7.1+5c0c7a"} Dec 05 11:42:31 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:42:31.843781024Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":"DELETE FROM inputs WHERE rowid IN (SELECT rowid FROM inputs WHERE created_at > ? LIMIT 50000)"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:42:32 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:42:32.238035945Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":"DELETE FROM inputs WHERE rowid IN (SELECT rowid FROM inputs WHERE created_at > ? LIMIT 50000)"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:42:32 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:42:32.238091518Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":"UPDATE inputs SET spent_at = NULL WHERE spent_at > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:42:32 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:42:32.244066865Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":"UPDATE inputs SET spent_at = NULL WHERE spent_at > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:42:32 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:42:32.244129133Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":"DELETE FROM checkpoints WHERE slot_no > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:42:32 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:42:32.244268915Z","thread":"11","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":"DELETE FROM checkpoints WHERE slot_no > ?"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:42:33 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:42:33.195236223Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:42:34 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:42:34.017198022Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210256,"inputs":113,"binaryData":21,"scripts":11}},"version":"v2.7.1+5c0c7a"} Dec 05 11:42:34 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:42:34.017265865Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:43:25 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:43:25.453551566Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210312,"inputs":66,"binaryData":23,"scripts":14}},"version":"v2.7.1+5c0c7a"} Dec 05 11:43:25 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:43:25.453622875Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:43:51 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:43:51.136865695Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210337,"inputs":98,"binaryData":20,"scripts":12}},"version":"v2.7.1+5c0c7a"} Dec 05 11:43:51 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:43:51.136928555Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:43:52 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:43:52.35218781Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210341,"inputs":0,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:43:52 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:43:52.35224546Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:43:57 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:43:57.284753031Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210346,"inputs":0,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:43:57 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:43:57.284816274Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:44:22 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:44:22.278154975Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210370,"inputs":26,"binaryData":11,"scripts":5}},"version":"v2.7.1+5c0c7a"} Dec 05 11:44:22 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:44:22.278214204Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:44:30 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:44:30.952705034Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210379,"inputs":9,"binaryData":1,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:44:30 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:44:30.952776761Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:46:01 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:46:01.694498167Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210467,"inputs":76,"binaryData":17,"scripts":10}},"version":"v2.7.1+5c0c7a"} Dec 05 11:46:01 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:46:01.694561456Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:46:22 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:46:22.582961327Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210489,"inputs":43,"binaryData":12,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:46:22 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:46:22.583041164Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:46:22 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:46:22.924736595Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210490,"inputs":4,"binaryData":2,"scripts":3}},"version":"v2.7.1+5c0c7a"} Dec 05 11:46:22 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:46:22.924806623Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:46:39 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:46:39.964792762Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210508,"inputs":13,"binaryData":1,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:46:39 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:46:39.964864561Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:46:46 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:46:46.954241863Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210515,"inputs":16,"binaryData":7,"scripts":4}},"version":"v2.7.1+5c0c7a"} Dec 05 11:46:46 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:46:46.954308073Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:46:48 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:46:48.880591733Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210517,"inputs":0,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:46:48 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:46:48.880659297Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:47:47 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:47:47.690947403Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210574,"inputs":94,"binaryData":15,"scripts":5}},"version":"v2.7.1+5c0c7a"} Dec 05 11:47:47 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:47:47.691016793Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:47:57 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:47:57.101385474Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210585,"inputs":11,"binaryData":3,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:47:57 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:47:57.101464078Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:48:13 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:48:13.021672975Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210600,"inputs":28,"binaryData":5,"scripts":5}},"version":"v2.7.1+5c0c7a"} Dec 05 11:48:13 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:48:13.021730674Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:48:22 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:48:22.385419686Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210610,"inputs":14,"binaryData":2,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:48:22 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:48:22.385500211Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:48:53 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:48:53.471738966Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210640,"inputs":213,"binaryData":5,"scripts":4}},"version":"v2.7.1+5c0c7a"} Dec 05 11:48:53 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:48:53.471841435Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:48:54 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:48:54.418617282Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210643,"inputs":2,"binaryData":0,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:48:54 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:48:54.418682986Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:49:00 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:49:00.695201732Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210649,"inputs":3,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:49:00 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:49:00.695260272Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:49:01 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:49:01.513239964Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210650,"inputs":1,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:49:01 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:49:01.513325028Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:49:02 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:49:02.660890323Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210651,"inputs":30,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:49:02 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:49:02.66097363Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:49:17 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:49:17.752183709Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210665,"inputs":27,"binaryData":7,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:49:17 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:49:17.752246729Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:49:37 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:49:37.484213648Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210685,"inputs":42,"binaryData":6,"scripts":4}},"version":"v2.7.1+5c0c7a"} Dec 05 11:49:37 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:49:37.48428036Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:49:45 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:49:45.148840866Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210693,"inputs":19,"binaryData":11,"scripts":9}},"version":"v2.7.1+5c0c7a"} Dec 05 11:49:45 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:49:45.148904115Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:49:45 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:49:45.684728616Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210694,"inputs":3,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:49:45 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:49:45.684791465Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:50:01 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:50:01.947945374Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210710,"inputs":23,"binaryData":4,"scripts":10}},"version":"v2.7.1+5c0c7a"} Dec 05 11:50:01 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:50:01.948012566Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:50:16 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:50:16.075140735Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210723,"inputs":49,"binaryData":7,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:50:16 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:50:16.075220567Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:50:19 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:50:19.582642049Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210728,"inputs":6,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:50:19 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:50:19.582706366Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:50:31 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:50:31.196865515Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210739,"inputs":3,"binaryData":1,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:50:31 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:50:31.196955332Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:50:41 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:50:41.419296329Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210749,"inputs":14,"binaryData":4,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:50:41 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:50:41.41936124Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:50:45 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:50:45.620328046Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210754,"inputs":8,"binaryData":6,"scripts":4}},"version":"v2.7.1+5c0c7a"} Dec 05 11:50:45 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:50:45.620413076Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:50:53 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:50:53.690445214Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210762,"inputs":23,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:50:53 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:50:53.690501818Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:51:21 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:51:21.329671852Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210788,"inputs":43,"binaryData":5,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:51:21 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:51:21.329744455Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:51:33 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:51:33.224045843Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210801,"inputs":21,"binaryData":2,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:51:33 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:51:33.224104985Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:51:37 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:51:37.141506333Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210805,"inputs":14,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:51:37 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:51:37.141572679Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:52:34 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:52:34.49891432Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210861,"inputs":56,"binaryData":12,"scripts":10}},"version":"v2.7.1+5c0c7a"} Dec 05 11:52:34 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:52:34.498974478Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:52:42 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:52:42.850045282Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210871,"inputs":26,"binaryData":2,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:52:42 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:52:42.850114882Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:52:56 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:52:56.845440048Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210885,"inputs":7,"binaryData":2,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:52:56 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:52:56.845504856Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:53:01 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:53:01.384339194Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210890,"inputs":4,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:53:01 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:53:01.384395604Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:53:19 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:53:19.807868375Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210908,"inputs":8,"binaryData":1,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:53:19 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:53:19.807931795Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:54:01 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:54:01.138174058Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210948,"inputs":32,"binaryData":5,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:54:01 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:54:01.138257363Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:54:40 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:54:40.729703452Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210987,"inputs":45,"binaryData":15,"scripts":6}},"version":"v2.7.1+5c0c7a"} Dec 05 11:54:40 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:54:40.72978309Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:54:49 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:54:49.13681886Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110210997,"inputs":16,"binaryData":6,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:54:49 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:54:49.136902135Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:55:09 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:55:09.526294715Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211017,"inputs":33,"binaryData":7,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:55:09 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:55:09.52635124Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:56:48 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:56:48.395581665Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211114,"inputs":74,"binaryData":25,"scripts":15}},"version":"v2.7.1+5c0c7a"} Dec 05 11:56:48 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:56:48.395653272Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:56:54 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:56:54.169900826Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211121,"inputs":62,"binaryData":14,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:56:54 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:56:54.169993344Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:57:17 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:57:17.562119142Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211145,"inputs":35,"binaryData":11,"scripts":9}},"version":"v2.7.1+5c0c7a"} Dec 05 11:57:17 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:57:17.562199161Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:57:34 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:57:34.95109809Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211162,"inputs":65,"binaryData":13,"scripts":8}},"version":"v2.7.1+5c0c7a"} Dec 05 11:57:34 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:57:34.95115942Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:57:51 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:57:51.976475238Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211180,"inputs":17,"binaryData":5,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:57:51 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:57:51.976559131Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:57:52 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:57:52.542268324Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211181,"inputs":4,"binaryData":2,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 11:57:52 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:57:52.542326141Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:57:58 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:57:58.353856907Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211187,"inputs":0,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:57:58 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:57:58.353927961Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:58:17 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:58:17.931804159Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211205,"inputs":34,"binaryData":13,"scripts":9}},"version":"v2.7.1+5c0c7a"} Dec 05 11:58:17 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:58:17.931893156Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:58:31 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:58:31.194062427Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211219,"inputs":15,"binaryData":5,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:58:31 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:58:31.194140725Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:58:33 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:58:33.768528867Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211222,"inputs":5,"binaryData":0,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:58:33 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:58:33.768593892Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:58:39 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:58:39.513628862Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211228,"inputs":7,"binaryData":1,"scripts":0}},"version":"v2.7.1+5c0c7a"} Dec 05 11:58:39 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:58:39.513703778Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:58:59 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T11:58:59.143149257Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211247,"inputs":45,"binaryData":2,"scripts":1}},"version":"v2.7.1+5c0c7a"} Dec 05 11:58:59 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:58:59.143233162Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:59:39 ns366159 bash[3092625]: {"severity":"Notice","timestamp":"2023-12-05T11:59:39.293328362Z","thread":"13","message":{"Gardener":{"tag":"GardenerBeginGarbageCollection","pruning":"inputs"}},"version":"v2.7.1+5c0c7a"} Dec 05 11:59:39 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:59:39.293426126Z","thread":"13","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionCreateShortLived","mode":"ReadWrite"}}},"version":"v2.7.1+5c0c7a"} Dec 05 11:59:39 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T11:59:39.294037392Z","thread":"13","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":"DELETE FROM inputs WHERE ext_output_reference IN ( SELECT ext_output_reference FROM inputs WHERE spent_at < ((SELECT MAX(slot_no) FROM checkpoints) - ?) LIMIT 50000)"}}},"version":"v2.7.1+5c0c7a"} Dec 05 12:02:27 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T12:02:27.927735103Z","thread":"31","message":{"Http":{"tag":"HttpRequest","path":["health"],"method":"GET"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:02:27 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T12:02:27.927897946Z","thread":"31","message":{"Http":{"tag":"HttpResponse","status":{"statusCode":200,"statusMessage":"OK"},"time":{"milliseconds":0}}},"version":"v2.7.1+5c0c7a"} Dec 05 12:02:31 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T12:02:31.260618024Z","thread":"13","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":"DELETE FROM inputs WHERE ext_output_reference IN ( SELECT ext_output_reference FROM inputs WHERE spent_at < ((SELECT MAX(slot_no) FROM checkpoints) - ?) LIMIT 50000)"}}},"version":"v2.7.1+5c0c7a"} Dec 05 12:02:32 ns366159 bash[3092625]: {"severity":"Notice","timestamp":"2023-12-05T12:02:32.843207389Z","thread":"13","message":{"Gardener":{"tag":"GardenerExitGarbageCollection","totalPrunedRows":12262}},"version":"v2.7.1+5c0c7a"} Dec 05 12:02:32 ns366159 bash[3092625]: {"severity":"Notice","timestamp":"2023-12-05T12:02:32.843296572Z","thread":"13","message":{"Gardener":{"tag":"GardenerBeginGarbageCollection","pruning":"binary_data"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:02:35 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T12:02:35.221088943Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211311,"inputs":96,"binaryData":17,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 12:02:35 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T12:02:35.22164587Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:02:35 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T12:02:35.222690915Z","thread":"13","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":" DELETE FROM binary_data WHERE binary_data_hash IN ( SELECT binary_data_hash FROM binary_data LEFT JOIN inputs ON binary_data_hash = inputs.datum_hash WHERE inputs.ext_output_reference IS NULL ORDER BY inputs.datum_hash LIMIT 50000 )"}}},"version":"v2.7.1+5c0c7a"} Dec 05 12:02:49 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T12:02:49.345434237Z","thread":"13","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":" DELETE FROM binary_data WHERE binary_data_hash IN ( SELECT binary_data_hash FROM binary_data LEFT JOIN inputs ON binary_data_hash = inputs.datum_hash WHERE inputs.ext_output_reference IS NULL ORDER BY inputs.datum_hash LIMIT 50000 )"}}},"version":"v2.7.1+5c0c7a"} Dec 05 12:02:51 ns366159 bash[3092625]: {"severity":"Notice","timestamp":"2023-12-05T12:02:51.074680071Z","thread":"13","message":{"Gardener":{"tag":"GardenerExitGarbageCollection","totalPrunedRows":1509}},"version":"v2.7.1+5c0c7a"} Dec 05 12:03:00 ns366159 bash[3092625]: {"severity":"Info","timestamp":"2023-12-05T12:03:00.59424087Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211404,"inputs":220,"binaryData":26,"scripts":20}},"version":"v2.7.1+5c0c7a"} Dec 05 12:03:00 ns366159 bash[3092625]: {"severity":"Debug","timestamp":"2023-12-05T12:03:00.594341772Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:03:00 ns366159 bash[3092625]: {"severity":"Notice","timestamp":"2023-12-05T12:03:00.595339155Z","thread":"13","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":"PRAGMA optimize"}}},"version":"v2.7.1+5c0c7a"} <<<< got stuck here, restart follows>>>>> Dec 05 12:08:42 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T12:08:42.883307474Z","thread":"4","message":{"Configuration":{"tag":"ConfigurationMaxConcurrency","maxConcurrentReaders":4,"maxConcurrentWriters":1}},"version":"v2.7.1+5c0c7a"} Dec 05 12:08:42 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T12:08:42.884395003Z","thread":"4","message":{"Database":{"tag":"DatabaseCurrentVersion","currentVersion":9}},"version":"v2.7.1+5c0c7a"} Dec 05 12:08:42 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T12:08:42.884443555Z","thread":"4","message":{"Database":{"tag":"DatabaseNoMigrationNeeded"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:08:42 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T12:08:42.884535143Z","thread":"4","message":{"Database":{"tag":"DatabaseIndexAlreadyExists","index":"inputsByAddress"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:08:42 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T12:08:42.884609424Z","thread":"4","message":{"Database":{"tag":"DatabaseIndexAlreadyExists","index":"inputsByPaymentCredential"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:08:42 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T12:08:42.884671581Z","thread":"4","message":{"Database":{"tag":"DatabaseIndexAlreadyExists","index":"inputsByCreatedAt"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:08:42 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T12:08:42.884734409Z","thread":"4","message":{"Database":{"tag":"DatabaseIndexAlreadyExists","index":"inputsBySpentAt"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:08:42 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T12:08:42.884793043Z","thread":"4","message":{"Database":{"tag":"DatabaseIndexAlreadyExists","index":"policiesByPolicyId"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:08:42 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T12:08:42.895184773Z","thread":"4","message":{"Configuration":{"tag":"ConfigurationPatterns","patterns":["*"]}},"version":"v2.7.1+5c0c7a"} Dec 05 12:08:42 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T12:08:42.89527552Z","thread":"4","message":{"Configuration":{"tag":"ConfigurationCardanoNode","nodeSocket":"/home/cardano/cardano-node/db/socket","nodeConfig":"/home/cardano/cardano-node/configuration/cardano/config.json"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:08:43 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T12:08:43.094362506Z","thread":"4","message":{"Configuration":{"tag":"ConfigurationNetwork","networkParameters":{"networkMagic":764824073,"slotsPerEpoch":21600,"systemStart":"2017-09-23T21:44:51Z"}}},"version":"v2.7.1+5c0c7a"} Dec 05 12:08:43 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T12:08:43.185231318Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:08:43 ns366159 bash[3119216]: {"severity":"Notice","timestamp":"2023-12-05T12:08:43.185349199Z","thread":"9","message":{"Http":{"tag":"HttpServerListening","host":"127.0.0.1","port":6667}},"version":"v2.7.1+5c0c7a"} Dec 05 12:08:43 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T12:08:43.185881079Z","thread":"14","message":{"Configuration":{"tag":"ConfigurationCheckpointsForIntersection","slots":[110211404,110211396,110211381,110211354,110211311,110211162,110210908,110210467,110209390,110207387,110203307,110195208,110179019,110146606,110081812]}},"version":"v2.7.1+5c0c7a"} Dec 05 12:08:43 ns366159 bash[3119216]: {"severity":"Notice","timestamp":"2023-12-05T12:08:43.189474491Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollBackward","point":110211404}},"version":"v2.7.1+5c0c7a"} Dec 05 12:08:43 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T12:08:43.189763867Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:08:46 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T12:08:46.062302869Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211467,"inputs":108,"binaryData":12,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 12:08:46 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T12:08:46.062361212Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:09:08 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T12:09:08.353080519Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211803,"inputs":899,"binaryData":149,"scripts":91}},"version":"v2.7.1+5c0c7a"} Dec 05 12:09:08 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T12:09:08.353199709Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:10:01 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T12:10:01.154816609Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211905,"inputs":114,"binaryData":17,"scripts":22}},"version":"v2.7.1+5c0c7a"} Dec 05 12:10:01 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T12:10:01.154887262Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:10:11 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T12:10:11.191263224Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211918,"inputs":51,"binaryData":7,"scripts":3}},"version":"v2.7.1+5c0c7a"} Dec 05 12:10:11 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T12:10:11.191315915Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:10:23 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T12:10:23.317565981Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211931,"inputs":33,"binaryData":14,"scripts":11}},"version":"v2.7.1+5c0c7a"} Dec 05 12:10:23 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T12:10:23.31763512Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:11:20 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T12:11:20.949569617Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110211986,"inputs":137,"binaryData":20,"scripts":11}},"version":"v2.7.1+5c0c7a"} Dec 05 12:11:21 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T12:11:20.949637175Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:11:51 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T12:11:51.02187137Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110212017,"inputs":63,"binaryData":14,"scripts":9}},"version":"v2.7.1+5c0c7a"} Dec 05 12:11:51 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T12:11:51.0219272Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:12:06 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T12:12:06.609926536Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110212034,"inputs":73,"binaryData":3,"scripts":4}},"version":"v2.7.1+5c0c7a"} Dec 05 12:12:06 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T12:12:06.610011312Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:12:15 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T12:12:15.378914652Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110212043,"inputs":16,"binaryData":6,"scripts":2}},"version":"v2.7.1+5c0c7a"} Dec 05 12:12:15 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T12:12:15.378970306Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} Dec 05 12:12:26 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T12:12:26.015487176Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110212053,"inputs":43,"binaryData":12,"scripts":8}},"version":"v2.7.1+5c0c7a"} Dec 05 12:12:26 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T12:12:26.015550608Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"} ```

While this hints at PRAGMA optimize from my POV, I tried running this command on the database manually and it did.. nothing. Not sure if the pragma simply has no effect when invoked seperately or what exactly the issue is.

UPDATE: Additional log data hints at indeed PRAGMA optimize to potentially block the database for a long time (especially in case of this "snoozed" db, where no cleanups have been performed for a while

Dec 05 13:10:28 ns366159 bash[3119216]: {"severity":"Notice","timestamp":"2023-12-05T13:10:28.006664991Z","thread":"13","message":{"Gardener":{"tag":"GardenerBeginGarbageCollection","pruning":"binary_data"}},"version":"v2.7.1+5c0c7a"}
Dec 05 13:10:30 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T13:10:30.049047469Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110215448,"inputs":37,"binaryData":12,"scripts":8}},"version":"v2.7.1+5c0c7a"}
Dec 05 13:10:30 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T13:10:30.049126604Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"}
Dec 05 13:10:30 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T13:10:30.050914891Z","thread":"13","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":" DELETE FROM binary_data WHERE binary_data_hash IN ( SELECT binary_data_hash FROM binary_data LEFT JOIN inputs ON binary_data_hash = inputs.datum_hash WHERE inputs.ext_output_reference IS NULL ORDER BY inputs.datum_hash LIMIT 50000 )"}}},"version":"v2.7.1+5c0c7a"}
Dec 05 13:11:09 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T13:11:09.522505499Z","thread":"13","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":" DELETE FROM binary_data WHERE binary_data_hash IN ( SELECT binary_data_hash FROM binary_data LEFT JOIN inputs ON binary_data_hash = inputs.datum_hash WHERE inputs.ext_output_reference IS NULL ORDER BY inputs.datum_hash LIMIT 50000 )"}}},"version":"v2.7.1+5c0c7a"}
Dec 05 13:11:11 ns366159 bash[3119216]: {"severity":"Notice","timestamp":"2023-12-05T13:11:11.380046865Z","thread":"13","message":{"Gardener":{"tag":"GardenerExitGarbageCollection","totalPrunedRows":1279}},"version":"v2.7.1+5c0c7a"}
Dec 05 13:11:17 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T13:11:17.756078007Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110215537,"inputs":240,"binaryData":71,"scripts":24}},"version":"v2.7.1+5c0c7a"}
Dec 05 13:11:17 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T13:11:17.756205449Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"}
Dec 05 13:11:17 ns366159 bash[3119216]: {"severity":"Notice","timestamp":"2023-12-05T13:11:17.75818417Z","thread":"13","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionBeginQuery","beginQuery":"PRAGMA optimize"}}},"version":"v2.7.1+5c0c7a"}
Dec 05 13:40:49 ns366159 bash[3119216]: {"severity":"Notice","timestamp":"2023-12-05T13:40:49.621925267Z","thread":"13","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionExitQuery","exitQuery":"PRAGMA optimize"}}},"version":"v2.7.1+5c0c7a"}
Dec 05 13:40:53 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T13:40:53.386114172Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110215584,"inputs":117,"binaryData":23,"scripts":15}},"version":"v2.7.1+5c0c7a"}
Dec 05 13:40:53 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T13:40:53.386208303Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"}
Dec 05 13:41:20 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T13:41:20.459622355Z","thread":"6","message":{"Database":{"tag":"DatabaseConnection","message":{"tag":"ConnectionDestroyShortLived","mode":"ReadWrite"}}},"version":"v2.7.1+5c0c7a"}
Dec 05 13:41:29 ns366159 bash[3119216]: {"severity":"Info","timestamp":"2023-12-05T13:41:29.208638766Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollForward","slotNo":110216232,"inputs":1529,"binaryData":401,"scripts":196}},"version":"v2.7.1+5c0c7a"}
Dec 05 13:41:29 ns366159 bash[3119216]: {"severity":"Debug","timestamp":"2023-12-05T13:41:29.208867389Z","thread":"11","message":{"Consumer":{"tag":"ConsumerWaitingForNextBatch"}},"version":"v2.7.1+5c0c7a"}
Dec 05 13:41:29 ns366159 bash[3119216]: {"severity":"Notice","timestamp":"2023-12-05T13:41:29.208895525Z","thread":"11","message":{"Consumer":{"tag":"ConsumerRollBackward","point":110216177}},"version":"v2.7.1+5

KtorZ Dec 6, 2023
Maintainer

PRAGMA optimize does nothing if it has recently run. Otherwise it helps the query planner for future queries. The recommendation is to run it ever so often, when closing connections or once a day. Which is why it runs as part of the GC.
Seems like on Linux, the executable isn't compiled in production mode and is missing some crucial runtime configuration. I'll fix that for the next releases, but in the meantime, you can manually apply the runtime configurations by adding: +RTS -N -A16m -qb -qg -RTS when invoking Kupo. This should speed up quite a few things in the block application.

Batches are also quite long to apply on your instance, which seems weird given that it isn't that small of a machine as it seems. It could very much be due to the build being a dev build and not a release build (the runtime flags will help, but the binary is still not fully optimized I am afraid).

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Kupo tip does not stay most recent with nodes under heavy load #149

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 1 comment 2 replies

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

Select a reply

Kupo tip does not stay most recent with nodes under heavy load #149

nielstron Dec 4, 2023

What Git revision / release tag are you using?

Describe what the problem is?

What should be the expected behavior?

If applicable, what are the logs from the server around the occurence of the problem?

Replies: 1 comment · 2 replies

KtorZ Dec 4, 2023 Maintainer

nielstron Dec 5, 2023 Author

Node

Call

Hardware specs

Indexes

Kupo details

More logs

KtorZ Dec 6, 2023 Maintainer

nielstron
Dec 4, 2023

Replies: 1 comment 2 replies

KtorZ
Dec 4, 2023
Maintainer

nielstron Dec 5, 2023
Author

KtorZ Dec 6, 2023
Maintainer