Code

feat: messenger improve latency#108

Code

Merged

gk-kindred merged 36 commits intomasterkindredgroup/talos:masterfrom feature/messenger-state-transition-timingskindredgroup/talos:feature/messenger-state-transition-timingsCopy head branch name to clipboardNov 11, 2024

+293-90

Commits

Commits on Oct 8, 2024

• feat: add timing to state transitions in messenger

  gk-kindred

  committed
  56f4a88

Commits on Oct 11, 2024

• chore: make tokio select biased for inbound service

  gk-kindred

  committed
  034485c

• chore: inbound service, process next actions even in candidate message handling

  gk-kindred

  committed
  e43eb6c

Commits on Oct 18, 2024

• chore: flip the arms in biased tokio::select for inbound service

  gk-kindred

  committed
  b40017e

Commits on Oct 21, 2024

• chore: make arm for feedback to run only if there is Some feedback

  gk-kindred

  committed
  544fe9c

• chore: use talos version - biased arms flipped - print time spend in each arms

  gk-kindred

  committed
  e264eb2

• chore: remove tokio::select and use mpsc channel try_recv

  gk-kindred

  committed
  163e24e

• chore: comment out the printing of stats in inbound service for try_recv logic

  gk-kindred

  committed
  9a87c85

• chore: remove the pruning and commit check for every feedback

  gk-kindred

  committed
  b79569f

Commits on Oct 22, 2024

• chore: use tokio select without biased and print useful metrics

  gk-kindred

  committed
  d2af214

• chore: optimize suffix operations - getting items to process and updating prune_index

  gk-kindred

  committed
  a6ceff4

Commits on Oct 23, 2024

• chore: reduce the prune_start_threshold

  gk-kindred

  committed
  407b3d9

• chore: commit and prune logic kicks in after 10_000 completed actions

  gk-kindred

  committed
  eb14fd3

• chore: commit and prune logic kicks in when prune_index is above the prune_threshold

  gk-kindred

  committed
  826ca48

• chore: call process_next_actions in 10ms interval

  gk-kindred

  committed
  91b9efe

• chore: reduce the interval to 5ms

  gk-kindred

  committed
  e9fab0a

Commits on Oct 28, 2024

• chore: use take_while to update prune_index

  gk-kindred

  committed
  004523f

Commits on Nov 1, 2024

• chore: clean up

  gk-kindred

  committed
  05b62a9

• chore: pass topic creation configs to create topic bin

  gk-kindred

  committed
  7708385

Commits on Nov 3, 2024

• chore: print topic configs passed to create_topic

  gk-kindred

  committed
  da92edf

Commits on Nov 4, 2024

• chore: print time taken between publish and receive acks

  gk-kindred

  committed
  100f869

Commits on Nov 6, 2024

• chore: print time taken for building the list of actions to process

  gk-kindred

  committed
  8a5cb34

• chore: update prune index at the end of processing next actions

  gk-kindred

  committed
  c1b1f94

• chore: print the timing from decision create to on_commit publish

  gk-kindred

  committed
  ceac5b0

• chore: print timestamps

  gk-kindred

  committed
  4dcecb6

Commits on Nov 7, 2024

• chore: update prune index only when completed

  gk-kindred

  committed
  b47f123

• chore: comment printing messages

  gk-kindred

  committed
  10d0886

Commits on Nov 11, 2024

• chore: final refactoring - part 1

  gk-kindred

  committed
  d1ca56c

• chore: final refactoring - part 2

  gk-kindred

  committed
  3f46a8a

• chore: prune check and commit more frequently

  gk-kindred

  committed
  f5461be

• chore: reduce commit frequency but do prune check often

  gk-kindred

  committed
  5e0cb0b

• chore: introduce config for inbound service and commit based on the config size

  gk-kindred

  committed
  38496b7

• chore: set the commit_size to 2000

  gk-kindred

  committed
  111b266

• chore: prune logic only when above the threshold

  gk-kindred

  committed
  518a4a7

• chore: update the default commit_size to 5K records

  gk-kindred

  committed
  88ca2cc

• chore: updates from review comments

  gk-kindred

  committed
  67140e1