Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New log buffer #12357

Merged
merged 63 commits into from
Apr 8, 2024
Merged

New log buffer #12357

merged 63 commits into from
Apr 8, 2024

Conversation

amirylm
Copy link
Collaborator

@amirylm amirylm commented Mar 8, 2024

AUTO-8231

Description

As part of working on reliability, several mechanisms require changes so we could use scaling parameters to configure the throughput and data loss strategies of log provider and buffer.

This PR introduce log buffer v1 with improved performance, stability and control over scaling parameters.

NOTE: This is a major change to the buffer, and therefore is being done on a new struct and under a feature flag.

Changes

Testing

Existing tests are running with a flag for default version / v0 and v1.
New tests (unit) were added accordingly.

Copy link
Contributor

github-actions bot commented Mar 8, 2024

I see that you haven't updated any CHANGELOG files. Would it make sense to do so?

@amirylm amirylm requested review from ferglor and infiloop2 March 8, 2024 15:34
- comments
- renaming
- new(atomic.Intxx)
- sizeOfWindow(end,start)
infiloop2
infiloop2 previously approved these changes Apr 5, 2024
@amirylm amirylm requested review from ferglor and infiloop2 April 8, 2024 10:01
@amirylm amirylm added this pull request to the merge queue Apr 8, 2024
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Apr 8, 2024
@amirylm amirylm added this pull request to the merge queue Apr 8, 2024
Merged via the queue into develop with commit a532acc Apr 8, 2024
105 checks passed
@amirylm amirylm deleted the AUTO-8231-new-log-buffer branch April 8, 2024 12:52
momentmaker added a commit that referenced this pull request Apr 8, 2024
* develop:
  [KS-136] Write target fixes (#12743)
  chore/release 2.10.0 to develop (#12740)
  [KS-136] Disallow non-trigger steps with no dependent ref (#12742)
  [KS-136] Correctly handle numbers in YAML by converting them to floats or ints (#12739)
  New log buffer (#12357)
  [KS-101] Add OCR3 capability contract wrapper (#12404)
  core/services/relay/evm: switch RequestRound DB & Tracker to use sqlutil.DataSource (#12706)
  Unregister filters for old coordinator contracts contract addresses from Functions LogPollerWrapper (#12696)
momentmaker added a commit that referenced this pull request Apr 8, 2024
…ersion

* develop: (32 commits)
  [KS-136] Write target fixes (#12743)
  chore/release 2.10.0 to develop (#12740)
  [KS-136] Disallow non-trigger steps with no dependent ref (#12742)
  [KS-136] Correctly handle numbers in YAML by converting them to floats or ints (#12739)
  New log buffer (#12357)
  [KS-101] Add OCR3 capability contract wrapper (#12404)
  core/services/relay/evm: switch RequestRound DB & Tracker to use sqlutil.DataSource (#12706)
  Unregister filters for old coordinator contracts contract addresses from Functions LogPollerWrapper (#12696)
  Add table support for capability "type" property (#12622)
  Backout CRIB setup on develop. (#12705)
  fix node upgrade test (#12702)
  Reduces changeset scope to `minor` for semver (#12699)
  rm oz dep (#12700)
  @chainlink.contracts release v1.0.0 (#11714)
  feat: contracts publishing in CI (#12102)
  Bump default PG conns from 20->100; enable auto-scaling open conns for mercury (#12697)
  chore: chainlink-github-actions/* to v2.3.10 (#12694)
  LOOPP plugin config validation service (#12430)
  [TT-924] Migrate functions load tests to Seth (#12659)
  Enhance automation test config (AUTO-9430) (#12689)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants