Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Init #1

Merged
merged 9 commits into from
Mar 16, 2024
Merged

Init #1

merged 9 commits into from
Mar 16, 2024

Conversation

apoorvsadana
Copy link
Contributor

@apoorvsadana apoorvsadana commented Mar 8, 2024 •
edited
Loading

The orchestrator service is meant to handle any arbitrary type of job. Types of job include

  • DA submission
  • Proof creation
  • Proof verification
  • State updation

You can add a new type of job to be handled and implement the JobTrait and the service should automatically handle

  • Job creation
  • Processing of jobs
  • Tracking of job completion
  • Retry of job in the case of failures

@apoorvsadana apoorvsadana merged commit eea4f83 into main Mar 16, 2024
5 checks passed
ocdbytes pushed a commit that referenced this pull request Jun 14, 2024
feat : added review #1 changes : added error handling for snos workers
10ba1e8
ocdbytes pushed a commit that referenced this pull request Jun 14, 2024
feat : added review #1 changes : added error handling for snos workers
2c80f7d
ocdbytes added a commit that referenced this pull request Jun 17, 2024
@ocdbytes
feat : added snos worker implementation and unit tests (#16)
b625f90 
* feat : added snos worker implementation and unit tests

* feat : added review #1 changes : added error handling for snos workers

* feat : added review #1 changes : added error handling for snos workers

* fix : lint

* fix : lint errors

---------

Co-authored-by: Arun Jangra <[email protected]>
ocdbytes added a commit that referenced this pull request Jun 24, 2024
@ocdbytes
Feature: Implement proving worker (#22)
5c96c8e 
* feat : added snos worker implementation and unit tests

* feat : added review #1 changes : added error handling for snos workers

* feat : added review #1 changes : added error handling for snos workers

* fix : lint

* fix : lint errors

* feat : added proving worker

* feat : added proving worker

* fix : refactor : uncomment temp changes

* fix : ci fixes

* fix : lint

* fix : lint

* feat : added complete implementation of proving job

* fix : tests fix proving worker

* fix : lint

* feat : db generic fucntion

* feat : refactoring

---------

Co-authored-by: Arun Jangra <[email protected]>
heemankv added a commit that referenced this pull request Jul 20, 2024
@heemankv
update: build_da_client impl #1
da1ad17
heemankv added a commit that referenced this pull request Jul 22, 2024
@heemankv
update: DA job draft #1
2310fcf
heemankv added a commit that referenced this pull request Jul 25, 2024
@heemankv
update: basic test draft #1
d02b19b
heemankv added a commit that referenced this pull request Jul 26, 2024
@heemankv
update: DA job tests draft #1
1dd102d
heemankv added a commit that referenced this pull request Jul 26, 2024
@heemankv
update: DA job tests draft #1
64475be
heemankv added a commit that referenced this pull request Jul 27, 2024
@heemankv
update: draft #1 all da-tests running
d22ce38
heemankv added a commit that referenced this pull request Jul 29, 2024
@heemankv
update: DA job tests draft #1
c508f32
heemankv added a commit that referenced this pull request Jul 29, 2024
@heemankv
update: draft #1 all da-tests running
9aaa1c0
heemankv added a commit that referenced this pull request Jul 30, 2024
@heemankv
update: draft #1 tests for settlement client
162e832
heemankv added a commit that referenced this pull request Jul 30, 2024
@heemankv
update: draft #1 tests for settlement client
12afa40
apoorvsadana added a commit that referenced this pull request Aug 3, 2024
@heemankv @apoorvsadana
feat: Data Submission Worker Integration. (#51)
43db46e 
* update: DA job draft #1

* docs: changelog updated

* update: is_worker_enabled impl & usage in da_submission, removal of String from VerificationFailed

* update: renamed  to

* update: run worker only if it's enabled using is_worker_enabled check

* build: linter fixes

* Update CHANGELOG.md

Co-authored-by: Apoorv Sadana <[email protected]>

* update: limit_to_one on get_jobs_by_status

* update: removed get_last_successful_job_by_type, added get_latest_job_by_type_and_status

* update: added error to job metadata

* update: pr resolution, simplifying get_jobs_by_status, rejected status in verify_jobs

* update: linting fixes

* Update crates/orchestrator/src/jobs/mod.rs

Co-authored-by: Apoorv Sadana <[email protected]>

* update: removing .expect from mongodb mod file

* update: fixed testcase for snos worker

* chore: correct variable name

* update: added support to check againt multiple status - is_worker_enabled, get_jobs_by_statuses

* docs: rewrote 1 job per block assumption

* docs: DataSubmissionWorker -> DataAvailabilitySynchronizer

* chore: liniting fix

* update: changed name : DataAvailabilitySynchronizer -> DataSubmissionWorker

---------

Co-authored-by: Apoorv Sadana <[email protected]>
heemankv added a commit that referenced this pull request Aug 8, 2024
@heemankv
update: DA job tests draft #1
edbb7a2
heemankv added a commit that referenced this pull request Aug 8, 2024
@heemankv
update: draft #1 all da-tests running
3cbde14
apoorvsadana added a commit that referenced this pull request Aug 8, 2024
@heemankv @apoorvsadana
Tests/data availability job (#74)
36e7890 
* update: DA job tests draft #1

* update: da_job: reformatting unit tests + added integration tests

* update: shifted unit tests from src/jobs/da_job to src/test/jobs/da_job

* update: draft #1 all da-tests running

* update: removing usage of serial

* docs: documented test functions

* Update crates/orchestrator/src/tests/jobs/da_job/mod.rs

Co-authored-by: Apoorv Sadana <[email protected]>

* Update crates/orchestrator/src/tests/jobs/da_job/mod.rs

Co-authored-by: Apoorv Sadana <[email protected]>

* update: PR reviews

* update: PR reviews #2

* update: added more testcases for test_da_job_process_job_success

* Update crates/orchestrator/src/tests/jobs/da_job/mod.rs

Co-authored-by: Apoorv Sadana <[email protected]>

* update: removed Result from test cases

* update: introducing assert_matches! in Da job tests

* update: moving unit tests back in da_job file

* update: removed pub from da_word

---------

Co-authored-by: Apoorv Sadana <[email protected]>
ocdbytes added a commit that referenced this pull request Aug 17, 2024
@ocdbytes
refactor : resolved comments #1
f988819
ocdbytes added a commit that referenced this pull request Aug 22, 2024
@ocdbytes
Tests : proving client tests (#85)
7926588 
* feat : added test boilerplate

* feat : updated sharp prover client and added certificate feature

* feat : updated sharp prover client and added certificate feature

* feat : added certificates for testing

* feat : added tests for proving client and fixed fact calculation logic

* fix : linter fixes

* feat : revamp code

* feat : test fix

* refactor : resolved comments #1

* refactor : removed redundant code

* fix : lint

* refactor : updated code as per comments (0xevolve)

* markdown lint fix

* feat : resolved comment
heemankv added a commit that referenced this pull request Aug 23, 2024
@heemankv
update: parallel tests draft #1
8a7a53e
heemankv added a commit that referenced this pull request Aug 27, 2024
@heemankv
update: parallel tests draft #1
dbe12a9
heemankv added a commit that referenced this pull request Sep 5, 2024
@heemankv
update: PR review changes #1
56f1e56
heemankv added a commit that referenced this pull request Sep 5, 2024
@heemankv
update: better alert impl. (#111)
21ec2cb 
* update: drilled config

* update: TestConfigBuilder with configurations

* chore: lint fixes

* chore: lint fixes #2

* update: Non-Arc Impl for TestConfigBuilder

* update: New TestConfigBuilder accomodating changed on TestCases

* update: uncomment fft tests

* update: better alert impl

* update: PR review changes #1

* ignore: empty comment to trigger CI

* update: TestConfigBuilder object name changes

* update: optimised init_<service> functions

* update: removed new_from_env() from AWSSNS

* ignore: empty comment to trigger CI
heemankv added a commit that referenced this pull request Sep 11, 2024
@heemankv @ocdbytes
Feature: Drilled Config (#107)
bbcf7b0 
* update: drilled config

* update: TestConfigBuilder with configurations

* chore: lint fixes

* chore: lint fixes #2

* update: Non-Arc Impl for TestConfigBuilder

* update: New TestConfigBuilder accomodating changed on TestCases

* update: uncomment fft tests

* update: PR review changes #1

* update: optimised init_<service> functions

* Improvement/better alert (#114)

* update: better alert impl

* ignore: empty comment to trigger CI

* update: TestConfigBuilder object name changes

* update: removed new_from_env() from AWSSNS

* ignore: empty comment to trigger CI

* update: starknet dummy provider optimisiation

* update: starknet dummy provider + Conversion optimisiation

* update: added default for ConfigType

* update: mod implement_client added

* update: adaptation to provider-config

* fix : e2e test

* update: fix integration tests

* fix: PR reviews fixed

* update: reworking Provider config to be an ARC

---------

Co-authored-by: Arun Jangra <[email protected]>
heemankv added a commit that referenced this pull request Sep 17, 2024
@heemankv
update: tracing draft #1
bcc0ee6
k4kratik pushed a commit that referenced this pull request Sep 18, 2024
@heemankv @ocdbytes @k4kratik
Feature: Drilled Config (#107)
ed9074c 
* update: drilled config

* update: TestConfigBuilder with configurations

* chore: lint fixes

* chore: lint fixes #2

* update: Non-Arc Impl for TestConfigBuilder

* update: New TestConfigBuilder accomodating changed on TestCases

* update: uncomment fft tests

* update: PR review changes #1

* update: optimised init_<service> functions

* Improvement/better alert (#114)

* update: better alert impl

* ignore: empty comment to trigger CI

* update: TestConfigBuilder object name changes

* update: removed new_from_env() from AWSSNS

* ignore: empty comment to trigger CI

* update: starknet dummy provider optimisiation

* update: starknet dummy provider + Conversion optimisiation

* update: added default for ConfigType

* update: mod implement_client added

* update: adaptation to provider-config

* fix : e2e test

* update: fix integration tests

* fix: PR reviews fixed

* update: reworking Provider config to be an ARC

---------

Co-authored-by: Arun Jangra <[email protected]>
ocdbytes pushed a commit that referenced this pull request Oct 16, 2024
@apoorvsadana
Merge pull request #1 from karnotxyz/init
9a4ad6a 
Init
ocdbytes added a commit that referenced this pull request Oct 16, 2024
@ocdbytes
feat : added snos worker implementation and unit tests (#16)
ee6885e 
* feat : added snos worker implementation and unit tests

* feat : added review #1 changes : added error handling for snos workers

* feat : added review #1 changes : added error handling for snos workers

* fix : lint

* fix : lint errors

---------

Co-authored-by: Arun Jangra <[email protected]>
ocdbytes added a commit that referenced this pull request Oct 16, 2024
@ocdbytes
Feature: Implement proving worker (#22)
bdfa14c 
* feat : added snos worker implementation and unit tests

* feat : added review #1 changes : added error handling for snos workers

* feat : added review #1 changes : added error handling for snos workers

* fix : lint

* fix : lint errors

* feat : added proving worker

* feat : added proving worker

* fix : refactor : uncomment temp changes

* fix : ci fixes

* fix : lint

* fix : lint

* feat : added complete implementation of proving job

* fix : tests fix proving worker

* fix : lint

* feat : db generic fucntion

* feat : refactoring

---------

Co-authored-by: Arun Jangra <[email protected]>
ocdbytes pushed a commit that referenced this pull request Oct 16, 2024
@heemankv @apoorvsadana
feat: Data Submission Worker Integration. (#51)
60414d6 
* update: DA job draft #1

* docs: changelog updated

* update: is_worker_enabled impl & usage in da_submission, removal of String from VerificationFailed

* update: renamed  to

* update: run worker only if it's enabled using is_worker_enabled check

* build: linter fixes

* Update CHANGELOG.md

Co-authored-by: Apoorv Sadana <[email protected]>

* update: limit_to_one on get_jobs_by_status

* update: removed get_last_successful_job_by_type, added get_latest_job_by_type_and_status

* update: added error to job metadata

* update: pr resolution, simplifying get_jobs_by_status, rejected status in verify_jobs

* update: linting fixes

* Update crates/orchestrator/src/jobs/mod.rs

Co-authored-by: Apoorv Sadana <[email protected]>

* update: removing .expect from mongodb mod file

* update: fixed testcase for snos worker

* chore: correct variable name

* update: added support to check againt multiple status - is_worker_enabled, get_jobs_by_statuses

* docs: rewrote 1 job per block assumption

* docs: DataSubmissionWorker -> DataAvailabilitySynchronizer

* chore: liniting fix

* update: changed name : DataAvailabilitySynchronizer -> DataSubmissionWorker

---------

Co-authored-by: Apoorv Sadana <[email protected]>
ocdbytes pushed a commit that referenced this pull request Oct 16, 2024
@heemankv @apoorvsadana
Tests/data availability job (#74)
c0869f1 
* update: DA job tests draft #1

* update: da_job: reformatting unit tests + added integration tests

* update: shifted unit tests from src/jobs/da_job to src/test/jobs/da_job

* update: draft #1 all da-tests running

* update: removing usage of serial

* docs: documented test functions

* Update crates/orchestrator/src/tests/jobs/da_job/mod.rs

Co-authored-by: Apoorv Sadana <[email protected]>

* Update crates/orchestrator/src/tests/jobs/da_job/mod.rs

Co-authored-by: Apoorv Sadana <[email protected]>

* update: PR reviews

* update: PR reviews #2

* update: added more testcases for test_da_job_process_job_success

* Update crates/orchestrator/src/tests/jobs/da_job/mod.rs

Co-authored-by: Apoorv Sadana <[email protected]>

* update: removed Result from test cases

* update: introducing assert_matches! in Da job tests

* update: moving unit tests back in da_job file

* update: removed pub from da_word

---------

Co-authored-by: Apoorv Sadana <[email protected]>
ocdbytes added a commit that referenced this pull request Oct 16, 2024
@ocdbytes
Tests : proving client tests (#85)
ab3985a 
* feat : added test boilerplate

* feat : updated sharp prover client and added certificate feature

* feat : updated sharp prover client and added certificate feature

* feat : added certificates for testing

* feat : added tests for proving client and fixed fact calculation logic

* fix : linter fixes

* feat : revamp code

* feat : test fix

* refactor : resolved comments #1

* refactor : removed redundant code

* fix : lint

* refactor : updated code as per comments (0xevolve)

* markdown lint fix

* feat : resolved comment
ocdbytes pushed a commit that referenced this pull request Oct 16, 2024
@heemankv
update: better alert impl. (#111)
e052eac 
* update: drilled config

* update: TestConfigBuilder with configurations

* chore: lint fixes

* chore: lint fixes #2

* update: Non-Arc Impl for TestConfigBuilder

* update: New TestConfigBuilder accomodating changed on TestCases

* update: uncomment fft tests

* update: better alert impl

* update: PR review changes #1

* ignore: empty comment to trigger CI

* update: TestConfigBuilder object name changes

* update: optimised init_<service> functions

* update: removed new_from_env() from AWSSNS

* ignore: empty comment to trigger CI
ocdbytes added a commit that referenced this pull request Oct 16, 2024
@heemankv @ocdbytes
Feature: Drilled Config (#107)
fee3867 
* update: drilled config

* update: TestConfigBuilder with configurations

* chore: lint fixes

* chore: lint fixes #2

* update: Non-Arc Impl for TestConfigBuilder

* update: New TestConfigBuilder accomodating changed on TestCases

* update: uncomment fft tests

* update: PR review changes #1

* update: optimised init_<service> functions

* Improvement/better alert (#114)

* update: better alert impl

* ignore: empty comment to trigger CI

* update: TestConfigBuilder object name changes

* update: removed new_from_env() from AWSSNS

* ignore: empty comment to trigger CI

* update: starknet dummy provider optimisiation

* update: starknet dummy provider + Conversion optimisiation

* update: added default for ConfigType

* update: mod implement_client added

* update: adaptation to provider-config

* fix : e2e test

* update: fix integration tests

* fix: PR reviews fixed

* update: reworking Provider config to be an ARC

---------

Co-authored-by: Arun Jangra <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@apoorvsadana