Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update baseline_resync branch with latest commits #234

Merged
merged 10 commits into from
Dec 3, 2024

Conversation

koujl
Copy link

@koujl koujl commented Nov 29, 2024

No description provided.

Hooper9973 and others added 6 commits November 5, 2024 02:13
this PR aims to support spare replicas in raft test framework , which is essential for testing pg move. what`s more, a basic replace_member UT is added
…hunk_id field to shard_info_superblk.

2. Enhance defensive checks in ChunkSelector for input validation and exception handling.

3. Adapt unit tests and introduce PGExceedSpaceTest.
1. Add check to ensure max_it points to an available chunk.
   If not, it indicates there are no available chunks left.
2. Add safeguards in the create and recover pg paths to ensure
   the pg size cannot be zero.
1 change on_destroy signature to adapt to homestore
2 add is leader check before any raft write operation
@codecov-commenter
Copy link

codecov-commenter commented Nov 29, 2024

⚠️ Please install the 'codecov app svg image' to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

Attention: Patch coverage is 66.89189% with 147 lines in your changes missing coverage. Please review.

Please upload report for BASE (baseline_resync@dac10d8). Learn more about missing BASE report.

Files with missing lines Patch % Lines
src/lib/homestore_backend/hs_shard_manager.cpp 50.00% 41 Missing and 4 partials ⚠️
src/lib/homestore_backend/heap_chunk_selector.cpp 78.12% 23 Missing and 19 partials ⚠️
...ib/homestore_backend/replication_state_machine.cpp 23.80% 28 Missing and 4 partials ⚠️
src/lib/homestore_backend/hs_pg_manager.cpp 78.33% 9 Missing and 4 partials ⚠️
src/lib/homestore_backend/hs_blob_manager.cpp 30.00% 4 Missing and 3 partials ⚠️
...lib/homestore_backend/snapshot_receive_handler.cpp 77.77% 3 Missing and 1 partial ⚠️
src/lib/homestore_backend/index_kv.cpp 0.00% 2 Missing and 1 partial ⚠️
src/lib/homestore_backend/heap_chunk_selector.h 85.71% 1 Missing ⚠️

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files
@@                Coverage Diff                 @@
##             baseline_resync     #234   +/-   ##
==================================================
  Coverage                   ?   65.64%           
==================================================
  Files                      ?       33           
  Lines                      ?     2262           
  Branches                   ?      255           
==================================================
  Hits                       ?     1485           
  Misses                     ?      653           
  Partials                   ?      124           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@xiaoxichen
Copy link
Collaborator

I think you can rebase and force push @yuwmao

@yuwmao
Copy link
Contributor

yuwmao commented Dec 2, 2024

I think you can rebase and force push @yuwmao

Yes, we should have permission, but I think @koujl prefer to use merge and it works as well.

@yuwmao
Copy link
Contributor

yuwmao commented Dec 2, 2024

We also need to make some changes to PGBlobIterator, I left some TODO in the PGBlobIterator.

@koujl
Copy link
Author

koujl commented Dec 2, 2024

Hooper9973 and others added 2 commits December 3, 2024 14:58
Bug Fixes:
- Resolved issues in create_shard and seal_shard functions to ensure correct shard management.
Enhancements:
- Added validation to prevent creation of placement groups with sizes smaller than the chunk size.
Test Improvements:
- pg test:
	- Added tests to verify that creating a placement group with a size smaller than the chunk size results in failure.
- shard test:
	- Created shard but shard size is larger than pg space left which should be failed.
	- Verified that successfully created shards have identical virtual chunk layouts.
@koujl koujl marked this pull request as ready for review December 3, 2024 07:47
@koujl
Copy link
Author

koujl commented Dec 3, 2024

This PR simply merged the latest commits into the feature branch.

Let's leave further changes / bug fixes to the next PR for simplicity.

Copy link
Contributor

@yuwmao yuwmao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@koujl koujl merged commit 2726477 into eBay:baseline_resync Dec 3, 2024
24 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants