Skip to content

DAOS-18607 placement: generate partial layout for rebuild and EC aggregation (#17829) - #17879

Merged
gnailzenh merged 3 commits into
release/2.6from
liang/b2_6_pl_partial
Apr 8, 2026
Merged

DAOS-18607 placement: generate partial layout for rebuild and EC aggregation (#17829)#17879
gnailzenh merged 3 commits into
release/2.6from
liang/b2_6_pl_partial

Conversation

@gnailzenh

@gnailzenh gnailzenh commented Apr 2, 2026 •
edited
Loading

Copy link
Copy Markdown
Collaborator

Rebuild and EC aggregation do not require the full object layout;
instead, they only need the localities of the shards within the
same redundancy group as the current shard.

This patch stops the layout computation after generating the layout
for the requested redundancy group, saving a significant amount of
computation resources.

Steps for the author:

  • Commit message follows the guidelines.
  • Appropriate Features or Test-tag pragmas were used.
  • Appropriate Functional Test Stages were run.
  • At least two positive code reviews including at least one code owner from each category referenced in the PR.
  • Testing is complete. If necessary, forced-landing label added and a reason added in a comment.

After all prior steps are complete:

  • Gatekeeper requested (daos-gatekeeper added as a reviewer).

gnailzenh added 2 commits April 2, 2026 10:14
@gnailzenh
DAOS-18607 placement: only compute required part of layout
01c50b0 
EC aggregation doesn't require full layout computation, instead it only
requires the layout up to the specified group.

This patch adds an option and allows the placement function to complete
layout computation early. It can significantly reduce computation time
for EC aggregation.

Signed-off-by: Liang Zhen <gnailzenh@gmail.com>
@gnailzenh
DAOS: generate partial layout for rebuild and EC aggregation (#17829)
6a9b508 
Rebuild and EC aggregation do not require the full object layout;
instead, they only need the localities of the shards within the
same redundancy group as the current shard.

This patch stops the layout computation after generating the layout
for the requested redundancy group, saving a significant amount of
computation resources.

Signed-off-by: Liang Zhen <gnailzenh@gmail.com>
@github-actions

github-actions Bot commented Apr 2, 2026 •
edited
Loading

Copy link
Copy Markdown

Errors are Title of PR is too long,Unable to load ticket data
https://daosio.atlassian.net/browse/DAOS-18607

@gnailzenh gnailzenh changed the title Liang/b2 6 pl partial DAOS: generate partial layout for rebuild and EC aggregation (#17829) Apr 2, 2026
@gnailzenh gnailzenh changed the title DAOS: generate partial layout for rebuild and EC aggregation (#17829) DAOS-18607: generate partial layout for rebuild and EC aggregation (#17829) Apr 2, 2026
@gnailzenh gnailzenh changed the title DAOS-18607: generate partial layout for rebuild and EC aggregation (#17829) DAOS-18607 placement: generate partial layout for rebuild and EC aggregation (#17829) Apr 2, 2026
@daosbuild3

daosbuild3 commented Apr 3, 2026

Copy link
Copy Markdown
Collaborator

Test stage Functional Hardware Medium Verbs Provider completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-17879/2/testReport/

@gnailzenh gnailzenh added priority Ticket has high priority (automatically managed) clean-cherry-pick Cherry-pick from another branch that did not require additional edits release-2.6.5 Targeted for release 2.6.5 labels Apr 6, 2026
@daosbuild3

daosbuild3 commented Apr 7, 2026

Copy link
Copy Markdown
Collaborator

Test stage Functional Hardware Medium Verbs Provider completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-17879/3/testReport/

@daosbuild3

daosbuild3 commented Apr 8, 2026

Copy link
Copy Markdown
Collaborator

Test stage Functional Hardware Medium Verbs Provider completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-17879/4/testReport/

@gnailzenh

gnailzenh commented Apr 8, 2026

Copy link
Copy Markdown
Collaborator Author

I'm landing this, the failed drain test is a known issue, Liwei has a workaround and we should add it to 2.6 as well.

@gnailzenh
gnailzenh marked this pull request as ready for review April 8, 2026 06:07
@gnailzenh
gnailzenh requested review from a team April 8, 2026 06:07
@gnailzenh
gnailzenh merged commit 91b8a3c into release/2.6 Apr 8, 2026
41 of 43 checks passed
@gnailzenh
gnailzenh deleted the liang/b2_6_pl_partial branch April 8, 2026 06:10
mchaarawi added a commit that referenced this pull request Apr 14, 2026
@mchaarawi
Revert "DAOS-18607 placement: generate partial layout for rebuild and…
2000be2 
… EC aggregation (#17829) (#17879)"

This reverts commit 91b8a3c.
@mchaarawi mchaarawi mentioned this pull request Apr 14, 2026
Closed
6 tasks
mchaarawi added a commit that referenced this pull request Apr 15, 2026
@mchaarawi
Revert "DAOS-18607 placement: generate partial layout for rebuild and…
ce2fb8f 
… EC aggregation (#17829) (#17879)"

This reverts commit 91b8a3c.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@liuxuezhao liuxuezhao liuxuezhao approved these changes
@wangshilong wangshilong wangshilong approved these changes

Assignees

No one assigned

Labels

clean-cherry-pick Cherry-pick from another branch that did not require additional edits priority Ticket has high priority (automatically managed) release-2.6.5 Targeted for release 2.6.5

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@gnailzenh @daosbuild3 @liuxuezhao @wangshilong