Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use per package global lock for container uploads instead of memory lock #31860

Open
wants to merge 10 commits into
base: main
Choose a base branch
from
Open

Use per package global lock for container uploads instead of memory lock #31860

wants to merge 10 commits into from

Conversation

lunny
Copy link
Member

@lunny lunny commented Aug 18, 2024 •
edited
Loading

This PR uses a per-package lock instead of a global lock for container uploads. So that different packages can be uploaded simultaneously.

@GiteaBot GiteaBot added the lgtm/need 2 This PR needs two approvals by maintainers to be considered for merging. label Aug 18, 2024
@pull-request-size pull-request-size bot added the size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. label Aug 18, 2024
@lunny lunny added type/enhancement An improvement of existing functionality and removed lgtm/need 2 This PR needs two approvals by maintainers to be considered for merging. size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. labels Aug 18, 2024
@github-actions github-actions bot added modifies/api This PR adds API routes or modifies them modifies/go Pull requests that update Go code labels Aug 18, 2024
@GiteaBot GiteaBot added the lgtm/need 2 This PR needs two approvals by maintainers to be considered for merging. label Aug 18, 2024
@pull-request-size pull-request-size bot added the size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. label Aug 18, 2024
@lunny lunny mentioned this pull request Aug 18, 2024
Merged
@lunny lunny changed the title Use per package lock Use per package lock for container uploads Aug 19, 2024
@wolfogre
Copy link
Member

Wait for #31908?

@pull-request-size pull-request-size bot added size/S Denotes a PR that changes 10-29 lines, ignoring generated files. and removed size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. labels Aug 26, 2024
@lunny
Copy link
Member Author

lunny commented Aug 26, 2024 •
edited
Loading

Depends on #31813

@lunny lunny mentioned this pull request Sep 3, 2024
Closed
@lunny lunny added this to the 1.23.0 milestone Sep 6, 2024
@GiteaBot GiteaBot added lgtm/need 1 This PR needs approval from one additional maintainer to be merged. and removed lgtm/need 2 This PR needs two approvals by maintainers to be considered for merging. labels Sep 8, 2024
@lunny lunny mentioned this pull request Sep 10, 2024
Merged
techknowlogick pushed a commit that referenced this pull request Sep 12, 2024
@lunny
Fix container parallel upload bugs (#32022)
30d989d 
This PR should be replaced by #31860 in v1.23. The aim of creating this
PR is to fix it in 1.22 because globallock hasn't been introduced.

Fix #27640
Fix #29563
Fix #31215
@lunny lunny marked this pull request as draft September 24, 2024 07:10
@lunny
Copy link
Member Author

lunny commented Sep 24, 2024 •
edited
Loading

The lock key should contain owner id.

@lunny lunny marked this pull request as ready for review September 24, 2024 22:35
@lunny lunny changed the title Use per package lock for container uploads Use per package global lock for container uploads instead of memory lock Sep 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@wxiaoguang wxiaoguang wxiaoguang left review comments

@wolfogre wolfogre wolfogre approved these changes

Assignees
No one assigned
Labels
lgtm/need 1 This PR needs approval from one additional maintainer to be merged. modifies/api This PR adds API routes or modifies them modifies/go Pull requests that update Go code size/S Denotes a PR that changes 10-29 lines, ignoring generated files. topic/packages type/enhancement An improvement of existing functionality
Projects
None yet
Milestone
1.23.0
Development

Successfully merging this pull request may close these issues.
6 participants
@lunny @wolfogre @wxiaoguang @KN4CK3R @GiteaBot @lafriks