Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve process termination race handling in the kernel runner's OOM logger #4007

Closed
achimnol opened this issue Mar 18, 2025 — with Lablup-Issue-Syncer · 0 comments · Fixed by #4008
Closed

Improve process termination race handling in the kernel runner's OOM logger #4007

achimnol opened this issue Mar 18, 2025 — with Lablup-Issue-Syncer · 0 comments · Fixed by #4008
Assignees
@achimnol

Comments

@achimnol
Copy link
Member

Summary  

There are some cases that the kernel runner crashes in a long-running user container with the following error:

image-20250318-071341.png{width=935 height=448}

Steps to Reproduce  

This has been observed in customer sites only.

Fix or Mitigation

We need to bypass potential races when enumerating and reading the user process information.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@achimnol achimnol

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fix: Improve handling of process termination races in the krunner's OOM logger lablup/backend.ai
1 participant
@achimnol