Skip to content

Commit

Permalink
plugins/amdgpu: Update README.md and criu-amdgpu-plugin.txt
Browse files Browse the repository at this point in the history
Signed-off-by: Yanning Yang <[email protected]>
  • Loading branch information
wweewrwer committed Dec 5, 2024
1 parent 729ef86 commit cb6b91d
Show file tree
Hide file tree
Showing 2 changed files with 24 additions and 1 deletion.
1 change: 1 addition & 0 deletions Documentation/criu-amdgpu-plugin.txt
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@ Checkpoint / Restore inside a docker container
Pytorch
Tensorflow
Using CRIU Image Streamer
Parallel Restore

DESCRIPTION
-----------
Expand Down
24 changes: 23 additions & 1 deletion plugins/amdgpu/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,8 @@ Supporting ROCm with CRIU

_Felix Kuehling <[email protected]>_<br>
_Rajneesh Bardwaj <[email protected]>_<br>
_David Yat Sin <[email protected]>_
_David Yat Sin <[email protected]>_<br>
_Yanning Yang <[email protected]>_

# Introduction

Expand Down Expand Up @@ -224,6 +225,27 @@ to resume execution on the GPUs.
*This new plugin is enabled by the new hook `__RESUME_DEVICES_LATE` in our RFC
patch series.*

## Restoring BO content in parallel

Restoring the BO content is an important part in the restore of GPU state and
usually takes a significant amount of time. A possible location for this
procedure is the `cr_plugin_restore_file` plugin. However, restoring in this
plugin blocks the target process from performing other restore operations, which
hinders further optimization of the restore process.

Therefore, a new plugin that runs in the master restore process is introduced,
and it interacts with the `cr_plugin_restore_file` plugin to complete the
restore of BO content. Specifically, the target process only needs to send the
relevant BOs to the master restore process, while this new plugin handles all
the restore of buffer objects. Through this method, during the restore of the BO
content, the target process can perform other restore operations, thus
accelerating the restore procedure. It is an implementation of gCROP from the
ACM SoCC'24 paper: [On-demand and Parallel Checkpoint/Restore for GPU
Applications](https://dl.acm.org/doi/10.1145/3698038.3698510).

*This new plugin is enabled by the new hook `__POST_FORKING` in our patch
series.*

## Other CRIU changes

In addition to the new plugins, we need to make some changes to CRIU itself to
Expand Down

0 comments on commit cb6b91d

Please sign in to comment.