Skip to content

Commit

Permalink
fix act recomp test
Browse files Browse the repository at this point in the history
  • Loading branch information
Quentin-Anthony committed Dec 18, 2024
1 parent 6334229 commit b212177
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -271,7 +271,7 @@ def test_gpt2_checkpointable_layers(self):

# Create a simple topology for testing
from deepspeed.runtime.pipe.topology import PipeModelDataParallelTopology
topo = PipeModelDataParallelTopology(num_pp=1, num_mp=1)
topo = PipeModelDataParallelTopology(num_pp=1, num_mp=1, num_dp=1)

# Create test classes that we want to checkpoint
class TestTransformerLayer(torch.nn.Module):
Expand Down

0 comments on commit b212177

Please sign in to comment.