Skip to content

Commit 180c6de

Browse files
authored
docs: fix minor typo (huggingface#13289)
`at` should be `a1`
1 parent 066fd04 commit 180c6de

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/source/parallelism.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -58,7 +58,7 @@ a0 | b0 | c0
5858
a1 | b1 | c1
5959
a2 | b2 | c2
6060
```
61-
Layer La has weights a0, at and a2.
61+
Layer La has weights a0, a1 and a2.
6262

6363
If we have 3 GPUs, the Sharded DDP (= Zero-DP) splits the model onto 3 GPUs like so:
6464

0 commit comments

Comments
 (0)