mirror of
https://github.com/ROCm/jax.git
synced 2025-04-19 05:16:06 +00:00
Merge pull request #19437 from 8bitmp3:shard_map_title
PiperOrigin-RevId: 600326508
This commit is contained in:
commit
a1213c7dd9
@ -5,7 +5,7 @@
|
||||
"id": "97c57a94",
|
||||
"metadata": {},
|
||||
"source": [
|
||||
"# Intro\n",
|
||||
"# SPMD multi-device parallelism with `shard_map`\n",
|
||||
"\n",
|
||||
"`shard_map` is a single-program multiple-data (SPMD) multi-device parallelism API to map a function over shards of data. Mapped function applications, or _instances_, communicate with each other via explicit collective communication operations.\n",
|
||||
"\n",
|
||||
|
@ -14,7 +14,7 @@ kernelspec:
|
||||
name: python3
|
||||
---
|
||||
|
||||
# Intro
|
||||
# SPMD multi-device parallelism with `shard_map`
|
||||
|
||||
`shard_map` is a single-program multiple-data (SPMD) multi-device parallelism API to map a function over shards of data. Mapped function applications, or _instances_, communicate with each other via explicit collective communication operations.
|
||||
|
||||
|
Loading…
x
Reference in New Issue
Block a user