530 Commits

Author SHA1 Message Date
Vladimir Belitskiy
df6758f021 Update XLA dependency to use revision
PiperOrigin-RevId: 700728296
2024-11-27 09:39:24 -08:00
jax authors
9c42379633 Update XLA dependency to use revision
9d5bac13a3.

PiperOrigin-RevId: 700465720
2024-11-26 14:44:04 -08:00
Vladimir Belitskiy
e453fa179e Update XLA dependency to use revision
PiperOrigin-RevId: 700373062
2024-11-26 09:48:02 -08:00
jax authors
ebea4353f8 Update XLA dependency to use revision
7059553f7e.

PiperOrigin-RevId: 700110142
2024-11-25 14:57:20 -08:00
Nitin Srinivasan
6761512658 Re-factor build CLI to a subcommand based approach
This commit reworks the JAX build CLI to a subcommand based approach where CLI use cases are now defined as subcommands. Two subcommands are defined: build and requirements_update. "build" is to be used when wanting to build a JAX wheel package. "requirements_update" is to be used when wanting to update the requirements_lock.txt files. The new structure offers a clear and organized CLI that enables users to execute specific build tasks without having to navigate through a monolithic script.

Each subcommand has specific arguments that apply to its respective build process. In addition, arguments are separated into groups to achieve a cleaner separation and improves the readability when the CLI subcommands are run with `--help`. It also makes it clear as to which parts of the build they affect. E.g: CUDA arguments only apply to CUDA builds, ROCM arguments only apply to ROCM builds, etc. This reduces the complexity and the potential for errors during the build process. Segregating functionalities into distinct subcommands also simplifies the code which should help with the maintenance and future extensions.

There is also a transition from using `subprocess.check_output` to `asyncio.create_subprocess_shell` for executing the build commands which allows for streaming logs and helps in showing the build progress in real time.

Usage:
* Building `jaxlib`:
```
python build/build.py build --wheels=jaxlib --python_version=3.10
```
* Building `jax-cuda-plugin`:
```
python build/build.py build --wheels=jax-cuda-plugin --cuda_version=12.3.2 --cudnn_version=9.1.1 --python_version=3.10
```
* Building multiple packages:
```
python build/build.py build --wheels=jaxlib,jax-cuda-plugin,jax-cuda-pjrt --cuda_version=12.3.2 --cudnn_version=9.1.1 --python_version=3.10
```
* Building `jax-rocm-pjrt`:
```
python build/build.py build --wheels=jax-rocm-pjrt --rocm_version=60 --rocm_path=/path/to/rocm
```
* Using a local XLA path:
```
python build/build.py build --wheels=jaxlib --local_xla_path=/path/to/xla
```
* Updating requirements_lock.txt files:
```
python build/build.py requirements_update --python_version=3.10
```

For more details on each argument and to see available options, run:
```
python build/build.py build --help
```
or
```
python build/build.py requirements_update --help
```

PiperOrigin-RevId: 700075411
2024-11-25 13:03:04 -08:00
jax authors
b372ce4b1a Update XLA dependency to use revision
40d457a268.

PiperOrigin-RevId: 699768724
2024-11-24 15:00:10 -08:00
jax authors
4d8751bff4 Update XLA dependency to use revision
90af2896ab.

PiperOrigin-RevId: 699545393
2024-11-23 15:31:36 -08:00
jax authors
9f6dbef3dc Update XLA dependency to use revision
0564969ba3.

PiperOrigin-RevId: 699295115
2024-11-22 14:50:57 -08:00
jax authors
26443bbd66 Update XLA dependency to use revision
85360d67ff.

PiperOrigin-RevId: 698915433
2024-11-21 14:26:26 -08:00
jax authors
6fe78042b5 Update XLA dependency to use revision
e763f8875b.

PiperOrigin-RevId: 698525361
2024-11-20 14:39:00 -08:00
jax authors
a582df0297 Update XLA dependency to use revision
fcee07f619.

PiperOrigin-RevId: 698371906
2024-11-20 06:39:06 -08:00
jax authors
3161a28424 Update XLA dependency to use revision
229f376e04.

PiperOrigin-RevId: 698136955
2024-11-19 14:01:25 -08:00
jax authors
b3ca6c47cc Update XLA dependency to use revision
082a701470.

PiperOrigin-RevId: 697756717
2024-11-18 14:21:51 -08:00
jax authors
742cabc547 Update XLA dependency to use revision
58ea2935b4.

PiperOrigin-RevId: 697425145
2024-11-17 14:19:34 -08:00
jax authors
7b9914d711 Update XLA dependency to use revision
9ab7d704d7.

PiperOrigin-RevId: 697222155
2024-11-16 13:40:11 -08:00
jax authors
1780ff2964 Update XLA dependency to use revision
195f45b708.

PiperOrigin-RevId: 696984108
2024-11-15 13:28:31 -08:00
jax authors
c40d405e43 Update XLA dependency to use revision
ecdba3f23b.

PiperOrigin-RevId: 696642961
2024-11-14 14:04:36 -08:00
jax authors
4a884d4184 Update XLA dependency to use revision
2a7890387f.

PiperOrigin-RevId: 696255293
2024-11-13 13:40:49 -08:00
jax authors
c4a0369f5c Update XLA dependency to use revision
f17344020c.

PiperOrigin-RevId: 695838490
2024-11-12 12:52:22 -08:00
jax authors
6892e628fb Update XLA dependency to use revision
e93a258e44.

PiperOrigin-RevId: 695470898
2024-11-11 13:52:20 -08:00
jax authors
098d582e70 Update XLA dependency to use revision
cebb50cc77.

PiperOrigin-RevId: 695127776
2024-11-10 14:43:02 -08:00
jax authors
b51187ca0c Update XLA dependency to use revision
290673692a.

PiperOrigin-RevId: 694921620
2024-11-09 14:39:09 -08:00
jax authors
c1360f5463 Update XLA dependency to use revision
6d95565e65.

PiperOrigin-RevId: 694624452
2024-11-08 13:41:22 -08:00
jax authors
37fc834975 Update XLA dependency to use revision
b0aae98821.

PiperOrigin-RevId: 694218761
2024-11-07 12:55:39 -08:00
jax authors
dc33a28028 Update XLA dependency to use revision
0f6331b188.

PiperOrigin-RevId: 693819727
2024-11-06 12:19:14 -08:00
jax authors
21f4b0854a Update XLA dependency to use revision
5a9f79f295.

PiperOrigin-RevId: 693439980
2024-11-05 12:28:17 -08:00
jax authors
38b4d00100 Update XLA dependency to use revision
c66d74e5b3.

PiperOrigin-RevId: 693065128
2024-11-04 13:01:55 -08:00
jax authors
2d94914c80 Update XLA dependency to use revision
336cc6ede4.

PiperOrigin-RevId: 692744387
2024-11-03 13:01:23 -08:00
jax authors
d679c0abaa Update XLA dependency to use revision
cbf3c8d5de.

PiperOrigin-RevId: 692531116
2024-11-02 13:35:58 -07:00
jax authors
d606c24293 Update XLA dependency to use revision
8ec02b3611.

PiperOrigin-RevId: 692266047
2024-11-01 12:57:20 -07:00
jax authors
8536eca46e Update XLA dependency to use revision
edf18ce242.

PiperOrigin-RevId: 691908973
2024-10-31 13:06:07 -07:00
jax authors
af14c43893 Update XLA dependency to use revision
2d9d84487e.

PiperOrigin-RevId: 691516089
2024-10-30 12:36:35 -07:00
jax authors
63e8aff268 Update XLA dependency to use revision
b5690e93ea.

PiperOrigin-RevId: 691102818
2024-10-29 11:45:45 -07:00
jax authors
bc03e5053a Update XLA dependency to use revision
7b4c7f36cc.

PiperOrigin-RevId: 690672528
2024-10-28 10:49:45 -07:00
jax authors
ef83ac6443 Update XLA dependency to use revision
a7bd6795db.

PiperOrigin-RevId: 690363812
2024-10-27 11:01:32 -07:00
jax authors
56dc89f1a2 Update XLA dependency to use revision
4d0fe880a5.

PiperOrigin-RevId: 690147893
2024-10-26 11:28:09 -07:00
jax authors
5afdbcbae7 Update XLA dependency to use revision
79142a8fdd.

PiperOrigin-RevId: 689867508
2024-10-25 12:05:27 -07:00
jax authors
bd417ba6d0 Update XLA dependency to use revision
1f6bd971dd.

PiperOrigin-RevId: 689457454
2024-10-24 11:36:55 -07:00
jax authors
16f8958ece Update XLA dependency to use revision
ffcd64e30e.

PiperOrigin-RevId: 689062763
2024-10-23 12:30:09 -07:00
jax authors
32be1992ee Update XLA dependency to use revision
bf8dafb2a7.

PiperOrigin-RevId: 688648145
2024-10-22 12:29:58 -07:00
jax authors
16fca386a3 Update XLA dependency to use revision
76da730179.

PiperOrigin-RevId: 688222632
2024-10-21 12:03:12 -07:00
jax authors
33a73852eb Update XLA dependency to use revision
8a7920d699.

PiperOrigin-RevId: 687898456
2024-10-20 13:03:47 -07:00
jax authors
77fb1eee11 Update XLA dependency to use revision
d0d716fb63.

PiperOrigin-RevId: 687675747
2024-10-19 13:38:07 -07:00
jax authors
22426519b7 Update XLA dependency to use revision
7e3b0097bd.

PiperOrigin-RevId: 687427622
2024-10-18 14:35:02 -07:00
jax authors
93389ab5f4 Update XLA dependency to use revision
70df652679.

PiperOrigin-RevId: 687045334
2024-10-17 14:29:44 -07:00
jax authors
a5b312378f Update XLA dependency to use revision
a0a21d14c1.

PiperOrigin-RevId: 686636541
2024-10-16 14:09:36 -07:00
jax authors
1df58b1854 Update XLA dependency to use revision
9136df1d97.

PiperOrigin-RevId: 686213543
2024-10-15 13:13:28 -07:00
jax authors
fff3b8747f Update XLA dependency to use revision
867b9f6e80.

PiperOrigin-RevId: 685797421
2024-10-14 12:30:37 -07:00
jax authors
b6f38bcc4b Update XLA dependency to use revision
58afa5b558.

PiperOrigin-RevId: 685467848
2024-10-13 11:58:59 -07:00
jax authors
44cfbbe35f Update XLA dependency to use revision
862d48eaee.

PiperOrigin-RevId: 685235393
2024-10-12 11:53:49 -07:00