68 Commits

Author SHA1 Message Date
Jieying Luo
f25a51ee4f Change bazel config name "rbe_cpu_linux_py39" to "rbe_cpu_linux_py3.9"to be consistent with cuda bazel build configs.
Change other python versions bazel config similarly.

PiperOrigin-RevId: 588100957
2023-12-05 09:42:14 -08:00
Peter Hawkins
6fa506cb4a Build CUDA kernels for sm_50 instead of sm_52.
This improves compatibility with older Maxwell cards, and it probably doesn't matter a whole lot for performance.

See: https://github.com/google/jax/issues/5723#issuecomment-1823093159
PiperOrigin-RevId: 585967281
2023-11-28 07:16:01 -08:00
jax authors
dce6ab4548 Reverts 2aaa7559f96e4bb7b0271665bf386bf3ba22c451
PiperOrigin-RevId: 584033001
2023-11-20 08:23:40 -08:00
jax authors
2aaa7559f9 Reverts a80d35f4eda99bac42a1573ff5029e7035ebe71b
PiperOrigin-RevId: 581285053
2023-11-10 09:32:29 -08:00
jax authors
a80d35f4ed Replace gcc with clang compiler in CI nightly jobs.
PiperOrigin-RevId: 581086810
2023-11-09 18:30:03 -08:00
Jieying Luo
0ce7c7b7bd Register plugin profiler for TPU and remove --config=tpu/--enable_tpu in jaxlib.
PiperOrigin-RevId: 580561059
2023-11-08 09:40:28 -08:00
jax authors
59192b0dd1 Replace gcc with clang compiler in presubmit and postsubmit CI Kokoro jobs.
PiperOrigin-RevId: 579032820
2023-11-02 18:01:36 -07:00
Peter Hawkins
8d49f9a159 Reverts 9b1a656c1ef1f93f9e93eccb662de9bebe66b51a
PiperOrigin-RevId: 576128882
2023-10-24 07:08:34 -07:00
jax authors
9b1a656c1e Reverts 84c516974ab2b37169938d2d48a6c29a63c62c21
PiperOrigin-RevId: 575891656
2023-10-23 12:13:56 -07:00
Jieying Luo
0290150c4c Build jaxlib without PJRT GPU deps when plugin will be built.
PiperOrigin-RevId: 573844805
2023-10-16 09:59:07 -07:00
Yash Katariya
f5a1439168 Delete cuda 12.0.1 rbe configs since JAX doesn't support it anymore
PiperOrigin-RevId: 573059967
2023-10-12 17:52:11 -07:00
Peter Hawkins
d856ecc6fb Set RPATH, not RUNPATH in JAX CUDA builds.
Fixes https://github.com/google/jax/issues/17497
2023-10-12 09:38:10 -07:00
Peter Hawkins
efc18e4147 [JAX] Obtain NCCL via a stub, rather than linking it statically or dynamically.
This shrinks the CUDA jaxlib wheel size by around 80MB.

PiperOrigin-RevId: 570554454
2023-10-03 18:33:58 -07:00
Yash Katariya
1c90a5dfd0 Add cuda 12.2 support to JAX
PiperOrigin-RevId: 568244230
2023-09-25 09:40:12 -07:00
Yash Katariya
9ca133b5da Add python 3.12 support to JAX
PiperOrigin-RevId: 567307333
2023-09-21 07:56:05 -07:00
Peter Hawkins
de5aee8676 Fix Bazel build failures from long command lines on Windows.
Fixes https://github.com/google/jax/issues/14950
2023-09-07 17:36:04 -04:00
Peter Hawkins
64d0a36eab Don't enable the XLA Python --enable_tpu flag when building with --enable_tpu.
This flag no longer does anything in XLA.

PiperOrigin-RevId: 559237161
2023-08-22 15:12:46 -07:00
Peter Hawkins
1d4b10b775 Remove --distinct_host_configuration from Bazel flags.
This flag does nothing under Bazel 6 and will be removed in Bazel 7.
2023-07-11 11:38:05 -04:00
Peter Hawkins
bfa113ba60 Remove references to Python 3.8.
Remove the old build scripts/Dockerfile, since they are unused and broken.

PiperOrigin-RevId: 542870354
2023-06-23 08:48:57 -07:00
Peter Hawkins
119661ce6b Remove older plugin device integration.
Users of this mechanism should migrate to the newer PJRT plugin registration mechanism (see the comments on discover_plugins() in this file).
2023-06-14 15:26:58 -04:00
Peter Hawkins
cb33fdf3f7 Include SASS/PTX for Hopper GPUs. 2023-06-05 09:42:12 -04:00
Peter Hawkins
84c516974a Revert: Switch to using Clang as the default compiler.
It appears this is causing deadlocks in multi-gpu tests.

PiperOrigin-RevId: 527706573
2023-04-27 15:52:28 -07:00
Parker Schuh
782d90dc85 Switch to using Clang as the default compiler.
PiperOrigin-RevId: 526815933
2023-04-24 19:01:49 -07:00
Yash Katariya
86c0b36bfd Remove Cuda 11.4 support. JAX from 0.4.8 release will support cuda 11.8 and cuda 12
PiperOrigin-RevId: 520056811
2023-03-28 09:54:36 -07:00
Peter Hawkins
b62f114524 Add support for using pip-installed CUDA wheels.
Add a currently undocumented jax[cuda11_pip] and jax[cuda12_pip] that depend on the pip CUDA wheels.
Add a currently undocumented jax[cuda11_local] and jax[cuda12_local] that avoid the CUDA wheel dependency.
2023-03-26 12:35:00 +00:00
Yash Katariya
06d610dcd4 Add Cuda 12 build configs to bazelrc
PiperOrigin-RevId: 516370916
2023-03-13 17:46:22 -07:00
Peter Hawkins
172a831219 Switch JAX to use the OpenXLA repository. 2023-03-13 18:38:26 +00:00
Stella Laurenzo
c1e13bdf3f A few developer workflow enhancements for working with jaxlib.
It seems to me that jaxlib development must be mostly happening on CI, because some basics are pretty essential. Here are a few things I've been typing/carrying for a while in my flow:

* Add .bazelrc.user to .gitignore so it doesn't accidentally get checked in.
* Add configs for 'debug_symbols' and 'debug' that make some things minimally workable under a debugger (or to get backtraces, etc).
* Add `--force-reinstall` to the copy/paste command to update a built jaxlib wheel (without this, if you are iterating, it fairly quietly does nothing).
2023-02-10 21:03:21 -08:00
Peter Hawkins
ec56d71d01 Drop support for NVIDIA Kepler series GPUs in jaxlib builds. 2023-02-10 14:15:15 -05:00
Yash Katariya
71569e1d16 Remove the specialized sm versions for testing. It caused release wheels to ship without correct sm versions compiled in.
PiperOrigin-RevId: 494854373
2022-12-12 16:02:46 -08:00
Yash Katariya
ea63baf1ad Remove python 3.7 from testing and release builds
PiperOrigin-RevId: 491752393
2022-11-29 15:26:46 -08:00
Yash Katariya
03aa266e45 Build GPU wheel only for Tesla (t4) when running on RBE. THis should in theory speed up the builds
PiperOrigin-RevId: 490553589
2022-11-23 11:57:24 -08:00
Yash Katariya
51e4b017bb Use the cuda 11.8 image for CPU builds to reduce the docker image churn from the JAX side in TF's RBE cluster
PiperOrigin-RevId: 490522647
2022-11-23 09:33:17 -08:00
Yash Katariya
6d11567142 Add cuda 11.8 configs to .bazelrc
PiperOrigin-RevId: 489591457
2022-11-18 16:55:28 -08:00
Yash Katariya
d77cccff43 Update docker images to add python 3.11 support.
PiperOrigin-RevId: 485488215
2022-11-01 20:35:38 -07:00
Rohit Santhanam
663441007c [ROCm] Added gfx90a and gfx1030. 2022-10-27 16:57:06 +00:00
Peter Hawkins
aa6445e6f5 Set --tsl_link_protobuf=true in .bazelrc to unbreak jaxlib build. 2022-10-13 13:50:09 +00:00
jax authors
254dc24a8b Merge pull request #11961 from jakeh-gc:plugin_device
PiperOrigin-RevId: 476363760
2022-09-23 07:29:17 -07:00
jax authors
fd90f40c45 Merge pull request #12443 from cloudhan:fix-mlir-chlo-stablehlo-symbols
PiperOrigin-RevId: 475808753
2022-09-21 06:12:44 -07:00
Cloud Han
dc414c8635 Switch from experimental_strict_action_env to incompatible_strict_action_env to avoid deprecation warning 2022-09-21 17:26:21 +08:00
Yash Katariya
a2e05b0df5 Try Cuda 11.2 build in presubmit for GPU. Presubmit uses 11.2 and CI uses 11.1
PiperOrigin-RevId: 473071603
2022-09-08 13:34:03 -07:00
Jake
21f82c6c0d Use the pjrt plugin device client. 2022-08-17 14:34:07 +01:00
Peter Hawkins
184f8ab723 Import .bazelrc.user to allow users to override bazel options easily. 2022-08-14 15:46:12 -04:00
Rohit Santhanam
080cf47002 [ROCm] Fixes for compilation failures caused by compiler changes in ROCm Tensorflow fork. 2022-06-29 14:34:08 +00:00
Peter Hawkins
69bda69fb6 Bump minimum Mac OS version to 10.14 (Mojave).
It turns out that the support for C++17 is partial in 10.12, and in particular absl::optional and std::optional are not the same thing under 10.12. Increment to 10.14 which is the lowest version that builds successfully with absl::optional == std::optional.

See: 89cdaed655/absl/base/config.h (L528)
Strictly speaking, we could allow 10.13, but not without updating ABSL in the TF repository to incorporate c86347d4ce which fixes the version detection test to permit 10.13 as well.
2022-06-01 20:32:22 -04:00
Nicholas Junge
7f7358cb58 Fix macOS builds by updating the minimum OSX version target
This commit bumps the minimum macOS version target to 10.12, from 10.9
previously. The reason is that a newer LLVM version, which the XLA
compiler depended on, used `std::shared_mutex`, which is only available
starting at macOS 10.12.

The fix here consists of setting the minimum version target flag that
bazel consumes for the build to 10.12.
2022-05-31 15:14:48 +02:00
Yash Katariya
dd261bde59 Switch to using C++17
PiperOrigin-RevId: 450559689
2022-05-23 17:15:00 -07:00
Peter Hawkins
ea868b4ffe Update .bazelrc to reflect GPU/TPU build changes.
PiperOrigin-RevId: 449306362
2022-05-17 13:48:55 -07:00
Peter Hawkins
9fb9e12169 Don't include PTX for older GPU generations.
See: https://github.com/tensorflow/tensorflow/pull/55613

For a CUDA build at head with the default compute capabilities, reduces wheel size from 141MB to 112MB.

Don't redundantly specify default compute capabilities in .bazelrc and in
build.py.
2022-05-02 20:27:37 +00:00
Yash Katariya
5fdad0ebf5 Roll forward manylinux2014 builds after fixes.
PiperOrigin-RevId: 440589273
2022-04-09 10:19:44 -07:00