Yash Katariya 34611be53d Add sharding rules to some more primitives so that backward pass of minformer passes. There are a couple of changes here: ...

* Handled transpose of `dot_general` correctly with shardings
* Handled transpose of `reduce_sum` correctly with shardings
* `ShapedArray.to_tangent_aval` now sets the sharding of the tangent (not handling unreduced yet).
* `ConcreteArray.aval` correctly sets the sharding which is extracted from the `val` attribute.
* (Paired with Dougal!) Added sharding rule for `reshape_p` only when singleton dims are added/removed.
* Added sharding rule for `select_n_p` because it gets called during `jax.grad` of minformer.
* Added `sharding` attribute to `broadcast_in_dim` because we need to provide the correct sharding to it during `full` and transpose of `reduce_sum`.

PiperOrigin-RevId: 689837320

2024-10-25 10:35:25 -07:00

..

filecheck

Re-land #23261 with appropriate compatibility checks.

2024-09-18 12:40:53 -07:00

mosaic

[pallas:mosaic_gpu] Added FragmentedArray.to_layout

2024-10-16 08:53:02 -07:00

notebooks

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

pallas

[Pallas TPU] Add lowerings for scalar absf and rsqrt

2024-10-24 15:59:34 -07:00

testdata

[PJRT C API] Add parsing PJRT client create options from json file.

2023-03-21 16:57:34 -07:00

third_party/scipy

Fix CI test failure in line_search_test.

2024-05-15 07:38:20 -07:00

ann_test.py

Avoid 'from jax import config' imports

2024-04-11 13:23:27 -07:00

aot_test.py

Avoid 'from jax import config' imports

2024-04-11 13:23:27 -07:00

api_test.py

improve concreteness error message in remat

2024-10-24 18:13:42 +00:00

api_util_test.py

Consolidate handling of input argument resolution in custom_* APIs.

2024-08-13 00:30:23 -07:00

array_api_skips.txt

[array API] update test suite to most recent commit

2024-08-08 12:33:30 -07:00

array_api_test.py

[array api] fix deprecation to support old import pattern

2024-08-01 14:38:59 -07:00

array_interoperability_test.py

Set PYTHONWARNINGS=error in bazel tests.

2024-09-24 12:30:11 -07:00

array_test.py

Do not allow None axis names in meshes.

2024-10-16 10:32:25 -07:00

attrs_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

batching_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

blocked_sampler_test.py

[Pallas] Implement block-invariant sampling.

2024-06-24 11:20:39 -07:00

BUILD

Add config option to log or fatal when jax.Arrays are GCed.

2024-10-17 12:23:16 -07:00

cache_key_test.py

Squashed commit of the following:

2024-09-10 17:30:08 -07:00

checkify_test.py

add checkify rule for remat

2024-10-01 02:01:18 +00:00

cholesky_update_test.py

Bump minimum jaxlib version to v0.4.30.

2024-06-18 12:35:08 -04:00

clear_backends_test.py

Avoid 'from jax import config' imports

2024-04-11 13:23:27 -07:00

compilation_cache_test.py

Delete jax.lib.xla_client.execute_with_python_values.

2024-10-01 14:32:22 -07:00

config_test.py

Set the value of config.jax_platforms directly instead of setting the env variable JAX_PLATFORMS. Setting JAX_PLATFORMS doesn’t do anything because config.jax_platforms is already initialized at that point.

2024-07-22 15:09:15 -07:00

core_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

cudnn_fusion_test.py

Disable cudnn_fusion_test on A100.

2024-10-01 10:18:41 -07:00

custom_linear_solve_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

custom_root_test.py

Avoid 'from jax import config' imports

2024-04-11 13:23:27 -07:00

debug_nans_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

debugger_test.py

test cleanup: use ExitStack to reduce test boilerplate

2024-06-06 14:18:27 -07:00

debugging_primitives_test.py

Make debug.print work with static args. Fixes: https://github.com/google/jax/issues/23600

2024-09-18 08:41:29 -07:00

deprecation_test.py

Fix incorrect usage of assertWarns in tests

2024-07-24 14:16:51 -07:00

device_test.py

Bump minimum jaxlib version to 0.4.31. The corresponding xla_extension_version is 279 and mlir_api_version is 57

2024-07-29 18:44:31 -07:00

dtypes_test.py

simplify conversion logic involving extended dtypes

2024-09-25 00:10:01 +00:00

dynamic_api_test.py

simplify conversion logic involving extended dtypes

2024-09-25 00:10:01 +00:00

errors_test.py

Add jax.errors.JaxRuntimeError as a public alias for the XlaRuntimeError class.

2024-09-26 08:39:30 -07:00

experimental_rnn_test.py

MAINT Do not import the config object in JAX internals

2023-10-18 10:55:13 +01:00

export_back_compat_test.py

Activate the FFI implementation of SVD on GPU.

2024-10-17 17:57:06 -07:00

export_harnesses_multi_platform_test.py

Disable many eigh tests.

2024-08-30 09:09:37 -07:00

export_test.py

[export] Add support for serialization for some custom PyTree nodes

2024-10-21 11:38:13 +02:00

extend_test.py

Merge pull request #21524 from andportnoy:aportnoy/unknown-platform-lowering-warning

2024-10-22 11:40:39 -07:00

fft_test.py

Remove checks for jaxlib v0.4.33 in tests

2024-10-11 15:39:24 -04:00

for_loop_test.py

Relax some test tolerances in for_loop_test.py.

2024-09-08 12:09:45 -07:00

fused_attention_stablehlo_test.py

fix bwd batcher for unsupported dbias

2024-09-23 17:43:25 +00:00

garbage_collection_guard_test.py

Finish 0.4.35 release by removing dead code

2024-10-24 08:45:43 -07:00

generated_fun_test.py

Avoid 'from jax import config' imports

2024-04-11 13:23:27 -07:00

gpu_memory_flags_test.py

Add CUDA custom call example as a JAX test

2024-06-17 15:21:49 -04:00

heap_profiler_test.py

Avoid 'from jax import config' imports

2024-04-11 13:23:27 -07:00

image_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

infeed_test.py

[host_callback] Remove most of the jax.experimental.host_callback module

2024-10-06 01:10:34 -07:00

jax_jit_test.py

MAINT Migrate remaining internal/test modules to use state objects

2023-10-12 17:32:15 +01:00

jax_to_ir_test.py

[jax2tf] Remove non-native serialization test from jax_to_ir_test

2024-10-07 04:21:38 -07:00

jaxpr_effects_test.py

Delete xmap and the jax.experimental.maps module. It's been 5 months since its deprecation (more than the standard 3 months deprecation period).

2024-07-24 10:24:09 -07:00

jaxpr_util_test.py

add pjit forwarding rule

2024-05-25 17:46:01 +00:00

jet_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

key_reuse_test.py

[key reuse] handle reuse of closed-over constants

2024-04-11 15:39:45 -07:00

lax_autodiff_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

lax_control_flow_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

lax_metal_test.py

adopt jax.extend.backend

2024-10-07 12:27:35 -07:00

lax_numpy_einsum_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

lax_numpy_indexing_test.py

Added scatter_sub_p

2024-10-03 00:27:31 -07:00

lax_numpy_operators_test.py

Implement jax.numpy.spacing

2024-10-03 10:40:39 -07:00

lax_numpy_reducers_test.py

Fix an incorrect output for jnp.cumsum.

2024-09-24 14:46:44 +00:00

lax_numpy_test.py

Perform searchsorted binary search using unsigned intermediate values.

2024-10-23 15:11:55 -04:00

lax_numpy_ufuncs_test.py

Make jnp.subtract a ufunc

2024-10-21 10:11:51 -07:00

lax_numpy_vectorize_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

lax_scipy_sparse_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

lax_scipy_special_functions_test.py

feat(lib): add real-valued implementation of jax.scipy.special.fresnel

2024-09-03 09:50:19 +02:00

lax_scipy_spectral_dac_test.py

Avoid 'from jax import config' imports

2024-04-11 13:23:27 -07:00

lax_scipy_test.py

Tighten test tolerances after the underlying issue causing nondeterministic results for _nrm2 in Eigen BLAS was fixed in https://gitlab.com/libeigen/eigen/-/merge_requests/1667 -> cl/663346025

2024-09-20 10:03:46 -07:00

lax_test.py

Dot algorithms are now supported for all types, change the test to reflect it.

2024-10-23 11:17:55 -07:00

lax_vmap_op_test.py

Avoid 'from jax import config' imports

2024-04-11 13:23:27 -07:00

lax_vmap_test.py

Add lax.FftType.

2024-10-10 08:07:35 -07:00

layout_test.py

Don't add mhlo.layout_mode = "default" since that is the default even in PJRT and will help reduce cruft in the IR

2024-10-11 14:54:32 -07:00

lazy_loader_test.py

lazy_loader_module: Move to new internal_test_util directory.

2023-03-10 10:29:33 -08:00

linalg_test.py

Activate FFI implementation of the QR decomposition.

2024-10-04 07:27:11 -07:00

lobpcg_test.py

Removed mentions of iree from the test suite

2024-05-24 10:31:57 +01:00

logging_test.py

Change asan build to use a self-hosted runner and Ubuntu 24.04.

2024-10-03 12:42:59 -04:00

lru_cache_test.py

Storing the last access time of a cache entry in a separate file

2024-07-03 13:54:36 +04:00

memories_test.py

Finish 0.4.35 release by removing dead code

2024-10-24 08:45:43 -07:00

mesh_utils_test.py

Use Iota order for certain v5e with 8 devices.

2024-10-15 13:53:01 -07:00

metadata_test.py

Disable test_source_file_prefix_removal test because there is cross-contamination of metadata information from different call sites because of cached jitted functions

2024-07-12 12:07:24 -07:00

mock_gpu_test.py

Rename mock_num_processes to mock_num_gpu_processes since this flag is only for GPUs. The naming change was a regression introduced in https://github.com/google/jax/pull/22619

2024-07-31 10:41:03 -07:00

monitoring_test.py

Allow duration event listeners to take extra keyword arguments.

2023-10-04 13:15:49 -07:00

mosaic_test.py

Avoid 'from jax import config' imports

2024-04-11 13:23:27 -07:00

multi_device_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

multibackend_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

multiprocess_gpu_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

mutable_array_test.py

Fix mutable array effects not being tracked properly

2024-09-30 18:55:15 -07:00

name_stack_test.py

Replace xla_computation in name_stack_test with jit(f).lower(...).compiler_ir()

2024-06-12 18:57:20 -07:00

nn_test.py

Adjusted atol/rtol for jax sdpa tests

2024-10-21 17:00:04 +00:00

ode_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

optimizers_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

package_structure_test.py

Add jax.errors.JaxRuntimeError as a public alias for the XlaRuntimeError class.

2024-09-26 08:39:30 -07:00

pgle_test.py

Disable breaking test-case

2024-10-18 08:54:36 -07:00

pickle_test.py

Avoid 'from jax import config' imports

2024-04-11 13:23:27 -07:00

pjit_test.py

Add sharding rules to some more primitives so that backward pass of minformer passes. There are a couple of changes here:

2024-10-25 10:35:25 -07:00

pmap_test.py

Set PYTHONWARNINGS=error in bazel tests.

2024-09-24 12:30:11 -07:00

polynomial_test.py

Avoid 'from jax import config' imports

2024-04-11 13:23:27 -07:00

pretty_printer_test.py

Compute source maps when pretty-printing jaxprs.

2024-05-06 15:45:25 -04:00

profiler_test.py

Support pathlib.Path input to start_trace

2024-07-19 23:41:02 +03:00

python_callback_test.py

Rename vmap methods for callbacks.

2024-10-21 15:03:04 -04:00

pytorch_interoperability_test.py

Set PYTHONWARNINGS=error in bazel tests.

2024-09-24 12:30:11 -07:00

qdwh_test.py

Bump up tolerance for tests using _testQdwh.

2024-06-14 23:18:20 -07:00

random_lax_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

random_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

scipy_fft_test.py

Fix dtype bug in jax.scipy.fft.idct

2024-09-25 12:55:43 -04:00

scipy_interpolate_test.py

Avoid 'from jax import config' imports

2024-04-11 13:23:27 -07:00

scipy_ndimage_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

scipy_optimize_test.py

Fix some warnings causing CI failures on ARM.

2024-09-24 17:25:26 -07:00

scipy_signal_test.py

Avoid 'from jax import config' imports

2024-04-11 13:23:27 -07:00

scipy_spatial_test.py

Add scalar_first argument to jax.scipy.spatial.transform.Rotation.as_quat

2024-09-16 21:57:55 +02:00

scipy_stats_test.py

Remove warning filters from pyproject.toml, add local warning

2024-09-24 01:38:24 +00:00

shape_poly_test.py

[shape_poly] Expands support for random.choice

2024-10-24 17:20:09 +03:00

shard_alike_test.py

Rename jtu.create_global_mesh to jtu.create_mesh and use jax.make_mesh inside jtu.create_mesh to get maximum test coverage of the new API.

2024-09-03 16:23:07 -07:00

shard_map_test.py

Fix float0 behavior inside shard_map transpose under scan.

2024-10-24 14:15:40 -07:00

source_info_test.py

Avoid 'from jax import config' imports

2024-04-11 13:23:27 -07:00

sourcemap_test.py

Merge pull request #21096 from gspschmid:gschmid/sourcemaps

2024-05-08 05:44:08 -07:00

sparse_bcoo_bcsr_test.py

Set PYTHONWARNINGS=error in bazel tests.

2024-09-24 12:30:11 -07:00

sparse_nm_test.py

Disable tests that trigger warning if x64 mode isn't enabled.

2024-05-10 19:58:22 +00:00

sparse_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

sparsify_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

stack_test.py

Avoid 'from jax import config' imports

2024-04-11 13:23:27 -07:00

state_test.py

Add an extension mechanism to run_state that allows:

2024-10-23 08:00:56 -07:00

stax_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

svd_test.py

Bump some SVD test tolerances.

2024-07-15 12:54:00 -07:00

transfer_guard_test.py

fix some additional warnings related to #21834

2024-06-13 16:06:14 -07:00

tree_util_test.py

Merge pull request #23684 from simonster:sjk/fix-prefix-error

2024-10-15 09:32:30 -07:00

typing_test.py

Upgrade remaining sources to Python 3.9

2023-12-13 10:29:45 +00:00

util_test.py

Avoid 'from jax import config' imports

2024-04-11 13:23:27 -07:00

version_test.py

Add more extensive tests for version strings

2023-09-08 11:33:49 -07:00

x64_context_test.py

Update references to the GitHub url in JAX codebase to reflect move from google/jax to jax-ml/jax

2024-09-20 07:52:33 -07:00

xla_bridge_test.py

Remove classic HLO lowering rule support from JAX.

2024-10-07 09:06:20 -07:00

xla_interpreter_test.py

Move some utilities out of dispatch.py next to their users, add more types.

2023-08-08 10:52:11 -07:00

xla_metadata_test.py

Add frontend attributes to Jax. This allows Jax users to annotate Jax code with frontend_attributes which can be traced down to the HLO level, to be used for numerical debugging purposes.

2024-09-06 16:44:56 -07:00