mirror of
https://github.com/ROCm/jax.git
synced 2025-04-14 10:56:06 +00:00
120125f3dd
This change also marks multiaccelerator test files in a way pytest can understand (if pytest is installed). By running single-device tests on a single TPU chip, running the test suite goes from 1hr 45m to 35m (both timings are running slow tests). I tried using bazel at first, which already supported parallel execution across TPU cores, but somehow it still takes 2h 20m! I'm not sure why it's so slow. It appears that bazel creates many new test processes over time, vs. pytest reuses the number of processes initially specified, and starting and stopping the TPU runtime takes a few seconds so that may be adding up. It also appears that single-process bazel is slower than single-process pytest, which I haven't looked into yet.
28 lines
1.5 KiB
INI
28 lines
1.5 KiB
INI
[pytest]
|
|
markers =
|
|
multiaccelerator: indicates that a test can make use of and possibly requires multiple accelerators
|
|
SlurmMultiNodeGpuTest: mark a test for Slurm multinode GPU nightly CI
|
|
filterwarnings =
|
|
error
|
|
ignore:No GPU/TPU found, falling back to CPU.:UserWarning
|
|
ignore:outfeed_receiver is unnecessary and deprecated:DeprecationWarning
|
|
# xmap
|
|
ignore:xmap is an experimental feature and probably has bugs!
|
|
# The rest are for experimental/jax_to_tf
|
|
ignore:the imp module is deprecated in favour of importlib.*:DeprecationWarning
|
|
ignore:can't resolve package from __spec__ or __package__:ImportWarning
|
|
ignore:Using or importing the ABCs.*:DeprecationWarning
|
|
# jax2tf tests due to mix of JAX and TF
|
|
ignore:numpy.ufunc size changed
|
|
ignore:.*experimental feature
|
|
ignore:index.*is deprecated.*:DeprecationWarning
|
|
ignore:jax.experimental.* is deprecated, import jax.example_libraries.* instead:FutureWarning
|
|
# numpy uses distutils which is deprecated
|
|
ignore:The distutils.* is deprecated.*:DeprecationWarning
|
|
ignore:`sharded_jit` is deprecated. Please use `pjit` instead.*:DeprecationWarning
|
|
# Print message for compilation_cache_test.py::CompilationCacheTest::test_cache_read/write_warning
|
|
default:Error reading persistent compilation cache entry for 'jit__lambda_'
|
|
default:Error writing persistent compilation cache entry for 'jit__lambda_'
|
|
doctest_optionflags = NUMBER NORMALIZE_WHITESPACE
|
|
addopts = --doctest-glob="*.rst"
|