==================== Test output for //tensorflow/python/data/kernel_tests:snapshot_test (shard 6 of 16): 2023-06-17 06:55:49.358160: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. Running tests under Python 3.11.4: /usr/local/bin/python3 [ RUN ] LegacySnapshotCheckpointTest.testCheckpointAfterOneEpochThenRunFewSteps_test_mode_graph_tfapiversion_1_pendingsnapshotexpiryseconds_None [ SKIPPED ] LegacySnapshotCheckpointTest.testCheckpointAfterOneEpochThenRunFewSteps_test_mode_graph_tfapiversion_1_pendingsnapshotexpiryseconds_None INFO:tensorflow:time(__main__.LegacySnapshotCheckpointTest.testCheckpointAfterOneEpochThenRunFewSteps_test_mode_graph_tfapiversion_1_pendingsnapshotexpiryseconds_None): 0.0s I0617 06:55:53.043796 281473522103168 test_util.py:2464] time(__main__.LegacySnapshotCheckpointTest.testCheckpointAfterOneEpochThenRunFewSteps_test_mode_graph_tfapiversion_1_pendingsnapshotexpiryseconds_None): 0.0s [ RUN ] LegacySnapshotCheckpointTest.testCheckpointBeforeOneEpochThenRunFewStepsMultipleThreads_test_mode_graph_tfapiversion_1_pendingsnapshotexpiryseconds_None [ SKIPPED ] LegacySnapshotCheckpointTest.testCheckpointBeforeOneEpochThenRunFewStepsMultipleThreads_test_mode_graph_tfapiversion_1_pendingsnapshotexpiryseconds_None INFO:tensorflow:time(__main__.LegacySnapshotCheckpointTest.testCheckpointBeforeOneEpochThenRunFewStepsMultipleThreads_test_mode_graph_tfapiversion_1_pendingsnapshotexpiryseconds_None): 0.0s I0617 06:55:53.044975 281473522103168 test_util.py:2464] time(__main__.LegacySnapshotCheckpointTest.testCheckpointBeforeOneEpochThenRunFewStepsMultipleThreads_test_mode_graph_tfapiversion_1_pendingsnapshotexpiryseconds_None): 0.0s [ RUN ] LegacySnapshotCheckpointTest.testSnapshotBeforeEpochEnd_test_mode_eager_tfapiversion_1_pendingsnapshotexpiryseconds_None [ SKIPPED ] LegacySnapshotCheckpointTest.testSnapshotBeforeEpochEnd_test_mode_eager_tfapiversion_1_pendingsnapshotexpiryseconds_None INFO:tensorflow:time(__main__.LegacySnapshotCheckpointTest.testSnapshotBeforeEpochEnd_test_mode_eager_tfapiversion_1_pendingsnapshotexpiryseconds_None): 0.0s I0617 06:55:53.045897 281473522103168 test_util.py:2464] time(__main__.LegacySnapshotCheckpointTest.testSnapshotBeforeEpochEnd_test_mode_eager_tfapiversion_1_pendingsnapshotexpiryseconds_None): 0.0s [ RUN ] LegacySnapshotTest.testForcePassthroughMode_test_mode_eager_tfapiversion_1 [ SKIPPED ] LegacySnapshotTest.testForcePassthroughMode_test_mode_eager_tfapiversion_1 INFO:tensorflow:time(__main__.LegacySnapshotTest.testForcePassthroughMode_test_mode_eager_tfapiversion_1): 0.0s I0617 06:55:53.047468 281473522103168 test_util.py:2464] time(__main__.LegacySnapshotTest.testForcePassthroughMode_test_mode_eager_tfapiversion_1): 0.0s [ RUN ] LegacySnapshotTest.testForceWriteMode_test_mode_eager_tfapiversion_1 [ SKIPPED ] LegacySnapshotTest.testForceWriteMode_test_mode_eager_tfapiversion_1 INFO:tensorflow:time(__main__.LegacySnapshotTest.testForceWriteMode_test_mode_eager_tfapiversion_1): 0.0s I0617 06:55:53.048995 281473522103168 test_util.py:2464] time(__main__.LegacySnapshotTest.testForceWriteMode_test_mode_eager_tfapiversion_1): 0.0s [ RUN ] LegacySnapshotTest.testReadSnapshotBackAfterMultiThreadedWrite_test_mode_eager_tfapiversion_1_compression_GZIP_size_1_threads_2 [ SKIPPED ] LegacySnapshotTest.testReadSnapshotBackAfterMultiThreadedWrite_test_mode_eager_tfapiversion_1_compression_GZIP_size_1_threads_2 INFO:tensorflow:time(__main__.LegacySnapshotTest.testReadSnapshotBackAfterMultiThreadedWrite_test_mode_eager_tfapiversion_1_compression_GZIP_size_1_threads_2): 0.0s I0617 06:55:53.050451 281473522103168 test_util.py:2464] time(__main__.LegacySnapshotTest.testReadSnapshotBackAfterMultiThreadedWrite_test_mode_eager_tfapiversion_1_compression_GZIP_size_1_threads_2): 0.0s [ RUN ] LegacySnapshotTest.testReadSnapshotBackAfterMultiThreadedWrite_test_mode_eager_tfapiversion_2_compression_None_size_1_threads_8 WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/data/kernel_tests/snapshot_test.runfiles/org_tensorflow/tensorflow/python/data/kernel_tests/snapshot_test.py:861: legacy_snapshot (from tensorflow.python.data.experimental.ops.snapshot) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.data.Dataset.shapshot(...)` instead. W0617 06:55:53.138008 281473522103168 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/data/kernel_tests/snapshot_test.runfiles/org_tensorflow/tensorflow/python/data/kernel_tests/snapshot_test.py:861: legacy_snapshot (from tensorflow.python.data.experimental.ops.snapshot) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.data.Dataset.shapshot(...)` instead. 2023-06-17 06:55:53.144315: I tensorflow/core/data/snapshot_utils.cc:1064] Graph hash is eef839c186074fc6, writing to /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/c19bb39d47b7a48b3a8b9cfccaae73708a22nvhx/tmp1y5kekti/snapshot/eef839c186074fc6-graph.pbtxt 2023-06-17 06:55:53.146248: I tensorflow/core/kernels/data/experimental/snapshot_dataset_op.cc:927] Graph def serialized to hash: eef839c186074fc6 2023-06-17 06:55:53.163724: I tensorflow/core/data/snapshot_utils.cc:1064] Graph hash is eef839c186074fc6, writing to /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/c19bb39d47b7a48b3a8b9cfccaae73708a22nvhx/tmp1y5kekti/snapshot/eef839c186074fc6-graph.pbtxt 2023-06-17 06:55:53.226208: I tensorflow/core/kernels/data/experimental/snapshot_dataset_op.cc:927] Graph def serialized to hash: eef839c186074fc6 2023-06-17 06:55:53.422256: I tensorflow/core/data/snapshot_utils.cc:1064] Graph hash is eef839c186074fc6, writing to /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/c19bb39d47b7a48b3a8b9cfccaae73708a22nvhx/tmp1y5kekti/snapshot/eef839c186074fc6-graph.pbtxt 2023-06-17 06:55:53.436874: I tensorflow/core/kernels/data/experimental/snapshot_dataset_op.cc:927] Graph def serialized to hash: eef839c186074fc6 2023-06-17 06:55:53.448905: I tensorflow/core/data/snapshot_utils.cc:1064] Graph hash is eef839c186074fc6, writing to /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/c19bb39d47b7a48b3a8b9cfccaae73708a22nvhx/tmp1y5kekti/snapshot/eef839c186074fc6-graph.pbtxt 2023-06-17 06:55:53.493302: I tensorflow/core/kernels/data/experimental/snapshot_dataset_op.cc:927] Graph def serialized to hash: eef839c186074fc6 INFO:tensorflow:time(__main__.LegacySnapshotTest.testReadSnapshotBackAfterMultiThreadedWrite_test_mode_eager_tfapiversion_2_compression_None_size_1_threads_8): 0.83s I0617 06:55:53.877493 281473522103168 test_util.py:2464] time(__main__.LegacySnapshotTest.testReadSnapshotBackAfterMultiThreadedWrite_test_mode_eager_tfapiversion_2_compression_None_size_1_threads_8): 0.83s [ OK ] LegacySnapshotTest.testReadSnapshotBackAfterMultiThreadedWrite_test_mode_eager_tfapiversion_2_compression_None_size_1_threads_8 [ RUN ] LegacySnapshotTest.testReadSnapshotBackAfterMultiThreadedWrite_test_mode_graph_tfapiversion_2_compression_GZIP_size_2_threads_2 WARNING:tensorflow:From /usr/lib/python3.11/contextlib.py:105: TensorFlowTestCase.test_session (from tensorflow.python.framework.test_util) is deprecated and will be removed in a future version. Instructions for updating: Use `self.session()` or `self.cached_session()` instead. W0617 06:55:53.900671 281473522103168 deprecation.py:364] From /usr/lib/python3.11/contextlib.py:105: TensorFlowTestCase.test_session (from tensorflow.python.framework.test_util) is deprecated and will be removed in a future version. Instructions for updating: Use `self.session()` or `self.cached_session()` instead. 2023-06-17 06:55:53.907491: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:382] MLIR V1 optimization pass is not enabled 2023-06-17 06:55:53.923657: I tensorflow/core/data/snapshot_utils.cc:1064] Graph hash is 6b074dea78d573ba, writing to /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/c19bb39d47b7a48b3a8b9cfccaae73708a22nvhx/tmprvpsan7v/snapshot/6b074dea78d573ba-graph.pbtxt 2023-06-17 06:55:53.924271: I tensorflow/core/kernels/data/experimental/snapshot_dataset_op.cc:927] Graph def serialized to hash: 6b074dea78d573ba 2023-06-17 06:55:53.928673: I tensorflow/core/data/snapshot_utils.cc:1064] Graph hash is 6b074dea78d573ba, writing to /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/c19bb39d47b7a48b3a8b9cfccaae73708a22nvhx/tmprvpsan7v/snapshot/6b074dea78d573ba-graph.pbtxt 2023-06-17 06:55:53.929903: I tensorflow/core/kernels/data/experimental/snapshot_dataset_op.cc:927] Graph def serialized to hash: 6b074dea78d573ba 2023-06-17 06:55:54.187416: I tensorflow/core/data/snapshot_utils.cc:1064] Graph hash is 6b074dea78d573ba, writing to /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/c19bb39d47b7a48b3a8b9cfccaae73708a22nvhx/tmprvpsan7v/snapshot/6b074dea78d573ba-graph.pbtxt 2023-06-17 06:55:54.188049: I tensorflow/core/kernels/data/experimental/snapshot_dataset_op.cc:927] Graph def serialized to hash: 6b074dea78d573ba 2023-06-17 06:55:54.192528: I tensorflow/core/data/snapshot_utils.cc:1064] Graph hash is 6b074dea78d573ba, writing to /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/c19bb39d47b7a48b3a8b9cfccaae73708a22nvhx/tmprvpsan7v/snapshot/6b074dea78d573ba-graph.pbtxt 2023-06-17 06:55:54.193140: I tensorflow/core/kernels/data/experimental/snapshot_dataset_op.cc:927] Graph def serialized to hash: 6b074dea78d573ba INFO:tensorflow:time(__main__.LegacySnapshotTest.testReadSnapshotBackAfterMultiThreadedWrite_test_mode_graph_tfapiversion_2_compression_GZIP_size_2_threads_2): 0.43s I0617 06:55:54.307942 281473522103168 test_util.py:2464] time(__main__.LegacySnapshotTest.testReadSnapshotBackAfterMultiThreadedWrite_test_mode_graph_tfapiversion_2_compression_GZIP_size_2_threads_2): 0.43s [ OK ] LegacySnapshotTest.testReadSnapshotBackAfterMultiThreadedWrite_test_mode_graph_tfapiversion_2_compression_GZIP_size_2_threads_2 [ RUN ] LegacySnapshotTest.testReadSnapshotBackAfterWrite_test_mode_graph_tfapiversion_1_compression_SNAPPY [ SKIPPED ] LegacySnapshotTest.testReadSnapshotBackAfterWrite_test_mode_graph_tfapiversion_1_compression_SNAPPY INFO:tensorflow:time(__main__.LegacySnapshotTest.testReadSnapshotBackAfterWrite_test_mode_graph_tfapiversion_1_compression_SNAPPY): 0.0s I0617 06:55:54.351017 281473522103168 test_util.py:2464] time(__main__.LegacySnapshotTest.testReadSnapshotBackAfterWrite_test_mode_graph_tfapiversion_1_compression_SNAPPY): 0.0s [ RUN ] LegacySnapshotTest.testSameFingerprintWithDifferentInitializationOrder_test_mode_eager_tfapiversion_1 [ SKIPPED ] LegacySnapshotTest.testSameFingerprintWithDifferentInitializationOrder_test_mode_eager_tfapiversion_1 INFO:tensorflow:time(__main__.LegacySnapshotTest.testSameFingerprintWithDifferentInitializationOrder_test_mode_eager_tfapiversion_1): 0.0s I0617 06:55:54.352626 281473522103168 test_util.py:2464] time(__main__.LegacySnapshotTest.testSameFingerprintWithDifferentInitializationOrder_test_mode_eager_tfapiversion_1): 0.0s [ RUN ] LegacySnapshotTest.testSpecifyShardSize_test_mode_graph_tfapiversion_1_compression_SNAPPY [ SKIPPED ] LegacySnapshotTest.testSpecifyShardSize_test_mode_graph_tfapiversion_1_compression_SNAPPY INFO:tensorflow:time(__main__.LegacySnapshotTest.testSpecifyShardSize_test_mode_graph_tfapiversion_1_compression_SNAPPY): 0.0s I0617 06:55:54.354093 281473522103168 test_util.py:2464] time(__main__.LegacySnapshotTest.testSpecifyShardSize_test_mode_graph_tfapiversion_1_compression_SNAPPY): 0.0s [ RUN ] LegacySnapshotTest.testWriteSnapshotMixTypes_test_mode_eager_tfapiversion_2_compression_None 2023-06-17 06:55:54.441887: I tensorflow/core/data/snapshot_utils.cc:1064] Graph hash is af72c093f38b78a2, writing to /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/c19bb39d47b7a48b3a8b9cfccaae73708a22nvhx/tmpkoe270ez/snapshot/af72c093f38b78a2-graph.pbtxt 2023-06-17 06:55:54.442950: I tensorflow/core/kernels/data/experimental/snapshot_dataset_op.cc:927] Graph def serialized to hash: af72c093f38b78a2 2023-06-17 06:55:54.479260: I tensorflow/core/data/snapshot_utils.cc:1064] Graph hash is f7a056a931e08ca3, writing to /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/c19bb39d47b7a48b3a8b9cfccaae73708a22nvhx/tmpkoe270ez/snapshot/f7a056a931e08ca3-graph.pbtxt 2023-06-17 06:55:54.480108: I tensorflow/core/kernels/data/experimental/snapshot_dataset_op.cc:927] Graph def serialized to hash: f7a056a931e08ca3 INFO:tensorflow:time(__main__.LegacySnapshotTest.testWriteSnapshotMixTypes_test_mode_eager_tfapiversion_2_compression_None): 0.77s I0617 06:55:55.123072 281473522103168 test_util.py:2464] time(__main__.LegacySnapshotTest.testWriteSnapshotMixTypes_test_mode_eager_tfapiversion_2_compression_None): 0.77s [ OK ] LegacySnapshotTest.testWriteSnapshotMixTypes_test_mode_eager_tfapiversion_2_compression_None [ RUN ] LegacySnapshotTest.testWriteSnapshotRepeatAfterwards_test_mode_eager_tfapiversion_2_compression_None 2023-06-17 06:55:55.133381: I tensorflow/core/data/snapshot_utils.cc:1064] Graph hash is 3788b1e2084a12ef, writing to /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/c19bb39d47b7a48b3a8b9cfccaae73708a22nvhx/tmp90hlqnli/snapshot/3788b1e2084a12ef-graph.pbtxt 2023-06-17 06:55:55.133845: I tensorflow/core/kernels/data/experimental/snapshot_dataset_op.cc:927] Graph def serialized to hash: 3788b1e2084a12ef 2023-06-17 06:55:55.143874: I tensorflow/core/data/snapshot_utils.cc:1064] Graph hash is 3788b1e2084a12ef, writing to /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/c19bb39d47b7a48b3a8b9cfccaae73708a22nvhx/tmp90hlqnli/snapshot/3788b1e2084a12ef-graph.pbtxt 2023-06-17 06:55:55.241780: I tensorflow/core/kernels/data/experimental/snapshot_dataset_op.cc:927] Graph def serialized to hash: 3788b1e2084a12ef INFO:tensorflow:time(__main__.LegacySnapshotTest.testWriteSnapshotRepeatAfterwards_test_mode_eager_tfapiversion_2_compression_None): 0.26s I0617 06:55:55.384092 281473522103168 test_util.py:2464] time(__main__.LegacySnapshotTest.testWriteSnapshotRepeatAfterwards_test_mode_eager_tfapiversion_2_compression_None): 0.26s [ OK ] LegacySnapshotTest.testWriteSnapshotRepeatAfterwards_test_mode_eager_tfapiversion_2_compression_None [ RUN ] LegacySnapshotTest.testWriteSnapshotSimpleSuccessful_test_mode_graph_tfapiversion_1_compression_SNAPPY [ SKIPPED ] LegacySnapshotTest.testWriteSnapshotSimpleSuccessful_test_mode_graph_tfapiversion_1_compression_SNAPPY INFO:tensorflow:time(__main__.LegacySnapshotTest.testWriteSnapshotSimpleSuccessful_test_mode_graph_tfapiversion_1_compression_SNAPPY): 0.0s I0617 06:55:55.387430 281473522103168 test_util.py:2464] time(__main__.LegacySnapshotTest.testWriteSnapshotSimpleSuccessful_test_mode_graph_tfapiversion_1_compression_SNAPPY): 0.0s [ RUN ] SnapshotCheckpointTest.testCheckpointBeforeEpochEndNoRepeat_test_mode_graph_tfapiversion_2 /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/data/kernel_tests/snapshot_test.runfiles/org_tensorflow/tensorflow/python/data/ops/dataset_ops.py:458: UserWarning: To make it possible to preserve tf.data options across serialization boundaries, their implementation has moved to be part of the TensorFlow graph. As a consequence, the options value is in general no longer known at graph construction time. Invoking this method in graph mode retains the legacy behavior of the original implementation, but note that the returned value might not reflect the actual value of the options. warnings.warn("To make it possible to preserve tf.data options across " WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/data/kernel_tests/snapshot_test.runfiles/org_tensorflow/tensorflow/python/data/kernel_tests/checkpoint_test_base.py:519: make_saveable_from_iterator (from tensorflow.python.data.experimental.ops.iterator_ops) is deprecated and will be removed in a future version. Instructions for updating: `make_saveable_from_iterator` is intended for use in TF1 with `tf.compat.v1.Saver`. In TF2, use `tf.train.Checkpoint` instead. W0617 06:55:55.454572 281473522103168 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/data/kernel_tests/snapshot_test.runfiles/org_tensorflow/tensorflow/python/data/kernel_tests/checkpoint_test_base.py:519: make_saveable_from_iterator (from tensorflow.python.data.experimental.ops.iterator_ops) is deprecated and will be removed in a future version. Instructions for updating: `make_saveable_from_iterator` is intended for use in TF1 with `tf.compat.v1.Saver`. In TF2, use `tf.train.Checkpoint` instead. 2023-06-17 06:55:55.582189: I tensorflow/core/grappler/optimizers/data/replicate_on_split.cc:32] Running replicate on split optimization 2023-06-17 06:55:55.923881: I tensorflow/core/grappler/optimizers/data/replicate_on_split.cc:32] Running replicate on split optimization INFO:tensorflow:Restoring parameters from /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/c19bb39d47b7a48b3a8b9cfccaae73708a22nvhx/tmp9uojri8d/iterator I0617 06:55:56.028308 281473522103168 saver.py:1413] Restoring parameters from /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/c19bb39d47b7a48b3a8b9cfccaae73708a22nvhx/tmp9uojri8d/iterator INFO:tensorflow:time(__main__.SnapshotCheckpointTest.testCheckpointBeforeEpochEndNoRepeat_test_mode_graph_tfapiversion_2): 0.85s I0617 06:55:56.236824 281473522103168 test_util.py:2464] time(__main__.SnapshotCheckpointTest.testCheckpointBeforeEpochEndNoRepeat_test_mode_graph_tfapiversion_2): 0.85s [ OK ] SnapshotCheckpointTest.testCheckpointBeforeEpochEndNoRepeat_test_mode_graph_tfapiversion_2 [ RUN ] SnapshotTest.testReadOptimizableUsingFlatMap_test_mode_eager_tfapiversion_2 2023-06-17 06:55:56.281325: I tensorflow/core/grappler/optimizers/data/replicate_on_split.cc:32] Running replicate on split optimization INFO:tensorflow:time(__main__.SnapshotTest.testReadOptimizableUsingFlatMap_test_mode_eager_tfapiversion_2): 1.78s I0617 06:55:58.017991 281473522103168 test_util.py:2464] time(__main__.SnapshotTest.testReadOptimizableUsingFlatMap_test_mode_eager_tfapiversion_2): 1.78s [ OK ] SnapshotTest.testReadOptimizableUsingFlatMap_test_mode_eager_tfapiversion_2 [ RUN ] SnapshotTest.testReadSnapshotDatasetDefault_test_mode_eager_tfapiversion_2 2023-06-17 06:55:58.164196: I tensorflow/core/grappler/optimizers/data/replicate_on_split.cc:32] Running replicate on split optimization 2023-06-17 06:55:59.523667: I tensorflow/core/grappler/optimizers/data/replicate_on_split.cc:32] Running replicate on split optimization INFO:tensorflow:time(__main__.SnapshotTest.testReadSnapshotDatasetDefault_test_mode_eager_tfapiversion_2): 2.23s I0617 06:56:00.264090 281473522103168 test_util.py:2464] time(__main__.SnapshotTest.testReadSnapshotDatasetDefault_test_mode_eager_tfapiversion_2): 2.23s [ OK ] SnapshotTest.testReadSnapshotDatasetDefault_test_mode_eager_tfapiversion_2 [ RUN ] SnapshotTest.testSnapshotDatasetInvalidReaderFn_test_mode_eager_tfapiversion_2 2023-06-17 06:56:00.285957: I tensorflow/core/grappler/optimizers/data/replicate_on_split.cc:32] Running replicate on split optimization INFO:tensorflow:time(__main__.SnapshotTest.testSnapshotDatasetInvalidReaderFn_test_mode_eager_tfapiversion_2): 0.23s I0617 06:56:00.511415 281473522103168 test_util.py:2464] time(__main__.SnapshotTest.testSnapshotDatasetInvalidReaderFn_test_mode_eager_tfapiversion_2): 0.23s [ OK ] SnapshotTest.testSnapshotDatasetInvalidReaderFn_test_mode_eager_tfapiversion_2 [ RUN ] SnapshotTest.testWriteSnapshotDatasetSameFingerprintIncompleteRunRestart_test_mode_eager_tfapiversion_2 2023-06-17 06:56:00.521294: I tensorflow/core/grappler/optimizers/data/replicate_on_split.cc:32] Running replicate on split optimization 2023-06-17 06:56:00.855745: I tensorflow/core/grappler/optimizers/data/replicate_on_split.cc:32] Running replicate on split optimization [ FAILED ] SnapshotTest.testWriteSnapshotDatasetSameFingerprintIncompleteRunRestart_test_mode_eager_tfapiversion_2 INFO:tensorflow:time(__main__.SnapshotTest.testWriteSnapshotDatasetSameFingerprintIncompleteRunRestart_test_mode_eager_tfapiversion_2): 0.93s I0617 06:56:01.441276 281473522103168 test_util.py:2464] time(__main__.SnapshotTest.testWriteSnapshotDatasetSameFingerprintIncompleteRunRestart_test_mode_eager_tfapiversion_2): 0.93s [ RUN ] SnapshotTest.testWriteSnapshotShuffleSameFingerprint_test_mode_eager_tfapiversion_2 2023-06-17 06:56:01.481021: I tensorflow/core/grappler/optimizers/data/replicate_on_split.cc:32] Running replicate on split optimization 2023-06-17 06:56:01.923578: I tensorflow/core/grappler/optimizers/data/replicate_on_split.cc:32] Running replicate on split optimization INFO:tensorflow:time(__main__.SnapshotTest.testWriteSnapshotShuffleSameFingerprint_test_mode_eager_tfapiversion_2): 1.26s I0617 06:56:02.723867 281473522103168 test_util.py:2464] time(__main__.SnapshotTest.testWriteSnapshotShuffleSameFingerprint_test_mode_eager_tfapiversion_2): 1.26s [ OK ] SnapshotTest.testWriteSnapshotShuffleSameFingerprint_test_mode_eager_tfapiversion_2 ====================================================================== FAIL: testWriteSnapshotDatasetSameFingerprintIncompleteRunRestart_test_mode_eager_tfapiversion_2 (__main__.SnapshotTest) SnapshotTest.testWriteSnapshotDatasetSameFingerprintIncompleteRunRestart_test_mode_eager_tfapiversion_2 testWriteSnapshotDatasetSameFingerprintIncompleteRunRestart_test_mode_eager_tfapiversion_2(mode='eager', tf_api_version=2) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/data/kernel_tests/snapshot_test.runfiles/absl_py/absl/testing/parameterized.py", line 314, in bound_param_test return test_method(self, **testcase_params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/data/kernel_tests/snapshot_test.runfiles/org_tensorflow/tensorflow/python/framework/test_combinations.py", line 360, in decorated execute_test_method() File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/data/kernel_tests/snapshot_test.runfiles/org_tensorflow/tensorflow/python/framework/test_combinations.py", line 343, in execute_test_method test_method(**kwargs_to_pass) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/data/kernel_tests/snapshot_test.runfiles/org_tensorflow/tensorflow/python/data/kernel_tests/snapshot_test.py", line 318, in testWriteSnapshotDatasetSameFingerprintIncompleteRunRestart self.assertSnapshotDirectoryContains( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/data/kernel_tests/snapshot_test.runfiles/org_tensorflow/tensorflow/python/data/kernel_tests/snapshot_test.py", line 108, in assertSnapshotDirectoryContains self.assertLen(run_dirlist, num_snapshot_shards_per_run) AssertionError: ['00000000.shard', '00000001.shard', '00000002.shard', '00000003.shard', '00000005.shard', '00000006.shard', '00000007.shard', '00000008.shard', '00000009.shard', '00000010.shard', '00000011.shard', '00000012.shard', '00000013.shard', '00000014.shard', '00000015.shard', '00000016.shard', '00000017.shard', '00000018.shard', '00000019.shard', '00000020.shard', '00000021.shard', '00000022.shard', '00000023.shard', '00000024.shard', '00000025.shard', '00000026.shard', '00000027.shard', '00000028.shard', '00000029.shard', '00000030.shard', '00000031.shard', '00000032.shard', '00000033.shard', '00000034.shard', '00000035.shard', '00000036.shard', '00000037.shard', '00000038.shard', '00000039.shard', '00000040.shard', '00000041.shard', '00000042.shard', '00000043.shard', '00000044.shard', '00000045.shard', '00000046.shard', '00000047.shard', '00000048.shard', '00000049.shard', '00000050.shard', '00000051.shard', '00000052.shard', '00000053.shard', '00000054.shard', '00000055.shard'] has length of 55, expected 56. ---------------------------------------------------------------------- Ran 20 tests in 9.694s FAILED (failures=1, skipped=10) ================================================================================ ==================== Test output for //tensorflow/compiler/mlir/lite/debug:debug_test: 2023-06-17 06:58:23.705411: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. 2023-06-17 06:58:23.705565: W tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Trying to register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay. The old value will be erased in order to register a new one. Please check if you link the metric more than once, or if the name is already used by other metrics. Running main() from gmock_main.cc [==========] Running 2 tests from 1 test suite. [----------] Global test environment set-up. [----------] 2 tests from InitPassManagerTest [ RUN ] InitPassManagerTest.CrashReproducer error: Failures have been detected while processing an MLIR pass pipeline [ OK ] InitPassManagerTest.CrashReproducer (20 ms) [ RUN ] InitPassManagerTest.Dump tensorflow/compiler/mlir/lite/debug/debug_test.cc:156: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (tsl::ReadFileToString( tsl::Env::Default(), tsl::io::JoinPath( dump_dir, "00000000.main.tensorflow_anonymous_namespace_NopPass_after.mlir"), &mlir_dump)) Which is: NOT_FOUND: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/compiler/mlir/lite/debug/debug_test/test.outputs/InitPassManagerTest.Dump/20230617_065823.727805/00000000.main.tensorflow_anonymous_namespace_NopPass_after.mlir; No such file or directory [ FAILED ] InitPassManagerTest.Dump (13 ms) [----------] 2 tests from InitPassManagerTest (34 ms total) [----------] Global test environment tear-down [==========] 2 tests from 1 test suite ran. (34 ms total) [ PASSED ] 1 test. [ FAILED ] 1 test, listed below: [ FAILED ] InitPassManagerTest.Dump 1 FAILED TEST ================================================================================ ==================== Test output for //tensorflow/compiler/mlir/lite/debug:debug_test: 2023-06-17 06:58:25.398446: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. 2023-06-17 06:58:25.398595: W tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Trying to register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay. The old value will be erased in order to register a new one. Please check if you link the metric more than once, or if the name is already used by other metrics. Running main() from gmock_main.cc [==========] Running 2 tests from 1 test suite. [----------] Global test environment set-up. [----------] 2 tests from InitPassManagerTest [ RUN ] InitPassManagerTest.CrashReproducer error: Failures have been detected while processing an MLIR pass pipeline [ OK ] InitPassManagerTest.CrashReproducer (12 ms) [ RUN ] InitPassManagerTest.Dump tensorflow/compiler/mlir/lite/debug/debug_test.cc:156: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (tsl::ReadFileToString( tsl::Env::Default(), tsl::io::JoinPath( dump_dir, "00000000.main.tensorflow_anonymous_namespace_NopPass_after.mlir"), &mlir_dump)) Which is: NOT_FOUND: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/compiler/mlir/lite/debug/debug_test/test.outputs/InitPassManagerTest.Dump/20230617_065825.412792/00000000.main.tensorflow_anonymous_namespace_NopPass_after.mlir; No such file or directory [ FAILED ] InitPassManagerTest.Dump (3 ms) [----------] 2 tests from InitPassManagerTest (16 ms total) [----------] Global test environment tear-down [==========] 2 tests from 1 test suite ran. (16 ms total) [ PASSED ] 1 test. [ FAILED ] 1 test, listed below: [ FAILED ] InitPassManagerTest.Dump 1 FAILED TEST ================================================================================ ==================== Test output for //tensorflow/compiler/mlir/lite/debug:debug_test: 2023-06-17 06:58:26.420652: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. 2023-06-17 06:58:26.420802: W tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Trying to register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay. The old value will be erased in order to register a new one. Please check if you link the metric more than once, or if the name is already used by other metrics. Running main() from gmock_main.cc [==========] Running 2 tests from 1 test suite. [----------] Global test environment set-up. [----------] 2 tests from InitPassManagerTest [ RUN ] InitPassManagerTest.CrashReproducer error: Failures have been detected while processing an MLIR pass pipeline [ OK ] InitPassManagerTest.CrashReproducer (16 ms) [ RUN ] InitPassManagerTest.Dump tensorflow/compiler/mlir/lite/debug/debug_test.cc:156: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (tsl::ReadFileToString( tsl::Env::Default(), tsl::io::JoinPath( dump_dir, "00000000.main.tensorflow_anonymous_namespace_NopPass_after.mlir"), &mlir_dump)) Which is: NOT_FOUND: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/compiler/mlir/lite/debug/debug_test/test.outputs/InitPassManagerTest.Dump/20230617_065826.439148/00000000.main.tensorflow_anonymous_namespace_NopPass_after.mlir; No such file or directory [ FAILED ] InitPassManagerTest.Dump (38 ms) [----------] 2 tests from InitPassManagerTest (55 ms total) [----------] Global test environment tear-down [==========] 2 tests from 1 test suite ran. (55 ms total) [ PASSED ] 1 test. [ FAILED ] 1 test, listed below: [ FAILED ] InitPassManagerTest.Dump 1 FAILED TEST ================================================================================ ==================== Test output for //tensorflow/python/distribute/failure_handling:failure_handler_test (shard 2 of 8): 2023-06-17 07:04:11.818951: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. Running tests under Python 3.11.4: /usr/local/bin/python3 [ RUN ] PreemptionCheckpointTest.test_grace_period_continue_training_test_inputarg_checkpoint_strategyoption_MS INFO:tensorflow:Using MirroredStrategy with devices ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1') I0617 07:04:17.592705 281473817867136 mirrored_strategy.py:423] Using MirroredStrategy with devices ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1') INFO:tensorflow:Start watcher for local signal. I0617 07:04:17.742967 281473817867136 failure_handling.py:674] Start watcher for local signal. INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. I0617 07:04:17.743361 281473817867136 failure_handling.py:538] PreemptionCheckpointHandler initialized or restored. WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py:198: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. Instructions for updating: Track steps using a tf.Variable saved in checkpoint instead. W0617 07:04:17.743636 281473817867136 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py:198: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. Instructions for updating: Track steps using a tf.Variable saved in checkpoint instead. INFO:tensorflow:Start training at 0 I0617 07:04:17.743823 281473817867136 failure_handler_test.py:197] Start training at 0 INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). I0617 07:04:17.890155 281473817867136 cross_device_ops.py:617] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). I0617 07:04:18.002928 281473817867136 cross_device_ops.py:617] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). I0617 07:04:18.453436 281473817867136 cross_device_ops.py:617] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). I0617 07:04:18.518250 281473817867136 cross_device_ops.py:617] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). I0617 07:04:18.653161 281473817867136 cross_device_ops.py:617] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). WARNING:tensorflow:5 out of the last 5 calls to .wrapped_fn at 0xffff0c73fd80> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. W0617 07:04:18.874221 281473817867136 polymorphic_function.py:154] 5 out of the last 5 calls to .wrapped_fn at 0xffff0c73fd80> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). I0617 07:04:18.906167 281473817867136 cross_device_ops.py:617] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). WARNING:tensorflow:6 out of the last 6 calls to .wrapped_fn at 0xffff0c73e2a0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. W0617 07:04:18.942310 281473817867136 polymorphic_function.py:154] 6 out of the last 6 calls to .wrapped_fn at 0xffff0c73e2a0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). I0617 07:04:19.052425 281473817867136 cross_device_ops.py:617] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). I0617 07:04:19.217012 281473817867136 cross_device_ops.py:617] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). I0617 07:04:19.301937 281473817867136 cross_device_ops.py:617] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). INFO:tensorflow:Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). I0617 07:04:19.383980 281473817867136 cross_device_ops.py:617] Reduce to /job:localhost/replica:0/task:0/device:CPU:0 then broadcast to ('/job:localhost/replica:0/task:0/device:CPU:0', '/job:localhost/replica:0/task:0/device:CPU:1'). INFO:tensorflow:epoch 0 finished I0617 07:04:19.724593 281473817867136 failure_handler_test.py:195] epoch 0 finished INFO:tensorflow:epoch 1 finished I0617 07:04:20.921304 281473817867136 failure_handler_test.py:195] epoch 1 finished INFO:tensorflow:epoch 2 finished I0617 07:04:22.015180 281473817867136 failure_handler_test.py:195] epoch 2 finished INFO:tensorflow:epoch 3 finished I0617 07:04:22.954728 281473817867136 failure_handler_test.py:195] epoch 3 finished INFO:tensorflow:epoch 4 finished I0617 07:04:24.497228 281473817867136 failure_handler_test.py:195] epoch 4 finished INFO:tensorflow:epoch 5 finished I0617 07:04:25.790284 281473817867136 failure_handler_test.py:195] epoch 5 finished INFO:tensorflow:sending sigterm I0617 07:04:26.617977 281470916620768 failure_handler_test.py:467] sending sigterm INFO:tensorflow:epoch 6 finished --- Logging error --- Traceback (most recent call last): File "/usr/lib/python3.11/logging/__init__.py", line 1113, in emit stream.write(msg + self.terminator) RuntimeError: reentrant call inside <_io.BufferedWriter name=''> During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.11/logging/__init__.py", line 1113, in emit stream.write(msg + self.terminator) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handling.py", line 1220, in _sigterm_handler_fn self._maybe_set_received_own_sigterm() File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handling.py", line 701, in _maybe_set_received_own_sigterm logging.info('Member %s has received termination notice.', File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/platform/tf_logging.py", line 204, in info get_logger().info(msg, *args, **kwargs) File "/usr/lib/python3.11/logging/__init__.py", line 1489, in info self._log(INFO, msg, args, **kwargs) File "/usr/lib/python3.11/logging/__init__.py", line 1634, in _log self.handle(record) File "/usr/lib/python3.11/logging/__init__.py", line 1644, in handle self.callHandlers(record) File "/usr/lib/python3.11/logging/__init__.py", line 1706, in callHandlers hdlr.handle(record) File "/usr/lib/python3.11/logging/__init__.py", line 978, in handle self.emit(record) File "/usr/lib/python3.11/logging/__init__.py", line 1118, in emit self.handleError(record) File "/usr/lib/python3.11/logging/__init__.py", line 1031, in handleError sys.stderr.write('--- Logging error ---\n') RuntimeError: reentrant call inside <_io.BufferedWriter name=''> Call stack: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py", line 558, in test_util.main() File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/test_util.py", line 138, in main multi_process_runner.test_main() File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 1455, in test_main multi_process_lib.test_main() File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 167, in test_main test.main() File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/eager/test.py", line 25, in main _test.main(argv) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/platform/test.py", line 56, in main return _googletest.main(argv) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/platform/googletest.py", line 62, in main benchmark.benchmarks_main(true_main=main_wrapper, argv=argv) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/platform/benchmark.py", line 489, in benchmarks_main true_main() File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/platform/googletest.py", line 60, in main_wrapper return app.run(main=g_main, argv=args) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/absl_py/absl/app.py", line 312, in run _run_main(main, args) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/absl_py/absl/app.py", line 258, in _run_main sys.exit(main(argv)) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/platform/googletest.py", line 51, in g_main absltest_main(argv=argv) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/absl_py/absl/testing/absltest.py", line 2049, in main _run_in_app(run_tests, args, kwargs) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/absl_py/absl/testing/absltest.py", line 2156, in _run_in_app function(argv, args, kwargs) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/absl_py/absl/testing/absltest.py", line 2568, in run_tests result = _run_and_get_tests_result( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/absl_py/absl/testing/absltest.py", line 2537, in _run_and_get_tests_result test_program = unittest.TestProgram(*args, **kwargs) File "/usr/lib/python3.11/unittest/main.py", line 102, in __init__ self.runTests() File "/usr/lib/python3.11/unittest/main.py", line 274, in runTests self.result = testRunner.run(self.test) File "/usr/lib/python3.11/unittest/runner.py", line 217, in run test(result) File "/usr/lib/python3.11/unittest/suite.py", line 84, in __call__ return self.run(*args, **kwds) File "/usr/lib/python3.11/unittest/suite.py", line 122, in run test(result) File "/usr/lib/python3.11/unittest/suite.py", line 84, in __call__ return self.run(*args, **kwds) File "/usr/lib/python3.11/unittest/suite.py", line 122, in run test(result) File "/usr/lib/python3.11/unittest/case.py", line 678, in __call__ return self.run(*args, **kwds) File "/usr/lib/python3.11/unittest/case.py", line 623, in run self._callTestMethod(testMethod) File "/usr/lib/python3.11/unittest/case.py", line 579, in _callTestMethod if method() is not None: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/absl_py/absl/testing/parameterized.py", line 314, in bound_param_test return test_method(self, **testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/framework/test_combinations.py", line 360, in decorated execute_test_method() File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/framework/test_combinations.py", line 343, in execute_test_method test_method(**kwargs_to_pass) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/combinations.py", line 559, in decorator test_method(self, **kwargs) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py", line 477, in test_grace_period_continue_training self.worker_fn(checkpoint_dir, cluster_spec, strategy_option, input_arg, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py", line 229, in worker_fn preemption_handler.run(distributed_train_step, epoch, step) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handling.py", line 893, in run return self._run_for_multi_worker_mirrored( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handling.py", line 909, in _run_for_multi_worker_mirrored result = distributed_train_function(*args, **kwargs) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py", line 195, in distributed_train_step logging.info('epoch %d finished', current_epoch) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/platform/tf_logging.py", line 204, in info get_logger().info(msg, *args, **kwargs) Message: 'epoch %d finished' Arguments: (6,) I0617 07:04:26.696829 281473817867136 failure_handler_test.py:195] epoch 6 finished INFO:tensorflow:epoch 7 finished I0617 07:04:28.988847 281473817867136 failure_handler_test.py:195] epoch 7 finished INFO:tensorflow:Training finished. I0617 07:04:28.989198 281473817867136 failure_handler_test.py:245] Training finished. INFO:tensorflow:time(__main__.PreemptionCheckpointTest.test_grace_period_continue_training_test_inputarg_checkpoint_strategyoption_MS): 11.41s I0617 07:04:28.992304 281473817867136 test_util.py:2464] time(__main__.PreemptionCheckpointTest.test_grace_period_continue_training_test_inputarg_checkpoint_strategyoption_MS): 11.41s [ OK ] PreemptionCheckpointTest.test_grace_period_continue_training_test_inputarg_checkpoint_strategyoption_MS [ RUN ] PreemptionCheckpointTest.test_passed_in_save_fn INFO:tensorflow:Using local port 36865 I0617 07:04:29.063959 281473817867136 test_util.py:3796] Using local port 36865 INFO:tensorflow:Using local port 36515 I0617 07:04:29.064388 281473817867136 test_util.py:3796] Using local port 36515 INFO:tensorflow:Using local port 35029 I0617 07:04:29.064683 281473817867136 test_util.py:3796] Using local port 35029 INFO:tensorflow:Using local port 46589 I0617 07:04:29.064964 281473817867136 test_util.py:3796] Using local port 46589 2023-06-17 07:04:29.875879: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. 2023-06-17 07:04:29.974774: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. INFO:tensorflow:Cluster starting. I0617 07:04:32.537754 281473817867136 failure_handler_test.py:525] Cluster starting. [worker-0]: I0617 07:04:32.577486 281473005089664 multi_process_runner.py:840] Subprocess with PID 1131521 (worker, 0) is now being started. [worker-0]: I0617 07:04:32.577893 281473005089664 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:36865", "localhost:36515", "localhost:35029", "localhost:46589"]}, "task": {"type": "worker", "index": 0}, "rpc_layer": "grpc"}' [worker-1]: I0617 07:04:32.645079 281473005089664 multi_process_runner.py:840] Subprocess with PID 1131667 (worker, 1) is now being started. [worker-1]: I0617 07:04:32.645484 281473005089664 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:36865", "localhost:36515", "localhost:35029", "localhost:46589"]}, "task": {"type": "worker", "index": 1}, "rpc_layer": "grpc"}' [worker-3]: I0617 07:04:32.649188 281473005089664 multi_process_runner.py:840] Subprocess with PID 1131675 (worker, 3) is now being started. [worker-3]: I0617 07:04:32.649565 281473005089664 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:36865", "localhost:36515", "localhost:35029", "localhost:46589"]}, "task": {"type": "worker", "index": 3}, "rpc_layer": "grpc"}' [worker-2]: I0617 07:04:32.651741 281473005089664 multi_process_runner.py:840] Subprocess with PID 1131669 (worker, 2) is now being started. [worker-2]: I0617 07:04:32.652151 281473005089664 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:36865", "localhost:36515", "localhost:35029", "localhost:46589"]}, "task": {"type": "worker", "index": 2}, "rpc_layer": "grpc"}' [worker-0]: 2023-06-17 07:04:32.717745: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:457] Started server with target: grpc://localhost:36865 [worker-0]: 2023-06-17 07:04:32.737086: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:551] /job:worker/replica:0/task:0 has connected to coordination service. Incarnation: 11586585620355555592 [worker-0]: 2023-06-17 07:04:32.746404: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:299] Coordination agent has successfully connected. [worker-3]: 2023-06-17 07:04:32.831150: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:457] Started server with target: grpc://localhost:46589 [worker-2]: 2023-06-17 07:04:32.881643: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:457] Started server with target: grpc://localhost:35029 [worker-0]: 2023-06-17 07:04:32.896453: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:551] /job:worker/replica:0/task:2 has connected to coordination service. Incarnation: 2647181799229689423 [worker-2]: 2023-06-17 07:04:32.896664: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:299] Coordination agent has successfully connected. [worker-0]: 2023-06-17 07:04:32.896576: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:551] /job:worker/replica:0/task:3 has connected to coordination service. Incarnation: 1471868969573969986 [worker-3]: 2023-06-17 07:04:32.903157: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:299] Coordination agent has successfully connected. [worker-1]: 2023-06-17 07:04:32.960985: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:457] Started server with target: grpc://localhost:36515 [worker-0]: 2023-06-17 07:04:32.976846: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:551] /job:worker/replica:0/task:1 has connected to coordination service. Incarnation: 2133273757612107185 [worker-1]: 2023-06-17 07:04:32.977067: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:299] Coordination agent has successfully connected. [worker-0]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-3]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1'] [worker-0]: I0617 07:04:32.978694 281473005089664 collective_all_reduce_strategy.py:531] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-3]: I0617 07:04:32.978721 281473005089664 collective_all_reduce_strategy.py:531] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1'] [worker-2]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-2]: I0617 07:04:32.978753 281473005089664 collective_all_reduce_strategy.py:531] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-1]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-1]: I0617 07:04:32.988273 281473005089664 collective_all_reduce_strategy.py:531] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-0]: INFO:tensorflow:Using MirroredStrategy with devices ('/job:worker/task:0/device:CPU:0',) [worker-2]: INFO:tensorflow:Using MirroredStrategy with devices ('/job:worker/task:2/device:CPU:0',) [worker-0]: I0617 07:04:33.039952 281473005089664 mirrored_strategy.py:423] Using MirroredStrategy with devices ('/job:worker/task:0/device:CPU:0',) [worker-2]: I0617 07:04:33.040501 281473005089664 mirrored_strategy.py:423] Using MirroredStrategy with devices ('/job:worker/task:2/device:CPU:0',) [worker-0]: INFO:tensorflow:Check health not enabled. [worker-2]: INFO:tensorflow:Check health not enabled. [worker-0]: I0617 07:04:33.041093 281473005089664 collective_all_reduce_strategy.py:574] Check health not enabled. [worker-2]: I0617 07:04:33.040969 281473005089664 collective_all_reduce_strategy.py:574] Check health not enabled. [worker-0]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:36865', 'localhost:36515', 'localhost:35029', 'localhost:46589']}, task_type = 'worker', task_id = 0, num_workers = 4, local_devices = ('/job:worker/task:0/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-2]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:36865', 'localhost:36515', 'localhost:35029', 'localhost:46589']}, task_type = 'worker', task_id = 2, num_workers = 4, local_devices = ('/job:worker/task:2/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-0]: I0617 07:04:33.041285 281473005089664 collective_all_reduce_strategy.py:576] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:36865', 'localhost:36515', 'localhost:35029', 'localhost:46589']}, task_type = 'worker', task_id = 0, num_workers = 4, local_devices = ('/job:worker/task:0/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-2]: I0617 07:04:33.041157 281473005089664 collective_all_reduce_strategy.py:576] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:36865', 'localhost:36515', 'localhost:35029', 'localhost:46589']}, task_type = 'worker', task_id = 2, num_workers = 4, local_devices = ('/job:worker/task:2/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-1]: INFO:tensorflow:Using MirroredStrategy with devices ('/job:worker/task:1/device:CPU:0',) [worker-1]: I0617 07:04:33.051318 281473005089664 mirrored_strategy.py:423] Using MirroredStrategy with devices ('/job:worker/task:1/device:CPU:0',) [worker-1]: INFO:tensorflow:Check health not enabled. [worker-1]: I0617 07:04:33.051856 281473005089664 collective_all_reduce_strategy.py:574] Check health not enabled. [worker-1]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:36865', 'localhost:36515', 'localhost:35029', 'localhost:46589']}, task_type = 'worker', task_id = 1, num_workers = 4, local_devices = ('/job:worker/task:1/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-1]: I0617 07:04:33.052038 281473005089664 collective_all_reduce_strategy.py:576] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:36865', 'localhost:36515', 'localhost:35029', 'localhost:46589']}, task_type = 'worker', task_id = 1, num_workers = 4, local_devices = ('/job:worker/task:1/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-3]: INFO:tensorflow:Using MirroredStrategy with devices ('/job:worker/task:3/device:CPU:0',) [worker-3]: I0617 07:04:33.066206 281473005089664 mirrored_strategy.py:423] Using MirroredStrategy with devices ('/job:worker/task:3/device:CPU:0',) [worker-3]: INFO:tensorflow:Check health not enabled. [worker-3]: I0617 07:04:33.066682 281473005089664 collective_all_reduce_strategy.py:574] Check health not enabled. [worker-3]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:36865', 'localhost:36515', 'localhost:35029', 'localhost:46589']}, task_type = 'worker', task_id = 3, num_workers = 4, local_devices = ('/job:worker/task:3/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-3]: I0617 07:04:33.066869 281473005089664 collective_all_reduce_strategy.py:576] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:36865', 'localhost:36515', 'localhost:35029', 'localhost:46589']}, task_type = 'worker', task_id = 3, num_workers = 4, local_devices = ('/job:worker/task:3/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-0]: INFO:tensorflow:Start watcher for peer's signal. [worker-0]: I0617 07:04:33.127432 281473005089664 failure_handling.py:634] Start watcher for peer's signal. [worker-2]: INFO:tensorflow:Start watcher for peer's signal. [worker-2]: I0617 07:04:33.131521 281473005089664 failure_handling.py:634] Start watcher for peer's signal. [worker-2]: INFO:tensorflow:Start watcher for local signal. [worker-2]: I0617 07:04:33.132228 281473005089664 failure_handling.py:674] Start watcher for local signal. [worker-2]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-2]: I0617 07:04:33.132445 281473005089664 failure_handling.py:538] PreemptionCheckpointHandler initialized or restored. [worker-2]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py:198: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-2]: Instructions for updating: [worker-2]: Track steps using a tf.Variable saved in checkpoint instead. [worker-2]: W0617 07:04:33.132703 281473005089664 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py:198: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-2]: Instructions for updating: [worker-2]: Track steps using a tf.Variable saved in checkpoint instead. [worker-2]: INFO:tensorflow:Start training at 0 [worker-2]: I0617 07:04:33.132853 281473005089664 failure_handler_test.py:197] Start training at 0 [worker-1]: INFO:tensorflow:Start watcher for peer's signal. [worker-1]: I0617 07:04:33.140702 281473005089664 failure_handling.py:634] Start watcher for peer's signal. [worker-1]: INFO:tensorflow:Start watcher for local signal. [worker-1]: I0617 07:04:33.141385 281473005089664 failure_handling.py:674] Start watcher for local signal. [worker-1]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-1]: I0617 07:04:33.141594 281473005089664 failure_handling.py:538] PreemptionCheckpointHandler initialized or restored. [worker-1]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py:198: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-1]: Instructions for updating: [worker-1]: Track steps using a tf.Variable saved in checkpoint instead. [worker-1]: W0617 07:04:33.141860 281473005089664 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py:198: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-1]: Instructions for updating: [worker-1]: Track steps using a tf.Variable saved in checkpoint instead. [worker-1]: INFO:tensorflow:Start training at 0 [worker-1]: I0617 07:04:33.142010 281473005089664 failure_handler_test.py:197] Start training at 0 [worker-3]: INFO:tensorflow:Start watcher for peer's signal. [worker-3]: I0617 07:04:33.151642 281473005089664 failure_handling.py:634] Start watcher for peer's signal. [worker-0]: INFO:tensorflow:Start watcher for local signal. [worker-3]: INFO:tensorflow:Start watcher for local signal. [worker-3]: I0617 07:04:33.176771 281473005089664 failure_handling.py:674] Start watcher for local signal. [worker-3]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-3]: I0617 07:04:33.177049 281473005089664 failure_handling.py:538] PreemptionCheckpointHandler initialized or restored. [worker-3]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py:198: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-3]: Instructions for updating: [worker-3]: Track steps using a tf.Variable saved in checkpoint instead. [worker-3]: W0617 07:04:33.177313 281473005089664 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py:198: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-3]: Instructions for updating: [worker-3]: Track steps using a tf.Variable saved in checkpoint instead. [worker-3]: INFO:tensorflow:Start training at 0 [worker-3]: I0617 07:04:33.177464 281473005089664 failure_handler_test.py:197] Start training at 0 [worker-0]: I0617 07:04:33.166438 281473005089664 failure_handling.py:674] Start watcher for local signal. [worker-0]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-0]: I0617 07:04:33.166718 281473005089664 failure_handling.py:538] PreemptionCheckpointHandler initialized or restored. [worker-0]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py:198: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-0]: Instructions for updating: [worker-0]: Track steps using a tf.Variable saved in checkpoint instead. [worker-0]: W0617 07:04:33.166989 281473005089664 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py:198: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-0]: Instructions for updating: [worker-0]: Track steps using a tf.Variable saved in checkpoint instead. [worker-0]: INFO:tensorflow:Start training at 0 [worker-0]: I0617 07:04:33.167141 281473005089664 failure_handler_test.py:197] Start training at 0 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:33.277991 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:33.323699 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:33.313088 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:33.445929 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:33.511306 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:33.534262 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:33.553901 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:33.550387 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:33.624150 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:33.626360 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:33.627191 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:33.659592 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:33.730958 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:33.737430 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:33.753203 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:33.759587 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:33.847886 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:33.860963 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:33.860083 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:33.874186 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: WARNING:tensorflow:5 out of the last 5 calls to .wrapped_fn at 0xffff869d25c0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-1]: WARNING:tensorflow:5 out of the last 5 calls to .wrapped_fn at 0xffff869d2520> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-0]: W0617 07:04:33.926918 281473005089664 polymorphic_function.py:154] 5 out of the last 5 calls to .wrapped_fn at 0xffff869d25c0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-2]: WARNING:tensorflow:5 out of the last 5 calls to .wrapped_fn at 0xffff869d25c0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-1]: W0617 07:04:33.927079 281473005089664 polymorphic_function.py:154] 5 out of the last 5 calls to .wrapped_fn at 0xffff869d2520> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-3]: WARNING:tensorflow:5 out of the last 5 calls to .wrapped_fn at 0xffff869d2480> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-2]: W0617 07:04:33.927292 281473005089664 polymorphic_function.py:154] 5 out of the last 5 calls to .wrapped_fn at 0xffff869d25c0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-3]: W0617 07:04:33.928745 281473005089664 polymorphic_function.py:154] 5 out of the last 5 calls to .wrapped_fn at 0xffff869d2480> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:33.933708 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:33.935372 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:33.949821 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:33.959599 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: WARNING:tensorflow:6 out of the last 6 calls to .wrapped_fn at 0xffff869d2b60> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-0]: W0617 07:04:34.037234 281473005089664 polymorphic_function.py:154] 6 out of the last 6 calls to .wrapped_fn at 0xffff869d2b60> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-3]: WARNING:tensorflow:6 out of the last 6 calls to .wrapped_fn at 0xffff869d0040> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-2]: WARNING:tensorflow:6 out of the last 6 calls to .wrapped_fn at 0xffff869d00e0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-1]: WARNING:tensorflow:6 out of the last 6 calls to .wrapped_fn at 0xffff869d3740> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-2]: W0617 07:04:34.041606 281473005089664 polymorphic_function.py:154] 6 out of the last 6 calls to .wrapped_fn at 0xffff869d00e0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-1]: W0617 07:04:34.041484 281473005089664 polymorphic_function.py:154] 6 out of the last 6 calls to .wrapped_fn at 0xffff869d3740> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-3]: W0617 07:04:34.041480 281473005089664 polymorphic_function.py:154] 6 out of the last 6 calls to .wrapped_fn at 0xffff869d0040> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:34.052348 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:34.064110 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:34.069458 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:34.076888 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:34.160420 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:34.164382 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:34.179715 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:34.169496 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:34.265598 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:34.281962 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:34.282135 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:34.268462 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:34.435678 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:34.436975 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:34.440298 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 INFO:tensorflow:sending SIGTERM [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 I0617 07:04:35.626636 281473817867136 failure_handler_test.py:531] sending SIGTERM [ FAILED ] PreemptionCheckpointTest.test_passed_in_save_fn [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 INFO:tensorflow:time(__main__.PreemptionCheckpointTest.test_passed_in_save_fn): 18.28s I0617 07:04:47.303842 281473817867136 test_util.py:2464] time(__main__.PreemptionCheckpointTest.test_passed_in_save_fn): 18.28s [worker-3]: I0617 07:04:34.469174 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [ RUN ] PreemptionCheckpointTest.test_preemption_checkpointing_test_apiwrappingtrain_False_inputarg_manager_strategyoption_OneDevice [worker-0]: I0617 07:04:34.517459 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:34.529468 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:34.520284 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:34.581942 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:34.619667 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:34.672293 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:34.672487 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:34.619573 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:34.736620 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:34.516566 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:34.581941 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:34.689614 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:34.740304 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:34.794464 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:epoch 0 finished [worker-3]: I0617 07:04:34.860141 281473005089664 failure_handler_test.py:195] epoch 0 finished [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:34.868167 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:34.931030 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:35.025165 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:34.736215 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:34.795601 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:35.097105 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:34.672415 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:34.821035 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:epoch 0 finished [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:34.860559 281473005089664 failure_handler_test.py:195] epoch 0 finished [worker-2]: I0617 07:04:34.736370 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:epoch 0 finished [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:35.154378 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:34.860372 281473005089664 failure_handler_test.py:195] epoch 0 finished [worker-1]: I0617 07:04:34.882744 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:35.202814 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:34.880741 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:34.795540 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:epoch 0 finished [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:34.860789 281473005089664 failure_handler_test.py:195] epoch 0 finished [worker-3]: I0617 07:04:35.256951 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:34.949463 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:34.931035 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:34.883428 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 INFO:tensorflow:Start watcher for local signal. I0617 07:04:47.329485 281473817867136 failure_handling.py:674] Start watcher for local signal. [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.025178 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:35.024659 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:34.932518 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. I0617 07:04:47.330529 281473817867136 failure_handling.py:538] PreemptionCheckpointHandler initialized or restored. [worker-3]: I0617 07:04:35.308060 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 INFO:tensorflow:Start training at 0 I0617 07:04:47.330932 281473817867136 failure_handler_test.py:197] Start training at 0 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.097451 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:35.044193 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:35.096332 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:35.361331 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:35.154506 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:35.097393 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:35.410523 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:35.155671 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:35.461298 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:35.207578 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:35.510290 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:35.203042 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:35.257673 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.155460 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:35.257097 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:35.562090 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:35.308365 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.209663 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:35.308062 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:35.362394 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.257534 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:35.608947 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:35.362273 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.308653 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:35.673680 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:35.410725 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:35.411239 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:epoch 1 finished [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:35.715524 281473005089664 failure_handler_test.py:195] epoch 1 finished [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:35.461510 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:35.724031 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.360905 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:35.461100 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:35.510583 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:35.772046 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.410739 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:35.510631 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:35.561726 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:35.825698 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.461980 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:35.561846 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:35.609688 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:35.873505 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:35.609367 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.513675 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:35.673680 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:epoch 1 finished [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:35.923435 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:35.715704 281473005089664 failure_handler_test.py:195] epoch 1 finished [worker-2]: I0617 07:04:35.674129 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.561769 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:epoch 1 finished [worker-3]: I0617 07:04:36.112183 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:35.723843 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:35.716023 281473005089664 failure_handler_test.py:195] epoch 1 finished [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.609185 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:36.169110 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:35.723993 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:35.772928 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:36.216652 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.673818 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:35.776606 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:epoch 1 finished [worker-0]: I0617 07:04:35.825428 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:36.263258 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.715963 281473005089664 failure_handler_test.py:195] epoch 1 finished [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:35.874286 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:35.826159 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.724098 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:36.310887 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:35.923471 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:35.874123 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.772291 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.112513 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:36.359008 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:35.922753 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.825815 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.169043 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:36.113263 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:36.403735 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.873050 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.216065 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:36.168605 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:36.448261 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:35.922749 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.263384 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:36.216649 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:36.494764 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.113108 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.311521 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 WARNING:tensorflow:5 out of the last 5 calls to .distributed_train_step..train_step at 0xffff0e0e3880> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 W0617 07:04:47.486755 281473817867136 polymorphic_function.py:154] 5 out of the last 5 calls to .distributed_train_step..train_step at 0xffff0e0e3880> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-3]: I0617 07:04:36.540044 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:epoch 2 finished [worker-2]: I0617 07:04:36.263031 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.169146 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.358537 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:36.578788 281473005089664 failure_handler_test.py:195] epoch 2 finished [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.217109 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.403600 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:36.312168 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:36.586087 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.447999 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.263064 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:36.358547 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:36.631390 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.494588 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:36.403682 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:36.680726 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.312076 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 WARNING:tensorflow:6 out of the last 6 calls to .distributed_train_step..train_step at 0xffff0e0e3880> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. W0617 07:04:47.501199 281473817867136 polymorphic_function.py:154] 6 out of the last 6 calls to .distributed_train_step..train_step at 0xffff0e0e3880> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:36.448250 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.538966 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.358534 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:36.727033 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:epoch 2 finished [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:36.494736 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.578988 281473005089664 failure_handler_test.py:195] epoch 2 finished [worker-1]: I0617 07:04:36.403642 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:36.772905 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:36.539160 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.585286 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.448915 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:epoch 2 finished [worker-0]: I0617 07:04:36.630475 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:36.818791 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:36.579188 281473005089664 failure_handler_test.py:195] epoch 2 finished [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.495135 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.681882 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:36.865519 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:36.586266 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.727991 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.539585 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:epoch 2 finished [worker-2]: I0617 07:04:36.632211 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:36.911249 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.579147 281473005089664 failure_handler_test.py:195] epoch 2 finished [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.773053 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:36.681068 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.586013 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.819457 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:36.956539 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:36.726773 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.632428 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.864967 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.002663 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:36.772432 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.681563 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.911117 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.048250 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:36.817927 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.727395 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:36.956727 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.094689 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:36.863950 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.773224 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.003360 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:36.910062 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.139488 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.049368 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.819084 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:36.955672 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.186083 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.094299 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.865226 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.001942 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.139734 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.233952 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.911236 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:epoch 3 finished [worker-2]: I0617 07:04:37.048183 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.186356 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.273317 281473005089664 failure_handler_test.py:195] epoch 3 finished [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:36.957533 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.093228 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.234110 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.280177 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.002819 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:epoch 3 finished [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.138966 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.326992 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.273519 281473005089664 failure_handler_test.py:195] epoch 3 finished [worker-1]: I0617 07:04:37.048558 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.370800 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.280282 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.184225 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.415579 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.326500 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.232688 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:epoch 3 finished [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.273594 281473005089664 failure_handler_test.py:195] epoch 3 finished [worker-3]: I0617 07:04:37.458492 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.370573 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.501372 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.415385 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.094510 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.279051 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.139828 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.458345 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.326687 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.544161 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.501183 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.185840 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.370629 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.586476 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.544289 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.234297 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.415606 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:epoch 3 finished [worker-3]: I0617 07:04:37.628599 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.586545 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.273681 281473005089664 failure_handler_test.py:195] epoch 3 finished [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.458500 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.670416 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.628656 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.280796 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.502422 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.712572 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.670562 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.327386 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.544917 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.755708 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.712705 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.372181 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.586809 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.798198 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.755898 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.415983 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.628695 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.840233 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.798413 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.458770 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.670739 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.881970 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.501379 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.840360 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.712884 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:epoch 4 finished [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.918421 281473005089664 failure_handler_test.py:195] epoch 4 finished [worker-1]: I0617 07:04:37.544469 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.882107 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.756001 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:epoch 4 finished [worker-3]: I0617 07:04:37.923774 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.918591 281473005089664 failure_handler_test.py:195] epoch 4 finished [worker-1]: I0617 07:04:37.586824 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.798356 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:37.965151 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.628810 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.923909 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.840561 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 INFO:tensorflow:epoch 0 finished I0617 07:04:47.621008 281473817867136 failure_handler_test.py:195] epoch 0 finished [worker-1]: I0617 07:04:37.671079 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.007535 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:37.966345 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.882200 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.049131 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:epoch 4 finished [worker-1]: I0617 07:04:37.712800 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.008124 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.918751 281473005089664 failure_handler_test.py:195] epoch 4 finished [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.090845 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.755913 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.049434 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.132222 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.924108 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.090978 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:37.965463 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.175374 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.133196 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.007669 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.218909 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.049744 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.176359 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.262786 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.219090 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.091048 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.262885 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.133586 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.306266 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.305633 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.175931 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.347805 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.347664 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.219965 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.389493 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.389333 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.798414 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.263099 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.431145 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.431238 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.840563 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.472672 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.305737 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.472823 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.347909 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.882195 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.514801 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.514880 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:epoch 4 finished [worker-0]: INFO:tensorflow:epoch 5 finished [worker-3]: INFO:tensorflow:epoch 5 finished [worker-2]: I0617 07:04:38.389639 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.918698 281473005089664 failure_handler_test.py:195] epoch 4 finished [worker-3]: I0617 07:04:38.551373 281473005089664 failure_handler_test.py:195] epoch 5 finished [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.551517 281473005089664 failure_handler_test.py:195] epoch 5 finished [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.431386 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.556739 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.924087 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.556869 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.472970 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.598443 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.598599 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:37.965425 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.514997 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.641378 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.641370 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.007637 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:epoch 5 finished [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.551683 281473005089664 failure_handler_test.py:195] epoch 5 finished [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.049429 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.688731 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.688746 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.557404 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.091118 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.734977 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.734978 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.598764 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.132587 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.780142 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.779967 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.640755 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.176054 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.826479 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.687018 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.826726 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.872479 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.219258 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.733906 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.917429 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.872491 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.263046 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:38.958454 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.916486 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.779901 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.305949 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.000704 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:38.958330 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.000586 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.347917 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.824974 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.042486 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.042399 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.084161 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.871508 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.389692 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.126076 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.916574 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.084067 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.167832 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:38.958556 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.125945 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.431368 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:epoch 6 finished [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.204759 281473005089664 failure_handler_test.py:195] epoch 6 finished [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.472951 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.167694 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:39.000943 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:epoch 6 finished [worker-0]: I0617 07:04:39.210106 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.514967 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.204637 281473005089664 failure_handler_test.py:195] epoch 6 finished [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:epoch 5 finished [worker-0]: I0617 07:04:39.251492 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.209905 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.551629 281473005089664 failure_handler_test.py:195] epoch 5 finished [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:39.042621 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.294467 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.251398 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.556966 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.294409 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.335980 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.598668 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:39.084316 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.336036 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.377329 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.641581 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.377262 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:39.126167 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.418852 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.688797 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.418778 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:39.168307 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.460192 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:epoch 6 finished [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.460134 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:39.204908 281473005089664 failure_handler_test.py:195] epoch 6 finished [worker-0]: I0617 07:04:39.501804 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.735106 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:39.210312 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.543086 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.501716 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.780239 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:39.251605 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.584447 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.826529 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.543032 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:39.294619 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.626531 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.584351 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.872566 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:39.336127 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.626055 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.916787 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.667567 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:39.377446 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.667491 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:38.958565 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.709311 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:39.419018 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.709264 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:39.000907 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:39.460371 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.750752 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:39.042638 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.750988 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:39.501879 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.793874 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.793979 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:39.084326 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:39.543273 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:epoch 7 finished [worker-3]: INFO:tensorflow:epoch 7 finished [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0617 07:04:39.830998 281473005089664 failure_handler_test.py:195] epoch 7 finished [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: Process _Process-2: [worker-2]: I0617 07:04:39.584619 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0617 07:04:39.830848 281473005089664 failure_handler_test.py:195] epoch 7 finished [worker-0]: Traceback (most recent call last): [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: Process _Process-5: [worker-1]: I0617 07:04:39.126238 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:39.626253 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: Traceback (most recent call last): [worker-0]: File "/usr/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: File "/usr/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap [worker-0]: self.run() [worker-2]: I0617 07:04:39.667763 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: self.run() [worker-1]: I0617 07:04:39.168045 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 755, in _run_with_setenv [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 INFO:tensorflow:epoch 1 finished I0617 07:04:47.863528 281473817867136 failure_handler_test.py:195] epoch 1 finished [worker-1]: INFO:tensorflow:epoch 6 finished [worker-0]: return self._actual_run() [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 755, in _run_with_setenv [worker-1]: I0617 07:04:39.204872 281473005089664 failure_handler_test.py:195] epoch 6 finished [worker-0]: ^^^^^^^^^^^^^^^^^^ [worker-2]: I0617 07:04:39.709487 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: return self._actual_run() [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 54, in _run_with_absl [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: ^^^^^^^^^^^^^^^^^^ [worker-0]: app.run(lambda _: self._run_impl()) [worker-2]: I0617 07:04:39.751092 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:39.210280 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 54, in _run_with_absl [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/absl_py/absl/app.py", line 312, in run [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: app.run(lambda _: self._run_impl()) [worker-1]: I0617 07:04:39.251593 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0617 07:04:39.794119 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: _run_main(main, args) [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:39.294732 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/absl_py/absl/app.py", line 258, in _run_main [worker-2]: INFO:tensorflow:epoch 7 finished [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: sys.exit(main(argv)) [worker-2]: I0617 07:04:39.831175 281473005089664 failure_handler_test.py:195] epoch 7 finished [worker-1]: I0617 07:04:39.336085 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: ^^^^^^^^^^ [worker-2]: Process _Process-4: [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:39.377479 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 54, in [worker-2]: Traceback (most recent call last): [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/absl_py/absl/app.py", line 312, in run [worker-2]: File "/usr/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap [worker-0]: app.run(lambda _: self._run_impl()) [worker-3]: _run_main(main, args) [worker-0]: ^^^^^^^^^^^^^^^^ [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: self.run() [worker-1]: I0617 07:04:39.419028 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/absl_py/absl/app.py", line 258, in _run_main [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 755, in _run_with_setenv [worker-0]: File "/usr/lib/python3.11/multiprocessing/process.py", line 108, in run [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: sys.exit(main(argv)) [worker-2]: return self._actual_run() [worker-2]: ^^^^^^^^^^^^^^^^^^ [worker-3]: ^^^^^^^^^^ [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 54, in _run_with_absl [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 54, in [worker-2]: app.run(lambda _: self._run_impl()) [worker-1]: I0617 07:04:39.460326 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/absl_py/absl/app.py", line 312, in run [worker-2]: _run_main(main, args) [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/absl_py/absl/app.py", line 258, in _run_main [worker-2]: sys.exit(main(argv)) [worker-2]: ^^^^^^^^^^ [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 54, in [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: app.run(lambda _: self._run_impl()) [worker-3]: app.run(lambda _: self._run_impl()) [worker-1]: I0617 07:04:39.501919 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: ^^^^^^^^^^^^^^^^ [worker-3]: ^^^^^^^^^^^^^^^^ [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:39.543252 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: File "/usr/lib/python3.11/multiprocessing/process.py", line 108, in run [worker-3]: File "/usr/lib/python3.11/multiprocessing/process.py", line 108, in run [worker-2]: self._target(*self._args, **self._kwargs) [worker-3]: self._target(*self._args, **self._kwargs) [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 866, in __call__ [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 866, in __call__ [worker-2]: six.reraise(*info.exc_info) [worker-3]: six.reraise(*info.exc_info) [worker-0]: self._target(*self._args, **self._kwargs) [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/six_archive/six.py", line 719, in reraise [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/six_archive/six.py", line 719, in reraise [worker-1]: I0617 07:04:39.584561 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 866, in __call__ [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: six.reraise(*info.exc_info) [worker-1]: I0617 07:04:39.626251 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: raise value [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/six_archive/six.py", line 719, in reraise [worker-3]: raise value [worker-0]: raise value [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 1060, in _run_contained [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 1060, in _run_contained [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 1060, in _run_contained [worker-1]: I0617 07:04:39.667680 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: return_value = fn(*args, **kwargs) [worker-3]: return_value = fn(*args, **kwargs) [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: return_value = fn(*args, **kwargs) [worker-2]: ^^^^^^^^^^^^^^^^^^^ [worker-3]: ^^^^^^^^^^^^^^^^^^^ [worker-1]: I0617 07:04:39.709509 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py", line 243, in worker_fn [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py", line 243, in worker_fn [worker-0]: ^^^^^^^^^^^^^^^^^^^ [worker-2]: training_finished.set() [worker-3]: training_finished.set() [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py", line 243, in worker_fn [worker-3]: ^^^^^^^^^^^^^^^^^^^^^ [worker-2]: ^^^^^^^^^^^^^^^^^^^^^ [worker-3]: AttributeError: 'NoneType' object has no attribute 'set' [worker-0]: training_finished.set() [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: ^^^^^^^^^^^^^^^^^^^^^ [worker-2]: AttributeError: 'NoneType' object has no attribute 'set' [worker-1]: I0617 07:04:39.751013 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: AttributeError: 'NoneType' object has no attribute 'set' [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0617 07:04:39.794195 281473005089664 cross_device_ops.py:1152] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:epoch 7 finished [worker-1]: I0617 07:04:39.831099 281473005089664 failure_handler_test.py:195] epoch 7 finished [worker-1]: Process _Process-3: [worker-1]: Traceback (most recent call last): [worker-1]: File "/usr/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap [worker-1]: self.run() [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 755, in _run_with_setenv [worker-1]: return self._actual_run() [worker-1]: ^^^^^^^^^^^^^^^^^^ [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 54, in _run_with_absl [worker-1]: app.run(lambda _: self._run_impl()) [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/absl_py/absl/app.py", line 312, in run [worker-1]: _run_main(main, args) [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/absl_py/absl/app.py", line 258, in _run_main [worker-1]: sys.exit(main(argv)) [worker-1]: ^^^^^^^^^^ [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 54, in [worker-1]: app.run(lambda _: self._run_impl()) [worker-1]: ^^^^^^^^^^^^^^^^ [worker-1]: File "/usr/lib/python3.11/multiprocessing/process.py", line 108, in run [worker-1]: self._target(*self._args, **self._kwargs) [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 866, in __call__ [worker-1]: six.reraise(*info.exc_info) [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/six_archive/six.py", line 719, in reraise [worker-1]: raise value [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 1060, in _run_contained [worker-1]: return_value = fn(*args, **kwargs) [worker-1]: ^^^^^^^^^^^^^^^^^^^ [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py", line 243, in worker_fn [worker-1]: training_finished.set() [worker-1]: ^^^^^^^^^^^^^^^^^^^^^ [worker-1]: AttributeError: 'NoneType' object has no attribute 'set' INFO:tensorflow:epoch 2 finished I0617 07:04:48.075630 281473817867136 failure_handler_test.py:195] epoch 2 finished INFO:tensorflow:epoch 3 finished I0617 07:04:48.266744 281473817867136 failure_handler_test.py:195] epoch 3 finished INFO:tensorflow:epoch 4 finished I0617 07:04:48.460345 281473817867136 failure_handler_test.py:195] epoch 4 finished INFO:tensorflow:epoch 5 finished I0617 07:04:48.665619 281473817867136 failure_handler_test.py:195] epoch 5 finished INFO:tensorflow:epoch 6 finished I0617 07:04:48.847065 281473817867136 failure_handler_test.py:195] epoch 6 finished INFO:tensorflow:epoch 7 finished I0617 07:04:49.037853 281473817867136 failure_handler_test.py:195] epoch 7 finished INFO:tensorflow:Training finished. I0617 07:04:49.038403 281473817867136 failure_handler_test.py:245] Training finished. INFO:tensorflow:sending sigterm I0617 07:04:49.306152 281470916620768 failure_handler_test.py:327] sending sigterm INFO:tensorflow:Member single_worker has received termination notice. I0617 07:04:49.306574 281473817867136 failure_handling.py:701] Member single_worker has received termination notice. INFO:tensorflow:time(__main__.PreemptionCheckpointTest.test_preemption_checkpointing_test_apiwrappingtrain_False_inputarg_manager_strategyoption_OneDevice): 2.0s I0617 07:04:49.306930 281473817867136 test_util.py:2464] time(__main__.PreemptionCheckpointTest.test_preemption_checkpointing_test_apiwrappingtrain_False_inputarg_manager_strategyoption_OneDevice): 2.0s [ OK ] PreemptionCheckpointTest.test_preemption_checkpointing_test_apiwrappingtrain_False_inputarg_manager_strategyoption_OneDevice [ RUN ] PreemptionCheckpointTest.test_preemption_checkpointing_test_apiwrappingtrain_True_inputarg_manager_strategyoption_OneDevice INFO:tensorflow:Start watcher for local signal. I0617 07:04:49.324895 281473817867136 failure_handling.py:674] Start watcher for local signal. INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. I0617 07:04:49.325368 281473817867136 failure_handling.py:538] PreemptionCheckpointHandler initialized or restored. INFO:tensorflow:Start training at 0 I0617 07:04:49.325573 281473817867136 failure_handler_test.py:197] Start training at 0 INFO:tensorflow:epoch 0 finished I0617 07:04:49.517296 281473817867136 failure_handler_test.py:195] epoch 0 finished INFO:tensorflow:epoch 1 finished I0617 07:04:49.904254 281473817867136 failure_handler_test.py:195] epoch 1 finished INFO:tensorflow:epoch 2 finished I0617 07:04:50.089444 281473817867136 failure_handler_test.py:195] epoch 2 finished INFO:tensorflow:epoch 3 finished I0617 07:04:50.359642 281473817867136 failure_handler_test.py:195] epoch 3 finished INFO:tensorflow:epoch 4 finished I0617 07:04:50.852589 281473817867136 failure_handler_test.py:195] epoch 4 finished INFO:tensorflow:epoch 5 finished I0617 07:04:51.049356 281473817867136 failure_handler_test.py:195] epoch 5 finished INFO:tensorflow:epoch 6 finished I0617 07:04:51.236087 281473817867136 failure_handler_test.py:195] epoch 6 finished INFO:tensorflow:sending sigterm I0617 07:04:51.329317 281470916620768 failure_handler_test.py:327] sending sigterm INFO:tensorflow:Member single_worker has received termination notice. I0617 07:04:51.333173 281473817867136 failure_handling.py:701] Member single_worker has received termination notice. INFO:tensorflow:Termination caught in main thread on preempted worker I0617 07:04:51.342981 281473817867136 failure_handling.py:1159] Termination caught in main thread on preempted worker INFO:tensorflow:PreemptionCheckpointHandler: Starting saving a checkpoint. I0617 07:04:51.355154 281473817867136 failure_handling.py:1063] PreemptionCheckpointHandler: Starting saving a checkpoint. INFO:tensorflow:Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/a8a80b439addf1111109eed9053a65ffmu78foq_/tmpag12120j/fh_ckpt I0617 07:04:51.422113 281473817867136 failure_handling.py:1078] Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/a8a80b439addf1111109eed9053a65ffmu78foq_/tmpag12120j/fh_ckpt INFO:tensorflow:PreemptionCheckpointHandler: checkpoint saved. Exiting. I0617 07:04:51.422427 281473817867136 failure_handling.py:1128] PreemptionCheckpointHandler: checkpoint saved. Exiting. INFO:tensorflow:restarting workers I0617 07:04:51.422704 281473817867136 failure_handler_test.py:351] restarting workers INFO:tensorflow:Start watcher for local signal. I0617 07:04:51.442443 281473817867136 failure_handling.py:674] Start watcher for local signal. INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. I0617 07:04:51.442886 281473817867136 failure_handling.py:538] PreemptionCheckpointHandler initialized or restored. INFO:tensorflow:Start training at 114 I0617 07:04:51.443086 281473817867136 failure_handler_test.py:197] Start training at 114 INFO:tensorflow:training restarted I0617 07:04:51.443232 281473817867136 failure_handler_test.py:207] training restarted INFO:tensorflow:epoch 7 finished I0617 07:04:51.512581 281473817867136 failure_handler_test.py:195] epoch 7 finished INFO:tensorflow:Training finished. I0617 07:04:51.513076 281473817867136 failure_handler_test.py:245] Training finished. INFO:tensorflow:time(__main__.PreemptionCheckpointTest.test_preemption_checkpointing_test_apiwrappingtrain_True_inputarg_manager_strategyoption_OneDevice): 2.21s I0617 07:04:51.513966 281473817867136 test_util.py:2464] time(__main__.PreemptionCheckpointTest.test_preemption_checkpointing_test_apiwrappingtrain_True_inputarg_manager_strategyoption_OneDevice): 2.21s [ OK ] PreemptionCheckpointTest.test_preemption_checkpointing_test_apiwrappingtrain_True_inputarg_manager_strategyoption_OneDevice ====================================================================== ERROR: test_passed_in_save_fn (__main__.PreemptionCheckpointTest) PreemptionCheckpointTest.test_passed_in_save_fn ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/failure_handler_test.py", line 532, in test_passed_in_save_fn os.kill(mpr.get_process_id('worker', killed_worker), signal.SIGTERM) ProcessLookupError: [Errno 3] No such process ---------------------------------------------------------------------- Ran 4 tests in 33.935s FAILED (errors=1) ================================================================================ ==================== Test output for //tensorflow/python/ops/ragged:ragged_cross_op_test: 2023-06-17 07:19:01.343494: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. Running tests under Python 3.11.4: /usr/local/bin/python3 [ RUN ] RaggedCrossOpTest.testRaggedCrossBatchSizeZero INFO:tensorflow:Running testRaggedCrossBatchSizeZero in GRAPH mode. I0617 07:19:08.763292 281473617851264 test_util.py:1494] Running testRaggedCrossBatchSizeZero in GRAPH mode. WARNING:tensorflow:From /usr/lib/python3.11/contextlib.py:105: TensorFlowTestCase.test_session (from tensorflow.python.framework.test_util) is deprecated and will be removed in a future version. Instructions for updating: Use `self.session()` or `self.cached_session()` instead. W0617 07:19:08.763683 281473617851264 deprecation.py:364] From /usr/lib/python3.11/contextlib.py:105: TensorFlowTestCase.test_session (from tensorflow.python.framework.test_util) is deprecated and will be removed in a future version. Instructions for updating: Use `self.session()` or `self.cached_session()` instead. 2023-06-17 07:19:08.839313: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:382] MLIR V1 optimization pass is not enabled INFO:tensorflow:time(__main__.RaggedCrossOpTest.testRaggedCrossBatchSizeZero): 0.66s I0617 07:19:09.418728 281473617851264 test_util.py:2464] time(__main__.RaggedCrossOpTest.testRaggedCrossBatchSizeZero): 0.66s INFO:tensorflow:Running testRaggedCrossBatchSizeZero in EAGER mode. I0617 07:19:09.422218 281473617851264 test_util.py:1503] Running testRaggedCrossBatchSizeZero in EAGER mode. INFO:tensorflow:time(__main__.RaggedCrossOpTest.testRaggedCrossBatchSizeZero): 0.15s I0617 07:19:09.567564 281473617851264 test_util.py:2464] time(__main__.RaggedCrossOpTest.testRaggedCrossBatchSizeZero): 0.15s [ OK ] RaggedCrossOpTest.testRaggedCrossBatchSizeZero [ RUN ] RaggedCrossOpTest.testRaggedCrossFiveInputs INFO:tensorflow:Running testRaggedCrossFiveInputs in GRAPH mode. I0617 07:19:09.570567 281473617851264 test_util.py:1494] Running testRaggedCrossFiveInputs in GRAPH mode. INFO:tensorflow:time(__main__.RaggedCrossOpTest.testRaggedCrossFiveInputs): 0.04s I0617 07:19:09.607452 281473617851264 test_util.py:2464] time(__main__.RaggedCrossOpTest.testRaggedCrossFiveInputs): 0.04s INFO:tensorflow:Running testRaggedCrossFiveInputs in EAGER mode. I0617 07:19:09.608508 281473617851264 test_util.py:1503] Running testRaggedCrossFiveInputs in EAGER mode. INFO:tensorflow:time(__main__.RaggedCrossOpTest.testRaggedCrossFiveInputs): 0.02s I0617 07:19:09.625292 281473617851264 test_util.py:2464] time(__main__.RaggedCrossOpTest.testRaggedCrossFiveInputs): 0.02s [ OK ] RaggedCrossOpTest.testRaggedCrossFiveInputs [ RUN ] RaggedCrossOpTest.testRaggedCrossHashed100BucketsCustomKey INFO:tensorflow:Running testRaggedCrossHashed100BucketsCustomKey in GRAPH mode. I0617 07:19:09.627071 281473617851264 test_util.py:1494] Running testRaggedCrossHashed100BucketsCustomKey in GRAPH mode. INFO:tensorflow:time(__main__.RaggedCrossOpTest.testRaggedCrossHashed100BucketsCustomKey): 0.47s I0617 07:19:10.096983 281473617851264 test_util.py:2464] time(__main__.RaggedCrossOpTest.testRaggedCrossHashed100BucketsCustomKey): 0.47s INFO:tensorflow:Running testRaggedCrossHashed100BucketsCustomKey in EAGER mode. I0617 07:19:10.100655 281473617851264 test_util.py:1503] Running testRaggedCrossHashed100BucketsCustomKey in EAGER mode. INFO:tensorflow:time(__main__.RaggedCrossOpTest.testRaggedCrossHashed100BucketsCustomKey): 0.1s I0617 07:19:10.199183 281473617851264 test_util.py:2464] time(__main__.RaggedCrossOpTest.testRaggedCrossHashed100BucketsCustomKey): 0.1s [ OK ] RaggedCrossOpTest.testRaggedCrossHashed100BucketsCustomKey [ RUN ] RaggedCrossOpTest.testRaggedCrossHashed100BucketsDefaultKey INFO:tensorflow:Running testRaggedCrossHashed100BucketsDefaultKey in GRAPH mode. I0617 07:19:10.201976 281473617851264 test_util.py:1494] Running testRaggedCrossHashed100BucketsDefaultKey in GRAPH mode. INFO:tensorflow:time(__main__.RaggedCrossOpTest.testRaggedCrossHashed100BucketsDefaultKey): 0.39s I0617 07:19:10.592530 281473617851264 test_util.py:2464] time(__main__.RaggedCrossOpTest.testRaggedCrossHashed100BucketsDefaultKey): 0.39s INFO:tensorflow:Running testRaggedCrossHashed100BucketsDefaultKey in EAGER mode. I0617 07:19:10.596727 281473617851264 test_util.py:1503] Running testRaggedCrossHashed100BucketsDefaultKey in EAGER mode. INFO:tensorflow:time(__main__.RaggedCrossOpTest.testRaggedCrossHashed100BucketsDefaultKey): 0.17s I0617 07:19:10.767754 281473617851264 test_util.py:2464] time(__main__.RaggedCrossOpTest.testRaggedCrossHashed100BucketsDefaultKey): 0.17s [ OK ] RaggedCrossOpTest.testRaggedCrossHashed100BucketsDefaultKey [ RUN ] RaggedCrossOpTest.testRaggedCrossHashedZeroBucketsCustomKey INFO:tensorflow:Running testRaggedCrossHashedZeroBucketsCustomKey in GRAPH mode. I0617 07:19:10.770865 281473617851264 test_util.py:1494] Running testRaggedCrossHashedZeroBucketsCustomKey in GRAPH mode. INFO:tensorflow:time(__main__.RaggedCrossOpTest.testRaggedCrossHashedZeroBucketsCustomKey): 0.69s I0617 07:19:11.457071 281473617851264 test_util.py:2464] time(__main__.RaggedCrossOpTest.testRaggedCrossHashedZeroBucketsCustomKey): 0.69s INFO:tensorflow:Running testRaggedCrossHashedZeroBucketsCustomKey in EAGER mode. I0617 07:19:11.460821 281473617851264 test_util.py:1503] Running testRaggedCrossHashedZeroBucketsCustomKey in EAGER mode. INFO:tensorflow:time(__main__.RaggedCrossOpTest.testRaggedCrossHashedZeroBucketsCustomKey): 0.1s I0617 07:19:11.557895 281473617851264 test_util.py:2464] time(__main__.RaggedCrossOpTest.testRaggedCrossHashedZeroBucketsCustomKey): 0.1s [ OK ] RaggedCrossOpTest.testRaggedCrossHashedZeroBucketsCustomKey [ RUN ] RaggedCrossOpTest.testRaggedCrossHashedZeroBucketsDefaultKey INFO:tensorflow:Running testRaggedCrossHashedZeroBucketsDefaultKey in GRAPH mode. I0617 07:19:11.561136 281473617851264 test_util.py:1494] Running testRaggedCrossHashedZeroBucketsDefaultKey in GRAPH mode. INFO:tensorflow:time(__main__.RaggedCrossOpTest.testRaggedCrossHashedZeroBucketsDefaultKey): 0.71s I0617 07:19:12.269366 281473617851264 test_util.py:2464] time(__main__.RaggedCrossOpTest.testRaggedCrossHashedZeroBucketsDefaultKey): 0.71s INFO:tensorflow:Running testRaggedCrossHashedZeroBucketsDefaultKey in EAGER mode. I0617 07:19:12.272922 281473617851264 test_util.py:1503] Running testRaggedCrossHashedZeroBucketsDefaultKey in EAGER mode. INFO:tensorflow:time(__main__.RaggedCrossOpTest.testRaggedCrossHashedZeroBucketsDefaultKey): 0.1s I0617 07:19:12.370683 281473617851264 test_util.py:2464] time(__main__.RaggedCrossOpTest.testRaggedCrossHashedZeroBucketsDefaultKey): 0.1s [ OK ] RaggedCrossOpTest.testRaggedCrossHashedZeroBucketsDefaultKey [ RUN ] RaggedCrossOpTest.testRaggedCrossHashedZeroKey INFO:tensorflow:Running testRaggedCrossHashedZeroKey in GRAPH mode. I0617 07:19:12.373804 281473617851264 test_util.py:1494] Running testRaggedCrossHashedZeroKey in GRAPH mode. INFO:tensorflow:time(__main__.RaggedCrossOpTest.testRaggedCrossHashedZeroKey): 0.02s I0617 07:19:12.398590 281473617851264 test_util.py:2464] time(__main__.RaggedCrossOpTest.testRaggedCrossHashedZeroKey): 0.02s INFO:tensorflow:Running testRaggedCrossHashedZeroKey in EAGER mode. I0617 07:19:12.399572 281473617851264 test_util.py:1503] Running testRaggedCrossHashedZeroKey in EAGER mode. INFO:tensorflow:time(__main__.RaggedCrossOpTest.testRaggedCrossHashedZeroKey): 0.01s I0617 07:19:12.413092 281473617851264 test_util.py:2464] time(__main__.RaggedCrossOpTest.testRaggedCrossHashedZeroKey): 0.01s [ OK ] RaggedCrossOpTest.testRaggedCrossHashedZeroKey [ RUN ] RaggedCrossOpTest.testRaggedCrossInvalidValue INFO:tensorflow:Running testRaggedCrossInvalidValue in GRAPH mode. I0617 07:19:12.414169 281473617851264 test_util.py:1494] Running testRaggedCrossInvalidValue in GRAPH mode. terminate called after throwing an instance of 'std::bad_alloc' what(): std::bad_alloc Fatal Python error: Aborted Thread 0x0000ffffaf017380 (most recent call first): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/org_tensorflow/tensorflow/python/client/session.py", line 1477 in _call_tf_sessionrun File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/org_tensorflow/tensorflow/python/client/session.py", line 1384 in _run_fn File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/org_tensorflow/tensorflow/python/client/session.py", line 1401 in _do_call File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/org_tensorflow/tensorflow/python/client/session.py", line 1394 in _do_run File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/org_tensorflow/tensorflow/python/client/session.py", line 1214 in _run File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/org_tensorflow/tensorflow/python/client/session.py", line 971 in run File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 2061 in run File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 2693 in evaluate File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/org_tensorflow/tensorflow/python/ops/ragged/ragged_cross_op_test.py", line 478 in testRaggedCrossInvalidValue File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/org_tensorflow/tensorflow/python/framework/test_util.py", line 1498 in decorated File "/usr/lib/python3.11/unittest/case.py", line 579 in _callTestMethod File "/usr/lib/python3.11/unittest/case.py", line 623 in run File "/usr/lib/python3.11/unittest/case.py", line 678 in __call__ File "/usr/lib/python3.11/unittest/suite.py", line 122 in run File "/usr/lib/python3.11/unittest/suite.py", line 84 in __call__ File "/usr/lib/python3.11/unittest/suite.py", line 122 in run File "/usr/lib/python3.11/unittest/suite.py", line 84 in __call__ File "/usr/lib/python3.11/unittest/runner.py", line 217 in run File "/usr/lib/python3.11/unittest/main.py", line 274 in runTests File "/usr/lib/python3.11/unittest/main.py", line 102 in __init__ File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/absl_py/absl/testing/absltest.py", line 2537 in _run_and_get_tests_result File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/absl_py/absl/testing/absltest.py", line 2568 in run_tests File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/absl_py/absl/testing/absltest.py", line 2156 in _run_in_app File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/absl_py/absl/testing/absltest.py", line 2049 in main File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/org_tensorflow/tensorflow/python/platform/googletest.py", line 51 in g_main File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/absl_py/absl/app.py", line 258 in _run_main File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/absl_py/absl/app.py", line 312 in run File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/org_tensorflow/tensorflow/python/platform/googletest.py", line 60 in main_wrapper File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/org_tensorflow/tensorflow/python/platform/benchmark.py", line 489 in benchmarks_main File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/org_tensorflow/tensorflow/python/platform/googletest.py", line 62 in main File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/ops/ragged/ragged_cross_op_test.runfiles/org_tensorflow/tensorflow/python/ops/ragged/ragged_cross_op_test.py", line 497 in Extension modules: numpy.core._multiarray_umath, numpy.core._multiarray_tests, numpy.linalg._umath_linalg, numpy.fft._pocketfft_internal, numpy.random._common, numpy.random.bit_generator, numpy.random._bounded_integers, numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox, numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, google._upb._message, tensorflow.python.framework.fast_tensor_util (total: 15) ================================================================================ //tensorflow/c:c_api_experimental_test PASSED in 37.0s //tensorflow/c:c_api_function_test PASSED in 37.3s //tensorflow/c:c_api_test_cpu PASSED in 41.1s //tensorflow/c:c_test PASSED in 37.4s //tensorflow/c:env_test_cpu PASSED in 29.0s //tensorflow/c:kernels_test_cpu PASSED in 43.1s //tensorflow/c:ops_test PASSED in 28.6s //tensorflow/c:while_loop_test PASSED in 42.1s //tensorflow/c/eager:c_api_cluster_test_cpu PASSED in 52.6s //tensorflow/c/eager:c_api_remote_function_test_cpu PASSED in 50.0s //tensorflow/c/eager:c_api_remote_test_cpu PASSED in 43.3s //tensorflow/c/eager:c_api_test_cpu PASSED in 58.1s //tensorflow/c/eager:custom_device_test PASSED in 43.2s //tensorflow/c/eager/parallel_device:parallel_device_lib_test PASSED in 41.5s //tensorflow/c/eager/parallel_device:parallel_device_remote_test PASSED in 55.4s //tensorflow/c/eager/parallel_device:parallel_device_test PASSED in 51.1s //tensorflow/c/experimental/filesystem/plugins/gcs:expiring_lru_cache_test PASSED in 0.2s //tensorflow/c/experimental/filesystem/plugins/gcs:ram_file_block_cache_test PASSED in 2.3s //tensorflow/c/experimental/grappler:grappler_test PASSED in 31.9s //tensorflow/c/experimental/ops/gen/common:case_format_test PASSED in 0.5s //tensorflow/c/experimental/ops/gen/cpp:cpp_generator_test PASSED in 1.3s //tensorflow/c/experimental/ops/gen/cpp/renderers:renderer_test PASSED in 0.5s //tensorflow/c/experimental/saved_model/core:constant_loading_test PASSED in 13.3s //tensorflow/c/experimental/saved_model/core:object_graph_traversal_test PASSED in 15.0s //tensorflow/c/experimental/saved_model/core:saved_variable_loading_test PASSED in 35.7s //tensorflow/c/experimental/saved_model/core:signature_flattening_test PASSED in 17.9s //tensorflow/c/experimental/saved_model/core:tf_concrete_function_loading_test PASSED in 20.1s //tensorflow/c/experimental/saved_model/core/ops:restore_ops_test PASSED in 17.1s //tensorflow/c/experimental/saved_model/core/ops:variable_ops_test PASSED in 24.4s //tensorflow/c/experimental/saved_model/internal:saved_model_api_test PASSED in 38.3s //tensorflow/c/experimental/stream_executor:stream_executor_test PASSED in 0.2s //tensorflow/c/kernels:bitcast_op_test PASSED in 0.9s //tensorflow/c/kernels:summary_op_benchmark_test PASSED in 1.0s //tensorflow/c/kernels:summary_op_test PASSED in 0.7s //tensorflow/c/kernels:tensor_shape_utils_test PASSED in 0.2s //tensorflow/cc:cc_op_gen_test PASSED in 0.2s //tensorflow/cc:client_client_session_test PASSED in 3.5s //tensorflow/cc:coordinator_test PASSED in 4.5s //tensorflow/cc:framework_cc_ops_test PASSED in 3.4s //tensorflow/cc:framework_gradient_checker_test PASSED in 6.4s //tensorflow/cc:framework_gradients_test PASSED in 5.2s //tensorflow/cc:framework_scope_test PASSED in 0.7s //tensorflow/cc:framework_while_gradients_test PASSED in 4.1s //tensorflow/cc:gradients_array_grad_test PASSED in 16.5s //tensorflow/cc:gradients_data_flow_grad_test PASSED in 2.6s //tensorflow/cc:gradients_functional_grad_test PASSED in 2.9s //tensorflow/cc:gradients_image_grad_test PASSED in 7.8s //tensorflow/cc:gradients_linalg_grad_test PASSED in 4.3s //tensorflow/cc:gradients_manip_grad_test PASSED in 2.3s //tensorflow/cc:gradients_math_grad_test PASSED in 8.5s //tensorflow/cc:gradients_nn_grad_test PASSED in 11.1s //tensorflow/cc:gradients_resource_variable_grad_test PASSED in 3.9s //tensorflow/cc:ops_const_op_test PASSED in 1.0s //tensorflow/cc:ops_while_loop_test PASSED in 3.1s //tensorflow/cc:queue_runner_test PASSED in 12.9s //tensorflow/cc/experimental/base/tests:tensor_test PASSED in 0.2s //tensorflow/cc/experimental/base/tests:tensorhandle_test PASSED in 40.6s //tensorflow/cc/experimental/libexport:load_test PASSED in 0.9s //tensorflow/cc/experimental/libexport:save_test PASSED in 0.3s //tensorflow/cc/experimental/libtf:libtf_module_test PASSED in 36.0s //tensorflow/cc/experimental/libtf:libtf_object_test PASSED in 0.2s //tensorflow/cc/experimental/libtf:libtf_perf_test PASSED in 0.7s //tensorflow/cc/experimental/libtf:libtf_runtime_test PASSED in 41.4s //tensorflow/cc/experimental/libtf:libtf_transform_test PASSED in 41.4s //tensorflow/cc/experimental/libtf:libtf_value_test PASSED in 0.1s //tensorflow/cc/experimental/libtf:libtf_visit_test PASSED in 0.4s //tensorflow/cc/experimental/libtf/impl:iostream_test PASSED in 0.3s //tensorflow/cc/experimental/libtf/impl:none_test PASSED in 0.1s //tensorflow/cc/experimental/libtf/impl:scalars_test PASSED in 0.1s //tensorflow/cc/experimental/libtf/impl:string_test PASSED in 0.1s //tensorflow/cc/experimental/libtf/impl:tensor_spec_test PASSED in 0.1s //tensorflow/cc/saved_model:bundle_v2_test PASSED in 0.1s //tensorflow/cc/saved_model:fingerprinting_test PASSED in 1.1s //tensorflow/cc/saved_model:metrics_test PASSED in 0.1s //tensorflow/cc/saved_model:reader_test PASSED in 0.1s //tensorflow/cc/saved_model:saved_model_bundle_lite_test PASSED in 6.1s //tensorflow/cc/saved_model:saved_model_bundle_test PASSED in 7.5s //tensorflow/cc/saved_model:util_test PASSED in 0.2s //tensorflow/cc/saved_model/experimental/tests:saved_model_api_test PASSED in 38.7s //tensorflow/cc/tools:freeze_saved_model_test PASSED in 4.0s //tensorflow/compiler/aot:codegen_test PASSED in 45.3s //tensorflow/compiler/jit:compilability_check_util_test PASSED in 27.2s //tensorflow/compiler/jit:deadness_analysis_test PASSED in 12.4s //tensorflow/compiler/jit:device_compilation_cache_test PASSED in 6.6s //tensorflow/compiler/jit:device_compilation_cluster_signature_test PASSED in 5.2s //tensorflow/compiler/jit:device_compilation_profiler_test PASSED in 27.0s //tensorflow/compiler/jit:device_compiler_client_test PASSED in 5.0s //tensorflow/compiler/jit:device_compiler_disable_test PASSED in 25.5s //tensorflow/compiler/jit:device_executable_persistor_test PASSED in 19.9s //tensorflow/compiler/jit:device_util_test PASSED in 5.1s //tensorflow/compiler/jit:encapsulate_util_test PASSED in 0.8s //tensorflow/compiler/jit:node_matchers_test PASSED in 0.8s //tensorflow/compiler/jit:resource_operation_safety_analysis_test PASSED in 10.4s //tensorflow/compiler/jit:shape_inference_test PASSED in 0.9s //tensorflow/compiler/jit:xla_activity_listener_test PASSED in 38.4s //tensorflow/compiler/jit:xla_cluster_util_test PASSED in 17.9s //tensorflow/compiler/jit:xla_compile_util_test PASSED in 7.4s //tensorflow/compiler/jit:xla_kernel_creator_test PASSED in 14.9s //tensorflow/compiler/jit:xla_launch_util_test PASSED in 23.9s //tensorflow/compiler/jit/tests:auto_clustering_test PASSED in 29.7s //tensorflow/compiler/mlir:mlir_graph_optimization_pass_test PASSED in 18.1s //tensorflow/compiler/mlir:register_common_dialects_test PASSED in 23.1s //tensorflow/compiler/mlir/lite:lstm_utils_test PASSED in 0.7s //tensorflow/compiler/mlir/lite:perception_ops_utils_test PASSED in 1.0s //tensorflow/compiler/mlir/lite:size_utils_test PASSED in 0.2s //tensorflow/compiler/mlir/lite:tftext_utils_test PASSED in 1.8s //tensorflow/compiler/mlir/lite/experimental/remat:rematerializer_test PASSED in 1.0s //tensorflow/compiler/mlir/lite/experimental/tac:execution_metadata_exporter_test PASSED in 6.6s //tensorflow/compiler/mlir/lite/experimental/tac/tests:compute-cost.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/experimental/tac/tests:device-transform-gpu.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/lite/experimental/tac/tests:device-transform-nnapi.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/experimental/tac/tests:fold-constants-to-subgraph.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/experimental/tac/tests:get-alternative-subgraph.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/experimental/tac/tests:get-op-cost.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/experimental/tac/tests:pick-subgraphs.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/experimental/tac/tests:raise-target-subgraphs.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/experimental/tac/tests:tac-filter.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/experimental/tac/tests:target-annotation.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/experimental/tac/tests/e2e:device-transform-nnapi.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/experimental/tac/tests/e2e:simple-graph.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/metrics:error_collector_inst_test PASSED in 1.0s //tensorflow/compiler/mlir/lite/quantization:numerical_utils_test PASSED in 0.3s //tensorflow/compiler/mlir/lite/quantization/lite:quantize_model_test PASSED in 13.5s //tensorflow/compiler/mlir/lite/quantization/lite:quantize_weights_test PASSED in 12.9s //tensorflow/compiler/mlir/lite/quantization/tensorflow/tests:fallback_to_flex_ops_default.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/quantization/tensorflow/tests:fallback_to_flex_ops_legacy.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/quantization/tensorflow/tests:tf_to_quant.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/quantization/tensorflow/tests:tf_to_quant_4bit.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/quantization/tests:import_quant_stats.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/lite/sparsity:sparsify_model_test PASSED in 0.9s //tensorflow/compiler/mlir/lite/stablehlo/tests:fold_broadcast.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/stablehlo/tests:fuse_mhlo_convolution.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-inplaceupdate.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-skip-quantization-ops.mlir.test PASSED in 2.1s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tf-fb-tf.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-add.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-broadcast_in_dim.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-clamp.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-compare.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-concat.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-constant.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-conv.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-dot.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-gather.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-max.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-mul.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-pad.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-reshape.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-rsqrt.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-scatter.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-sub.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-add.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-broadcast.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-clamp.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-concat.mlir.test PASSED in 2.0s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-constant.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-conv.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-max.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-mul.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-pad.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-reshape.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-rsqrt.mlir.test PASSED in 3.3s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-sub.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/stablehlo/tests:odml-to-stablehlo-allow-tf.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/stablehlo/tests:odml-to-stablehlo-smuggle-resize.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:optimize.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:tf-tfl-translate-serialize-stablehlo-clamp.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/stablehlo/tests:tf-tfl-translate-serialize-stablehlo-concat.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/lite/stablehlo/tests:tf-tfl-translate-serialize-stablehlo-conv.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/stablehlo/tests:tf-tfl-translate-serialize-stablehlo-division.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/stablehlo/tests:tf-tfl-translate-serialize-stablehlo-logistic.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:tf-tfl-translate-serialize-stablehlo-multiply.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:tf-tfl-translate-serialize-stablehlo-reduce-window.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:tf-tfl-translate-serialize-stablehlo-resize-bilinear.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:tf-tfl-translate-serialize-stablehlo-subtract.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/stablehlo/tests:tf-tfl-translate-serialize-stablehlo.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:tf-tfl-translate-tf-quantize.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:unfuse_mhlo_batch_norm.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests:analyze-variables.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests:canonicalize.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests:decompose-hybrid-quantization.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests:default_quant_params.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests:dilated-conv.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests:fuse-tftext.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/lite/tests:get-arithmetic-count.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests:guarantee_func_has_one_use.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/lite/tests:inlining.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests:insert_call_once_op.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests:legalize-tf-assert.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests:legalize-tf-hashtables.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/lite/tests:legalize-tf-no-runtime-verification.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests:legalize-tf-variables.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests:legalize-tf-while.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/lite/tests:legalize-tf.mlir.test PASSED in 2.7s //tensorflow/compiler/mlir/lite/tests:legalize_jax_random.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/lite/tests:lift_tflite_flex_ops.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/lite/tests:lower-static-tensor-list-default-to-single-batch.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests:lower-static-tensor-list-enable-dynamic-update-slice.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests:lower-static-tensor-list.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests:modify_io_nodes.mlir.test PASSED in 2.3s //tensorflow/compiler/mlir/lite/tests:ops.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests:optimize-after-quantization.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests:optimize.mlir.test PASSED in 1.9s //tensorflow/compiler/mlir/lite/tests:optimize_functional_ops.mlir.test PASSED in 1.8s //tensorflow/compiler/mlir/lite/tests:optimize_no_verify.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests:optimize_op_order.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests:partitioned-topological-sort.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/lite/tests:pin-ops-with-side-effects.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests:post-quantize-dynamic-range.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/lite/tests:post-quantize.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/lite/tests:prepare-composite-functions-tf.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/lite/tests:prepare-quantize-dynamic-range.mlir.test PASSED in 2.3s //tensorflow/compiler/mlir/lite/tests:prepare-quantize-post-training-16bits.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests:prepare-quantize-post-training.mlir.test PASSED in 3.5s //tensorflow/compiler/mlir/lite/tests:prepare-quantize-signed.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests:prepare-quantize.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/lite/tests:prepare-tf-fake-quant-4bit.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests:prepare-tf-fake-quant.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/lite/tests:prepare-tf-with-allowing-bf16-and-f16-type-legalization.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests:prepare-tf.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/lite/tests:quantize-dynamic-range.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/lite/tests:quantize-numeric-verify.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests:quantize-variables.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/lite/tests:quantize.mlir.test PASSED in 2.9s //tensorflow/compiler/mlir/lite/tests:raise-custom-ops.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/lite/tests:reduce_while_operands.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests:shape-inference.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests:split-merged-operands.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests:tfl_while_op_licm.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests:tfl_while_outline.mlir.test PASSED in 1.9s //tensorflow/compiler/mlir/lite/tests:trim-functions-tf.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests:unfold-large-splat-constant.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/debuginfo:v1_1.0_224_frozen.wrong_attr.line.part.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/debuginfo:v1_1.0_224_frozen.wrong_attr.stack.part.pbtxt.test PASSED in 1.4s //tensorflow/compiler/mlir/lite/tests/end2end:add.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/end2end:back2back_fake_quant.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/end2end:control_flow_v1.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/end2end:conv_2d.pbtxt.test PASSED in 1.1s //tensorflow/compiler/mlir/lite/tests/end2end:conv_2d_nchw.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/end2end:custom_opdef.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/end2end:disallow_stateful_partitioned_call.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/end2end:fake_quant_per_channel.pbtxt.test PASSED in 1.3s //tensorflow/compiler/mlir/lite/tests/end2end:fake_quant_per_channel_4bit.pbtxt.test PASSED in 1.1s //tensorflow/compiler/mlir/lite/tests/end2end:fake_quant_without_identity.pbtxt.test PASSED in 1.0s //tensorflow/compiler/mlir/lite/tests/end2end:fake_quant_without_identity_4bit.pbtxt.test PASSED in 1.3s //tensorflow/compiler/mlir/lite/tests/end2end:graph-input-node.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/end2end:graph_with_placeholder_with_default.pbtxt.test PASSED in 1.4s //tensorflow/compiler/mlir/lite/tests/end2end:if_op.pbtxt.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests/end2end:quant_stats.pbtxt.test PASSED in 1.3s //tensorflow/compiler/mlir/lite/tests/end2end:unroll_batch_matmul.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/end2end:unroll_batch_matmul_disabled.pbtxt.test PASSED in 1.0s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:basic_lstm.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:bucketize.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:constants.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:control_edges.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:custom_op.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:dynamic_shape.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:empty_input_output_names.json.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:external_constant.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:if_op.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:import_json.json.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:importer_test_min_max.cc.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:importer_test_min_max.cc.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:input_arrays.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:input_output_names_attr.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:legacy_reshape.json.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:lstm.json.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:lstm.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:many_attribute_op.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:math.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:matmul.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:multi_output_op.json.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:optional.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:optional_input.json.test PASSED in 1.0s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:output_arrays.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:pruning.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:pruning_function_input_as_output.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:quant_stats.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:quantization.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:reshape.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:signature.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:signature_with_multiple_entry_points.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:simple.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:tf_variant_type.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:unranked_function_output.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:unranked_tensor.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:while_op.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests/mlir2exec:tfl_while_op.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:basic_lstm.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:bucketize.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:custom_op_with_tflite_op.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:depthwise_conv2d.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:depthwise_conv2d_v2.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:disable_builtin.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:disable_custom.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:disable_flex.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:disable_flex_enable_builtin.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:dynamic_shape_constant.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:fake_quant.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:flex_exclusively.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:flex_op_with_complex128.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:flex_op_with_f64.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:flex_op_with_tflite_op.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:fully_connected.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:fully_connected_v2.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:hashtable_resource.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:if_op.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:logical.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:low_bit_packing.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:lstm.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:lstm_asym_attr.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:lstm_quantized.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:math.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:metadata.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:mul_v2.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:mul_v3.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:nn.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:numeric_verify.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:optional.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:quantization.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:reshape.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:signature_def.mlir.test PASSED in 1.9s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:signature_def_output_override.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:signature_def_with_multiple_entry_points.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:signature_def_with_no_inputs.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:simple.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:simple_with_connected_control_nodes.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:simple_with_unconnected_control_nodes.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:svdf.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:svdf_v2.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:tf_entry_function.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:tfl_while_op.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:transpose_conv_optional.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:type_attr.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:unidirectional_sequence_lstm.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:unidirectional_sequence_rnn.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:unranked_tensor.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:unsorted_segment_prod.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:variant_type_on_func.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:variant_type_on_op.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:while_op.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/quantization/stablehlo:math_utils_test PASSED in 0.1s //tensorflow/compiler/mlir/quantization/stablehlo/tests:fill_quantization_options_test PASSED in 0.1s //tensorflow/compiler/mlir/quantization/tensorflow/calibrator:calibrator_singleton_test PASSED in 0.7s //tensorflow/compiler/mlir/quantization/tensorflow/calibrator:custom_aggregator_op_test PASSED in 13.6s //tensorflow/compiler/mlir/quantization/tensorflow/cc:const_op_size_test PASSED in 0.5s //tensorflow/compiler/mlir/quantization/tensorflow/cc:convert_asset_args_test PASSED in 7.2s //tensorflow/compiler/mlir/quantization/tensorflow/cc:save_variables_test PASSED in 0.5s //tensorflow/compiler/mlir/quantization/tensorflow/cc:status_macro_test PASSED in 0.1s //tensorflow/compiler/mlir/quantization/tensorflow/debugging:mlir_dump_test PASSED in 0.2s //tensorflow/compiler/mlir/quantization/tensorflow/python:concurrency_test PASSED in 41.0s //tensorflow/compiler/mlir/quantization/tensorflow/python:pywrap_quantize_model_test PASSED in 15.2s //tensorflow/compiler/mlir/quantization/tensorflow/python:representative_dataset_test PASSED in 7.0s //tensorflow/compiler/mlir/quantization/tensorflow/tests:cast_bf16_ops_to_f32.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/quantization/tensorflow/tests:convert_custom_aggregation_op_to_quant_stats.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/quantization/tensorflow/tests:convert_fake_quant_to_qdq.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/quantization/tensorflow/tests:convert_tf_quant_ops_to_mhlo.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/quantization/tensorflow/tests:convert_tpu_model_to_cpu.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/quantization/tensorflow/tests:duplicate_shape_determining_constants.mlir.test PASSED in 2.1s //tensorflow/compiler/mlir/quantization/tensorflow/tests:fake_quant_e2e_flow.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/quantization/tensorflow/tests:fake_quant_e2e_xla.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/quantization/tensorflow/tests:insert_custom_aggregation_ops.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/quantization/tensorflow/tests:insert_main_function.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/quantization/tensorflow/tests:insert_quantized_functions.mlir.test PASSED in 1.8s //tensorflow/compiler/mlir/quantization/tensorflow/tests:insert_quantized_functions_drq.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/quantization/tensorflow/tests:insert_quantized_functions_weight_only.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/quantization/tensorflow/tests:insert_restore_op.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/quantization/tensorflow/tests:insert_save_op.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/quantization/tensorflow/tests:issue_ids_of_custom_aggregation_ops.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/quantization/tensorflow/tests:lift_hashtable_ops_as_args.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/quantization/tensorflow/tests:lift_quantizable_spots_as_functions.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/quantization/tensorflow/tests:lift_quantizable_spots_as_functions_drq.mlir.test PASSED in 1.7s //tensorflow/compiler/mlir/quantization/tensorflow/tests:lift_quantizable_spots_as_functions_drq_min_elements.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/quantization/tensorflow/tests:lift_quantizable_spots_as_functions_xla.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/quantization/tensorflow/tests:mark_functions_noinline.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/quantization/tensorflow/tests:merge_duplicate_resource_ops.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/quantization/tensorflow/tests:merge_initializer_function_ops_to_main.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/quantization/tensorflow/tests:merge_save_function_ops_to_main.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/quantization/tensorflow/tests:optimize.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/quantization/tensorflow/tests:prepare_lifting.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/quantization/tensorflow/tests:prepare_quantize.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/quantization/tensorflow/tests:prepare_quantize_drq.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/quantization/tensorflow/tests:prepare_quantize_drq_per_channel.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/quantization/tensorflow/tests:prepare_quantize_ptq.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/quantization/tensorflow/tests:prepare_quantize_ptq_per_channel.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/quantization/tensorflow/tests:preprocess_op.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/quantization/tensorflow/tests:preprocess_op_weight_only.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/quantization/tensorflow/tests:quantize.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/quantization/tensorflow/tests:quantize_composite_functions.mlir.test PASSED in 2.8s //tensorflow/compiler/mlir/quantization/tensorflow/tests:quantize_composite_functions_drq.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/quantization/tensorflow/tests:quantize_composite_functions_weight_only.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/quantization/tensorflow/tests:quantize_composite_functions_xla.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/quantization/tensorflow/tests:quantize_drq.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/quantization/tensorflow/tests:quantize_xla.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/quantization/tensorflow/tests:remove_var_init_by_const.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/quantization/tensorflow/tests:replace_cast_hacks_with_tf_xla_ops.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/quantization/tensorflow/tests:replace_cast_hacks_with_tf_xla_ops_large_constants.mlir.test PASSED in 14.7s //tensorflow/compiler/mlir/quantization/tensorflow/tests:unfreeze_constants.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/quantization/tensorflow/utils:tf_to_xla_attribute_utils_test PASSED in 44.1s //tensorflow/compiler/mlir/stablehlo:stablehlo_test PASSED in 0.2s //tensorflow/compiler/mlir/tensorflow:bridge_logger_test PASSED in 5.9s //tensorflow/compiler/mlir/tensorflow:call_graph_util_test PASSED in 1.3s //tensorflow/compiler/mlir/tensorflow:cluster_util_test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow:convert_tensor_test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow:convert_type_test PASSED in 0.1s //tensorflow/compiler/mlir/tensorflow:device_util_test PASSED in 0.4s //tensorflow/compiler/mlir/tensorflow:dump_graph_test PASSED in 0.4s //tensorflow/compiler/mlir/tensorflow:dump_mlir_util_test PASSED in 15.0s //tensorflow/compiler/mlir/tensorflow:error_util_test PASSED in 0.1s //tensorflow/compiler/mlir/tensorflow:tf_saved_model_test PASSED in 0.4s //tensorflow/compiler/mlir/tensorflow:tpu_rewrite_device_util_test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow:xla_rewrite_util_test PASSED in 0.3s //tensorflow/compiler/mlir/tensorflow/tests:add_functions_for_exported_names.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/tensorflow/tests:annotate-parameter-replication.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:batchmatmul_to_einsum.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:breakup-islands.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:cannonicalize_ops_outside_compilation.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:canonicalize.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:canonicalize_compile_and_replicate_attributes.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:check_control_dependencies.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:cluster_formation.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:cluster_ops_by_policy.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:cluster_outlining.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:cluster_tf_ops_pass.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:constant-fold.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:constant_op_device_assignment.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:convert-tf-control-flow-to-scf.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:convert_control_to_data_outputs.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tensorflow/tests:convert_launch_func_to_tf_call.mlir.test PASSED in 1.7s //tensorflow/compiler/mlir/tensorflow/tests:convert_session_initializer_to_function.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:convert_to_legacy_compile_and_replicate_attributes.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:decompose_reduce_dataset.mlir.test PASSED in 1.7s //tensorflow/compiler/mlir/tensorflow/tests:decompose_resource_ops.mlir.test PASSED in 2.4s //tensorflow/compiler/mlir/tensorflow/tests:device_assignment.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:device_assignment_by_func_attr.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:device_attribute_to_launch.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/tensorflow/tests:device_canonicalize.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:device_copy.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:drop_while_shape_invariant.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:einsum.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:embedding_pipelining.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:embedding_sequencing.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:empty-main.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/tensorflow/tests:end-to-end-tpu-reshard-variables.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:executor_canonicalize.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests:executor_island_coarsening.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:executor_island_materialize_const.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:extract_head_tail_outside_compilation.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:extract_outside_compilation.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:extract_tpu_copy_with_dynamic_shape_op.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/tensorflow/tests:fold-broadcast.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:freeze_variables.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:func-attr-invalid.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:func-attr.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:functional-control-flow-to-cfg.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:functional-control-flow-to-regions.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:functionalize-if-fail.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:functionalize-if.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:fused_kernel_matcher.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:gpu_fusion.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:graph_pruning.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:graph_pruning_preserve_ops.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:group_by_dialect.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:guarantee-all-funcs-one-use.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:hoist_loop_invariant.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:hoist_replicate_invariant_resource_writes.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:host_launch_to_outside_compiled.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:init_text_file_to_import.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:init_text_file_to_import_invalid.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:init_text_file_to_import_saved_model.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:inlining.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:isolate-placer.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:launch_outlining.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:launch_to_device_attribute.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:launch_to_device_attribute_legacy.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:layout_optimization_layout_assignment_gpu_cc_60.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:layout_optimization_layout_assignment_gpu_cc_70.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:layout_optimization_layout_assignment_to_nchw.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:layout_optimization_layout_assignment_to_nhwc.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:layout_optimization_move_transposes_begin.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:layout_optimization_move_transposes_end.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:layout_optimization_to_nchw.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:layout_optimization_to_nhwc.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/tensorflow/tests:legalize_hlo.mlir.test PASSED in 2.0s //tensorflow/compiler/mlir/tensorflow/tests:legalize_tfg.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:legalize_tfg_arg_control_dep.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:legalize_tfg_with_control_flow.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:localize_var_handles.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:lower_globals_to_ml_program.mlir.test PASSED in 1.9s //tensorflow/compiler/mlir/tensorflow/tests:lower_globals_to_ml_program_invalid.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:lower_quantized.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:lower_tf.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:lower_variable_ops_to_ml_program.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:mark_input_output_aliases.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:mark_ops_for_outside_compilation.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:materialize_passthrough_op.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:merge_control_flow.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:mlprogram.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:name_anonymous_iterators.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:optimize-arg-operand-constraint.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:optimize.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:order_by_dialect.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests:outside_compiled_to_host_launch.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:parallel_execute_to_islands.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:parallel_execute_to_islands_legacy.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests:prepare_tpu_computation_for_tf_export.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:promote_resources_to_args.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:promote_resources_to_args_functions.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:promote_var_handles_to_args.mlir.test PASSED in 1.8s //tensorflow/compiler/mlir/tensorflow/tests:readonly_references_to_resources.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:region-control-flow-to-functional.mlir.test PASSED in 1.8s //tensorflow/compiler/mlir/tensorflow/tests:remove_unused_arguments.mlir.test PASSED in 1.8s //tensorflow/compiler/mlir/tensorflow/tests:remove_unused_while_results.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:replica_id_to_device_ordinal.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:replicate_invariant_op_hoisting.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:replicate_tensor_list_init_ops.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tensorflow/tests:replicate_to_island.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:replicate_to_island_legacy.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/tensorflow/tests:resource-alias-analysis-test.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:resource-device-inference.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:resource_analyzer.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests:resource_inlining.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests:resource_op_lifting.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests:rewrite_tpu_embedding_ops.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:roundtrip-tf-executor.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:shape_inference.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:side-effect-analysis-test.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests:sink_constant.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:split_into_island_per_op.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:stack_ops_decomposition.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:strip_noinline.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:strip_saved_module_metadata.mlir.test PASSED in 2.0s //tensorflow/compiler/mlir/tensorflow/tests:strip_tf_attributes.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:tensor_array_ops_decomposition.mlir.test PASSED in 1.8s //tensorflow/compiler/mlir/tensorflow/tests:tensor_list_ops_decomposition.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tf-executor-to-functional.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tensorflow/tests:tf-functional-to-executor.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tf-ops.mlir.test PASSED in 2.2s //tensorflow/compiler/mlir/tensorflow/tests:tf-reduce-identity.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tf_data_fuse_map_and_batch.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:tf_data_fuse_pmap_and_batch.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tf_device_index_selector.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tf_device_ops.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/tensorflow/tests:tf_device_ops_invalid.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:tf_executor_ops.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:tf_executor_ops_invalid.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/tensorflow/tests:tf_executor_ops_location_roundtrip.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/tensorflow/tests:tf_executor_ops_printer.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tf_executor_ops_side_effect.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tf_optimize.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_asset_sinking.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_deduplicate_bound_input_bindings.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_freeze_assets.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_freeze_global_tensors.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_freeze_global_tensors_mutable_tensors.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_initialize_variables_in_session_init.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_initialize_variables_in_session_init_fail.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_lift_variables.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_lift_variables_invalid_session.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_mark_initialized_variables.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_ops.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_ops_invalid.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_optimize_global_tensors.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_optimize_global_tensors_interprocedural.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_remove_vars_in_session_initializer.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tf_side_effect.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tf_trait_folds.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tpu-annotate-dynamic-shape-inputs.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests:tpu-cluster-cleanup-attributes.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tpu-dynamic-layout-pass.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tpu-merge-variables-with-execute.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tpu-multiple-while-body-func.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:tpu-resource-read-for-write.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tpu-variable-runtime-reformatting.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests:tpu_cluster_formation.mlir.test PASSED in 2.2s //tensorflow/compiler/mlir/tensorflow/tests:tpu_colocate_composite_resource_ops.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tpu_colocate_splits.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tpu_device_propagation.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tpu_host_computation_expansion.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tpu_identity_pruning.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tpu_parallel_execute_sink_resource_write.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:tpu_partitioned_op_conversion.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:tpu_reorder_replicate_and_partitioned_inputs.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tpu_resource_partitioning.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tpu_rewrite.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:tpu_sharding_identification.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests:tpu_space_to_depth_pass.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:tpu_tail_with_tobool_op.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/tensorflow/tests:tpu_update_embedding_enqueue_op_inputs.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:tpu_validate_inputs.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:transpose-op.mlir.test PASSED in 2.1s //tensorflow/compiler/mlir/tensorflow/tests:unroll-batch-matmul.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:update_control_dependencies.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:warn_when_using_deprecated_dumps.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:while_licm.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:xla_call_module_deserialization.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:xla_call_module_round_trip.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:xla_call_module_serialization.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:xla_cluster_formation.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:xla_inline_device_ops.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:xla_rewrite.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:xla_rewrite_v2.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:xla_validate_iputs.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:add.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:argument-sharding-invalid.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:argument-sharding.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:constant-folding-hook.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:constant-folding.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:graph-resource.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:graph-resource.pbtxt.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:graph.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:mlir-module-serialized-str-attr.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:replicate-tensor-list-init-ops.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:result-sharding.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:serialized-mlir-module-str-attr-invalid.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:serialized-mlir-module-str-attr.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:shape-inference-after-legalization.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:shape-inference.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:stablehlo_add.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/executor_tpuv1_island_coarsening:executor_tpuv1_island_coarsening.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tensorflow/tests/executor_tpuv1_island_coarsening:while_op.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/executor_tpuv1_island_inlining:executor_tpuv1_inline_tpu_island.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/tensorflow/tests/executor_tpuv1_island_inlining:while_op.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/executor_tpuv1_outline_island:case_op.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/executor_tpuv1_outline_island:executor_tpuv1_outline_tpu_island.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/executor_tpuv1_outline_island:while_op.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:add.pbtxt.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:arg-as-fetch.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:arg-control-dep.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:arg-data-type-with-subtype.pbtxt.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:arg-data-type.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:arg-multi-data-type-with-subtype.pbtxt.test PASSED in 1.4s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:arg-retval-attrs.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:case_op.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:const-values.pbtxt.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:device-arg-retval-attr.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:empty-input-shapes.pbtxt.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:empty-value-attr.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:feed-as-fetch.pbtxt.test PASSED in 1.4s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:feed-control-dep.pbtxt.test PASSED in 2.4s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:force_shared_name_for_resource_ops.pbtxt.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:function-func-attr.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:functional-if-ops.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:functional-while-ops.pbtxt.test PASSED in 1.3s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-as-function-control-ret.pbtxt.test PASSED in 1.4s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-as-function-retval-of-arg.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-as-function.pbtxt.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-custom-operation.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-default-attr.pbtxt.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-device-retval.pbtxt.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-empty-tensor-content.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-func-attr.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-function-call.pbtxt.test PASSED in 1.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-function-control-ret-diff-island.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-function-control-ret-same-island.pbtxt.test PASSED in 1.9s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-function-defs.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-function-input-shapes.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-function-name-bug.pbtxt.test PASSED in 1.4s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-function-resource-args.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-gradient-def.pbtxt.test PASSED in 1.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-input-func-arg-name-collision.pbtxt.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-library.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-malformed.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-scalar-input.pbtxt.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-uint8-return.pbtxt.test PASSED in 1.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-undefined-output.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-version-info.pbtxt.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-while-loop.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:invalid-output-index.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:legacy-fed-input-without-inputs.pbtxt.test PASSED in 2.1s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:merge_node_with_function.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:mlir_passthrough_op.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:multi-output-feeds.pbtxt.test PASSED in 2.2s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:multiple-use-next-iteration.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:node-locations.pbtxt.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:output-shapes-attr.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:output-shapes.pbtxt.test PASSED in 1.4s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:parse_example.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:parse_example_v2.pbtxt.test PASSED in 1.4s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:partial-device-name.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:prune_unused_nodes.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:quint8-const.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:shape-attrs.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:stateful-attribute.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:string-attr.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:switch_n.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:target.pbtxt.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:tensor-list.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:tf-data-pipeline.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:unregistered_kernel.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir/batch_use_same_function:saved_model.pbtxt.test PASSED in 1.8s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:aliasing_arg_attr.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:case.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:convert_tensor.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:derived_shape_attr.mlir.test PASSED in 1.9s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:derived_size_attr.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:device-arg-retval-attr.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:export_main_to_flib.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:fetch_feed_names.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:func_attr.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:func_list_attr.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:function-control-ret.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:function-order.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:function-resource-args-handle-info.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:function-resource-args.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:functional-if-ops.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:functional-while-ops.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:graph-as-function.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:infer_derived_attribute.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:invalid_input.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:legalized_name.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:missing-main.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:noop.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:optional_symbol_ref.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:output-shapes-attr.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:parse_example.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:parse_example_v2.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:preserve-entry-func-names.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:ref-type-attr.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:ref-while-loop.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:shape_list_attr.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:simple.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:simple_tf_dialect_op.mlir.test PASSED in 2.1s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:stringescape.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:switchn.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:tf-gradient-attr.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:tf-legacy-call.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:tf_add.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:tf_identity_n.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:tf_tpu_embedding_ops.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:type_attr.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:type_list_attr.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:unique_name.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:unique_output_name.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:while-loop.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/tf_to_hlo_pipeline:sccp-post-shape-inference.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/tpu_bridge_v1:end_to_end.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tf2xla/api/v0:compile_mlir_util_test PASSED in 5.2s //tensorflow/compiler/mlir/tf2xla/api/v0:compile_tf_graph_test PASSED in 0.8s //tensorflow/compiler/mlir/tf2xla/api/v1:legalize_tf_test PASSED in 26.4s //tensorflow/compiler/mlir/tf2xla/internal:mlir_pass_instrumentation_test PASSED in 6.1s //tensorflow/compiler/mlir/tf2xla/tests:adjust-layout.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tf2xla/tests:convert-mhlo-quant-to-int.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tf2xla/tests:hlo_xla_runtime_pipeline.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tf2xla/tests:hlo_xla_sparsification.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tf2xla/tests:legalize-tf-BatchMatMulV2.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tf2xla/tests:legalize-tf-binary-elementwise.mlir.test PASSED in 2.3s //tensorflow/compiler/mlir/tf2xla/tests:legalize-tf-collective.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/tf2xla/tests:legalize-tf-communication.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tf2xla/tests:legalize-tf-include-tf2xla-fallback.mlir.test PASSED in 2.7s //tensorflow/compiler/mlir/tf2xla/tests:legalize-tf-no-tf2xla-fallback.mlir.test PASSED in 5.2s //tensorflow/compiler/mlir/tf2xla/tests:legalize-tf-prefer-tf2xla.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tf2xla/tests:legalize-tf-types.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tf2xla/tests:legalize-tf-with-tf2xla-hlo-importer.mlir.test PASSED in 1.7s //tensorflow/compiler/mlir/tf2xla/tests:legalize-tf.mlir.test PASSED in 10.0s //tensorflow/compiler/mlir/tf2xla/tests:tfxla_device_specific_transformations_cpu.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tf2xla/tests:tfxla_device_specific_transformations_gpu.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tf2xla/tests:verify-tfxla-legalization-no-chlo.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tf2xla/tests:verify-tfxla-legalization.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tf2xla/transforms:legalization_op_config_test PASSED in 16.4s //tensorflow/compiler/mlir/tf2xla/transforms:tf2xla_rewriter_test PASSED in 16.8s //tensorflow/compiler/mlir/tf2xla/transforms:verify_tfxla_legalization_test PASSED in 18.2s //tensorflow/compiler/mlir/tf2xla/transforms:xla_legalize_targets_test PASSED in 0.7s //tensorflow/compiler/mlir/tf2xla/transforms:xla_legalize_tf_test PASSED in 3.4s //tensorflow/compiler/mlir/tfr:graph_decompose_test PASSED in 21.5s //tensorflow/compiler/mlir/tfr:node_expansion_test PASSED in 7.2s //tensorflow/compiler/mlir/tfr:op_reg_gen_test PASSED in 17.0s //tensorflow/compiler/mlir/tfr:tfr_decompose_ctx_test PASSED in 6.0s //tensorflow/compiler/mlir/tfr:tfr_gen_test PASSED in 20.8s //tensorflow/compiler/mlir/tfr/examples/customization:test_ops_test PASSED in 15.0s //tensorflow/compiler/mlir/tfr/examples/pad:pad_ops_test PASSED in 13.6s //tensorflow/compiler/mlir/tools/kernel_gen/tests:buffer_deallocation.mlir.test PASSED in 2.0s //tensorflow/compiler/mlir/tools/kernel_gen/tests:buffer_reuse.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tools/kernel_gen/tests:bufferize.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tools/kernel_gen/tests:copy_cleanup.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tools/kernel_gen/tests:embed_tf_framework.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tools/kernel_gen/tests:invalid.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/tools/kernel_gen/tests:isinf.mlir.test PASSED in 1.7s //tensorflow/compiler/mlir/tools/kernel_gen/tests:ops.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tools/kernel_gen/tests:parallel_loops_to_sequential.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tools/kernel_gen/tests:rewrite_tf_framework_assert.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/tools/kernel_gen/tests:tanh.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/tools/kernel_gen/tests:tf-legalize-to-lmhlo.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tools/kernel_gen/tests:tf_abi_knowledge.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/tools/kernel_gen/tests:tf_framework_legalize_to_llvm.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tools/kernel_gen/tests:tf_kernel_gpu_launch_to_llvm.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tools/kernel_gen/tests:tf_to_jit_invocations.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/tosa/tests:convert-tfl-uint8.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tosa/tests:convert_metadata.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tosa/tests:fuse-bias-tf.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tosa/tests:lower-complex-types.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tosa/tests:lower_global_tensors.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tosa/tests:multi_add.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tosa/tests:retain_call_once_funcs.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tosa/tests:strip-quant-types.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tosa/tests:strip_metadata.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tosa/tests:tf-tfl-to-tosa-pipeline.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tosa/tests:tf-to-tosa-pipeline.mlir.test PASSED in 2.5s //tensorflow/compiler/mlir/tosa/tests:tfl-to-tosa-dequantize_softmax.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tosa/tests:tfl-to-tosa-pipeline-filtered.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/tosa/tests:tfl-to-tosa-pipeline.mlir.test PASSED in 6.2s //tensorflow/compiler/mlir/tosa/tests:verify_fully_converted.mlir.test PASSED in 0.6s //tensorflow/compiler/tests:adadelta_test_cpu PASSED in 15.4s //tensorflow/compiler/tests:adagrad_da_test_cpu PASSED in 10.1s //tensorflow/compiler/tests:adagrad_test_cpu PASSED in 14.4s //tensorflow/compiler/tests:adam_test_cpu PASSED in 15.9s //tensorflow/compiler/tests:add_n_test_cpu PASSED in 7.2s //tensorflow/compiler/tests:argminmax_test_cpu PASSED in 11.3s //tensorflow/compiler/tests:argminmax_test_cpu_mlir_bridge_test PASSED in 14.9s //tensorflow/compiler/tests:bucketize_op_test_cpu PASSED in 7.4s //tensorflow/compiler/tests:bucketize_op_test_cpu_mlir_bridge_test PASSED in 7.6s //tensorflow/compiler/tests:case_test_cpu PASSED in 18.7s //tensorflow/compiler/tests:cast_ops_test_cpu PASSED in 6.3s //tensorflow/compiler/tests:cast_ops_test_cpu_mlir_bridge_test PASSED in 8.2s //tensorflow/compiler/tests:categorical_op_test_cpu PASSED in 10.4s //tensorflow/compiler/tests:categorical_op_test_cpu_mlir_bridge_test PASSED in 14.0s //tensorflow/compiler/tests:cholesky_op_test_cpu PASSED in 14.5s //tensorflow/compiler/tests:cholesky_op_test_cpu_mlir_bridge_test PASSED in 18.5s //tensorflow/compiler/tests:clustering_test_cpu PASSED in 8.6s //tensorflow/compiler/tests:clustering_test_cpu_mlir_bridge_test PASSED in 7.4s //tensorflow/compiler/tests:concat_ops_test_cpu PASSED in 13.8s //tensorflow/compiler/tests:concat_ops_test_cpu_mlir_bridge_test PASSED in 8.4s //tensorflow/compiler/tests:cond_test_cpu PASSED in 8.3s //tensorflow/compiler/tests:const_arg_test_cpu PASSED in 7.0s //tensorflow/compiler/tests:const_test_cpu PASSED in 7.2s //tensorflow/compiler/tests:data_format_ops_test_cpu PASSED in 9.8s //tensorflow/compiler/tests:data_format_ops_test_cpu_mlir_bridge_test PASSED in 12.4s //tensorflow/compiler/tests:dense_layer_test_cpu PASSED in 11.3s //tensorflow/compiler/tests:dynamic_slice_ops_test_cpu PASSED in 9.0s //tensorflow/compiler/tests:dynamic_slice_ops_test_cpu_mlir_bridge_test PASSED in 14.7s //tensorflow/compiler/tests:dynamic_stitch_test_cpu PASSED in 6.6s //tensorflow/compiler/tests:dynamic_stitch_test_cpu_mlir_bridge_test PASSED in 10.8s //tensorflow/compiler/tests:eager_test_cpu PASSED in 20.3s //tensorflow/compiler/tests:einsum_op_test_cpu PASSED in 7.2s //tensorflow/compiler/tests:einsum_op_test_cpu_mlir_bridge_test PASSED in 8.3s //tensorflow/compiler/tests:ensure_shape_op_test_cpu PASSED in 6.3s //tensorflow/compiler/tests:extract_image_patches_op_test_cpu PASSED in 9.2s //tensorflow/compiler/tests:extract_image_patches_op_test_cpu_mlir_bridge_test PASSED in 8.2s //tensorflow/compiler/tests:fake_quant_ops_test_cpu PASSED in 12.6s //tensorflow/compiler/tests:fake_quant_ops_test_cpu_mlir_bridge_test PASSED in 20.1s //tensorflow/compiler/tests:fifo_queue_test_cpu PASSED in 7.7s //tensorflow/compiler/tests:fifo_queue_test_cpu_mlir_bridge_test PASSED in 7.6s //tensorflow/compiler/tests:ftrl_ops_test_cpu PASSED in 9.4s //tensorflow/compiler/tests:ftrl_ops_test_cpu_mlir_bridge_test PASSED in 12.3s //tensorflow/compiler/tests:function_test_cpu PASSED in 6.3s //tensorflow/compiler/tests:function_test_cpu_mlir_bridge_test PASSED in 7.0s //tensorflow/compiler/tests:gather_nd_op_test_cpu PASSED in 19.9s //tensorflow/compiler/tests:gather_nd_op_test_cpu_mlir_bridge_test PASSED in 8.1s //tensorflow/compiler/tests:gather_test_cpu PASSED in 42.3s //tensorflow/compiler/tests:gather_test_cpu_mlir_bridge_test PASSED in 88.5s //tensorflow/compiler/tests:jit_test_cpu PASSED in 51.0s //tensorflow/compiler/tests:listdiff_op_test_cpu PASSED in 11.0s //tensorflow/compiler/tests:listdiff_op_test_cpu_mlir_bridge_test PASSED in 11.7s //tensorflow/compiler/tests:lrn_ops_test_cpu PASSED in 8.6s //tensorflow/compiler/tests:lrn_ops_test_cpu_mlir_bridge_test PASSED in 8.5s //tensorflow/compiler/tests:lstm_test_cpu PASSED in 26.3s //tensorflow/compiler/tests:manip_ops_test_cpu PASSED in 19.8s //tensorflow/compiler/tests:manip_ops_test_cpu_mlir_bridge_test PASSED in 19.0s //tensorflow/compiler/tests:matrix_band_part_test_cpu PASSED in 34.1s //tensorflow/compiler/tests:matrix_band_part_test_cpu_mlir_bridge_test PASSED in 37.5s //tensorflow/compiler/tests:matrix_inverse_op_test_cpu PASSED in 28.5s //tensorflow/compiler/tests:matrix_inverse_op_test_cpu_mlir_bridge_test PASSED in 27.4s //tensorflow/compiler/tests:matrix_solve_op_test_cpu PASSED in 11.3s //tensorflow/compiler/tests:matrix_solve_op_test_cpu_mlir_bridge_test PASSED in 7.8s //tensorflow/compiler/tests:matrix_triangular_solve_op_test_cpu PASSED in 23.1s //tensorflow/compiler/tests:matrix_triangular_solve_op_test_cpu_mlir_bridge_test PASSED in 47.9s //tensorflow/compiler/tests:momentum_test_cpu PASSED in 14.3s //tensorflow/compiler/tests:nary_ops_test_cpu PASSED in 9.5s //tensorflow/compiler/tests:nary_ops_test_cpu_mlir_bridge_test PASSED in 10.0s //tensorflow/compiler/tests:nullary_ops_test_cpu PASSED in 8.2s //tensorflow/compiler/tests:nullary_ops_test_cpu_mlir_bridge_test PASSED in 7.7s //tensorflow/compiler/tests:placeholder_test_cpu PASSED in 8.9s //tensorflow/compiler/tests:placeholder_test_cpu_mlir_bridge_test PASSED in 7.5s //tensorflow/compiler/tests:proximal_adagrad_test_cpu PASSED in 7.6s //tensorflow/compiler/tests:proximal_gradient_descent_test_cpu PASSED in 9.4s //tensorflow/compiler/tests:quantized_ops_test_cpu PASSED in 15.3s //tensorflow/compiler/tests:reduce_window_test_cpu PASSED in 6.8s //tensorflow/compiler/tests:reduce_window_test_cpu_mlir_bridge_test PASSED in 9.2s //tensorflow/compiler/tests:reshape_op_test_cpu PASSED in 9.7s //tensorflow/compiler/tests:reshape_op_test_cpu_mlir_bridge_test PASSED in 8.3s //tensorflow/compiler/tests:reverse_ops_test_cpu PASSED in 11.0s //tensorflow/compiler/tests:reverse_ops_test_cpu_mlir_bridge_test PASSED in 19.6s //tensorflow/compiler/tests:reverse_sequence_op_test_cpu PASSED in 8.0s //tensorflow/compiler/tests:reverse_sequence_op_test_cpu_mlir_bridge_test PASSED in 8.2s //tensorflow/compiler/tests:risc_ops_test_cpu_mlir_bridge_test PASSED in 6.9s //tensorflow/compiler/tests:rmsprop_test_cpu PASSED in 10.1s //tensorflow/compiler/tests:scatter_nd_op_test_cpu PASSED in 26.8s //tensorflow/compiler/tests:scatter_nd_op_test_cpu_mlir_bridge_test PASSED in 20.5s //tensorflow/compiler/tests:searchsorted_op_test_cpu PASSED in 10.7s //tensorflow/compiler/tests:searchsorted_op_test_cpu_mlir_bridge_test PASSED in 13.2s //tensorflow/compiler/tests:segment_reduction_ops_test_cpu PASSED in 22.6s //tensorflow/compiler/tests:segment_reduction_ops_test_cpu_mlir_bridge_test PASSED in 23.2s //tensorflow/compiler/tests:self_adjoint_eig_op_test_cpu PASSED in 15.7s //tensorflow/compiler/tests:self_adjoint_eig_op_test_cpu_mlir_bridge_test PASSED in 18.5s //tensorflow/compiler/tests:slice_ops_test_cpu PASSED in 32.0s //tensorflow/compiler/tests:slice_ops_test_cpu_mlir_bridge_test PASSED in 18.9s //tensorflow/compiler/tests:sparse_to_dense_op_test_cpu PASSED in 7.2s //tensorflow/compiler/tests:sparse_to_dense_op_test_cpu_mlir_bridge_test PASSED in 8.4s //tensorflow/compiler/tests:stack_ops_test_cpu PASSED in 6.9s //tensorflow/compiler/tests:tensor_float_32_test_cpu PASSED in 14.3s //tensorflow/compiler/tests:tensor_float_32_test_cpu_mlir_bridge_test PASSED in 10.3s //tensorflow/compiler/tests:tensor_list_ops_test_cpu PASSED in 9.9s //tensorflow/compiler/tests:tridiagonal_matmul_ops_test_cpu PASSED in 14.1s //tensorflow/compiler/tests:tridiagonal_matmul_ops_test_cpu_mlir_bridge_test PASSED in 20.5s //tensorflow/compiler/tests:tridiagonal_solve_ops_test_cpu PASSED in 25.0s //tensorflow/compiler/tests:tridiagonal_solve_ops_test_cpu_mlir_bridge_test PASSED in 14.0s //tensorflow/compiler/tests:unique_ops_test_cpu PASSED in 7.1s //tensorflow/compiler/tests:variable_ops_test_cpu PASSED in 37.9s //tensorflow/compiler/tests:variable_ops_test_cpu_mlir_bridge_test PASSED in 19.3s //tensorflow/compiler/tests:where_op_test_cpu PASSED in 10.3s //tensorflow/compiler/tests:while_test_cpu PASSED in 9.4s //tensorflow/compiler/tests:xla_call_module_no_platform_check_test_cpu PASSED in 8.2s //tensorflow/compiler/tests:xla_call_module_test_cpu PASSED in 9.7s //tensorflow/compiler/tests:xla_custom_call_ops_test_cpu PASSED in 8.4s //tensorflow/compiler/tests:xla_device_gpu_test_cpu PASSED in 6.5s //tensorflow/compiler/tests:xla_device_test_cpu PASSED in 11.6s //tensorflow/compiler/tests:xla_device_test_cpu_mlir_bridge_test PASSED in 19.7s //tensorflow/compiler/tests:xla_ops_test_cpu PASSED in 52.0s //tensorflow/compiler/tests:xla_ops_test_cpu_mlir_bridge_test PASSED in 37.7s //tensorflow/compiler/tests:xla_test_test PASSED in 7.7s //tensorflow/compiler/tf2xla:const_analysis_test PASSED in 7.2s //tensorflow/compiler/tf2xla:cpu_function_runtime_test PASSED in 0.1s //tensorflow/compiler/tf2xla:functionalize_cond_test PASSED in 1.6s //tensorflow/compiler/tf2xla:functionalize_control_flow_test PASSED in 1.4s //tensorflow/compiler/tf2xla:fused_batchnorm_reserve_space_test_cpu PASSED in 36.7s //tensorflow/compiler/tf2xla:graph_compiler_test PASSED in 5.6s //tensorflow/compiler/tf2xla:literal_util_test PASSED in 0.6s //tensorflow/compiler/tf2xla:resource_operation_table_test PASSED in 8.3s //tensorflow/compiler/tf2xla:resource_util_test_cpu PASSED in 2.4s //tensorflow/compiler/tf2xla:sharding_util_test PASSED in 0.7s //tensorflow/compiler/tf2xla:tf2xla_opset_test PASSED in 9.7s //tensorflow/compiler/tf2xla:tf2xla_test PASSED in 24.4s //tensorflow/compiler/tf2xla:tf2xla_util_test PASSED in 0.5s //tensorflow/compiler/tf2xla:xla_compiler_test PASSED in 19.6s //tensorflow/compiler/tf2xla:xla_jit_compiled_cpu_function_test PASSED in 25.5s //tensorflow/compiler/tf2xla:xla_op_registry_test PASSED in 5.9s //tensorflow/compiler/tf2xla/kernels:rng_converter_utils_test PASSED in 1.4s //tensorflow/compiler/xla:array2d_test PASSED in 0.1s //tensorflow/compiler/xla:array3d_test PASSED in 0.2s //tensorflow/compiler/xla:array4d_test PASSED in 0.2s //tensorflow/compiler/xla:array_test PASSED in 0.2s //tensorflow/compiler/xla:bit_cast_test PASSED in 0.1s //tensorflow/compiler/xla:comparison_util_test PASSED in 0.4s //tensorflow/compiler/xla:debug_options_parsers_test PASSED in 0.1s //tensorflow/compiler/xla:index_util_test PASSED in 0.2s //tensorflow/compiler/xla:iterator_util_test PASSED in 0.3s //tensorflow/compiler/xla:layout_test PASSED in 0.1s //tensorflow/compiler/xla:layout_util_test PASSED in 0.6s //tensorflow/compiler/xla:literal_test PASSED in 0.2s //tensorflow/compiler/xla:parse_flags_from_env_test PASSED in 0.9s //tensorflow/compiler/xla:permutation_util_test PASSED in 0.6s //tensorflow/compiler/xla:primitive_util_test PASSED in 0.8s //tensorflow/compiler/xla:refcounting_hash_map_test PASSED in 0.2s //tensorflow/compiler/xla:reference_util_test PASSED in 0.4s //tensorflow/compiler/xla:shape_test PASSED in 0.1s //tensorflow/compiler/xla:shape_tree_test PASSED in 0.1s //tensorflow/compiler/xla:shape_util_test PASSED in 2.7s //tensorflow/compiler/xla:status_macros_test PASSED in 0.8s //tensorflow/compiler/xla:text_literal_reader_test PASSED in 0.7s //tensorflow/compiler/xla:text_literal_writer_test PASSED in 0.2s //tensorflow/compiler/xla:types_test PASSED in 0.5s //tensorflow/compiler/xla:util_test PASSED in 0.3s //tensorflow/compiler/xla:window_util_test PASSED in 0.2s //tensorflow/compiler/xla/client:padding_test PASSED in 0.4s //tensorflow/compiler/xla/client:xla_builder_test PASSED in 1.0s //tensorflow/compiler/xla/client/lib:arithmetic_test_cpu PASSED in 10.1s //tensorflow/compiler/xla/client/lib:comparators_test_cpu PASSED in 13.7s //tensorflow/compiler/xla/client/lib:constants_test_cpu PASSED in 8.5s //tensorflow/compiler/xla/client/lib:logdet_test_cpu PASSED in 10.7s //tensorflow/compiler/xla/client/lib:math_test_cpu PASSED in 17.6s //tensorflow/compiler/xla/client/lib:matrix_test_cpu PASSED in 11.3s //tensorflow/compiler/xla/client/lib:pooling_test_cpu PASSED in 9.3s //tensorflow/compiler/xla/client/lib:qr_test_cpu PASSED in 12.4s //tensorflow/compiler/xla/client/lib:slicing_test_cpu PASSED in 9.2s //tensorflow/compiler/xla/client/lib:sorting_test_cpu PASSED in 8.2s //tensorflow/compiler/xla/examples/axpy:stablehlo_compile_test PASSED in 12.3s //tensorflow/compiler/xla/experiments/sm_bandwidth_benchmark:sm_bw_test PASSED in 0.2s //tensorflow/compiler/xla/hlo/evaluator:hlo_evaluator_test PASSED in 20.3s //tensorflow/compiler/xla/hlo/experimental/auto_sharding:auto_sharding_test PASSED in 8.9s //tensorflow/compiler/xla/hlo/transforms:hlo_constant_splitter_test PASSED in 1.0s //tensorflow/compiler/xla/hlo/utils:hlo_live_range_test PASSED in 1.9s //tensorflow/compiler/xla/hlo/utils:hlo_matchers_test PASSED in 1.0s //tensorflow/compiler/xla/hlo/utils:hlo_sharding_util_test PASSED in 0.4s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:collective_ops.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:fft.mlir.test PASSED in 1.3s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:legalize_i1_vector_transfers.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:library_ops_to_cpu_runtime.mlir.test PASSED in 1.8s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:lmhlo_custom_call.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:remove_copies_to_out_params.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:rng_bit_generator.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:xla_abi_legalization.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:xla_cpu_infeed.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:xla_cpu_memref_element_cast_to_llvm.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:xla_cpu_outfeed.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:add_concurrent_regions.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:add_hlo_trace.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:gpu_launch.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:gpu_memcpy.mlir.test PASSED in 1.5s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:gpu_memset.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_case.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_custom_call.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_fft.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_gpu_cholesky.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_gpu_conv.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_gpu_cublas_lt_matmul.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_gpu_gemm.mlir.test PASSED in 1.5s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_infeed.mlir.test PASSED in 3.5s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_outfeed.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_send_recv.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_while.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:memref_get_global_to_arg.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:outline_cuda_graphs.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/framework/tests:legalize-xla-framework.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/mlir/framework/tests:outline-with-xla-framework.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/framework/tests:xla-framework.mlir.test PASSED in 1.3s //tensorflow/compiler/xla/mlir/math/transforms/tests:math_optimization.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/memref/transforms/tests:aligned_allocations.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/runtime/ir/tests:ops.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir/runtime/ir/tests:ops_verify.mlir.test PASSED in 1.4s //tensorflow/compiler/xla/mlir/runtime/ir/tests:testlib.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/runtime/transforms:calling_convention_test PASSED in 0.3s //tensorflow/compiler/xla/mlir/runtime/transforms:type_converter_test PASSED in 1.1s //tensorflow/compiler/xla/mlir/runtime/transforms/tests:compilation_pipeline.mlir.test PASSED in 1.6s //tensorflow/compiler/xla/mlir/runtime/transforms/tests:convert_asserts.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/runtime/transforms/tests:convert_custom_calls.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/runtime/transforms/tests:export_functions.mlir.test PASSED in 1.6s //tensorflow/compiler/xla/mlir/runtime/transforms/tests:ordinal_assignment.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/runtime/transforms/tests:rt_to_llvm.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/rewrites/tests:erase-op-without-results.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/rewrites/tests:inline-scf-while.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/rewrites/tests:reduce-scf-forall-bounds.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/rewrites/tests:replace-op-with-constant.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/rewrites/tests:replace-op-with-value.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/rewrites/tests:replace-operand-with-constant.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/rewrites/tests:return-operands-of-terminator-operands.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/rewrites/tests:truncate-function.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/tests:bisect.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/tests:no-bug.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/tests:snapshot.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir/tools/mlir_replay/public:execution_trace_utils_test PASSED in 2.2s //tensorflow/compiler/xla/mlir/utils:error_util_test PASSED in 0.2s //tensorflow/compiler/xla/mlir/xla_cpu/tests:bufferize.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/xla_cpu/tests:invalid.mlir.test PASSED in 0.3s //tensorflow/compiler/xla/mlir/xla_cpu/tests:ops.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/bufferization/hlo_one_shot_bufferize.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/chlo/chlo_legalize_to_hlo_broadcasts.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/chlo/chlo_legalize_to_hlo_no_broadcasts.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/chlo/chlo_legalize_to_mhlo.mlir.test PASSED in 2.2s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/chlo/sparse_chlo_legalize_to_linalg.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/deallocation/analysis.mlir.test PASSED in 2.2s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/deallocation/buffer_reuse.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/deallocation/convert_deallocation_ops_to_llvm.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/deallocation/deallocate.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/deallocation/deallocate_invalid.mlir.test PASSED in 0.3s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/deallocation/deallocation_ops.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/deallocation/deallocation_simplification.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/deallocation/deallocation_to_scf.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/deallocation/split_alloc_tensors.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/add_debug_info.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/bufferization.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/collapse-shape.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/collect_stats.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/compose_extract_insert_slice.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/batch_matmul.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/conv_2d_nhwc_hwcf.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/dot.mlir.test PASSED in 1.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/duplicate_fusions.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/fibonacci.mlir.test PASSED in 2.8s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/fusion_outlining.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/fusion_planning_for_cpu.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/inline_fusion_clusters.mlir.test PASSED in 0.3s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/map_bcast_map.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/map_matmul.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/map_reduce_map.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/map_reshape_map.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/matmul.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/reduce_1d.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/reduce_1d_map.mlir.test PASSED in 0.3s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/reduce_2d.mlir.test PASSED in 1.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/reduce_window.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/reverse.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/scatter.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/sort.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/transpose.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/greedy_fusion.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/invalid.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/lower_vectors.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/nested_tiling_softmax.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/ops.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/optimize_linalg_ops.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/rewrite_forall_to_for.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/simplify_dead_copy.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/tile_by_one.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/tiling_softmax.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/vectorize_copy.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/vectorize_for_cpu.mlir.test PASSED in 1.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/lhlo/lhlo-legalize-select-and-scatter.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/lhlo/lhlo-legalize-to-affine.mlir.test PASSED in 3.2s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/lhlo/lhlo-legalize-to-gpu.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/lhlo/lhlo-legalize-to-parallel-loops.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/lhlo/lhlo-legalize-to-tensor-op.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/lhlo/ops.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/lhlo_gpu/lhlo_gpu_ops.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/attrs.mlir.test PASSED in 1.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/broadcast_propagation.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/bitcast.mlir.test PASSED in 1.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/canonicalize.mlir.test PASSED in 1.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/concatenate.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/convert.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/convolution.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/custom_call.mlir.test PASSED in 1.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/folder_limit.mlir.test PASSED in 1.3s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/reduce.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/reshape.mlir.test PASSED in 0.3s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/reverse.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/scatter.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/transpose.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/tuple.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/while.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/constraint_fusion.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/convert_to_signless.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/expand_hlo_tuples.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/expand_ops_simplifier.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/group_reduction_dimensions.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-collapse-elementwise-map.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-einsum-to-dot-general.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-gather-to-torch-index-select.mlir.test PASSED in 0.3s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-rng-to-linalg.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-shape-ops-to-standard.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-sort.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-arithmetic.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-lhlo-only-dynamic.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-lhlo-unranked.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-lhlo.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-linalg.mlir.test PASSED in 4.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-memref-unranked.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-memref.mlir.test PASSED in 1.3s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-stablehlo-experimental.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-stablehlo.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/inlining.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/invalid.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/legalize-control-flow.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/legalize-hlo-shape-computations.mlir.test PASSED in 0.3s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/legalize-mhlo-to-thlo.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/legalize-to-std.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/lower-complex.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/lower-general-dot.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/materialize-broadcasts.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/merge_assuming_ops.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_bytecode_customizations.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_canonicalize_dot.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_canonicalize_gather.mlir.test PASSED in 1.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_canonicalize_reduction.mlir.test PASSED in 1.8s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_canonicalize_scatter.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_flatten_tuple.mlir.test PASSED in 0.3s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_infer_shape_type_methods.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_ops_prettyprint.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_reduce_pretty_print.mlir.test PASSED in 2.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/ops.mlir.test PASSED in 1.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/optimize-hlo.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/prepare-for-export.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/reify-result-types.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/restrict_max_rank.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/shape_legalize_to_hlo.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/shape_reification.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/sink-constants-to-control-flow.mlir.test PASSED in 1.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/sparse_gendot_lower.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/sparse_lower.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/sparse_ops.mlir.test PASSED in 1.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/sparse_rewriting.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/sparse_transpose.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/stablehlo-legalize-to-hlo.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/symbolic-shape-optimization.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/unfuse_batch_norm.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/verifier_bounds.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/verifier_conv_op.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/verifier_reduce_op.mlir.test PASSED in 1.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/verifier_reduce_window_op.mlir.test PASSED in 1.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/verifier_scatter_op.mlir.test PASSED in 1.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/verifier_select_and_scatter_op.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/verifier_while_op.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/while_prettyprint.mlir.test PASSED in 1.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/thlo/bufferize.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/thlo/canonicalize.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/thlo/invalid.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/thlo/legalize_sort.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/thlo/ops.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/thlo/tiling.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:alloc_to_arg.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:assuming-structural-propagation.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:buffer_packing.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:bufferize.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/mlir_hlo/tests:bufferize_one_shot.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:collapse_parallel_loops_to_1d_pass.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:detensorize_scf_ops.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:index_type_llvm_lowering.mlir.test PASSED in 1.3s //tensorflow/compiler/xla/mlir_hlo/tests:legalize-trigonometric-to-approximation.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:lower_index_cast.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir_hlo/tests:propagate_static_shapes.mlir.test PASSED in 0.3s //tensorflow/compiler/xla/mlir_hlo/tests:rank-specialization.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:scalarization.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/mlir_hlo/tests:shape-component-analysis.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:shape_simplification.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:test_userange.mlir.test PASSED in 0.3s //tensorflow/compiler/xla/mlir_hlo/tests:tile_loops.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:unbufferize.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:unroll-loops.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tools/mlir_interpreter/framework/tests:interpreter_value_test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tools/mlir_interpreter/framework/tests:tensor_or_memref_test PASSED in 0.4s //tensorflow/compiler/xla/pjrt:host_callback_test PASSED in 0.4s //tensorflow/compiler/xla/pjrt:lru_cache_test PASSED in 0.4s //tensorflow/compiler/xla/pjrt:pjrt_api_test PASSED in 0.4s //tensorflow/compiler/xla/pjrt:pjrt_client_test_cpu PASSED in 11.3s //tensorflow/compiler/xla/pjrt:pjrt_compiler_test PASSED in 0.4s //tensorflow/compiler/xla/pjrt:pjrt_executable_test PASSED in 0.2s //tensorflow/compiler/xla/pjrt:pjrt_stream_executor_client_test PASSED in 9.3s //tensorflow/compiler/xla/pjrt:semaphore_test PASSED in 0.5s //tensorflow/compiler/xla/pjrt:tf_pjrt_client_test PASSED in 9.6s //tensorflow/compiler/xla/pjrt:tfrt_cpu_pjrt_client_test PASSED in 11.2s //tensorflow/compiler/xla/pjrt:tracked_device_buffer_test PASSED in 12.5s //tensorflow/compiler/xla/pjrt:tracked_tfrt_cpu_device_buffer_test PASSED in 0.4s //tensorflow/compiler/xla/pjrt:transpose_test PASSED in 45.9s //tensorflow/compiler/xla/pjrt/c:pjrt_c_api_cpu_test PASSED in 7.4s //tensorflow/compiler/xla/pjrt/c:pjrt_c_api_helpers_test PASSED in 0.2s //tensorflow/compiler/xla/pjrt/distributed:client_server_test PASSED in 44.5s //tensorflow/compiler/xla/pjrt/distributed:topology_util_test PASSED in 0.2s //tensorflow/compiler/xla/python:outfeed_receiver_test_cpu PASSED in 11.2s //tensorflow/compiler/xla/python/ifrt:array_test PASSED in 0.7s //tensorflow/compiler/xla/python/ifrt:array_test_no_impl PASSED in 0.7s //tensorflow/compiler/xla/python/ifrt:client_test_no_impl PASSED in 1.0s //tensorflow/compiler/xla/python/ifrt:future_test PASSED in 0.3s //tensorflow/compiler/xla/python/ifrt:index_domain_test PASSED in 0.9s //tensorflow/compiler/xla/python/ifrt:index_test PASSED in 0.3s //tensorflow/compiler/xla/python/ifrt:shape_test PASSED in 0.2s //tensorflow/compiler/xla/python/ifrt:sharding_test PASSED in 0.3s //tensorflow/compiler/xla/python/ifrt:tuple_test_no_impl PASSED in 0.8s //tensorflow/compiler/xla/python/ifrt/ir/tests:executable_test_no_impl PASSED in 2.6s //tensorflow/compiler/xla/python/ifrt/ir/tests:ifrt_duplicated_callee_elimination.mlir.test PASSED in 0.3s //tensorflow/compiler/xla/python/ifrt/ir/tests:spmd_interface_verification.mlir.test PASSED in 1.5s //tensorflow/compiler/xla/python/ifrt/ir/tests:verify_array.mlir.test PASSED in 0.3s //tensorflow/compiler/xla/python/ifrt/ir/tests:verify_assemble.mlir.test PASSED in 1.3s //tensorflow/compiler/xla/python/ifrt/ir/tests:verify_attrs.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/python/ifrt/ir/tests:verify_call.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/python/ifrt/ir/tests:verify_call_loaded_executable.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/python/ifrt/ir/tests:verify_disassemble.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/python/ifrt/ir/tests:verify_loaded_executable.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/python/ifrt/ir/tests:verify_reshard.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/python/ifrt/support:sharding_param_to_op_sharding_test PASSED in 0.3s //tensorflow/compiler/xla/python/pjrt_ifrt:pjrt_array_impl_test_tfrt_cpu PASSED in 19.1s //tensorflow/compiler/xla/python/pjrt_ifrt:pjrt_client_impl_test_tfrt_cpu PASSED in 9.8s //tensorflow/compiler/xla/python/pjrt_ifrt:pjrt_executable_impl_test_tfrt_cpu PASSED in 9.4s //tensorflow/compiler/xla/python/pjrt_ifrt:pjrt_tuple_impl_test_tfrt_cpu PASSED in 8.8s //tensorflow/compiler/xla/python/pjrt_ifrt:xla_executable_test_no_impl PASSED in 1.3s //tensorflow/compiler/xla/python_api:xla_literal_test PASSED in 0.7s //tensorflow/compiler/xla/python_api:xla_shape_test PASSED in 1.4s //tensorflow/compiler/xla/rpc:grpc_client_test PASSED in 3.1s //tensorflow/compiler/xla/runtime:arguments_test PASSED in 0.9s //tensorflow/compiler/xla/runtime:async_runtime_test PASSED in 0.3s //tensorflow/compiler/xla/runtime:custom_call_test PASSED in 1.9s //tensorflow/compiler/xla/runtime:diagnostics_test PASSED in 0.2s //tensorflow/compiler/xla/runtime:executable_test PASSED in 4.9s //tensorflow/compiler/xla/runtime:ffi_test PASSED in 5.8s //tensorflow/compiler/xla/runtime:map_by_type_test PASSED in 0.2s //tensorflow/compiler/xla/runtime:module_test PASSED in 0.2s //tensorflow/compiler/xla/runtime:results_test PASSED in 0.2s //tensorflow/compiler/xla/runtime:state_test PASSED in 0.7s //tensorflow/compiler/xla/runtime:symbolic_shape_test PASSED in 0.1s //tensorflow/compiler/xla/runtime:type_id_test PASSED in 0.7s //tensorflow/compiler/xla/service:algebraic_simplifier_overflow_test_cpu PASSED in 11.4s //tensorflow/compiler/xla/service:algebraic_simplifier_test PASSED in 16.2s //tensorflow/compiler/xla/service:all_gather_broadcast_reorder_test PASSED in 0.9s //tensorflow/compiler/xla/service:all_gather_combiner_test PASSED in 0.8s //tensorflow/compiler/xla/service:all_gather_decomposer_test PASSED in 1.7s //tensorflow/compiler/xla/service:all_reduce_combiner_test PASSED in 0.9s //tensorflow/compiler/xla/service:all_reduce_contiguous_test PASSED in 1.8s //tensorflow/compiler/xla/service:all_reduce_folder_test PASSED in 0.8s //tensorflow/compiler/xla/service:all_reduce_promotion_test PASSED in 1.0s //tensorflow/compiler/xla/service:all_reduce_reassociate_test PASSED in 2.7s //tensorflow/compiler/xla/service:all_reduce_simplifier_test PASSED in 1.1s //tensorflow/compiler/xla/service:ar_crs_combiner_test PASSED in 1.3s //tensorflow/compiler/xla/service:async_collective_creator_test PASSED in 0.9s //tensorflow/compiler/xla/service:async_op_canonicalizer_test PASSED in 1.9s //tensorflow/compiler/xla/service:batch_dot_simplification_test PASSED in 0.8s //tensorflow/compiler/xla/service:batchnorm_expander_test_cpu PASSED in 10.2s //tensorflow/compiler/xla/service:bfloat16_conversion_folding_test PASSED in 0.7s //tensorflow/compiler/xla/service:bfloat16_propagation_test PASSED in 1.0s //tensorflow/compiler/xla/service:bitcast_dtypes_expander_test PASSED in 0.7s //tensorflow/compiler/xla/service:broadcast_canonicalizer_test PASSED in 0.9s //tensorflow/compiler/xla/service:buffer_assignment_test PASSED in 11.8s //tensorflow/compiler/xla/service:call_graph_test PASSED in 0.8s //tensorflow/compiler/xla/service:call_inliner_test PASSED in 0.8s //tensorflow/compiler/xla/service:change_op_data_type_test PASSED in 2.5s //tensorflow/compiler/xla/service:collective_ops_utils_test PASSED in 0.8s //tensorflow/compiler/xla/service:collective_transformation_reorderer_test PASSED in 0.9s //tensorflow/compiler/xla/service:collectives_schedule_linearizer_test PASSED in 0.8s //tensorflow/compiler/xla/service:compilation_environments_test PASSED in 0.3s //tensorflow/compiler/xla/service:conditional_canonicalizer_test PASSED in 0.8s //tensorflow/compiler/xla/service:conditional_code_motion_test PASSED in 3.6s //tensorflow/compiler/xla/service:conditional_simplifier_test PASSED in 0.8s //tensorflow/compiler/xla/service:conditional_to_select_test PASSED in 1.2s //tensorflow/compiler/xla/service:constant_value_test PASSED in 0.4s //tensorflow/compiler/xla/service:convert_async_collectives_to_sync_test PASSED in 0.9s //tensorflow/compiler/xla/service:convert_mover_test PASSED in 1.5s //tensorflow/compiler/xla/service:convert_operand_folding_test PASSED in 0.8s //tensorflow/compiler/xla/service:convolution_4d_expander_test PASSED in 1.8s //tensorflow/compiler/xla/service:convolution_group_converter_test PASSED in 0.9s //tensorflow/compiler/xla/service:convolution_pred_expander_test PASSED in 1.4s //tensorflow/compiler/xla/service:copy_insertion_test PASSED in 3.7s //tensorflow/compiler/xla/service:custom_call_status_test PASSED in 0.1s //tensorflow/compiler/xla/service:data_parallel_collective_optimizer_test PASSED in 0.9s //tensorflow/compiler/xla/service:defuser_test PASSED in 0.7s //tensorflow/compiler/xla/service:despecializer_test PASSED in 1.3s //tensorflow/compiler/xla/service:dfs_hlo_visitor_with_default_test PASSED in 0.9s //tensorflow/compiler/xla/service:dot_decomposer_test PASSED in 0.9s //tensorflow/compiler/xla/service:dot_dimension_merger_test PASSED in 1.1s //tensorflow/compiler/xla/service:dot_merger_test PASSED in 1.0s //tensorflow/compiler/xla/service:dynamic_dimension_inference_test PASSED in 0.8s //tensorflow/compiler/xla/service:dynamic_dimension_simplifier_test PASSED in 2.0s //tensorflow/compiler/xla/service:dynamic_index_splitter_test PASSED in 1.2s //tensorflow/compiler/xla/service:dynamic_padder_test_cpu PASSED in 11.6s //tensorflow/compiler/xla/service:dynamic_parameter_binding_test PASSED in 0.8s //tensorflow/compiler/xla/service:dynamic_update_slice_test_cpu PASSED in 9.7s //tensorflow/compiler/xla/service:elemental_ir_emitter_test_cpu PASSED in 10.3s //tensorflow/compiler/xla/service:flatten_call_graph_test PASSED in 1.0s //tensorflow/compiler/xla/service:float_normalization_test PASSED in 1.1s //tensorflow/compiler/xla/service:fusion_node_indexing_evaluation_test PASSED in 1.1s //tensorflow/compiler/xla/service:gather_expander_test PASSED in 1.2s //tensorflow/compiler/xla/service:gather_simplifier_test PASSED in 1.0s //tensorflow/compiler/xla/service:heap_simulator_test PASSED in 0.9s //tensorflow/compiler/xla/service:hlo_alias_analysis_test PASSED in 0.7s //tensorflow/compiler/xla/service:hlo_casting_utils_test PASSED in 10.5s //tensorflow/compiler/xla/service:hlo_computation_deduplicator_test PASSED in 0.8s //tensorflow/compiler/xla/service:hlo_computation_test PASSED in 2.4s //tensorflow/compiler/xla/service:hlo_constant_folding_test PASSED in 7.0s //tensorflow/compiler/xla/service:hlo_cost_analysis_test PASSED in 12.2s //tensorflow/compiler/xla/service:hlo_creation_utils_test PASSED in 5.2s //tensorflow/compiler/xla/service:hlo_cse_test PASSED in 19.3s //tensorflow/compiler/xla/service:hlo_dataflow_analysis_test PASSED in 1.3s //tensorflow/compiler/xla/service:hlo_dce_test PASSED in 1.2s //tensorflow/compiler/xla/service:hlo_domain_test PASSED in 1.0s //tensorflow/compiler/xla/service:hlo_element_type_converter_test PASSED in 0.9s //tensorflow/compiler/xla/service:hlo_execution_profile_test PASSED in 9.3s //tensorflow/compiler/xla/service:hlo_graph_dumper_test PASSED in 1.5s //tensorflow/compiler/xla/service:hlo_input_output_alias_config_test PASSED in 1.3s //tensorflow/compiler/xla/service:hlo_instruction_test PASSED in 0.9s //tensorflow/compiler/xla/service:hlo_liveness_analysis_test PASSED in 2.0s //tensorflow/compiler/xla/service:hlo_memory_scheduler_test PASSED in 1.9s //tensorflow/compiler/xla/service:hlo_module_dce_test PASSED in 1.5s //tensorflow/compiler/xla/service:hlo_module_metadata_test PASSED in 0.6s //tensorflow/compiler/xla/service:hlo_module_test PASSED in 1.0s //tensorflow/compiler/xla/service:hlo_opcode_test PASSED in 1.1s //tensorflow/compiler/xla/service:hlo_ordering_test PASSED in 1.2s //tensorflow/compiler/xla/service:hlo_parser_test PASSED in 0.6s //tensorflow/compiler/xla/service:hlo_pass_pipeline_test PASSED in 0.7s //tensorflow/compiler/xla/service:hlo_phi_graph_test PASSED in 0.5s //tensorflow/compiler/xla/service:hlo_proto_util_test PASSED in 1.1s //tensorflow/compiler/xla/service:hlo_reachability_test PASSED in 0.9s //tensorflow/compiler/xla/service:hlo_rematerialization_test PASSED in 1.0s //tensorflow/compiler/xla/service:hlo_rematerialization_test_utils_test PASSED in 0.7s //tensorflow/compiler/xla/service:hlo_replication_analysis_test PASSED in 0.8s //tensorflow/compiler/xla/service:hlo_schedule_test PASSED in 0.7s //tensorflow/compiler/xla/service:hlo_sharding_test PASSED in 2.6s //tensorflow/compiler/xla/service:hlo_value_semantics_analysis_test PASSED in 0.8s //tensorflow/compiler/xla/service:hlo_verifier_test PASSED in 4.7s //tensorflow/compiler/xla/service:indexed_array_analysis_test PASSED in 0.7s //tensorflow/compiler/xla/service:instruction_fusion_test PASSED in 1.0s //tensorflow/compiler/xla/service:latency_hiding_scheduler_test PASSED in 1.1s //tensorflow/compiler/xla/service:layout_assignment_test PASSED in 7.1s //tensorflow/compiler/xla/service:layout_normalization_test PASSED in 1.1s //tensorflow/compiler/xla/service:logistic_expander_test PASSED in 1.1s //tensorflow/compiler/xla/service:loop_schedule_linearizer_test PASSED in 0.7s //tensorflow/compiler/xla/service:map_inliner_test PASSED in 0.7s //tensorflow/compiler/xla/service:mapped_ptr_container_sorter_test PASSED in 0.1s //tensorflow/compiler/xla/service:memory_space_assignment_best_fit_repacker_test PASSED in 0.3s //tensorflow/compiler/xla/service:memory_space_assignment_test PASSED in 1.8s //tensorflow/compiler/xla/service:memory_space_propagation_test PASSED in 0.8s //tensorflow/compiler/xla/service:name_uniquer_test PASSED in 0.1s //tensorflow/compiler/xla/service:operand_upcaster_test PASSED in 0.8s //tensorflow/compiler/xla/service:optimize_input_output_buffer_alias_test PASSED in 0.7s //tensorflow/compiler/xla/service:pattern_matcher_gmock_test PASSED in 0.3s //tensorflow/compiler/xla/service:pattern_matcher_test PASSED in 2.0s //tensorflow/compiler/xla/service:profile_guided_latency_estimator_test PASSED in 1.0s //tensorflow/compiler/xla/service:real_imag_expander_test PASSED in 1.4s //tensorflow/compiler/xla/service:reduce_decomposer_test PASSED in 1.0s //tensorflow/compiler/xla/service:reduce_scatter_combiner_test PASSED in 0.9s //tensorflow/compiler/xla/service:reduce_scatter_decomposer_test PASSED in 1.0s //tensorflow/compiler/xla/service:reduce_scatter_reassociate_test PASSED in 1.2s //tensorflow/compiler/xla/service:reshape_decomposer_test PASSED in 0.9s //tensorflow/compiler/xla/service:reshape_mover_test PASSED in 1.6s //tensorflow/compiler/xla/service:result_caster_test PASSED in 1.6s //tensorflow/compiler/xla/service:root_instruction_sinker_test PASSED in 1.0s //tensorflow/compiler/xla/service:scatter_expander_test PASSED in 1.0s //tensorflow/compiler/xla/service:scatter_simplifier_test PASSED in 1.1s //tensorflow/compiler/xla/service:select_and_scatter_expander_test PASSED in 0.7s //tensorflow/compiler/xla/service:shape_inference_test PASSED in 0.2s //tensorflow/compiler/xla/service:shaped_buffer_test PASSED in 8.3s //tensorflow/compiler/xla/service:sharding_propagation_test PASSED in 4.2s //tensorflow/compiler/xla/service:sharding_remover_test PASSED in 0.7s //tensorflow/compiler/xla/service:simplify_fp_conversions_test PASSED in 1.1s //tensorflow/compiler/xla/service:slice_sinker_test PASSED in 2.3s //tensorflow/compiler/xla/service:sort_simplifier_test PASSED in 0.7s //tensorflow/compiler/xla/service:space_to_batch_converter_test PASSED in 1.1s //tensorflow/compiler/xla/service:stable_sort_expander_test PASSED in 1.7s //tensorflow/compiler/xla/service:stochastic_convert_decomposer_test PASSED in 1.9s //tensorflow/compiler/xla/service:stream_pool_test PASSED in 0.5s //tensorflow/compiler/xla/service:topk_rewriter_test PASSED in 8.4s //tensorflow/compiler/xla/service:transpose_folding_test PASSED in 2.3s //tensorflow/compiler/xla/service:tuple_points_to_analysis_test PASSED in 0.7s //tensorflow/compiler/xla/service:tuple_simplifier_test PASSED in 2.9s //tensorflow/compiler/xla/service:tuple_util_test PASSED in 1.6s //tensorflow/compiler/xla/service:value_range_test PASSED in 2.1s //tensorflow/compiler/xla/service:while_loop_all_reduce_code_motion_test PASSED in 1.3s //tensorflow/compiler/xla/service:while_loop_analysis_test PASSED in 1.8s //tensorflow/compiler/xla/service:while_loop_concat_code_motion_test PASSED in 1.5s //tensorflow/compiler/xla/service:while_loop_constant_sinking_test PASSED in 3.0s //tensorflow/compiler/xla/service:while_loop_expensive_invariant_code_motion_test PASSED in 0.9s //tensorflow/compiler/xla/service:while_loop_invariant_code_motion_test PASSED in 0.7s //tensorflow/compiler/xla/service:while_loop_simplifier_test PASSED in 2.7s //tensorflow/compiler/xla/service:while_loop_trip_count_annotator_test PASSED in 1.7s //tensorflow/compiler/xla/service:while_util_test PASSED in 0.7s //tensorflow/compiler/xla/service:xla_aot_compile_stablehlo_cpu_test PASSED in 11.1s //tensorflow/compiler/xla/service:xla_debug_info_manager_test PASSED in 1.2s //tensorflow/compiler/xla/service:zero_sized_hlo_elimination_test PASSED in 1.2s //tensorflow/compiler/xla/service/cpu:conv_canonicalization_test PASSED in 1.3s //tensorflow/compiler/xla/service/cpu:cpu_eigen_tensor_alignment_test PASSED in 1.2s //tensorflow/compiler/xla/service/cpu:cpu_instruction_fusion_test PASSED in 1.8s //tensorflow/compiler/xla/service/cpu:cpu_layout_assignment_test PASSED in 1.6s //tensorflow/compiler/xla/service/cpu:ir_emission_utils_test PASSED in 1.1s //tensorflow/compiler/xla/service/cpu:parallel_task_assignment_test PASSED in 3.3s //tensorflow/compiler/xla/service/cpu:runtime_fft_test PASSED in 0.2s //tensorflow/compiler/xla/service/cpu:shape_partition_test PASSED in 1.1s //tensorflow/compiler/xla/service/cpu:xfeed_manager_test PASSED in 1.6s //tensorflow/compiler/xla/service/cpu/tests:cpu_bytesizeof_test PASSED in 0.6s //tensorflow/compiler/xla/service/cpu/tests:cpu_dyn_shape_test PASSED in 15.1s //tensorflow/compiler/xla/service/cpu/tests:cpu_eigen_dot_operation_test PASSED in 15.7s //tensorflow/compiler/xla/service/cpu/tests:cpu_external_constants_test PASSED in 32.7s //tensorflow/compiler/xla/service/cpu/tests:cpu_fusion_test PASSED in 9.1s //tensorflow/compiler/xla/service/cpu/tests:cpu_infeed_test PASSED in 14.3s //tensorflow/compiler/xla/service/cpu/tests:cpu_intrinsic_test PASSED in 20.4s //tensorflow/compiler/xla/service/cpu/tests:cpu_key_value_sort_test PASSED in 15.0s //tensorflow/compiler/xla/service/cpu/tests:cpu_literal_caching_test PASSED in 8.1s //tensorflow/compiler/xla/service/cpu/tests:cpu_noalias_test PASSED in 9.6s //tensorflow/compiler/xla/service/cpu/tests:cpu_outfeed_test PASSED in 15.5s //tensorflow/compiler/xla/service/cpu/tests:cpu_profiling_test PASSED in 12.1s //tensorflow/compiler/xla/service/cpu/tests:cpu_spmd_compile_test PASSED in 14.8s //tensorflow/compiler/xla/service/cpu/tests:cpu_topk_test PASSED in 12.8s //tensorflow/compiler/xla/service/cpu/tests:cpu_vectorization_test PASSED in 11.6s //tensorflow/compiler/xla/service/cpu/tests:cpu_while_test PASSED in 12.8s //tensorflow/compiler/xla/service/cpu/tests:tree_reduction_rewriter_test PASSED in 14.3s //tensorflow/compiler/xla/service/gpu:alias_passthrough_params_test PASSED in 3.5s //tensorflow/compiler/xla/service/gpu:all_reduce_blueconnect_test PASSED in 0.8s //tensorflow/compiler/xla/service/gpu:backend_configs_test PASSED in 1.0s //tensorflow/compiler/xla/service/gpu:copy_fusion_test PASSED in 1.6s //tensorflow/compiler/xla/service/gpu:cublas_pad_for_gemms_test PASSED in 1.4s //tensorflow/compiler/xla/service/gpu:cudnn_pad_for_convolutions_test PASSED in 1.7s //tensorflow/compiler/xla/service/gpu:cudnn_simplify_padding_test PASSED in 1.6s //tensorflow/compiler/xla/service/gpu:cudnn_support_utils_test PASSED in 2.2s //tensorflow/compiler/xla/service/gpu:cudnn_vectorize_convolutions_test PASSED in 1.2s //tensorflow/compiler/xla/service/gpu:fusion_merger_test PASSED in 1.5s //tensorflow/compiler/xla/service/gpu:gemm_rewriter_triton_test PASSED in 1.6s //tensorflow/compiler/xla/service/gpu:gpu_async_collective_annotator_test PASSED in 1.1s //tensorflow/compiler/xla/service/gpu:gpu_conv_padding_legalization_test PASSED in 1.1s //tensorflow/compiler/xla/service/gpu:gpu_conv_rewriter_test PASSED in 1.4s //tensorflow/compiler/xla/service/gpu:gpu_convert_async_collectives_to_sync_test PASSED in 3.7s //tensorflow/compiler/xla/service/gpu:gpu_copy_insertion_test PASSED in 9.7s //tensorflow/compiler/xla/service/gpu:gpu_fusible_test PASSED in 1.3s //tensorflow/compiler/xla/service/gpu:gpu_hlo_cost_analysis_test PASSED in 1.2s //tensorflow/compiler/xla/service/gpu:gpu_performance_model_test PASSED in 1.2s //tensorflow/compiler/xla/service/gpu:gpu_sanitize_constant_names_test PASSED in 2.2s //tensorflow/compiler/xla/service/gpu:hlo_algorithm_denylist_test PASSED in 0.2s //tensorflow/compiler/xla/service/gpu:hlo_fusion_stats_test PASSED in 1.4s //tensorflow/compiler/xla/service/gpu:instruction_fusion_test PASSED in 3.4s //tensorflow/compiler/xla/service/gpu:ir_emission_utils_test PASSED in 2.0s //tensorflow/compiler/xla/service/gpu:matmul_utils_test PASSED in 1.5s //tensorflow/compiler/xla/service/gpu:move_copy_to_users_test PASSED in 1.4s //tensorflow/compiler/xla/service/gpu:multi_output_fusion_test PASSED in 1.6s //tensorflow/compiler/xla/service/gpu:non_atomically_upgradeable_rw_lock_test PASSED in 0.1s //tensorflow/compiler/xla/service/gpu:reduction_splitter_test PASSED in 1.4s //tensorflow/compiler/xla/service/gpu:scatter_slice_simplifier_test PASSED in 0.8s //tensorflow/compiler/xla/service/gpu:target_util_test PASSED in 0.5s //tensorflow/compiler/xla/service/gpu:topk_splitter_test PASSED in 34.0s //tensorflow/compiler/xla/service/gpu:variadic_op_splitter_test PASSED in 1.9s //tensorflow/compiler/xla/service/gpu:while_transformer_test PASSED in 2.0s //tensorflow/compiler/xla/service/gpu/llvm_gpu_backend:utils_test PASSED in 0.5s //tensorflow/compiler/xla/service/gpu/tests:gpu_reduce_scatter_creator_test PASSED in 0.9s //tensorflow/compiler/xla/service/gpu/tests:reduction_degenerate_dim_remover_test PASSED in 1.4s //tensorflow/compiler/xla/service/gpu/tests:reduction_dimension_grouper_test PASSED in 1.4s //tensorflow/compiler/xla/service/gpu/tests:tree_reduction_rewriter_test PASSED in 2.3s //tensorflow/compiler/xla/service/graphcycles:graphcycles_test PASSED in 0.8s //tensorflow/compiler/xla/service/graphcycles:ordered_set_test PASSED in 0.2s //tensorflow/compiler/xla/service/llvm_ir:alias_analysis_test PASSED in 6.6s //tensorflow/compiler/xla/service/llvm_ir:ir_array_test PASSED in 1.3s //tensorflow/compiler/xla/service/spmd:canonicalize_all_gather_for_cse_test PASSED in 0.9s //tensorflow/compiler/xla/service/spmd:collective_permute_motion_test PASSED in 1.0s //tensorflow/compiler/xla/service/spmd:partition_assignment_test PASSED in 0.7s //tensorflow/compiler/xla/service/spmd:schedule_aware_collective_ops_cse_test PASSED in 2.0s //tensorflow/compiler/xla/service/spmd:spmd_partitioner_test PASSED in 25.7s //tensorflow/compiler/xla/service/spmd:stateful_rng_spmd_partitioner_test PASSED in 1.6s //tensorflow/compiler/xla/stream_executor:dnn_test PASSED in 0.6s //tensorflow/compiler/xla/stream_executor:stream_test PASSED in 0.2s //tensorflow/compiler/xla/stream_executor/host:host_stream_test PASSED in 0.3s //tensorflow/compiler/xla/tests:all_reduce_test_cpu PASSED in 10.5s //tensorflow/compiler/xla/tests:axpy_simple_test_cpu PASSED in 8.2s //tensorflow/compiler/xla/tests:bad_rng_shape_validation_test_cpu PASSED in 12.9s //tensorflow/compiler/xla/tests:binop_scaling_test_cpu PASSED in 12.2s //tensorflow/compiler/xla/tests:bitcast_convert_test_cpu PASSED in 11.6s //tensorflow/compiler/xla/tests:broadcast_simple_test_cpu PASSED in 16.8s //tensorflow/compiler/xla/tests:broadcast_test_cpu PASSED in 9.7s //tensorflow/compiler/xla/tests:buffer_donation_test_cpu PASSED in 7.4s //tensorflow/compiler/xla/tests:call_test_cpu PASSED in 10.1s //tensorflow/compiler/xla/tests:check_execution_arity_test_cpu PASSED in 9.8s //tensorflow/compiler/xla/tests:cholesky_test_cpu PASSED in 23.7s //tensorflow/compiler/xla/tests:client_test_cpu PASSED in 7.7s //tensorflow/compiler/xla/tests:collective_ops_test_cpu PASSED in 27.9s //tensorflow/compiler/xla/tests:compilation_cache_test_cpu PASSED in 10.6s //tensorflow/compiler/xla/tests:compute_constant_test_cpu PASSED in 9.4s //tensorflow/compiler/xla/tests:concat_test_cpu PASSED in 12.1s //tensorflow/compiler/xla/tests:constant_reduction_function_test_cpu PASSED in 10.4s //tensorflow/compiler/xla/tests:constants_test_cpu PASSED in 13.2s //tensorflow/compiler/xla/tests:convert_test_cpu PASSED in 12.3s //tensorflow/compiler/xla/tests:copy_test_cpu PASSED in 14.1s //tensorflow/compiler/xla/tests:cpu_gpu_fusion_test_cpu PASSED in 16.1s //tensorflow/compiler/xla/tests:custom_call_test_cpu PASSED in 11.1s //tensorflow/compiler/xla/tests:data_parallel_collective_optimizer_execution_test_cpu PASSED in 19.6s //tensorflow/compiler/xla/tests:deallocation_test_cpu PASSED in 9.3s //tensorflow/compiler/xla/tests:deconstruct_tuple_test_cpu PASSED in 10.8s //tensorflow/compiler/xla/tests:deep_graph_test_cpu PASSED in 8.3s //tensorflow/compiler/xla/tests:fft_test_cpu PASSED in 11.9s //tensorflow/compiler/xla/tests:float8_test_cpu PASSED in 10.3s //tensorflow/compiler/xla/tests:floor_ceil_test_cpu PASSED in 11.0s //tensorflow/compiler/xla/tests:fmax_fmin_test_cpu PASSED in 10.4s //tensorflow/compiler/xla/tests:gather_operation_test_cpu PASSED in 12.8s //tensorflow/compiler/xla/tests:get_dimension_size_test_cpu PASSED in 8.6s //tensorflow/compiler/xla/tests:half_test_cpu PASSED in 11.4s //tensorflow/compiler/xla/tests:hlo_metadata_test PASSED in 10.9s //tensorflow/compiler/xla/tests:literal_test_util_test PASSED in 9.8s //tensorflow/compiler/xla/tests:local_client_allocation_test_cpu PASSED in 15.6s //tensorflow/compiler/xla/tests:local_client_aot_test PASSED in 0.1s //tensorflow/compiler/xla/tests:log_test_cpu PASSED in 9.0s //tensorflow/compiler/xla/tests:map_test_cpu PASSED in 10.2s //tensorflow/compiler/xla/tests:matrix_ops_simple_test_cpu PASSED in 16.6s //tensorflow/compiler/xla/tests:multidimensional_slice_test_cpu PASSED in 11.1s //tensorflow/compiler/xla/tests:multiple_devices_on_host_test PASSED in 10.1s //tensorflow/compiler/xla/tests:multithreaded_compilation_test_cpu PASSED in 11.5s //tensorflow/compiler/xla/tests:outfeed_in_nested_computation_test_cpu PASSED in 10.7s //tensorflow/compiler/xla/tests:pad_test_cpu PASSED in 15.2s //tensorflow/compiler/xla/tests:pred_test_cpu PASSED in 9.9s //tensorflow/compiler/xla/tests:query_inferred_shape_test_cpu PASSED in 9.1s //tensorflow/compiler/xla/tests:reduce_hlo_test_cpu PASSED in 11.4s //tensorflow/compiler/xla/tests:reduce_precision_test_cpu PASSED in 9.6s //tensorflow/compiler/xla/tests:replay_test_cpu PASSED in 10.8s //tensorflow/compiler/xla/tests:reshape_motion_test_cpu PASSED in 11.1s //tensorflow/compiler/xla/tests:reverse_test_cpu PASSED in 11.3s //tensorflow/compiler/xla/tests:round_trip_packed_literal_test_cpu PASSED in 10.3s //tensorflow/compiler/xla/tests:round_trip_transfer_test_cpu PASSED in 10.7s //tensorflow/compiler/xla/tests:sample_text_test_cpu PASSED in 11.0s //tensorflow/compiler/xla/tests:scatter_test_cpu PASSED in 18.8s //tensorflow/compiler/xla/tests:select_test_cpu PASSED in 10.6s //tensorflow/compiler/xla/tests:test_utils_test_cpu PASSED in 11.4s //tensorflow/compiler/xla/tests:token_hlo_test_cpu PASSED in 12.8s //tensorflow/compiler/xla/tests:topk_test_cpu PASSED in 11.2s //tensorflow/compiler/xla/tests:transfer_manager_test_cpu PASSED in 15.6s //tensorflow/compiler/xla/tests:transpose_test_cpu PASSED in 15.4s //tensorflow/compiler/xla/tests:tuple_test_cpu PASSED in 15.9s //tensorflow/compiler/xla/tests:unary_op_test_cpu PASSED in 16.5s //tensorflow/compiler/xla/tests:value_inference_test_cpu PASSED in 10.8s //tensorflow/compiler/xla/tests:vector_ops_reduce_test_cpu PASSED in 10.9s //tensorflow/compiler/xla/tests:vector_ops_simple_test_cpu PASSED in 11.7s //tensorflow/compiler/xla/tests:while_test_cpu PASSED in 12.6s //tensorflow/compiler/xla/tests/fuzz:rand_000000_cpu PASSED in 10.3s //tensorflow/compiler/xla/tests/fuzz:rand_000003_cpu PASSED in 14.1s //tensorflow/compiler/xla/tests/fuzz:rand_000005_cpu PASSED in 10.0s //tensorflow/compiler/xla/tests/fuzz:rand_000006_cpu PASSED in 11.3s //tensorflow/compiler/xla/tests/fuzz:rand_000007_cpu PASSED in 10.0s //tensorflow/compiler/xla/tests/fuzz:rand_000008_cpu PASSED in 12.0s //tensorflow/compiler/xla/tests/fuzz:rand_000009_cpu PASSED in 12.0s //tensorflow/compiler/xla/tests/fuzz:rand_000013_cpu PASSED in 11.7s //tensorflow/compiler/xla/tests/fuzz:rand_000015_cpu PASSED in 9.7s //tensorflow/compiler/xla/tests/fuzz:rand_000016_cpu PASSED in 12.6s //tensorflow/compiler/xla/tests/fuzz:rand_000017_cpu PASSED in 9.6s //tensorflow/compiler/xla/tests/fuzz:rand_000018_cpu PASSED in 11.9s //tensorflow/compiler/xla/tests/fuzz:rand_000019_cpu PASSED in 10.1s //tensorflow/compiler/xla/tests/fuzz:rand_000020_cpu PASSED in 13.5s //tensorflow/compiler/xla/tests/fuzz:rand_000022_cpu PASSED in 11.2s //tensorflow/compiler/xla/tests/fuzz:rand_000024_cpu PASSED in 9.3s //tensorflow/compiler/xla/tests/fuzz:rand_000025_cpu PASSED in 10.7s //tensorflow/compiler/xla/tests/fuzz:rand_000026_cpu PASSED in 12.2s //tensorflow/compiler/xla/tests/fuzz:rand_000030_cpu PASSED in 8.3s //tensorflow/compiler/xla/tests/fuzz:rand_000031_cpu PASSED in 10.5s //tensorflow/compiler/xla/tests/fuzz:rand_000032_cpu PASSED in 9.6s //tensorflow/compiler/xla/tests/fuzz:rand_000033_cpu PASSED in 11.6s //tensorflow/compiler/xla/tests/fuzz:rand_000034_cpu PASSED in 11.0s //tensorflow/compiler/xla/tests/fuzz:rand_000035_cpu PASSED in 12.1s //tensorflow/compiler/xla/tests/fuzz:rand_000036_cpu PASSED in 15.6s //tensorflow/compiler/xla/tests/fuzz:rand_000039_cpu PASSED in 9.2s //tensorflow/compiler/xla/tests/fuzz:rand_000040_cpu PASSED in 9.5s //tensorflow/compiler/xla/tests/fuzz:rand_000041_cpu PASSED in 9.4s //tensorflow/compiler/xla/tests/fuzz:rand_000043_cpu PASSED in 10.2s //tensorflow/compiler/xla/tests/fuzz:rand_000049_cpu PASSED in 10.6s //tensorflow/compiler/xla/tests/fuzz:rand_000053_cpu PASSED in 10.5s //tensorflow/compiler/xla/tests/fuzz:rand_000056_cpu PASSED in 12.1s //tensorflow/compiler/xla/tests/fuzz:rand_000059_cpu PASSED in 10.1s //tensorflow/compiler/xla/tests/fuzz:rand_000061_cpu PASSED in 9.7s //tensorflow/compiler/xla/tests/fuzz:rand_000062_cpu PASSED in 12.6s //tensorflow/compiler/xla/tests/fuzz:rand_000064_cpu PASSED in 9.9s //tensorflow/compiler/xla/tests/fuzz:rand_000066_cpu PASSED in 11.1s //tensorflow/compiler/xla/tests/fuzz:rand_000069_cpu PASSED in 9.7s //tensorflow/compiler/xla/tests/fuzz:rand_000071_cpu PASSED in 10.3s //tensorflow/compiler/xla/tests/fuzz:rand_000077_cpu PASSED in 11.1s //tensorflow/compiler/xla/tests/fuzz:rand_000078_cpu PASSED in 10.4s //tensorflow/compiler/xla/tests/fuzz:rand_000079_cpu PASSED in 17.3s //tensorflow/compiler/xla/tests/fuzz:rand_000081_cpu PASSED in 10.5s //tensorflow/compiler/xla/tests/fuzz:rand_000084_cpu PASSED in 11.4s //tensorflow/compiler/xla/tests/fuzz:rand_000085_cpu PASSED in 8.6s //tensorflow/compiler/xla/tests/fuzz:rand_000086_cpu PASSED in 9.8s //tensorflow/compiler/xla/tests/fuzz:rand_000088_cpu PASSED in 11.7s //tensorflow/compiler/xla/tests/fuzz:rand_000089_cpu PASSED in 9.7s //tensorflow/compiler/xla/tests/fuzz:rand_000090_cpu PASSED in 9.5s //tensorflow/compiler/xla/tests/fuzz:rand_000092_cpu PASSED in 12.1s //tensorflow/compiler/xla/tests/fuzz:rand_000094_cpu PASSED in 9.9s //tensorflow/compiler/xla/tests/fuzz:rand_000095_cpu PASSED in 10.8s //tensorflow/compiler/xla/tools:hlo_control_flow_flattening_test PASSED in 1.1s //tensorflow/compiler/xla/tools:hlo_extractor_test PASSED in 1.0s //tensorflow/compiler/xla/tools:hlo_module_loader_test PASSED in 1.1s //tensorflow/compiler/xla/tools:hlo_slicer_test PASSED in 1.1s //tensorflow/compiler/xla/tools:interactive_graphviz_bin_test PASSED in 0.2s //tensorflow/compiler/xla/tools:run_hlo_module_bin_test PASSED in 1.1s //tensorflow/compiler/xla/tools/hlo_bisect:hlo_bisect_state_test PASSED in 1.6s //tensorflow/compiler/xla/translate/hlo_to_mhlo:hlo_utils_test PASSED in 0.7s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:bool_compare.hlotxt.test PASSED in 1.3s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:case_conditional.hlotxt.test PASSED in 0.6s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:dynamic_param.hlo.test PASSED in 0.6s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:entry_computation_layout.hlotxt.test PASSED in 0.6s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:frontend_attributes.hlotxt.test PASSED in 0.4s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:fully_connected_reference_model.hlotxt.test PASSED in 0.9s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:fusion.hlotxt.test PASSED in 0.4s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:if_conditional.hlotxt.test PASSED in 1.3s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:import.hlotxt.test PASSED in 1.6s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:import_async.hlotxt.test PASSED in 0.8s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:layouts_and_names.hlotxt.test PASSED in 0.5s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:location.hlotxt.test PASSED in 0.5s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:module_attributes.hlo.test PASSED in 0.9s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:send_recv.hlotxt.test PASSED in 1.4s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:simple.hlo.test PASSED in 0.5s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:spmd_module_sharding.hlo.test PASSED in 0.5s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:types.hlotxt.test PASSED in 1.0s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:while.hlotxt.test PASSED in 1.6s //tensorflow/compiler/xla/translate/mhlo_to_hlo:type_to_shape_test PASSED in 1.8s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:add.mlir.test PASSED in 1.5s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:case.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:dynamic.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:export-with-layouts.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:export.mlir.test PASSED in 2.9s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:export_and_check_layouts.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:export_large_constants.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:export_replicas.mlir.test PASSED in 1.7s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:frontend_attributes.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:fusion.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:if.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:input_output_aliasing.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:layouts_and_names.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:location_to_op_metadata.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:missing_main.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:module_attributes.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:multiple_return_tuple.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:opaque_elements_attr.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:rng_get_and_update_state.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:sharding.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:simple.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:unsupported_type.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:while.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/translate/mhlo_to_lhlo_with_xla/tests:hlo_text_to_lhlo_no_opt.hlotxt.test PASSED in 1.2s //tensorflow/compiler/xla/translate/mhlo_to_lhlo_with_xla/tests:no_opt_ops.hlotxt.test PASSED in 1.5s //tensorflow/compiler/xla/translate/mhlo_to_lhlo_with_xla/tests:non_identity_layouts.hlotxt.test PASSED in 0.7s //tensorflow/compiler/xla/translate/mhlo_to_lhlo_with_xla/tests:ops.mlir.test PASSED in 9.7s //tensorflow/compiler/xla/translate/mhlo_to_lhlo_with_xla/tests:passthrough.mlir.test PASSED in 0.9s //tensorflow/core:__tensorflow_core_lib_core_legacy_lib_core_all_tests PASSED in 12.4s //tensorflow/core:__tensorflow_core_lib_gtl_legacy_lib_gtl_tests PASSED in 0.7s //tensorflow/core:__tensorflow_core_lib_monitoring_cell_reader_test PASSED in 42.3s //tensorflow/core:__tensorflow_core_lib_monitoring_collection_registry_test PASSED in 0.1s //tensorflow/core:__tensorflow_core_lib_monitoring_counter_test PASSED in 0.7s //tensorflow/core:__tensorflow_core_lib_monitoring_gauge_test PASSED in 0.5s //tensorflow/core:__tensorflow_core_lib_monitoring_metric_def_test PASSED in 0.5s //tensorflow/core:__tensorflow_core_lib_monitoring_percentile_sampler_test PASSED in 0.1s //tensorflow/core:__tensorflow_core_lib_monitoring_sampler_test PASSED in 0.3s //tensorflow/core:__tensorflow_core_lib_monitoring_test_utils_test PASSED in 1.1s //tensorflow/core:__tensorflow_core_lib_strings_legacy_low_level_library_tests PASSED in 0.2s //tensorflow/core:__tensorflow_core_lib_wav_wav_io_test PASSED in 0.6s //tensorflow/core:__tensorflow_core_util_mkl_util_test_srcs PASSED in 0.3s //tensorflow/core:__tensorflow_tsl_lib_core_legacy_lib_core_all_tests PASSED in 0.4s //tensorflow/core:lib_strings_ordered_code_test PASSED in 1.7s //tensorflow/core:lib_strings_proto_serialization_test PASSED in 0.6s //tensorflow/core/api_def:api_test PASSED in 4.9s //tensorflow/core/api_def:update_api_def_test PASSED in 0.2s //tensorflow/core/common_runtime:all_to_all_test_cpu PASSED in 0.9s //tensorflow/core/common_runtime:arg_ret_placement_test PASSED in 0.5s //tensorflow/core/common_runtime:buf_rendezvous_test PASSED in 0.9s //tensorflow/core/common_runtime:collective_executor_mgr_test PASSED in 0.9s //tensorflow/core/common_runtime:collective_param_resolver_local_test PASSED in 5.7s //tensorflow/core/common_runtime:collective_rma_local_test PASSED in 1.6s //tensorflow/core/common_runtime:composite_device_test PASSED in 0.6s //tensorflow/core/common_runtime:cost_measurement_registry_test PASSED in 2.8s //tensorflow/core/common_runtime:cost_util_test PASSED in 0.1s //tensorflow/core/common_runtime:device_mgr_test PASSED in 0.8s //tensorflow/core/common_runtime:device_propagation_test PASSED in 0.8s //tensorflow/core/common_runtime:device_resolver_local_test PASSED in 1.6s //tensorflow/core/common_runtime:device_set_test PASSED in 2.0s //tensorflow/core/common_runtime:direct_session_test_cpu PASSED in 3.9s //tensorflow/core/common_runtime:direct_session_with_debug_test PASSED in 4.0s //tensorflow/core/common_runtime:direct_session_with_tracking_alloc_test PASSED in 1.2s //tensorflow/core/common_runtime:dynamic_device_mgr_test PASSED in 1.3s //tensorflow/core/common_runtime:eval_const_tensor_test PASSED in 1.0s //tensorflow/core/common_runtime:executor_test PASSED in 1.9s //tensorflow/core/common_runtime:function_optimization_registration_test PASSED in 2.9s //tensorflow/core/common_runtime:function_optimization_registry_no_pass_test PASSED in 1.5s //tensorflow/core/common_runtime:function_optimization_registry_pass_failure_test PASSED in 0.9s //tensorflow/core/common_runtime:function_optimization_registry_test PASSED in 4.2s //tensorflow/core/common_runtime:function_threadpool_test PASSED in 2.2s //tensorflow/core/common_runtime:graph_constructor_test PASSED in 2.5s //tensorflow/core/common_runtime:graph_runner_test PASSED in 0.7s //tensorflow/core/common_runtime:hierarchical_tree_broadcaster_test_cpu PASSED in 4.7s //tensorflow/core/common_runtime:inline_function_utils_test PASSED in 1.1s //tensorflow/core/common_runtime:input_colocation_exemption_registry_test PASSED in 0.5s //tensorflow/core/common_runtime:int32_fulltype_test PASSED in 1.0s //tensorflow/core/common_runtime:isolate_placer_inspection_required_ops_pass_test PASSED in 1.2s //tensorflow/core/common_runtime:lower_case_op_test PASSED in 3.2s //tensorflow/core/common_runtime:lower_function_call_test PASSED in 2.8s //tensorflow/core/common_runtime:lower_functional_ops_test PASSED in 4.4s //tensorflow/core/common_runtime:lower_if_op_test PASSED in 3.2s //tensorflow/core/common_runtime:lower_while_op_test PASSED in 3.4s //tensorflow/core/common_runtime:mkl_cpu_allocator_test PASSED in 0.1s //tensorflow/core/common_runtime:mkl_threadpool_device_test PASSED in 0.4s //tensorflow/core/common_runtime:no_op_cost_measurement_test PASSED in 0.2s //tensorflow/core/common_runtime:null_request_cost_accessor_test PASSED in 0.1s //tensorflow/core/common_runtime:optimization_registry_test PASSED in 1.3s //tensorflow/core/common_runtime:optimize_cross_host_control_deps_test PASSED in 6.0s //tensorflow/core/common_runtime:optimize_function_graph_utils_test PASSED in 1.6s //tensorflow/core/common_runtime:partitioning_utils_test PASSED in 1.2s //tensorflow/core/common_runtime:pending_counts_test PASSED in 0.8s //tensorflow/core/common_runtime:permuter_test_cpu PASSED in 3.7s //tensorflow/core/common_runtime:placer_inspection_required_ops_utils_test PASSED in 2.5s //tensorflow/core/common_runtime:placer_test PASSED in 1.4s //tensorflow/core/common_runtime:process_function_library_runtime_test_cpu PASSED in 0.7s //tensorflow/core/common_runtime:process_util_test PASSED in 0.8s //tensorflow/core/common_runtime:quantize_training_test PASSED in 2.5s //tensorflow/core/common_runtime:rendezvous_util_test PASSED in 0.2s //tensorflow/core/common_runtime:replicate_per_replica_nodes_test PASSED in 1.4s //tensorflow/core/common_runtime:request_cost_accessor_registry_test PASSED in 3.0s //tensorflow/core/common_runtime:request_cost_test PASSED in 0.1s //tensorflow/core/common_runtime:ring_gatherer_test_cpu PASSED in 3.9s //tensorflow/core/common_runtime:ring_reducer_test_cpu PASSED in 7.6s //tensorflow/core/common_runtime:scoped_allocator_mgr_test PASSED in 4.6s //tensorflow/core/common_runtime:session_test PASSED in 1.0s //tensorflow/core/common_runtime:shape_refiner_test PASSED in 2.7s //tensorflow/core/common_runtime:single_threaded_executor_test PASSED in 0.9s //tensorflow/core/common_runtime:threadpool_device_test PASSED in 1.4s //tensorflow/core/common_runtime:type_inference_test PASSED in 2.4s //tensorflow/core/common_runtime/eager:attr_builder_test PASSED in 39.1s //tensorflow/core/common_runtime/eager:context_test PASSED in 18.7s //tensorflow/core/common_runtime/eager:custom_device_test PASSED in 12.3s //tensorflow/core/common_runtime/eager:eager_executor_test PASSED in 14.0s //tensorflow/core/common_runtime/eager:eager_op_rewrite_registry_test PASSED in 0.7s //tensorflow/core/common_runtime/eager:eager_operation_test PASSED in 13.6s //tensorflow/core/common_runtime/eager:execute_node_test PASSED in 13.6s //tensorflow/core/common_runtime/eager:execute_test PASSED in 38.6s //tensorflow/core/common_runtime/eager:kernel_and_device_test PASSED in 1.8s //tensorflow/core/common_runtime/eager:mkl_eager_op_rewrite_test PASSED in 14.0s //tensorflow/core/common_runtime/eager:placement_test PASSED in 15.6s //tensorflow/core/common_runtime/eager:placement_utils_test PASSED in 15.4s //tensorflow/core/common_runtime/eager:summary_optimizer_test PASSED in 0.1s //tensorflow/core/common_runtime/eager:tensor_handle_data_test PASSED in 13.7s //tensorflow/core/common_runtime/eager:tensor_handle_test PASSED in 13.8s //tensorflow/core/common_runtime/gpu:gpu_device_on_non_gpu_machine_test PASSED in 0.7s //tensorflow/core/common_runtime/next_pluggable_device/c:plugin_c_api_test PASSED in 44.8s //tensorflow/core/config:flags_py_test PASSED in 5.8s //tensorflow/core/config:flags_test PASSED in 0.1s //tensorflow/core/data:compression_utils_test PASSED in 2.3s //tensorflow/core/data:dataset_utils_test PASSED in 0.5s //tensorflow/core/data:hash_utils_test PASSED in 0.8s //tensorflow/core/data:metric_utils_test PASSED in 5.6s //tensorflow/core/data:name_utils_test PASSED in 0.1s //tensorflow/core/data:rewrite_utils_test PASSED in 0.5s //tensorflow/core/data:serialization_utils_test PASSED in 0.5s //tensorflow/core/data:snapshot_utils_test PASSED in 0.8s //tensorflow/core/data:split_utils_test PASSED in 0.6s //tensorflow/core/data:standalone_save_restore_test PASSED in 1.5s //tensorflow/core/data:standalone_test PASSED in 1.3s //tensorflow/core/data:tfdataz_metrics_test PASSED in 2.7s //tensorflow/core/data:unbounded_thread_pool_test PASSED in 0.4s //tensorflow/core/data/service:auto_shard_rewriter_test PASSED in 1.3s //tensorflow/core/data/service:common_test PASSED in 0.2s //tensorflow/core/data/service:credentials_factory_test PASSED in 0.7s //tensorflow/core/data/service:cross_trainer_cache_test PASSED in 1.4s //tensorflow/core/data/service:data_service_test PASSED in 14.2s //tensorflow/core/data/service:data_transfer_test PASSED in 0.4s //tensorflow/core/data/service:dataset_store_test PASSED in 1.2s //tensorflow/core/data/service:dispatcher_client_test PASSED in 5.6s //tensorflow/core/data/service:dispatcher_state_test PASSED in 0.6s //tensorflow/core/data/service:grpc_dispatcher_impl_test PASSED in 2.6s //tensorflow/core/data/service:grpc_util_test PASSED in 0.6s //tensorflow/core/data/service:grpc_worker_impl_test PASSED in 3.8s //tensorflow/core/data/service:journal_test PASSED in 3.5s //tensorflow/core/data/service:logging_utils_test PASSED in 0.4s //tensorflow/core/data/service:task_runner_test PASSED in 4.7s //tensorflow/core/data/service:test_util_test PASSED in 3.7s //tensorflow/core/data/service:url_test PASSED in 0.3s //tensorflow/core/data/service:utils_test PASSED in 1.3s //tensorflow/core/data/service:validate_utils_test PASSED in 0.1s //tensorflow/core/data/service:worker_client_test PASSED in 10.8s //tensorflow/core/data/service:worker_impl_test PASSED in 3.8s //tensorflow/core/data/service/client:data_service_client_test PASSED in 4.8s //tensorflow/core/data/service/client:utils_test PASSED in 7.9s //tensorflow/core/data/service/client:validate_utils_test PASSED in 2.0s //tensorflow/core/data/service/snapshot:distributed_snapshot_test PASSED in 20.5s //tensorflow/core/data/service/snapshot:file_utils_test PASSED in 0.6s //tensorflow/core/data/service/snapshot:path_utils_test PASSED in 0.2s //tensorflow/core/data/service/snapshot:snapshot_manager_test PASSED in 4.8s //tensorflow/core/data/service/snapshot:snapshot_split_provider_test PASSED in 0.9s //tensorflow/core/data/service/snapshot:snapshot_stream_writer_checkpoint_test PASSED in 6.5s //tensorflow/core/data/service/snapshot:snapshot_stream_writer_test PASSED in 4.1s //tensorflow/core/data/service/snapshot:utils_test PASSED in 0.2s //tensorflow/core/debug:debug_graph_utils_test PASSED in 0.6s //tensorflow/core/distributed_runtime:call_options_test PASSED in 0.2s //tensorflow/core/distributed_runtime:cluster_function_library_runtime_test PASSED in 7.0s //tensorflow/core/distributed_runtime:collective_param_resolver_distributed_test PASSED in 2.0s //tensorflow/core/distributed_runtime:collective_rma_distributed_test PASSED in 0.9s //tensorflow/core/distributed_runtime:device_resolver_distributed_test PASSED in 0.6s //tensorflow/core/distributed_runtime:message_wrappers_test PASSED in 0.1s //tensorflow/core/distributed_runtime:partial_run_mgr_test PASSED in 0.5s //tensorflow/core/distributed_runtime:recent_request_ids_test PASSED in 0.5s //tensorflow/core/distributed_runtime:request_id_test PASSED in 0.2s //tensorflow/core/distributed_runtime:rpc_collective_executor_mgr_test PASSED in 1.2s //tensorflow/core/distributed_runtime:server_lib_test PASSED in 0.1s //tensorflow/core/distributed_runtime:session_mgr_test PASSED in 1.2s //tensorflow/core/distributed_runtime:tensor_coding_test PASSED in 0.2s //tensorflow/core/distributed_runtime/coordination:coordination_service_barrier_proxy_test PASSED in 2.4s //tensorflow/core/distributed_runtime/eager:eager_service_impl_test PASSED in 25.9s //tensorflow/core/distributed_runtime/eager:remote_mgr_test PASSED in 13.4s //tensorflow/core/distributed_runtime/integration_test:c_api_multi_client_test_cpu PASSED in 43.6s //tensorflow/core/distributed_runtime/integration_test:c_api_recoverable_jobs_test_cpu PASSED in 63.4s //tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu PASSED in 56.6s //tensorflow/core/distributed_runtime/rpc:grpc_tensor_coding_test PASSED in 3.7s //tensorflow/core/distributed_runtime/rpc:grpc_worker_cache_test PASSED in 1.1s //tensorflow/core/distributed_runtime/rpc/eager:grpc_eager_client_test PASSED in 1.1s //tensorflow/core/example:example_parser_configuration_test PASSED in 0.9s //tensorflow/core/example:feature_util_test PASSED in 0.2s //tensorflow/core/framework:allocator_test PASSED in 8.8s //tensorflow/core/framework:attr_value_util_test PASSED in 1.0s //tensorflow/core/framework:batch_util_test PASSED in 1.1s //tensorflow/core/framework:bfloat16_test PASSED in 0.9s //tensorflow/core/framework:common_shape_fns_test PASSED in 1.5s //tensorflow/core/framework:dataset_test PASSED in 1.8s //tensorflow/core/framework:device_base_test PASSED in 1.3s //tensorflow/core/framework:disable_jit_test PASSED in 1.5s //tensorflow/core/framework:framework_op_gen_lib_test PASSED in 0.1s //tensorflow/core/framework:framework_op_segment_test PASSED in 1.0s //tensorflow/core/framework:framework_resource_var_test PASSED in 0.5s //tensorflow/core/framework:framework_run_handler_test PASSED in 4.3s //tensorflow/core/framework:framework_run_handler_util_test PASSED in 3.8s //tensorflow/core/framework:full_type_inference_util_test PASSED in 1.2s //tensorflow/core/framework:full_type_util_test PASSED in 1.2s //tensorflow/core/framework:function_test PASSED in 1.2s //tensorflow/core/framework:graph_def_util_test PASSED in 1.7s //tensorflow/core/framework:graph_to_functiondef_test PASSED in 1.0s //tensorflow/core/framework:kernel_def_builder_test PASSED in 0.9s //tensorflow/core/framework:kernel_def_util_test PASSED in 1.0s //tensorflow/core/framework:memory_types_test PASSED in 1.4s //tensorflow/core/framework:model_test PASSED in 1.0s //tensorflow/core/framework:node_def_builder_test PASSED in 2.3s //tensorflow/core/framework:node_def_util_test PASSED in 1.2s //tensorflow/core/framework:node_properties_test PASSED in 1.6s //tensorflow/core/framework:op_compatibility_test PASSED in 1.5s //tensorflow/core/framework:op_def_builder_test PASSED in 1.6s //tensorflow/core/framework:op_def_util_test PASSED in 1.5s //tensorflow/core/framework:op_kernel_test PASSED in 0.7s //tensorflow/core/framework:op_registration_test PASSED in 1.2s //tensorflow/core/framework:partial_tensor_shape_test PASSED in 1.3s //tensorflow/core/framework:rendezvous_test PASSED in 3.5s //tensorflow/core/framework:resource_handle_test PASSED in 0.5s //tensorflow/core/framework:resource_mgr_test PASSED in 2.7s //tensorflow/core/framework:resource_op_kernel_test PASSED in 0.9s //tensorflow/core/framework:shape_inference_test PASSED in 1.4s //tensorflow/core/framework:shape_inference_testutil_test PASSED in 1.3s //tensorflow/core/framework:tensor_shape_test PASSED in 6.7s //tensorflow/core/framework:tensor_slice_test PASSED in 0.8s //tensorflow/core/framework:tensor_test PASSED in 31.0s //tensorflow/core/framework:tensor_testutil_test PASSED in 1.1s //tensorflow/core/framework:tensor_util_test PASSED in 0.8s //tensorflow/core/framework:tracking_allocator_test PASSED in 1.1s //tensorflow/core/framework:types_test PASSED in 1.4s //tensorflow/core/framework:variant_op_registry_test PASSED in 19.2s //tensorflow/core/framework:variant_test PASSED in 0.9s //tensorflow/core/framework/registration:registration_test PASSED in 0.8s //tensorflow/core/function/capture:by_ref_capture_test PASSED in 9.7s //tensorflow/core/function/capture:capture_container_test PASSED in 6.9s //tensorflow/core/function/integration_test:side_inputs_manual_api_test PASSED in 14.5s //tensorflow/core/function/integration_test:side_inputs_test PASSED in 15.2s //tensorflow/core/function/polymorphism:function_cache_test PASSED in 6.4s //tensorflow/core/function/polymorphism:function_type_test PASSED in 7.9s //tensorflow/core/function/polymorphism:type_dispatch_test PASSED in 6.7s //tensorflow/core/function/runtime_client:runtime_client_cc_test PASSED in 52.4s //tensorflow/core/function/trace_type:default_types_test PASSED in 7.5s //tensorflow/core/function/trace_type:serialization_test PASSED in 6.0s //tensorflow/core/function/trace_type:trace_type_test PASSED in 12.7s //tensorflow/core/graph:algorithm_test PASSED in 1.1s //tensorflow/core/graph:collective_order_test PASSED in 0.6s //tensorflow/core/graph:control_flow_test PASSED in 1.1s //tensorflow/core/graph:costmodel_test PASSED in 0.8s //tensorflow/core/graph:edgeset_test PASSED in 0.8s //tensorflow/core/graph:graph_debug_info_builder_test PASSED in 1.0s //tensorflow/core/graph:graph_def_builder_test PASSED in 1.6s //tensorflow/core/graph:graph_partition_test PASSED in 1.1s //tensorflow/core/graph:graph_test PASSED in 1.5s //tensorflow/core/graph:node_builder_test PASSED in 0.8s //tensorflow/core/graph:optimizer_cse_test PASSED in 1.1s //tensorflow/core/graph:subgraph_test PASSED in 1.8s //tensorflow/core/graph:tensor_id_test PASSED in 0.8s //tensorflow/core/graph:validate_test PASSED in 0.9s //tensorflow/core/graph/regularization:simple_delete_test PASSED in 0.3s //tensorflow/core/graph/regularization:util_test PASSED in 0.3s //tensorflow/core/grappler:graph_topology_view_test PASSED in 0.7s //tensorflow/core/grappler:graph_view_test PASSED in 1.7s //tensorflow/core/grappler:grappler_item_builder_test PASSED in 2.4s //tensorflow/core/grappler:grappler_item_test PASSED in 2.4s //tensorflow/core/grappler:mutable_graph_view_test PASSED in 2.4s //tensorflow/core/grappler:utils_test PASSED in 2.7s //tensorflow/core/grappler/clusters:single_machine_test PASSED in 26.3s //tensorflow/core/grappler/clusters:virtual_cluster_test PASSED in 2.0s //tensorflow/core/grappler/costs:analytical_cost_estimator_test PASSED in 2.2s //tensorflow/core/grappler/costs:cost_estimator_test PASSED in 0.1s //tensorflow/core/grappler/costs:graph_memory_test PASSED in 2.5s //tensorflow/core/grappler/costs:graph_properties_test PASSED in 3.5s //tensorflow/core/grappler/costs:robust_stats_test PASSED in 0.1s //tensorflow/core/grappler/costs:utils_test PASSED in 1.8s //tensorflow/core/grappler/costs:virtual_placer_test PASSED in 0.3s //tensorflow/core/grappler/costs:virtual_scheduler_test PASSED in 2.5s //tensorflow/core/grappler/graph_analyzer:gen_node_test PASSED in 2.0s //tensorflow/core/grappler/graph_analyzer:graph_analyzer_test PASSED in 2.8s //tensorflow/core/grappler/graph_analyzer:hash_tools_test PASSED in 2.2s //tensorflow/core/grappler/graph_analyzer:sig_node_test PASSED in 4.2s //tensorflow/core/grappler/graph_analyzer:subgraph_test PASSED in 2.2s //tensorflow/core/grappler/inputs:utils_test PASSED in 0.4s //tensorflow/core/grappler/optimizers:arithmetic_optimizer_test_cpu PASSED in 9.5s //tensorflow/core/grappler/optimizers:auto_parallel_test_cpu PASSED in 2.1s //tensorflow/core/grappler/optimizers:common_subgraph_elimination_test_cpu PASSED in 3.5s //tensorflow/core/grappler/optimizers:custom_graph_optimizer_registry_test_cpu PASSED in 5.4s //tensorflow/core/grappler/optimizers:debug_stripper_test_cpu PASSED in 3.7s //tensorflow/core/grappler/optimizers:dependency_optimizer_test_cpu PASSED in 3.9s //tensorflow/core/grappler/optimizers:evaluation_utils_test PASSED in 0.6s //tensorflow/core/grappler/optimizers:function_api_info_test PASSED in 0.1s //tensorflow/core/grappler/optimizers:function_optimizer_test_cpu PASSED in 4.7s //tensorflow/core/grappler/optimizers:generic_layout_optimizer_test_cpu PASSED in 3.2s //tensorflow/core/grappler/optimizers:generic_layout_optimizer_transposer_factory_test PASSED in 0.3s //tensorflow/core/grappler/optimizers:generic_layout_optimizer_transposer_test_cpu PASSED in 3.5s //tensorflow/core/grappler/optimizers:graph_optimizer_stage_test_cpu PASSED in 2.5s //tensorflow/core/grappler/optimizers:implementation_selector_test PASSED in 2.3s //tensorflow/core/grappler/optimizers:loop_optimizer_test_cpu PASSED in 2.6s //tensorflow/core/grappler/optimizers:memory_optimizer_test_cpu PASSED in 4.0s //tensorflow/core/grappler/optimizers:meta_optimizer_test_cpu PASSED in 8.2s //tensorflow/core/grappler/optimizers:mkl_remapper_test PASSED in 2.2s //tensorflow/core/grappler/optimizers:model_pruner_test_cpu PASSED in 4.2s //tensorflow/core/grappler/optimizers:pin_to_host_optimizer_test_cpu PASSED in 3.0s //tensorflow/core/grappler/optimizers:scoped_allocator_optimizer_test PASSED in 2.8s //tensorflow/core/grappler/optimizers:shape_optimizer_test_cpu PASSED in 3.5s //tensorflow/core/grappler/optimizers:static_schedule_test_cpu PASSED in 2.3s //tensorflow/core/grappler/optimizers:tfg_optimizer_hook_test PASSED in 0.5s //tensorflow/core/grappler/optimizers/data:auto_shard_test PASSED in 1.4s //tensorflow/core/grappler/optimizers/data:autotune_buffer_sizes_test PASSED in 0.8s //tensorflow/core/grappler/optimizers/data:batch_parallelization_test PASSED in 1.0s //tensorflow/core/grappler/optimizers/data:disable_intra_op_parallelism_test PASSED in 0.5s //tensorflow/core/grappler/optimizers/data:disable_prefetch_legacy_autotune_test PASSED in 0.5s //tensorflow/core/grappler/optimizers/data:enable_gradient_descent_test PASSED in 0.9s //tensorflow/core/grappler/optimizers/data:filter_fusion_test PASSED in 0.5s //tensorflow/core/grappler/optimizers/data:filter_parallelization_test PASSED in 0.6s //tensorflow/core/grappler/optimizers/data:function_utils_test PASSED in 0.7s //tensorflow/core/grappler/optimizers/data:fusion_utils_test PASSED in 0.8s //tensorflow/core/grappler/optimizers/data:graph_utils_test PASSED in 1.6s //tensorflow/core/grappler/optimizers/data:inject_prefetch_test PASSED in 0.6s //tensorflow/core/grappler/optimizers/data:make_deterministic_test PASSED in 0.6s //tensorflow/core/grappler/optimizers/data:make_sloppy_test PASSED in 1.0s //tensorflow/core/grappler/optimizers/data:map_and_batch_fusion_test PASSED in 0.4s //tensorflow/core/grappler/optimizers/data:map_and_filter_fusion_test PASSED in 0.6s //tensorflow/core/grappler/optimizers/data:map_fusion_test PASSED in 0.6s //tensorflow/core/grappler/optimizers/data:map_parallelization_test PASSED in 0.6s //tensorflow/core/grappler/optimizers/data:noop_elimination_test PASSED in 0.3s //tensorflow/core/grappler/optimizers/data:parallel_batch_test PASSED in 0.9s //tensorflow/core/grappler/optimizers/data:replicate_on_split_test PASSED in 1.0s //tensorflow/core/grappler/optimizers/data:shuffle_and_repeat_fusion_test PASSED in 0.4s //tensorflow/core/grappler/optimizers/data:slack_test PASSED in 0.9s //tensorflow/core/grappler/optimizers/data:split_utils_test PASSED in 1.6s //tensorflow/core/grappler/optimizers/data:use_private_thread_pool_test PASSED in 0.6s //tensorflow/core/grappler/optimizers/inference:batch_op_rewriter_test PASSED in 0.6s //tensorflow/core/grappler/utils:canonicalizer_test PASSED in 2.6s //tensorflow/core/grappler/utils:colocation_test PASSED in 0.9s //tensorflow/core/grappler/utils:frame_test PASSED in 0.6s //tensorflow/core/grappler/utils:functions_test PASSED in 1.8s //tensorflow/core/grappler/utils:graph_view_internal_test PASSED in 1.5s //tensorflow/core/grappler/utils:graph_view_test PASSED in 2.6s //tensorflow/core/grappler/utils:grappler_test_test PASSED in 7.3s //tensorflow/core/grappler/utils:pattern_utils_test PASSED in 1.5s //tensorflow/core/grappler/utils:scc_test PASSED in 2.5s //tensorflow/core/grappler/utils:symbolic_shapes_test PASSED in 0.9s //tensorflow/core/grappler/utils:topological_sort_test PASSED in 0.9s //tensorflow/core/grappler/utils:tpu_test PASSED in 0.1s //tensorflow/core/grappler/utils:transitive_fanin_test PASSED in 0.7s //tensorflow/core/grappler/utils:traversal_test PASSED in 0.8s //tensorflow/core/grappler/verifiers:structure_verifier_test PASSED in 2.0s //tensorflow/core/ir:interfaces_test PASSED in 0.2s //tensorflow/core/ir:ops_test PASSED in 0.2s //tensorflow/core/ir:shape_inference_utils_test PASSED in 0.3s //tensorflow/core/ir:tf_op_registry_test PASSED in 0.4s //tensorflow/core/ir:tf_op_wrapper_test PASSED in 0.2s //tensorflow/core/ir:utility_test PASSED in 0.1s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:arg_as_control_ret.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:backedge_segment.pbtxt.test PASSED in 1.0s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:empty.pbtxt.test PASSED in 0.7s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:error_during_backedge.pbtxt.test PASSED in 0.9s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:import_case_with_attr_inference.pbtxt.test PASSED in 0.6s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:import_if_with_attr_inference.pbtxt.test PASSED in 0.7s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:import_iterator_get_next_attr_inference.pbtxt.test PASSED in 1.4s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:import_underscore_output_shapes.pbtxt.test PASSED in 0.4s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:import_while_with_attr_inference.pbtxt.test PASSED in 1.7s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:infeed_dequeue.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:infer_arg_handle_type.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:infer_with_output_shapes.pbtxt.test PASSED in 1.1s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_arg_name.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_backedge_input_size.pbtxt.test PASSED in 2.4s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_duplicated_node_name.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_edge_index.pbtxt.test PASSED in 0.8s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_edge_name.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_empty_attr_key.pbtxt.test PASSED in 0.4s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_empty_func_attr_key.pbtxt.test PASSED in 0.6s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_empty_func_attr_name.pbtxt.test PASSED in 0.4s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_empty_op_type.pbtxt.test PASSED in 1.3s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_func_with_empty_name.pbtxt.test PASSED in 0.7s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_function_import.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_generic_func_with_empty_control_result.pbtxt.test PASSED in 2.3s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_generic_func_with_empty_input.pbtxt.test PASSED in 0.4s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_generic_func_with_empty_name.pbtxt.test PASSED in 1.1s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_generic_func_with_empty_result.pbtxt.test PASSED in 0.8s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_generic_function_attr_name.pbtxt.test PASSED in 1.0s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_generic_function_named_edge_index.pbtxt.test PASSED in 1.7s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_handle_data.pbtxt.test PASSED in 2.0s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_missing_control_input.pbtxt.test PASSED in 1.2s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_missing_control_result.pbtxt.test PASSED in 0.4s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_missing_control_result_value.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_missing_data_result.pbtxt.test PASSED in 0.7s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_missing_data_result_value.pbtxt.test PASSED in 0.6s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_missing_input.pbtxt.test PASSED in 0.7s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_missing_two_inputs.pbtxt.test PASSED in 1.0s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_named_edge_index.pbtxt.test PASSED in 1.8s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_op_name.pbtxt.test PASSED in 0.4s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_type_list.pbtxt.test PASSED in 1.2s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:legacy_call.pbtxt.test PASSED in 0.8s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:negative_shape.pbtxt.test PASSED in 0.4s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:negative_zero_constant.pbtxt.test PASSED in 0.4s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:three_nodes_with_attrs.pbtxt.test PASSED in 0.6s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:version.pbtxt.test PASSED in 0.9s //tensorflow/core/ir/importexport/tests/mlir_to_graphdef:empty.mlir.test PASSED in 0.7s //tensorflow/core/ir/importexport/tests/mlir_to_graphdef:fulltype.mlir.test PASSED in 1.1s //tensorflow/core/ir/importexport/tests/mlir_to_graphdef:func_with_no_args_or_results.mlir.test PASSED in 0.4s //tensorflow/core/ir/importexport/tests/mlir_to_graphdef:negative_zero_constant.mlir.test PASSED in 0.4s //tensorflow/core/ir/importexport/tests/mlir_to_graphdef:nested_legacy_call.mlir.test PASSED in 1.2s //tensorflow/core/ir/importexport/tests/mlir_to_graphdef:three_nodes_with_attrs.mlir.test PASSED in 0.4s //tensorflow/core/ir/importexport/tests/mlir_to_graphdef:version.mlir.test PASSED in 0.8s //tensorflow/core/ir/importexport/tests/saved_model:saved_model_roundtrip_test PASSED in 0.3s //tensorflow/core/ir/tests:attributes.mlir.test PASSED in 0.6s //tensorflow/core/ir/tests:canonicalize.mlir.test PASSED in 0.6s //tensorflow/core/ir/tests:compatible_types.mlir.test PASSED in 0.4s //tensorflow/core/ir/tests:concrete-ops.mlir.test PASSED in 0.8s //tensorflow/core/ir/tests:generic_concrete_ops.mlir.test PASSED in 1.1s //tensorflow/core/ir/tests:invalid-concrete-ops.mlir.test PASSED in 0.4s //tensorflow/core/ir/tests:invalid-preserved-attrs.mlir.test PASSED in 0.7s //tensorflow/core/ir/tests:invalid.mlir.test PASSED in 1.4s //tensorflow/core/ir/tests:invalid_types.mlir.test PASSED in 1.7s //tensorflow/core/ir/tests:ops.mlir.test PASSED in 0.3s //tensorflow/core/ir/tests:region-invalid-ops.mlir.test PASSED in 0.4s //tensorflow/core/ir/tests:region-ops-graph.mlir.test PASSED in 0.8s //tensorflow/core/ir/tests:region-ops.mlir.test PASSED in 0.7s //tensorflow/core/ir/tests:types.mlir.test PASSED in 0.4s //tensorflow/core/ir/types:dialect_test PASSED in 0.2s //tensorflow/core/kernels:as_string_op_test PASSED in 0.7s //tensorflow/core/kernels:basic_ops_benchmark_test PASSED in 1.3s //tensorflow/core/kernels:batch_kernels_env_test PASSED in 0.7s //tensorflow/core/kernels:batch_kernels_test PASSED in 16.8s //tensorflow/core/kernels:bias_op_test PASSED in 0.5s //tensorflow/core/kernels:bincount_op_test_cpu PASSED in 1.0s //tensorflow/core/kernels:broadcast_to_op_test_cpu PASSED in 0.9s //tensorflow/core/kernels:cast_op_test_cpu PASSED in 1.9s //tensorflow/core/kernels:checkpoint_callback_manager_test PASSED in 1.2s //tensorflow/core/kernels:clustering_ops_test PASSED in 0.5s //tensorflow/core/kernels:composite_tensor_variant_test PASSED in 0.6s //tensorflow/core/kernels:concat_op_test PASSED in 0.5s //tensorflow/core/kernels:constant_op_test_cpu PASSED in 1.1s //tensorflow/core/kernels:control_flow_ops_test PASSED in 7.6s //tensorflow/core/kernels:conv_grad_filter_ops_benchmark_test_cpu PASSED in 0.6s //tensorflow/core/kernels:conv_grad_input_ops_benchmark_test_cpu PASSED in 1.1s //tensorflow/core/kernels:conv_ops_benchmark_test_cpu PASSED in 0.8s //tensorflow/core/kernels:conv_ops_test_cpu PASSED in 8.7s //tensorflow/core/kernels:count_ops_test PASSED in 0.6s //tensorflow/core/kernels:cross_op_test PASSED in 1.1s //tensorflow/core/kernels:cwise_ops_test_cpu PASSED in 1.1s //tensorflow/core/kernels:debug_ops_test PASSED in 1.0s //tensorflow/core/kernels:decode_wav_op_test PASSED in 2.5s //tensorflow/core/kernels:deep_conv2d_test PASSED in 0.7s //tensorflow/core/kernels:dequantize_op_test PASSED in 0.5s //tensorflow/core/kernels:diag_op_test_cpu PASSED in 0.5s //tensorflow/core/kernels:dynamic_partition_op_test_cpu PASSED in 1.1s //tensorflow/core/kernels:dynamic_stitch_op_test_cpu PASSED in 1.2s //tensorflow/core/kernels:eigen_activations_test PASSED in 0.1s //tensorflow/core/kernels:eigen_attention_test PASSED in 0.4s //tensorflow/core/kernels:eigen_backward_cuboid_convolutions_test PASSED in 0.4s //tensorflow/core/kernels:eigen_backward_spatial_convolutions_test PASSED in 0.2s //tensorflow/core/kernels:eigen_benchmark_cpu_test PASSED in 1.0s //tensorflow/core/kernels:eigen_mkldnn_contraction_kernel_test PASSED in 0.3s //tensorflow/core/kernels:eigen_pooling_test PASSED in 0.8s //tensorflow/core/kernels:encode_wav_op_test PASSED in 4.6s //tensorflow/core/kernels:fingerprint_op_test PASSED in 1.6s //tensorflow/core/kernels:fused_batch_norm_ex_op_test_cpu PASSED in 1.2s //tensorflow/core/kernels:fused_batch_norm_op_test_cpu PASSED in 0.5s //tensorflow/core/kernels:gather_nd_op_test_cpu PASSED in 0.8s //tensorflow/core/kernels:gather_op_test_cpu PASSED in 1.1s //tensorflow/core/kernels:guarantee_const_op_test PASSED in 1.4s //tensorflow/core/kernels:identity_n_op_test PASSED in 0.8s //tensorflow/core/kernels:identity_op_test PASSED in 0.6s //tensorflow/core/kernels:immutable_constant_op_test PASSED in 1.0s //tensorflow/core/kernels:in_topk_op_test PASSED in 0.7s //tensorflow/core/kernels:isotonic_regression_op_test PASSED in 1.5s //tensorflow/core/kernels:logging_ops_test PASSED in 1.8s //tensorflow/core/kernels:lookup_ops_test PASSED in 0.6s //tensorflow/core/kernels:loss_test PASSED in 0.7s //tensorflow/core/kernels:lrn_op_test_cpu PASSED in 0.6s //tensorflow/core/kernels:matmul_op_test_cpu PASSED in 8.2s //tensorflow/core/kernels:merge_v2_checkpoints_op_test PASSED in 0.7s //tensorflow/core/kernels:mfcc_dct_test PASSED in 0.1s //tensorflow/core/kernels:mfcc_mel_filterbank_test PASSED in 0.3s //tensorflow/core/kernels:mfcc_op_test_cpu PASSED in 2.4s //tensorflow/core/kernels:mfcc_test PASSED in 0.2s //tensorflow/core/kernels:multinomial_op_test_cpu PASSED in 0.7s //tensorflow/core/kernels:nn_ops_test_cpu PASSED in 0.8s //tensorflow/core/kernels:one_hot_op_test PASSED in 0.5s //tensorflow/core/kernels:ops_testutil_test PASSED in 1.6s //tensorflow/core/kernels:ops_util_test PASSED in 0.1s //tensorflow/core/kernels:parameterized_truncated_normal_op_test_cpu PASSED in 1.2s //tensorflow/core/kernels:parse_tensor_test PASSED in 0.5s //tensorflow/core/kernels:quantization_utils_test PASSED in 1.1s //tensorflow/core/kernels:quantize_and_dequantize_op_test_cpu PASSED in 1.2s //tensorflow/core/kernels:quantize_down_and_shrink_range_op_test PASSED in 0.9s //tensorflow/core/kernels:quantize_op_test PASSED in 1.5s //tensorflow/core/kernels:quantized_activation_ops_test PASSED in 0.8s //tensorflow/core/kernels:quantized_add_op_test PASSED in 1.2s //tensorflow/core/kernels:quantized_batch_norm_op_test PASSED in 0.7s //tensorflow/core/kernels:quantized_bias_add_op_test PASSED in 0.9s //tensorflow/core/kernels:quantized_concat_op_test PASSED in 1.1s //tensorflow/core/kernels:quantized_conv_ops_test PASSED in 1.1s //tensorflow/core/kernels:quantized_instance_norm_test PASSED in 1.5s //tensorflow/core/kernels:quantized_matmul_op_test PASSED in 1.1s //tensorflow/core/kernels:quantized_mul_op_test PASSED in 2.7s //tensorflow/core/kernels:quantized_pooling_ops_test PASSED in 0.9s //tensorflow/core/kernels:quantized_reshape_op_test PASSED in 0.9s //tensorflow/core/kernels:quantized_resize_bilinear_op_test PASSED in 2.1s //tensorflow/core/kernels:ragged_fill_empty_rows_op_test PASSED in 2.1s //tensorflow/core/kernels:ragged_gather_op_test PASSED in 1.0s //tensorflow/core/kernels:ragged_range_op_test PASSED in 1.8s //tensorflow/core/kernels:ragged_tensor_from_variant_op_test PASSED in 1.5s //tensorflow/core/kernels:ragged_tensor_to_sparse_kernel_test PASSED in 1.3s //tensorflow/core/kernels:ragged_tensor_to_tensor_op_test PASSED in 0.7s //tensorflow/core/kernels:ragged_tensor_to_variant_op_test PASSED in 1.4s //tensorflow/core/kernels:random_binomial_op_test_cpu PASSED in 0.8s //tensorflow/core/kernels:random_index_shuffle_test PASSED in 0.3s //tensorflow/core/kernels:random_op_test_cpu PASSED in 1.0s //tensorflow/core/kernels:random_poisson_op_test_cpu PASSED in 0.6s //tensorflow/core/kernels:range_sampler_test PASSED in 0.9s //tensorflow/core/kernels:reduction_ops_test_cpu PASSED in 0.8s //tensorflow/core/kernels:regex_replace_op_test PASSED in 0.9s //tensorflow/core/kernels:requantization_range_op_test PASSED in 2.1s //tensorflow/core/kernels:requantize_op_test PASSED in 1.4s //tensorflow/core/kernels:resource_ops_test PASSED in 1.5s //tensorflow/core/kernels:restore_op_test PASSED in 1.7s //tensorflow/core/kernels:restore_v2_op_test PASSED in 0.8s //tensorflow/core/kernels:reverse_op_test PASSED in 0.9s //tensorflow/core/kernels:roll_op_test PASSED in 1.3s //tensorflow/core/kernels:save_op_test PASSED in 0.7s //tensorflow/core/kernels:save_v2_op_test PASSED in 0.6s //tensorflow/core/kernels:scan_ops_test_cpu PASSED in 0.6s //tensorflow/core/kernels:scatter_nd_op_test_cpu PASSED in 0.9s //tensorflow/core/kernels:scatter_op_test PASSED in 1.4s //tensorflow/core/kernels:scoped_allocator_ops_test_cpu PASSED in 8.8s //tensorflow/core/kernels:sdca_ops_test PASSED in 2.0s //tensorflow/core/kernels:segment_reduction_ops_test PASSED in 0.9s //tensorflow/core/kernels:sendrecv_ops_test PASSED in 1.6s //tensorflow/core/kernels:sequence_ops_test PASSED in 0.6s //tensorflow/core/kernels:shape_ops_test PASSED in 0.6s //tensorflow/core/kernels:slice_op_test PASSED in 0.6s //tensorflow/core/kernels:spacetobatch_benchmark_test_cpu PASSED in 0.6s //tensorflow/core/kernels:sparse_add_op_test PASSED in 0.8s //tensorflow/core/kernels:sparse_dense_binary_op_shared_test PASSED in 1.5s //tensorflow/core/kernels:sparse_fill_empty_rows_op_test_cpu PASSED in 0.8s //tensorflow/core/kernels:sparse_matmul_op_test_cpu PASSED in 0.9s //tensorflow/core/kernels:sparse_reduce_sum_op_test PASSED in 2.0s //tensorflow/core/kernels:sparse_tensor_dense_matmul_op_test_cpu PASSED in 0.8s //tensorflow/core/kernels:sparse_to_dense_op_test_cpu PASSED in 1.7s //tensorflow/core/kernels:sparse_utils_test PASSED in 0.4s //tensorflow/core/kernels:sparse_xent_op_test_cpu PASSED in 1.2s //tensorflow/core/kernels:spectrogram_op_test_cpu PASSED in 2.9s //tensorflow/core/kernels:spectrogram_test PASSED in 0.3s //tensorflow/core/kernels:split_op_test_cpu PASSED in 0.5s //tensorflow/core/kernels:split_v_op_test_cpu PASSED in 0.6s //tensorflow/core/kernels:strided_slice_op_test PASSED in 1.2s //tensorflow/core/kernels:string_format_op_test PASSED in 5.7s //tensorflow/core/kernels:string_ngrams_op_test PASSED in 2.0s //tensorflow/core/kernels:string_split_op_test PASSED in 1.1s //tensorflow/core/kernels:substr_op_test PASSED in 1.1s //tensorflow/core/kernels:summary_audio_op_test PASSED in 1.3s //tensorflow/core/kernels:summary_image_op_test PASSED in 0.6s //tensorflow/core/kernels:summary_op_test PASSED in 1.1s //tensorflow/core/kernels:summary_tensor_op_test PASSED in 2.0s //tensorflow/core/kernels:tensor_cord_test PASSED in 0.3s //tensorflow/core/kernels:tensor_flag_utils_test PASSED in 0.7s //tensorflow/core/kernels:tensor_map_test PASSED in 0.2s //tensorflow/core/kernels:training_ops_test PASSED in 0.5s //tensorflow/core/kernels:transpose_util_test PASSED in 0.7s //tensorflow/core/kernels:unary_ops_composition_test_cpu PASSED in 2.7s //tensorflow/core/kernels:unique_op_test PASSED in 0.7s //tensorflow/core/kernels:variable_ops_test PASSED in 2.1s //tensorflow/core/kernels:while_op_test PASSED in 1.5s //tensorflow/core/kernels:xent_op_test_cpu PASSED in 0.8s //tensorflow/core/kernels/batching_util:basic_batch_scheduler_test PASSED in 0.1s //tensorflow/core/kernels/batching_util:batch_input_task_test PASSED in 0.6s //tensorflow/core/kernels/batching_util:batch_resource_base_test PASSED in 0.1s //tensorflow/core/kernels/batching_util:batch_scheduler_test PASSED in 0.7s //tensorflow/core/kernels/batching_util:bounded_executor_test PASSED in 33.5s //tensorflow/core/kernels/batching_util:input_split_metadata_test PASSED in 0.1s //tensorflow/core/kernels/batching_util:periodic_function_test PASSED in 2.8s //tensorflow/core/kernels/batching_util:serial_device_batch_scheduler_test PASSED in 2.6s //tensorflow/core/kernels/batching_util:shared_batch_scheduler_test PASSED in 4.2s //tensorflow/core/kernels/batching_util:threadsafe_status_test PASSED in 0.1s //tensorflow/core/kernels/data:batch_dataset_op_test PASSED in 0.9s //tensorflow/core/kernels/data:cache_dataset_ops_test PASSED in 3.7s //tensorflow/core/kernels/data:concatenate_dataset_op_test PASSED in 1.4s //tensorflow/core/kernels/data:filter_dataset_op_test PASSED in 1.5s //tensorflow/core/kernels/data:finalize_dataset_op_test PASSED in 3.0s //tensorflow/core/kernels/data:fixed_length_record_dataset_op_test PASSED in 1.1s //tensorflow/core/kernels/data:flat_map_dataset_op_test PASSED in 2.4s //tensorflow/core/kernels/data:get_options_op_test PASSED in 0.6s //tensorflow/core/kernels/data:interleave_dataset_op_test PASSED in 1.7s //tensorflow/core/kernels/data:iterator_ops_test PASSED in 1.3s //tensorflow/core/kernels/data:map_dataset_op_test PASSED in 1.5s //tensorflow/core/kernels/data:map_defun_op_test PASSED in 0.5s //tensorflow/core/kernels/data:optimize_dataset_op_test PASSED in 1.5s //tensorflow/core/kernels/data:options_dataset_op_test PASSED in 0.6s //tensorflow/core/kernels/data:padded_batch_dataset_op_test PASSED in 1.2s //tensorflow/core/kernels/data:parallel_batch_dataset_op_test PASSED in 5.2s //tensorflow/core/kernels/data:parallel_filter_dataset_op_test PASSED in 2.8s //tensorflow/core/kernels/data:parallel_interleave_dataset_op_test PASSED in 5.5s //tensorflow/core/kernels/data:parallel_map_dataset_op_test PASSED in 1.1s //tensorflow/core/kernels/data:prefetch_autotuner_test PASSED in 0.3s //tensorflow/core/kernels/data:prefetch_dataset_op_test PASSED in 3.1s //tensorflow/core/kernels/data:range_dataset_op_test PASSED in 1.6s //tensorflow/core/kernels/data:reduce_dataset_op_test PASSED in 1.6s //tensorflow/core/kernels/data:repeat_dataset_op_test PASSED in 0.7s //tensorflow/core/kernels/data:rewrite_dataset_op_test PASSED in 1.2s //tensorflow/core/kernels/data:shard_dataset_op_test PASSED in 2.6s //tensorflow/core/kernels/data:shuffle_dataset_op_test PASSED in 2.5s //tensorflow/core/kernels/data:skip_dataset_op_test PASSED in 1.0s //tensorflow/core/kernels/data:sparse_tensor_slice_dataset_op_test PASSED in 2.2s //tensorflow/core/kernels/data:take_dataset_op_test PASSED in 2.9s //tensorflow/core/kernels/data:tensor_dataset_op_test PASSED in 0.7s //tensorflow/core/kernels/data:tensor_slice_dataset_op_test PASSED in 1.0s //tensorflow/core/kernels/data:text_line_dataset_op_test PASSED in 0.8s //tensorflow/core/kernels/data:tf_record_dataset_op_test PASSED in 1.1s //tensorflow/core/kernels/data:window_dataset_op_test PASSED in 0.7s //tensorflow/core/kernels/data:zip_dataset_op_test PASSED in 1.1s //tensorflow/core/kernels/data/experimental:assert_next_dataset_op_test PASSED in 0.9s //tensorflow/core/kernels/data/experimental:assert_prev_dataset_op_test PASSED in 1.3s //tensorflow/core/kernels/data/experimental:auto_shard_dataset_op_test PASSED in 0.9s //tensorflow/core/kernels/data/experimental:directed_interleave_dataset_op_test PASSED in 0.6s //tensorflow/core/kernels/data/experimental:list_dataset_op_test PASSED in 1.7s //tensorflow/core/kernels/data/experimental:map_and_batch_dataset_op_test PASSED in 2.0s //tensorflow/core/kernels/data/experimental:parallel_interleave_dataset_op_test PASSED in 0.8s //tensorflow/core/kernels/data/experimental:random_dataset_op_test PASSED in 1.3s //tensorflow/core/kernels/data/experimental:sampling_dataset_op_test PASSED in 0.7s //tensorflow/core/kernels/data/experimental:save_dataset_op_test PASSED in 1.3s //tensorflow/core/kernels/data/experimental:unique_dataset_op_test PASSED in 0.8s //tensorflow/core/kernels/image:adjust_contrast_op_benchmark_test_cpu PASSED in 1.6s //tensorflow/core/kernels/image:adjust_contrast_op_test PASSED in 1.6s //tensorflow/core/kernels/image:colorspace_op_test PASSED in 1.3s //tensorflow/core/kernels/image:crop_and_resize_op_benchmark_test_cpu PASSED in 1.1s //tensorflow/core/kernels/image:crop_and_resize_op_test PASSED in 0.8s //tensorflow/core/kernels/image:encode_jpeg_op_test PASSED in 0.7s //tensorflow/core/kernels/image:mirror_pad_op_benchmark_test_cpu PASSED in 0.7s //tensorflow/core/kernels/image:mirror_pad_op_test PASSED in 1.0s //tensorflow/core/kernels/image:non_max_suppression_op_benchmark_test PASSED in 0.6s //tensorflow/core/kernels/image:non_max_suppression_op_test PASSED in 0.9s //tensorflow/core/kernels/image:resize_area_op_test PASSED in 1.5s //tensorflow/core/kernels/image:resize_benchmark_test_cpu PASSED in 1.5s //tensorflow/core/kernels/image:resize_bicubic_op_test PASSED in 6.8s //tensorflow/core/kernels/image:resize_ops_test_cpu PASSED in 2.8s //tensorflow/core/kernels/image:sampling_kernels_test PASSED in 0.6s //tensorflow/core/kernels/image:scale_and_translate_op_test PASSED in 2.5s //tensorflow/core/kernels/linalg:banded_triangular_solve_op_test_cpu PASSED in 1.6s //tensorflow/core/kernels/linalg:matrix_triangular_solve_op_test_cpu PASSED in 0.7s //tensorflow/core/kernels/mkl:mkl_conv_ops_test PASSED in 0.7s //tensorflow/core/kernels/mkl:mkl_dequantize_op_test PASSED in 0.1s //tensorflow/core/kernels/mkl:mkl_fused_batch_norm_op_test PASSED in 0.3s //tensorflow/core/kernels/mkl:mkl_fused_ops_test PASSED in 3.4s //tensorflow/core/kernels/mkl:mkl_matmul_op_benchmark PASSED in 0.1s //tensorflow/core/kernels/mkl:mkl_qmatmul_op_test PASSED in 0.3s //tensorflow/core/kernels/mkl:mkl_quantize_op_test PASSED in 0.3s //tensorflow/core/kernels/mkl:mkl_quantized_concat_op_test PASSED in 0.3s //tensorflow/core/kernels/mkl:mkl_quantized_conv_ops_perchannel_test PASSED in 0.1s //tensorflow/core/kernels/mkl:mkl_quantized_conv_ops_test PASSED in 1.0s //tensorflow/core/kernels/mkl:mkl_quantized_pooling_ops_test PASSED in 0.5s //tensorflow/core/kernels/mkl:mkl_relu_op_test PASSED in 0.5s //tensorflow/core/kernels/mkl:mkl_requantize_ops_test PASSED in 0.3s //tensorflow/core/kernels/mkl:mkl_swish_op_test PASSED in 0.6s //tensorflow/core/kernels/mkl:onednn_nn_ops_benchmark PASSED in 0.1s //tensorflow/core/kernels/sparse:kernels_test PASSED in 0.8s //tensorflow/core/kernels/uniform_quant_ops:math_utils_test PASSED in 1.0s //tensorflow/core/kernels/uniform_quant_ops:tensor_utils_test PASSED in 0.1s //tensorflow/core/kernels/uniform_quant_ops:uniform_dequantize_op_test PASSED in 0.8s //tensorflow/core/kernels/uniform_quant_ops:uniform_quantize_op_test PASSED in 0.7s //tensorflow/core/kernels/uniform_quant_ops:uniform_quantized_add_op_test PASSED in 0.9s //tensorflow/core/kernels/uniform_quant_ops:uniform_quantized_clip_by_value_op_test PASSED in 1.3s //tensorflow/core/kernels/uniform_quant_ops:uniform_quantized_convolution_ops_test PASSED in 0.7s //tensorflow/core/kernels/uniform_quant_ops:uniform_quantized_dot_ops_test PASSED in 0.7s //tensorflow/core/kernels/uniform_quant_ops:uniform_requantize_op_test PASSED in 0.6s //tensorflow/core/lib/db:sqlite_test PASSED in 0.9s //tensorflow/core/lib/gif:lib_gif_io_test PASSED in 1.9s //tensorflow/core/lib/jpeg:lib_jpeg_jpeg_mem_unittest PASSED in 0.5s //tensorflow/core/ops:cudnn_rnn_ops_test_cc PASSED in 0.8s //tensorflow/core/ops:ops_array_grad_test PASSED in 2.1s //tensorflow/core/ops:ops_math_grad_test PASSED in 4.9s //tensorflow/core/ops:ops_tests PASSED in 0.9s //tensorflow/core/ops/compat:backwards_compatibility_test PASSED in 2.1s //tensorflow/core/platform:__tensorflow_tsl_platform_profile_utils_cpu_utils_test PASSED in 0.5s //tensorflow/core/platform:enable_tf2_utils_test PASSED in 0.1s //tensorflow/core/platform:env_test PASSED in 5.9s //tensorflow/core/platform:fake_python_env_test PASSED in 0.3s //tensorflow/core/platform:file_system_test PASSED in 0.1s //tensorflow/core/platform:platform_strings_test PASSED in 0.3s //tensorflow/core/platform:ram_file_system_test PASSED in 30.4s //tensorflow/core/platform:resource_loader_test PASSED in 0.1s //tensorflow/core/platform:vmodule_benchmark_test PASSED in 0.5s //tensorflow/core/platform:vmodule_test PASSED in 0.3s //tensorflow/core/profiler/backends/cpu:host_tracer_test PASSED in 0.3s //tensorflow/core/profiler/convert:dcn_analysis_test PASSED in 0.3s //tensorflow/core/profiler/convert:dcn_utils_test PASSED in 0.3s //tensorflow/core/profiler/convert:hlo_proto_to_graph_view_test PASSED in 0.2s //tensorflow/core/profiler/convert:hlo_proto_to_memory_visualization_utils_test PASSED in 0.1s //tensorflow/core/profiler/convert:op_stats_to_pod_stats_test PASSED in 0.1s //tensorflow/core/profiler/convert:op_stats_to_pod_viewer_test PASSED in 0.5s //tensorflow/core/profiler/convert:op_stats_to_tf_stats_test PASSED in 0.2s //tensorflow/core/profiler/convert:repository_test PASSED in 0.1s //tensorflow/core/profiler/convert:xplane_to_kernel_stats_db_test PASSED in 0.4s //tensorflow/core/profiler/convert:xplane_to_memory_profile_test PASSED in 0.3s //tensorflow/core/profiler/convert:xplane_to_op_metrics_db_test PASSED in 0.1s //tensorflow/core/profiler/convert:xplane_to_op_stats_test PASSED in 0.3s //tensorflow/core/profiler/convert:xplane_to_step_events_test PASSED in 0.4s //tensorflow/core/profiler/convert:xplane_to_tf_functions_test PASSED in 0.1s //tensorflow/core/profiler/convert:xplane_to_tool_names_test PASSED in 0.3s //tensorflow/core/profiler/convert/trace_viewer:trace_viewer_visibility_test PASSED in 0.3s //tensorflow/core/profiler/internal:tfprof_show_test PASSED in 1.2s //tensorflow/core/profiler/internal:tfprof_stats_test PASSED in 1.0s //tensorflow/core/profiler/internal:tfprof_tensor_test PASSED in 1.0s //tensorflow/core/profiler/internal:tfprof_timeline_test PASSED in 1.5s //tensorflow/core/profiler/internal/advisor:tfprof_advisor_test PASSED in 0.7s //tensorflow/core/profiler/lib:profiler_disabled_test PASSED in 0.2s //tensorflow/core/profiler/utils:derived_timeline_test PASSED in 0.2s //tensorflow/core/profiler/utils:kernel_stats_utils_test PASSED in 0.2s //tensorflow/core/profiler/utils:op_metrics_db_utils_test PASSED in 0.6s //tensorflow/core/profiler/utils:step_intersection_test PASSED in 0.1s //tensorflow/core/summary:schema_test PASSED in 0.7s //tensorflow/core/summary:summary_db_writer_test PASSED in 0.1s //tensorflow/core/summary:summary_file_writer_test PASSED in 0.4s //tensorflow/core/tfrt/common:pjrt_cpu_client_registration_test PASSED in 8.7s //tensorflow/core/tfrt/common:pjrt_state_test PASSED in 9.5s //tensorflow/core/tfrt/common:pjrt_util_test PASSED in 6.6s //tensorflow/core/tfrt/fallback:cost_recorder_test PASSED in 0.1s //tensorflow/core/tfrt/fallback:fallback_state_test PASSED in 0.5s //tensorflow/core/transforms:eval_utils_test PASSED in 2.4s //tensorflow/core/transforms:graph_transform_wrapper_test PASSED in 0.6s //tensorflow/core/util:bcast_test PASSED in 1.3s //tensorflow/core/util:command_line_flags_test PASSED in 1.4s //tensorflow/core/util:debug_data_dumper_test PASSED in 1.6s //tensorflow/core/util:debug_events_writer_test PASSED in 1.3s //tensorflow/core/util:dump_graph_test PASSED in 0.8s //tensorflow/core/util:equal_graph_def_test PASSED in 0.9s //tensorflow/core/util:events_writer_test PASSED in 3.2s //tensorflow/core/util:example_proto_fast_parsing_test PASSED in 1.4s //tensorflow/core/util:example_proto_helper_test PASSED in 1.1s //tensorflow/core/util:exec_on_stall_test PASSED in 2.7s //tensorflow/core/util:fake_clock_env_test PASSED in 1.9s //tensorflow/core/util:incremental_barrier_test PASSED in 0.1s //tensorflow/core/util:matmul_bcast_test PASSED in 1.0s //tensorflow/core/util:memmapped_file_system_test PASSED in 1.0s //tensorflow/core/util:overflow_test PASSED in 0.3s //tensorflow/core/util:presized_cuckoo_map_test PASSED in 2.2s //tensorflow/core/util:ragged_to_dense_util_test PASSED in 0.9s //tensorflow/core/util:reffed_status_callback_test PASSED in 0.8s //tensorflow/core/util:reporter_test PASSED in 2.2s //tensorflow/core/util:saved_tensor_slice_util_test PASSED in 1.0s //tensorflow/core/util:semver_test PASSED in 1.8s //tensorflow/core/util:stat_summarizer_test PASSED in 0.8s //tensorflow/core/util:strided_slice_op_test PASSED in 1.3s //tensorflow/core/util:tensor_format_test PASSED in 1.1s //tensorflow/core/util:tensor_slice_reader_test PASSED in 1.5s //tensorflow/core/util:tensor_slice_set_test PASSED in 0.7s //tensorflow/core/util:tensor_slice_util_test PASSED in 3.6s //tensorflow/core/util:tensor_slice_writer_test PASSED in 1.7s //tensorflow/core/util:work_sharder_test PASSED in 1.4s //tensorflow/core/util/ctc:ctc_beam_search_test PASSED in 0.6s //tensorflow/core/util/proto:descriptor_pool_registry_test PASSED in 0.5s //tensorflow/core/util/proto:proto_utils_test PASSED in 0.7s //tensorflow/core/util/quantization:uniform_quant_ops_params_test PASSED in 1.1s //tensorflow/core/util/sparse:sparse_tensor_test PASSED in 0.4s //tensorflow/core/util/tensor_bundle:tensor_bundle_test PASSED in 42.3s //tensorflow/dtensor/mlir:dtensor_location_test PASSED in 0.2s //tensorflow/dtensor/mlir:group_assignment_test PASSED in 0.1s //tensorflow/dtensor/mlir/tests:annotate_global_shape.mlir.test PASSED in 1.6s //tensorflow/dtensor/mlir/tests:cluster_function_conversion.mlir.test PASSED in 0.9s //tensorflow/dtensor/mlir/tests:constant_folding.mlir.test PASSED in 1.2s //tensorflow/dtensor/mlir/tests:decompose_controlflow.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:designate_resource_handle_mesh.mlir.test PASSED in 0.8s //tensorflow/dtensor/mlir/tests:device_mesh_cluster_coarsening.mlir.test PASSED in 0.4s //tensorflow/dtensor/mlir/tests:dtensor_all_gather.mlir.test PASSED in 0.4s //tensorflow/dtensor/mlir/tests:dtensor_all_scatter.mlir.test PASSED in 0.8s //tensorflow/dtensor/mlir/tests:dtensor_allreduce_combine_optimization.mlir.test PASSED in 1.2s //tensorflow/dtensor/mlir/tests:dtensor_allreduce_lowering.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:dtensor_allreduce_scatter_optimization.mlir.test PASSED in 0.4s //tensorflow/dtensor/mlir/tests:dtensor_allreduce_sum_optimization.mlir.test PASSED in 1.3s //tensorflow/dtensor/mlir/tests:dtensor_alltoall_lowering.mlir.test PASSED in 0.4s //tensorflow/dtensor/mlir/tests:dtensor_layout_must_execute.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:dtensor_layout_to_xla_sharding_op.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:dtensor_mixed_precision_reduce.mlir.test PASSED in 0.4s //tensorflow/dtensor/mlir/tests:dtensor_reduce_scatter_lowering.mlir.test PASSED in 1.1s //tensorflow/dtensor/mlir/tests:dtensor_remove_dtensorlayout.mlir.test PASSED in 1.3s //tensorflow/dtensor/mlir/tests:dtensor_replace_auxiliary_layout_op.mlir.test PASSED in 1.1s //tensorflow/dtensor/mlir/tests:dtensor_replace_relayout_with_identity.mlir.test PASSED in 0.4s //tensorflow/dtensor/mlir/tests:dtensor_set_hlo_sharding.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:dtensor_set_hlo_sharding_default.mlir.test PASSED in 0.8s //tensorflow/dtensor/mlir/tests:dtensor_xla_spmd_integration.mlir.test PASSED in 0.9s //tensorflow/dtensor/mlir/tests:elide_identity_before_copy_to_mesh.mlir.test PASSED in 0.8s //tensorflow/dtensor/mlir/tests:function_renaming.mlir.test PASSED in 0.4s //tensorflow/dtensor/mlir/tests:handle_cross_cluster_dependencies.mlir.test PASSED in 0.6s //tensorflow/dtensor/mlir/tests:handle_sparsetensors.mlir.test PASSED in 0.6s //tensorflow/dtensor/mlir/tests:layout_propagation_v2.mlir.test PASSED in 1.2s //tensorflow/dtensor/mlir/tests:lower_send_recv.mlir.test PASSED in 1.3s //tensorflow/dtensor/mlir/tests:merge_clusters.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:mesh_propagation.mlir.test PASSED in 0.6s //tensorflow/dtensor/mlir/tests:multi_device_expansion.mlir.test PASSED in 0.4s //tensorflow/dtensor/mlir/tests:op_to_device_cluster.mlir.test PASSED in 1.5s //tensorflow/dtensor/mlir/tests:propagate_default_layout.mlir.test PASSED in 0.7s //tensorflow/dtensor/mlir/tests:propagate_device_id_to_function.mlir.test PASSED in 0.9s //tensorflow/dtensor/mlir/tests:restore_and_assign.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:restore_shape_inference.mlir.test PASSED in 0.8s //tensorflow/dtensor/mlir/tests:set_default_sharding.mlir.test PASSED in 0.8s //tensorflow/dtensor/mlir/tests:sparse_expansion.mlir.test PASSED in 1.1s //tensorflow/dtensor/mlir/tests:spmd_batchparallel.mlir.test PASSED in 1.5s //tensorflow/dtensor/mlir/tests:spmd_concat.mlir.test PASSED in 0.7s //tensorflow/dtensor/mlir/tests:spmd_conv.mlir.test PASSED in 0.6s //tensorflow/dtensor/mlir/tests:spmd_einsum.mlir.test PASSED in 0.7s //tensorflow/dtensor/mlir/tests:spmd_expansion.mlir.test PASSED in 1.0s //tensorflow/dtensor/mlir/tests:spmd_io_ops.mlir.test PASSED in 1.2s //tensorflow/dtensor/mlir/tests:spmd_iterator.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:spmd_matmul.mlir.test PASSED in 1.1s //tensorflow/dtensor/mlir/tests:spmd_random.mlir.test PASSED in 1.6s //tensorflow/dtensor/mlir/tests:spmd_save_restore.mlir.test PASSED in 0.6s //tensorflow/dtensor/mlir/tests:spmd_segment_sum.mlir.test PASSED in 8.9s //tensorflow/dtensor/mlir/tests:spmd_slice.mlir.test PASSED in 1.1s //tensorflow/dtensor/mlir/tests:spmd_softmax_loss.mlir.test PASSED in 0.9s //tensorflow/dtensor/mlir/tests:spmd_squeeze.mlir.test PASSED in 0.4s //tensorflow/dtensor/mlir/tests:spmd_var_handle.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:tf_dtensor_ops.mlir.test PASSED in 0.8s //tensorflow/dtensor/mlir/tests:tpu_add_resource_device_attribute.mlir.test PASSED in 0.6s //tensorflow/dtensor/mlir/tests:tpu_integration.mlir.test PASSED in 1.5s //tensorflow/dtensor/mlir/tests:undo_merge_const_across_mesh.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:update_tpu_metadata.mlir.test PASSED in 0.6s //tensorflow/dtensor/python/tests:collective_combine_all_reduce_test_cpu PASSED in 15.6s //tensorflow/dtensor/python/tests:collective_test_cpu PASSED in 17.1s //tensorflow/dtensor/python/tests:config_test_cpu PASSED in 6.7s //tensorflow/dtensor/python/tests:device_test_cpu PASSED in 40.4s //tensorflow/dtensor/python/tests:layout_test_cpu PASSED in 15.5s //tensorflow/dtensor/python/tests:multi_client_test_cpu PASSED in 20.5s //tensorflow/dtensor/python/tests:numpy_util_test_cpu PASSED in 10.9s //tensorflow/dtensor/tests:dtensor_operation_test PASSED in 49.5s //tensorflow/dtensor/tests:executable_manager_test PASSED in 44.7s //tensorflow/dtensor/tests:layout_to_xla_sharding_test PASSED in 0.3s //tensorflow/dtensor/tests:slice_util_test PASSED in 0.4s //tensorflow/dtensor/tests:spmd_expander_test PASSED in 7.9s //tensorflow/dtensor/tests:tensor_layout_test PASSED in 0.3s //tensorflow/examples/adding_an_op:fact_test PASSED in 14.4s //tensorflow/examples/adding_an_op:zero_out_1_test PASSED in 18.2s //tensorflow/examples/adding_an_op:zero_out_2_test PASSED in 17.0s //tensorflow/examples/adding_an_op:zero_out_3_test PASSED in 13.7s //tensorflow/examples/custom_ops_doc/multiplex_1:multiplex_1_test PASSED in 19.0s //tensorflow/examples/custom_ops_doc/multiplex_2:multiplex_2_test_cpu PASSED in 13.5s //tensorflow/examples/custom_ops_doc/multiplex_3:multiplex_3_test PASSED in 15.9s //tensorflow/examples/custom_ops_doc/multiplex_4:multiplex_4_test PASSED in 16.9s //tensorflow/examples/custom_ops_doc/simple_hash_table:simple_hash_table_test PASSED in 16.6s //tensorflow/examples/custom_ops_doc/sleep:sleep_test PASSED in 22.3s //tensorflow/examples/speech_commands:accuracy_utils_test PASSED in 3.0s //tensorflow/examples/speech_commands:models_test PASSED in 16.1s //tensorflow/examples/speech_commands:recognize_commands_test PASSED in 3.7s //tensorflow/examples/wav_to_spectrogram:wav_to_spectrogram_test PASSED in 3.1s //tensorflow/js:ts_op_gen_test PASSED in 0.2s //tensorflow/python/autograph/converters:asserts_test PASSED in 12.0s //tensorflow/python/autograph/converters:break_statements_test PASSED in 6.7s //tensorflow/python/autograph/converters:call_trees_test PASSED in 9.5s //tensorflow/python/autograph/converters:conditional_expressions_test PASSED in 6.8s //tensorflow/python/autograph/converters:continue_statements_test PASSED in 13.9s //tensorflow/python/autograph/converters:control_flow_test PASSED in 12.0s //tensorflow/python/autograph/converters:directives_test PASSED in 7.7s //tensorflow/python/autograph/converters:functions_test PASSED in 9.0s //tensorflow/python/autograph/converters:list_comprehensions_test PASSED in 6.9s //tensorflow/python/autograph/converters:lists_test PASSED in 7.1s //tensorflow/python/autograph/converters:logical_expressions_test PASSED in 6.9s //tensorflow/python/autograph/converters:return_statements_test PASSED in 10.0s //tensorflow/python/autograph/converters:slices_test PASSED in 6.9s //tensorflow/python/autograph/converters:variables_test PASSED in 7.3s //tensorflow/python/autograph/core:converter_test PASSED in 6.4s //tensorflow/python/autograph/core:function_wrappers_test PASSED in 7.4s //tensorflow/python/autograph/impl:api_test PASSED in 12.5s //tensorflow/python/autograph/impl:conversion_test PASSED in 7.4s //tensorflow/python/autograph/lang:special_functions_test PASSED in 7.6s //tensorflow/python/autograph/operators:conditional_expressions_test PASSED in 9.0s //tensorflow/python/autograph/operators:control_flow_test PASSED in 13.8s //tensorflow/python/autograph/operators:data_structures_test PASSED in 7.0s //tensorflow/python/autograph/operators:exceptions_test PASSED in 6.6s //tensorflow/python/autograph/operators:logical_test PASSED in 9.2s //tensorflow/python/autograph/operators:py_builtins_test PASSED in 20.6s //tensorflow/python/autograph/operators:slices_test PASSED in 6.4s //tensorflow/python/autograph/operators:variables_test PASSED in 6.8s //tensorflow/python/autograph/pyct:anno_test PASSED in 6.7s //tensorflow/python/autograph/pyct:ast_util_test PASSED in 6.2s //tensorflow/python/autograph/pyct:cache_test PASSED in 9.2s //tensorflow/python/autograph/pyct:cfg_test PASSED in 9.4s //tensorflow/python/autograph/pyct:error_utils_test PASSED in 6.1s //tensorflow/python/autograph/pyct:inspect_utils_test PASSED in 10.3s //tensorflow/python/autograph/pyct:loader_test PASSED in 6.3s //tensorflow/python/autograph/pyct:naming_test PASSED in 8.5s //tensorflow/python/autograph/pyct:origin_info_test PASSED in 20.6s //tensorflow/python/autograph/pyct:parser_test PASSED in 7.1s //tensorflow/python/autograph/pyct:pretty_printer_test PASSED in 7.6s //tensorflow/python/autograph/pyct:qual_names_test PASSED in 6.3s //tensorflow/python/autograph/pyct:templates_test PASSED in 6.7s //tensorflow/python/autograph/pyct:transformer_test PASSED in 7.3s //tensorflow/python/autograph/pyct:transpiler_test PASSED in 6.7s //tensorflow/python/autograph/pyct/static_analysis:activity_test PASSED in 7.4s //tensorflow/python/autograph/pyct/static_analysis:liveness_test PASSED in 6.9s //tensorflow/python/autograph/pyct/static_analysis:reaching_definitions_test PASSED in 6.6s //tensorflow/python/autograph/pyct/static_analysis:reaching_fndefs_test PASSED in 6.2s //tensorflow/python/autograph/pyct/static_analysis:type_inference_test PASSED in 6.5s //tensorflow/python/autograph/tests:assertion_test PASSED in 15.6s //tensorflow/python/autograph/tests:basic_ifexp_test PASSED in 16.6s //tensorflow/python/autograph/tests:call_to_builtin_function_test PASSED in 20.0s //tensorflow/python/autograph/tests:call_to_lambda_function_test PASSED in 15.7s //tensorflow/python/autograph/tests:call_to_named_tuple_test PASSED in 17.9s //tensorflow/python/autograph/tests:call_to_numpy_function_test PASSED in 13.5s //tensorflow/python/autograph/tests:call_to_print_function_test PASSED in 16.9s //tensorflow/python/autograph/tests:call_to_tf_api_test PASSED in 13.9s //tensorflow/python/autograph/tests:call_to_user_function_test PASSED in 14.4s //tensorflow/python/autograph/tests:composite_names_in_control_flow_test PASSED in 29.0s //tensorflow/python/autograph/tests:cond_basic_test PASSED in 27.0s //tensorflow/python/autograph/tests:datasets_test PASSED in 33.0s //tensorflow/python/autograph/tests:early_return_test PASSED in 21.2s //tensorflow/python/autograph/tests:ext_slice_test PASSED in 16.4s //tensorflow/python/autograph/tests:generator_test PASSED in 16.8s //tensorflow/python/autograph/tests:logical_expression_test PASSED in 15.5s //tensorflow/python/autograph/tests:loop_basic_test PASSED in 67.4s //tensorflow/python/autograph/tests:loop_control_flow_illegal_cases_test PASSED in 17.7s //tensorflow/python/autograph/tests:loop_created_variables_test PASSED in 34.8s //tensorflow/python/autograph/tests:loop_scoping_test PASSED in 19.1s //tensorflow/python/autograph/tests:loop_with_function_call_test PASSED in 25.9s //tensorflow/python/autograph/tests:loop_with_variable_type_illegal_cases_test PASSED in 19.7s //tensorflow/python/autograph/tests:loop_with_variable_type_test PASSED in 29.1s //tensorflow/python/autograph/tests:nested_control_flow_test PASSED in 53.1s //tensorflow/python/autograph/tests:type_annotations_test PASSED in 13.3s //tensorflow/python/autograph/utils:context_managers_test PASSED in 16.0s //tensorflow/python/autograph/utils:misc_test PASSED in 8.0s //tensorflow/python/autograph/utils:tensor_list_test PASSED in 7.7s //tensorflow/python/autograph/utils:tensors_test PASSED in 6.9s //tensorflow/python/checkpoint:benchmarks_test PASSED in 7.2s //tensorflow/python/checkpoint:checkpoint_management_test_cpu PASSED in 19.9s //tensorflow/python/checkpoint:checkpoint_metrics_test PASSED in 13.2s //tensorflow/python/checkpoint:checkpoint_test PASSED in 22.8s //tensorflow/python/checkpoint:checkpoint_view_test PASSED in 10.8s //tensorflow/python/checkpoint:checkpoint_with_v1_optimizers_test PASSED in 17.8s //tensorflow/python/checkpoint:functional_saver_test_cpu PASSED in 7.7s //tensorflow/python/checkpoint:restore_test PASSED in 8.9s //tensorflow/python/checkpoint:save_util_v1_test PASSED in 6.6s //tensorflow/python/checkpoint:saveable_compat_test PASSED in 6.9s //tensorflow/python/checkpoint:tensor_callable_test PASSED in 8.8s //tensorflow/python/checkpoint:trackable_view_test PASSED in 9.8s //tensorflow/python/client:device_lib_test_cpu PASSED in 6.5s //tensorflow/python/client:events_writer_test PASSED in 7.0s //tensorflow/python/client:session_benchmark_cpu PASSED in 13.5s //tensorflow/python/client:session_list_devices_test PASSED in 7.8s //tensorflow/python/client:session_partial_run_test PASSED in 12.7s //tensorflow/python/client:timeline_test_cpu PASSED in 9.5s //tensorflow/python/client:virtual_gpu_test_cpu PASSED in 9.0s //tensorflow/python/compat:compat_test PASSED in 8.0s //tensorflow/python/compat:disable_v2_behavior_test PASSED in 7.4s //tensorflow/python/compiler/mlir:mlir_test PASSED in 6.8s //tensorflow/python/compiler/tensorrt:trt_convert_test_cpu PASSED in 7.7s //tensorflow/python/compiler/tensorrt/test:batch_matmul_test_cpu PASSED in 15.4s //tensorflow/python/compiler/tensorrt/test:biasadd_matmul_test_cpu PASSED in 7.1s //tensorflow/python/compiler/tensorrt/test:binary_tensor_weight_broadcast_test_cpu PASSED in 10.0s //tensorflow/python/compiler/tensorrt/test:bool_test_cpu PASSED in 10.5s //tensorflow/python/compiler/tensorrt/test:cast_test_cpu PASSED in 8.1s //tensorflow/python/compiler/tensorrt/test:concatenation_test_cpu PASSED in 15.9s //tensorflow/python/compiler/tensorrt/test:const_broadcast_test_cpu PASSED in 16.3s //tensorflow/python/compiler/tensorrt/test:data_dependent_shape_test_cpu PASSED in 11.1s //tensorflow/python/compiler/tensorrt/test:dynamic_input_shapes_test_cpu PASSED in 14.6s //tensorflow/python/compiler/tensorrt/test:identity_output_test_cpu PASSED in 8.2s //tensorflow/python/compiler/tensorrt/test:int32_test_cpu PASSED in 7.3s //tensorflow/python/compiler/tensorrt/test:lru_cache_test_cpu PASSED in 7.8s //tensorflow/python/compiler/tensorrt/test:multi_connection_neighbor_engine_test_cpu PASSED in 9.0s //tensorflow/python/compiler/tensorrt/test:neighboring_engine_test_cpu PASSED in 7.2s //tensorflow/python/compiler/tensorrt/test:quantization_test_cpu PASSED in 7.0s //tensorflow/python/compiler/tensorrt/test:rank_two_test_cpu PASSED in 7.3s //tensorflow/python/compiler/tensorrt/test:reshape_transpose_test_cpu PASSED in 8.7s //tensorflow/python/compiler/tensorrt/test:topk_test_cpu PASSED in 8.5s //tensorflow/python/compiler/tensorrt/test:trt_engine_op_shape_test_cpu PASSED in 8.4s //tensorflow/python/compiler/tensorrt/test:trt_mode_test_cpu PASSED in 8.8s //tensorflow/python/compiler/tensorrt/test:unary_test_cpu PASSED in 9.2s //tensorflow/python/compiler/tensorrt/test:vgg_block_nchw_test_cpu PASSED in 7.3s //tensorflow/python/compiler/tensorrt/test:vgg_block_test_cpu PASSED in 8.1s //tensorflow/python/compiler/xla:jit_compile_test_cpu PASSED in 11.2s //tensorflow/python/compiler/xla:jit_test_cpu PASSED in 12.4s //tensorflow/python/compiler/xla:xla_test_cpu PASSED in 22.7s //tensorflow/python/compiler/xla/experimental:xla_sharding_test PASSED in 8.0s //tensorflow/python/data/benchmarks:batch_benchmark PASSED in 8.4s //tensorflow/python/data/benchmarks:filter_benchmark PASSED in 8.8s //tensorflow/python/data/benchmarks:from_tensor_slices_benchmark PASSED in 8.3s //tensorflow/python/data/benchmarks:interleave_benchmark PASSED in 7.5s //tensorflow/python/data/benchmarks:list_files_benchmark PASSED in 6.9s //tensorflow/python/data/benchmarks:map_benchmark PASSED in 12.2s //tensorflow/python/data/benchmarks:meta_benchmark PASSED in 15.5s //tensorflow/python/data/benchmarks:prefetch_benchmark PASSED in 6.4s //tensorflow/python/data/benchmarks:range_benchmark PASSED in 7.5s //tensorflow/python/data/experimental/benchmarks:autotune_benchmark PASSED in 6.7s //tensorflow/python/data/experimental/benchmarks:csv_dataset_benchmark PASSED in 7.1s //tensorflow/python/data/experimental/benchmarks:map_and_batch_benchmark PASSED in 7.5s //tensorflow/python/data/experimental/benchmarks:map_defun_benchmark PASSED in 7.7s //tensorflow/python/data/experimental/benchmarks:matching_files_benchmark PASSED in 7.5s //tensorflow/python/data/experimental/benchmarks:optimize_benchmark PASSED in 8.1s //tensorflow/python/data/experimental/benchmarks:parameter_value_benchmark PASSED in 7.8s //tensorflow/python/data/experimental/benchmarks:rejection_resample_benchmark PASSED in 6.6s //tensorflow/python/data/experimental/benchmarks:snapshot_dataset_benchmark PASSED in 7.6s //tensorflow/python/data/experimental/benchmarks:unbatch_benchmark PASSED in 7.5s //tensorflow/python/data/experimental/kernel_tests:assert_cardinality_test PASSED in 25.9s //tensorflow/python/data/experimental/kernel_tests:assert_next_test PASSED in 8.0s //tensorflow/python/data/experimental/kernel_tests:assert_prev_test PASSED in 8.0s //tensorflow/python/data/experimental/kernel_tests:checkpoint_input_pipeline_hook_test PASSED in 15.0s //tensorflow/python/data/experimental/kernel_tests:compression_ops_test PASSED in 11.1s //tensorflow/python/data/experimental/kernel_tests:copy_to_device_test_cpu PASSED in 13.1s //tensorflow/python/data/experimental/kernel_tests:dense_to_sparse_batch_test PASSED in 22.3s //tensorflow/python/data/experimental/kernel_tests:from_list_test PASSED in 32.1s //tensorflow/python/data/experimental/kernel_tests:io_test PASSED in 31.2s //tensorflow/python/data/experimental/kernel_tests:lookup_ops_test PASSED in 11.3s //tensorflow/python/data/experimental/kernel_tests:make_csv_dataset_test PASSED in 18.1s //tensorflow/python/data/experimental/kernel_tests:make_saveable_from_iterator_test PASSED in 7.4s //tensorflow/python/data/experimental/kernel_tests:make_tf_record_dataset_test PASSED in 52.5s //tensorflow/python/data/experimental/kernel_tests:map_defun_op_test PASSED in 7.1s //tensorflow/python/data/experimental/kernel_tests:matching_files_dataset_test PASSED in 22.8s //tensorflow/python/data/experimental/kernel_tests:model_dataset_test PASSED in 8.0s //tensorflow/python/data/experimental/kernel_tests:non_serializable_test PASSED in 9.4s //tensorflow/python/data/experimental/kernel_tests:pad_to_cardinality_test PASSED in 8.5s //tensorflow/python/data/experimental/kernel_tests:prefetch_to_device_test_cpu PASSED in 9.6s //tensorflow/python/data/experimental/kernel_tests:prefetch_with_slack_test PASSED in 8.6s //tensorflow/python/data/experimental/kernel_tests:shuffle_and_repeat_test PASSED in 17.8s //tensorflow/python/data/experimental/kernel_tests:sleep_test PASSED in 8.0s //tensorflow/python/data/experimental/kernel_tests:tf_record_writer_test PASSED in 13.8s //tensorflow/python/data/experimental/kernel_tests:variant_test PASSED in 9.0s //tensorflow/python/data/experimental/kernel_tests:wrap_unwrap_test_cpu PASSED in 7.6s //tensorflow/python/data/experimental/kernel_tests/optimization:filter_fusion_test PASSED in 31.3s //tensorflow/python/data/experimental/kernel_tests/optimization:filter_parallelization_test PASSED in 80.1s //tensorflow/python/data/experimental/kernel_tests/optimization:grappler_test_cpu PASSED in 9.9s //tensorflow/python/data/experimental/kernel_tests/optimization:make_deterministic_test PASSED in 24.9s //tensorflow/python/data/experimental/kernel_tests/optimization:map_and_batch_fusion_test PASSED in 8.9s //tensorflow/python/data/experimental/kernel_tests/optimization:map_and_filter_fusion_test PASSED in 31.3s //tensorflow/python/data/experimental/kernel_tests/optimization:map_fusion_test PASSED in 25.5s //tensorflow/python/data/experimental/kernel_tests/optimization:map_parallelization_test PASSED in 19.9s //tensorflow/python/data/experimental/kernel_tests/optimization:noop_elimination_test PASSED in 19.3s //tensorflow/python/data/experimental/kernel_tests/service:multi_device_test PASSED in 13.3s //tensorflow/python/data/experimental/service:server_lib_test PASSED in 11.6s //tensorflow/python/data/kernel_tests:as_numpy_iterator_test PASSED in 8.8s //tensorflow/python/data/kernel_tests:bucket_by_sequence_length_test PASSED in 25.0s //tensorflow/python/data/kernel_tests:cache_test PASSED in 58.9s //tensorflow/python/data/kernel_tests:cardinality_test PASSED in 15.1s //tensorflow/python/data/kernel_tests:checkpoint_test PASSED in 21.3s //tensorflow/python/data/kernel_tests:concatenate_test PASSED in 32.5s //tensorflow/python/data/kernel_tests:counter_test PASSED in 28.1s //tensorflow/python/data/kernel_tests:dataset_spec_test PASSED in 8.0s //tensorflow/python/data/kernel_tests:dataset_test PASSED in 24.4s //tensorflow/python/data/kernel_tests:enumerate_test PASSED in 18.9s //tensorflow/python/data/kernel_tests:from_sparse_tensor_slices_test PASSED in 7.2s //tensorflow/python/data/kernel_tests:from_tensor_slices_test PASSED in 43.6s //tensorflow/python/data/kernel_tests:from_tensors_test PASSED in 20.4s //tensorflow/python/data/kernel_tests:get_single_element_test PASSED in 10.5s //tensorflow/python/data/kernel_tests:ignore_errors_test PASSED in 17.6s //tensorflow/python/data/kernel_tests:io_test PASSED in 43.3s //tensorflow/python/data/kernel_tests:iterator_test_cpu PASSED in 18.2s //tensorflow/python/data/kernel_tests:len_test PASSED in 7.8s //tensorflow/python/data/kernel_tests:list_files_test PASSED in 9.2s //tensorflow/python/data/kernel_tests:optional_test_cpu PASSED in 9.6s //tensorflow/python/data/kernel_tests:options_test PASSED in 9.1s //tensorflow/python/data/kernel_tests:placement_test_cpu PASSED in 15.7s //tensorflow/python/data/kernel_tests:prefetch_test PASSED in 35.8s //tensorflow/python/data/kernel_tests:random_test PASSED in 36.5s //tensorflow/python/data/kernel_tests:range_test PASSED in 79.5s //tensorflow/python/data/kernel_tests:rebatch_test PASSED in 6.7s //tensorflow/python/data/kernel_tests:reduce_test_cpu PASSED in 41.4s //tensorflow/python/data/kernel_tests:scan_test_cpu PASSED in 37.0s //tensorflow/python/data/kernel_tests:sparse_batch_test PASSED in 24.7s //tensorflow/python/data/kernel_tests:unbatch_test PASSED in 24.3s //tensorflow/python/data/util:convert_test PASSED in 7.8s //tensorflow/python/data/util:nest_test PASSED in 9.9s //tensorflow/python/data/util:options_test PASSED in 6.6s //tensorflow/python/data/util:random_seed_test PASSED in 8.8s //tensorflow/python/data/util:sparse_test PASSED in 8.2s //tensorflow/python/data/util:structure_test PASSED in 21.3s //tensorflow/python/data/util:traverse_test PASSED in 8.7s //tensorflow/python/debug/cli:analyzer_cli_test_cpu PASSED in 14.1s //tensorflow/python/debug/cli:cli_config_test PASSED in 11.2s //tensorflow/python/debug/cli:cli_shared_test PASSED in 9.1s //tensorflow/python/debug/cli:command_parser_test PASSED in 6.8s //tensorflow/python/debug/cli:debugger_cli_common_test PASSED in 6.7s //tensorflow/python/debug/cli:evaluator_test PASSED in 6.7s //tensorflow/python/debug/cli:profile_analyzer_cli_test PASSED in 7.1s //tensorflow/python/debug/cli:readline_ui_test PASSED in 6.5s //tensorflow/python/debug/cli:tensor_format_test PASSED in 6.1s //tensorflow/python/debug/lib:check_numerics_callback_test_cpu PASSED in 17.1s //tensorflow/python/debug/lib:common_test PASSED in 11.7s //tensorflow/python/debug/lib:debug_data_test PASSED in 8.0s //tensorflow/python/debug/lib:debug_events_monitors_test PASSED in 9.6s //tensorflow/python/debug/lib:debug_events_writer_test PASSED in 7.5s //tensorflow/python/debug/lib:debug_gradients_test_cpu PASSED in 7.2s //tensorflow/python/debug/lib:debug_graph_reconstruction_test_cpu PASSED in 8.5s //tensorflow/python/debug/lib:debug_graphs_test PASSED in 6.8s //tensorflow/python/debug/lib:debug_grappler_test_cpu PASSED in 7.2s //tensorflow/python/debug/lib:debug_utils_test PASSED in 6.5s //tensorflow/python/debug/lib:debug_v2_ops_test_cpu PASSED in 14.8s //tensorflow/python/debug/lib:profiling_test PASSED in 8.4s //tensorflow/python/debug/lib:session_debug_file_test_cpu PASSED in 12.7s //tensorflow/python/debug/lib:session_debug_multi_gpu_test_cpu PASSED in 7.2s //tensorflow/python/debug/lib:source_utils_test PASSED in 16.6s //tensorflow/python/debug/wrappers:disk_usage_test PASSED in 7.8s //tensorflow/python/debug/wrappers:dumping_wrapper_test PASSED in 6.6s //tensorflow/python/debug/wrappers:framework_test PASSED in 9.4s //tensorflow/python/debug/wrappers:local_cli_wrapper_test PASSED in 7.6s //tensorflow/python/distribute:checkpoint_utils_test_2gpu PASSED in 10.5s //tensorflow/python/distribute:checkpoint_utils_test_cpu PASSED in 10.2s //tensorflow/python/distribute:checkpointing_test_2gpu PASSED in 8.3s //tensorflow/python/distribute:checkpointing_test_cpu PASSED in 10.3s //tensorflow/python/distribute:collective_util_test PASSED in 6.3s //tensorflow/python/distribute:combinations_test_2gpu PASSED in 21.3s //tensorflow/python/distribute:combinations_test_cpu PASSED in 22.3s //tensorflow/python/distribute:cross_device_utils_test_cpu PASSED in 9.0s //tensorflow/python/distribute:custom_training_loop_gradient_test_2gpu PASSED in 12.1s //tensorflow/python/distribute:custom_training_loop_gradient_test_cpu PASSED in 10.2s //tensorflow/python/distribute:device_util_test_cpu PASSED in 10.3s //tensorflow/python/distribute:distribute_coordinator_test PASSED in 15.3s //tensorflow/python/distribute:distribute_lib_test PASSED in 11.0s //tensorflow/python/distribute:distribute_utils_test_2gpu PASSED in 8.4s //tensorflow/python/distribute:distribute_utils_test_cpu PASSED in 8.3s //tensorflow/python/distribute:input_ops_test_cpu PASSED in 18.4s //tensorflow/python/distribute:metrics_v1_test_2gpu PASSED in 24.4s //tensorflow/python/distribute:metrics_v1_test_cpu PASSED in 25.9s //tensorflow/python/distribute:mirrored_values_test_2gpu PASSED in 8.3s //tensorflow/python/distribute:mirrored_values_test_cpu PASSED in 20.8s //tensorflow/python/distribute:mirrored_variable_test_2gpu PASSED in 20.0s //tensorflow/python/distribute:mirrored_variable_test_cpu PASSED in 16.7s //tensorflow/python/distribute:multi_process_runner_no_init_test PASSED in 7.3s //tensorflow/python/distribute:multi_worker_continuous_run_test_cpu PASSED in 22.8s //tensorflow/python/distribute:multi_worker_util_test PASSED in 6.4s //tensorflow/python/distribute:numpy_dataset_test PASSED in 19.1s //tensorflow/python/distribute:one_device_strategy_test_cpu PASSED in 15.8s //tensorflow/python/distribute:packed_distributed_variable_test PASSED in 8.3s //tensorflow/python/distribute:parameter_server_strategy_test_2gpu PASSED in 40.0s //tensorflow/python/distribute:parameter_server_strategy_test_cpu PASSED in 26.3s //tensorflow/python/distribute:parameter_server_strategy_v2_test_2gpu PASSED in 25.1s //tensorflow/python/distribute:parameter_server_strategy_v2_test_cpu PASSED in 19.5s //tensorflow/python/distribute:per_replica_test_2gpu PASSED in 10.4s //tensorflow/python/distribute:per_replica_test_cpu PASSED in 8.0s //tensorflow/python/distribute:ps_values_test_2gpu PASSED in 9.2s //tensorflow/python/distribute:ps_values_test_cpu PASSED in 8.2s //tensorflow/python/distribute:remote_mirrored_strategy_eager_test_cpu PASSED in 9.4s //tensorflow/python/distribute:sharded_variable_test PASSED in 15.1s //tensorflow/python/distribute:shared_variable_creator_test PASSED in 6.6s //tensorflow/python/distribute:strategy_combinations_test_cpu PASSED in 43.8s //tensorflow/python/distribute:template_mirrored_strategy_test_cpu PASSED in 8.5s //tensorflow/python/distribute:test_util_test_2gpu PASSED in 19.1s //tensorflow/python/distribute:test_util_test_cpu PASSED in 17.6s //tensorflow/python/distribute:tf_function_test_2gpu PASSED in 9.3s //tensorflow/python/distribute:tf_function_test_cpu PASSED in 10.1s //tensorflow/python/distribute:values_v2_test_cpu PASSED in 22.0s //tensorflow/python/distribute:warm_starting_util_test_2gpu PASSED in 10.6s //tensorflow/python/distribute:warm_starting_util_test_cpu PASSED in 9.2s //tensorflow/python/distribute/cluster_resolver:base_cluster_resolver_py_test PASSED in 8.0s //tensorflow/python/distribute/cluster_resolver:gce_cluster_resolver_py_test PASSED in 8.6s //tensorflow/python/distribute/cluster_resolver:kubernetes_cluster_resolver_py_test PASSED in 7.6s //tensorflow/python/distribute/cluster_resolver:sagemaker_cluster_resolver_py_test PASSED in 8.5s //tensorflow/python/distribute/cluster_resolver:slurm_cluster_resolver_py_test PASSED in 7.3s //tensorflow/python/distribute/cluster_resolver:tfconfig_cluster_resolver_py_test PASSED in 7.6s //tensorflow/python/distribute/cluster_resolver/tpu:tpu_cluster_resolver_py_test PASSED in 7.9s //tensorflow/python/distribute/coordinator:watchdog_test PASSED in 61.9s //tensorflow/python/distribute/experimental:dtensor_util_test_cpu PASSED in 11.1s //tensorflow/python/distribute/experimental:mirrored_strategy_test_cpu PASSED in 31.3s //tensorflow/python/distribute/experimental:multi_worker_mirrored_strategy_test_cpu PASSED in 24.8s //tensorflow/python/distribute/integration_test:saved_model_test_cpu PASSED in 34.2s //tensorflow/python/distribute/parallel_device:parallel_device_test_cpu PASSED in 10.6s //tensorflow/python/distribute/v1:all_reduce_test PASSED in 58.2s //tensorflow/python/distribute/v1:cross_device_ops_test_2gpu PASSED in 39.1s //tensorflow/python/distribute/v1:cross_device_ops_test_cpu PASSED in 38.8s //tensorflow/python/dlpack:dlpack_test_cpu PASSED in 7.0s //tensorflow/python/eager:backprop_test_cpu PASSED in 91.3s //tensorflow/python/eager:benchmarks_test_cpu PASSED in 7.7s //tensorflow/python/eager:cancellation_test_cpu PASSED in 6.6s //tensorflow/python/eager:context_test_cpu PASSED in 8.6s //tensorflow/python/eager:core_test_cpu PASSED in 31.2s //tensorflow/python/eager:gradient_input_output_exclusions_test PASSED in 39.2s //tensorflow/python/eager:graph_only_ops_test_cpu PASSED in 6.8s //tensorflow/python/eager:lift_to_graph_test PASSED in 7.2s //tensorflow/python/eager:monitoring_test_cpu PASSED in 8.2s //tensorflow/python/eager:ops_test_cpu PASSED in 11.8s //tensorflow/python/eager:profiler_client_test PASSED in 7.7s //tensorflow/python/eager:profiler_test_cpu PASSED in 7.7s //tensorflow/python/eager:pywrap_tfe_test PASSED in 20.9s //tensorflow/python/eager:record_test PASSED in 18.8s //tensorflow/python/eager:remote_benchmarks_test_cpu PASSED in 11.3s //tensorflow/python/eager:run_eager_op_as_function_test_cpu PASSED in 8.4s //tensorflow/python/eager:run_eager_op_as_function_xla_test_cpu PASSED in 6.8s //tensorflow/python/eager:small_constants_optimizer_test_cpu PASSED in 175.8s //tensorflow/python/eager:tensor_test_cpu PASSED in 11.8s //tensorflow/python/eager:wrap_function_device_test_cpu PASSED in 8.3s //tensorflow/python/eager:wrap_function_test PASSED in 8.9s //tensorflow/python/eager/benchmarks:kpi_benchmark_test_cpu PASSED in 14.2s //tensorflow/python/eager/memory_tests:remote_memory_test_cpu PASSED in 7.5s //tensorflow/python/eager/polymorphic_function:argument_naming_test_cpu PASSED in 7.9s //tensorflow/python/eager/polymorphic_function:atomic_function_test_cpu PASSED in 7.3s //tensorflow/python/eager/polymorphic_function:collection_test_cpu PASSED in 7.4s //tensorflow/python/eager/polymorphic_function:compiler_ir_test_cpu PASSED in 7.3s //tensorflow/python/eager/polymorphic_function:compiler_ir_test_cpu_mlir_bridge_test PASSED in 7.3s //tensorflow/python/eager/polymorphic_function:concrete_function_test_cpu PASSED in 6.8s //tensorflow/python/eager/polymorphic_function:function_spec_test PASSED in 6.9s //tensorflow/python/eager/polymorphic_function:polymorphic_function_xla_jit_test_cpu PASSED in 22.0s //tensorflow/python/eager/polymorphic_function:polymorphic_function_xla_jit_test_cpu_mlir_bridge_test PASSED in 23.2s //tensorflow/python/eager/polymorphic_function:polymorphic_function_xla_test_cpu PASSED in 16.0s //tensorflow/python/eager/polymorphic_function:quarantine_test PASSED in 40.0s //tensorflow/python/feature_column:sequence_feature_column_integration_test PASSED in 9.1s //tensorflow/python/feature_column:serialization_test PASSED in 11.2s //tensorflow/python/framework:auto_control_deps_test PASSED in 22.7s //tensorflow/python/framework:c_api_util_test PASSED in 8.6s //tensorflow/python/framework:common_shapes_test PASSED in 6.5s //tensorflow/python/framework:composite_tensor_test PASSED in 7.6s //tensorflow/python/framework:config_test_2gpu PASSED in 13.0s //tensorflow/python/framework:config_test_cpu PASSED in 11.4s //tensorflow/python/framework:constant_op_test PASSED in 8.4s //tensorflow/python/framework:device_spec_test PASSED in 6.9s //tensorflow/python/framework:device_test PASSED in 6.4s //tensorflow/python/framework:dtypes_test PASSED in 17.2s //tensorflow/python/framework:error_interpolation_test PASSED in 7.6s //tensorflow/python/framework:errors_test PASSED in 6.7s //tensorflow/python/framework:extension_type_field_test PASSED in 7.7s //tensorflow/python/framework:extension_type_test PASSED in 13.5s //tensorflow/python/framework:file_system_test PASSED in 6.9s //tensorflow/python/framework:flexible_dtypes_test PASSED in 114.7s //tensorflow/python/framework:function_def_to_graph_test PASSED in 7.7s //tensorflow/python/framework:graph_building_benchmark_cpu PASSED in 6.6s //tensorflow/python/framework:graph_util_test PASSED in 7.5s //tensorflow/python/framework:immutable_dict_test PASSED in 6.4s //tensorflow/python/framework:importer_test PASSED in 7.5s //tensorflow/python/framework:indexed_slices_test PASSED in 6.6s //tensorflow/python/framework:kernels_test PASSED in 8.8s //tensorflow/python/framework:meta_graph_test PASSED in 11.6s //tensorflow/python/framework:node_file_writer_test_cpu PASSED in 7.6s //tensorflow/python/framework:offset_counter_helper_test PASSED in 0.2s //tensorflow/python/framework:op_allowlist_namespace_test PASSED in 1.7s //tensorflow/python/framework:op_callbacks_test_cpu PASSED in 9.9s //tensorflow/python/framework:op_def_library_test PASSED in 8.5s //tensorflow/python/framework:op_def_util_test PASSED in 7.1s //tensorflow/python/framework:ops_enable_eager_test PASSED in 1.9s //tensorflow/python/framework:ops_test PASSED in 20.9s //tensorflow/python/framework:proto_test PASSED in 14.0s //tensorflow/python/framework:py_context_manager_test PASSED in 7.2s //tensorflow/python/framework:python_api_dispatcher_test PASSED in 7.5s //tensorflow/python/framework:python_api_info_test PASSED in 10.3s //tensorflow/python/framework:python_api_parameter_converter_test PASSED in 8.1s //tensorflow/python/framework:python_op_gen_annotation_test PASSED in 3.1s //tensorflow/python/framework:python_op_gen_annotator_test PASSED in 0.2s //tensorflow/python/framework:python_tensor_converter_test PASSED in 7.5s //tensorflow/python/framework:random_seed_test PASSED in 6.9s //tensorflow/python/framework:registry_test PASSED in 7.8s //tensorflow/python/framework:smart_cond_test PASSED in 8.0s //tensorflow/python/framework:sparse_tensor_test PASSED in 9.8s //tensorflow/python/framework:subscribe_test PASSED in 19.4s //tensorflow/python/framework:tensor_shape_test PASSED in 8.4s //tensorflow/python/framework:tensor_test PASSED in 7.2s //tensorflow/python/framework:tensor_util_test PASSED in 10.6s //tensorflow/python/framework:test_combinations_test PASSED in 8.6s //tensorflow/python/framework:test_util_test_cpu PASSED in 19.3s //tensorflow/python/framework:tf2_test PASSED in 7.4s //tensorflow/python/framework:traceable_stack_test PASSED in 6.5s //tensorflow/python/framework:type_spec_test PASSED in 8.7s //tensorflow/python/framework:versions_test PASSED in 7.7s //tensorflow/python/framework:weak_tensor_test PASSED in 8.0s //tensorflow/python/framework/experimental:graph_building_test_cpu PASSED in 7.7s //tensorflow/python/framework/experimental:unified_api_test_cpu PASSED in 13.9s //tensorflow/python/grappler:arithmetic_optimizer_test_cpu PASSED in 10.3s //tensorflow/python/grappler:auto_mixed_precision_test_cpu PASSED in 19.6s //tensorflow/python/grappler:constant_folding_test_cpu PASSED in 7.0s //tensorflow/python/grappler:cost_analyzer_test PASSED in 8.3s //tensorflow/python/grappler:datasets_test PASSED in 8.9s //tensorflow/python/grappler:item_test PASSED in 7.9s //tensorflow/python/grappler:memory_optimizer_test PASSED in 14.9s //tensorflow/python/grappler:model_analyzer_test PASSED in 8.4s //tensorflow/python/grappler:remapper_test_cpu PASSED in 8.6s //tensorflow/python/grappler:tf_optimizer_test PASSED in 8.6s //tensorflow/python/kernel_tests:benchmark_test_cpu PASSED in 8.0s //tensorflow/python/kernel_tests:check_ops_test_cpu PASSED in 15.1s //tensorflow/python/kernel_tests:collective_ops_multi_worker_test PASSED in 25.7s //tensorflow/python/kernel_tests:composite_tensor_ops_test PASSED in 7.8s //tensorflow/python/kernel_tests:critical_section_test_cpu PASSED in 17.8s //tensorflow/python/kernel_tests:garbage_collection_test PASSED in 11.1s //tensorflow/python/kernel_tests:gradient_correctness_test_cpu PASSED in 8.3s //tensorflow/python/kernel_tests:histogram_ops_test_cpu PASSED in 7.2s //tensorflow/python/kernel_tests:logging_ops_test_cpu PASSED in 7.8s //tensorflow/python/kernel_tests:numerics_test_cpu PASSED in 12.5s //tensorflow/python/kernel_tests:template_test PASSED in 8.7s //tensorflow/python/kernel_tests:trace_op_test_cpu PASSED in 6.8s //tensorflow/python/kernel_tests/array_ops:batch_gather_op_test_cpu PASSED in 13.4s //tensorflow/python/kernel_tests/array_ops:batch_scatter_ops_test PASSED in 8.3s //tensorflow/python/kernel_tests/array_ops:batchtospace_op_test_cpu PASSED in 12.5s //tensorflow/python/kernel_tests/array_ops:bcast_ops_test PASSED in 10.3s //tensorflow/python/kernel_tests/array_ops:bitcast_op_test_cpu PASSED in 14.3s //tensorflow/python/kernel_tests/array_ops:broadcast_to_ops_test_cpu PASSED in 28.8s //tensorflow/python/kernel_tests/array_ops:cast_op_test_cpu PASSED in 11.2s //tensorflow/python/kernel_tests/array_ops:constant_op_eager_test_cpu PASSED in 9.2s //tensorflow/python/kernel_tests/array_ops:constant_op_test_cpu PASSED in 10.1s //tensorflow/python/kernel_tests/array_ops:denormal_test_cpu PASSED in 14.5s //tensorflow/python/kernel_tests/array_ops:depthtospace_op_test_cpu PASSED in 12.1s //tensorflow/python/kernel_tests/array_ops:edit_distance_op_test PASSED in 9.2s //tensorflow/python/kernel_tests/array_ops:fingerprint_op_test PASSED in 7.2s //tensorflow/python/kernel_tests/array_ops:gather_nd_op_test_cpu PASSED in 9.8s //tensorflow/python/kernel_tests/array_ops:identity_n_op_py_test PASSED in 8.1s //tensorflow/python/kernel_tests/array_ops:identity_op_py_test PASSED in 7.1s //tensorflow/python/kernel_tests/array_ops:large_concat_op_test_cpu PASSED in 13.0s //tensorflow/python/kernel_tests/array_ops:manip_ops_test_cpu PASSED in 9.1s //tensorflow/python/kernel_tests/array_ops:one_hot_op_test_cpu PASSED in 8.6s //tensorflow/python/kernel_tests/array_ops:pad_op_test_cpu PASSED in 15.0s //tensorflow/python/kernel_tests/array_ops:reshape_op_test_cpu PASSED in 10.2s //tensorflow/python/kernel_tests/array_ops:reverse_sequence_op_test_cpu PASSED in 18.3s //tensorflow/python/kernel_tests/array_ops:scalar_test_cpu PASSED in 20.0s //tensorflow/python/kernel_tests/array_ops:shape_ops_test_cpu PASSED in 14.6s //tensorflow/python/kernel_tests/array_ops:slice_op_test_cpu PASSED in 11.8s //tensorflow/python/kernel_tests/array_ops:spacetobatch_op_test_cpu PASSED in 15.3s //tensorflow/python/kernel_tests/array_ops:spacetodepth_op_test_cpu PASSED in 19.4s //tensorflow/python/kernel_tests/array_ops:stack_op_test_cpu PASSED in 14.4s //tensorflow/python/kernel_tests/array_ops:unique_op_test_cpu PASSED in 7.3s //tensorflow/python/kernel_tests/array_ops:unstack_op_test_cpu PASSED in 9.1s //tensorflow/python/kernel_tests/array_ops:where_op_test_cpu PASSED in 16.4s //tensorflow/python/kernel_tests/control_flow:cond_v2_test_cpu PASSED in 56.4s //tensorflow/python/kernel_tests/control_flow:control_flow_util_test PASSED in 7.3s //tensorflow/python/kernel_tests/control_flow:control_flow_util_v2_test PASSED in 8.8s //tensorflow/python/kernel_tests/control_flow:py_func_test_cpu PASSED in 15.0s //tensorflow/python/kernel_tests/control_flow:scan_ops_test_cpu PASSED in 69.4s //tensorflow/python/kernel_tests/control_flow:while_v2_test_cpu PASSED in 80.9s //tensorflow/python/kernel_tests/custom_ops:ackermann_test PASSED in 7.9s //tensorflow/python/kernel_tests/custom_ops:duplicate_op_test PASSED in 7.4s //tensorflow/python/kernel_tests/custom_ops:invalid_op_test PASSED in 7.1s //tensorflow/python/kernel_tests/data_structures:conditional_accumulator_test PASSED in 12.2s //tensorflow/python/kernel_tests/data_structures:dynamic_partition_op_test_2gpu PASSED in 18.4s //tensorflow/python/kernel_tests/data_structures:dynamic_partition_op_test_cpu PASSED in 11.9s //tensorflow/python/kernel_tests/data_structures:dynamic_stitch_op_test_cpu PASSED in 21.3s //tensorflow/python/kernel_tests/data_structures:fifo_queue_test PASSED in 11.0s //tensorflow/python/kernel_tests/data_structures:list_ops_test_cpu PASSED in 24.1s //tensorflow/python/kernel_tests/data_structures:listdiff_op_test PASSED in 8.3s //tensorflow/python/kernel_tests/data_structures:lookup_ops_test PASSED in 21.4s //tensorflow/python/kernel_tests/data_structures:map_ops_test PASSED in 12.4s //tensorflow/python/kernel_tests/data_structures:padding_fifo_queue_test_cpu PASSED in 8.2s //tensorflow/python/kernel_tests/data_structures:priority_queue_test PASSED in 8.8s //tensorflow/python/kernel_tests/data_structures:stack_ops_test_cpu PASSED in 8.0s //tensorflow/python/kernel_tests/data_structures:stage_op_test_cpu PASSED in 20.1s //tensorflow/python/kernel_tests/distributions:bernoulli_test_cpu PASSED in 13.0s //tensorflow/python/kernel_tests/distributions:bijector_test_cpu PASSED in 7.7s //tensorflow/python/kernel_tests/distributions:categorical_test_cpu PASSED in 11.6s //tensorflow/python/kernel_tests/distributions:dirichlet_multinomial_test_cpu PASSED in 13.6s //tensorflow/python/kernel_tests/distributions:dirichlet_test_cpu PASSED in 12.4s //tensorflow/python/kernel_tests/distributions:exponential_test_cpu PASSED in 8.9s //tensorflow/python/kernel_tests/distributions:gamma_test_cpu PASSED in 42.0s //tensorflow/python/kernel_tests/distributions:identity_bijector_test_cpu PASSED in 7.6s //tensorflow/python/kernel_tests/distributions:kullback_leibler_test_cpu PASSED in 8.2s //tensorflow/python/kernel_tests/distributions:laplace_test_cpu PASSED in 39.0s //tensorflow/python/kernel_tests/distributions:multinomial_test_cpu PASSED in 7.9s //tensorflow/python/kernel_tests/distributions:normal_test_cpu PASSED in 28.0s //tensorflow/python/kernel_tests/distributions:special_math_test_cpu PASSED in 19.6s //tensorflow/python/kernel_tests/distributions:uniform_test_cpu PASSED in 15.8s //tensorflow/python/kernel_tests/image_ops:attention_ops_test PASSED in 9.3s //tensorflow/python/kernel_tests/image_ops:decode_bmp_op_test PASSED in 9.3s //tensorflow/python/kernel_tests/image_ops:decode_compressed_op_test PASSED in 10.0s //tensorflow/python/kernel_tests/image_ops:decode_image_op_test PASSED in 6.9s //tensorflow/python/kernel_tests/image_ops:decode_jpeg_op_test PASSED in 6.8s //tensorflow/python/kernel_tests/image_ops:decode_png_op_test PASSED in 18.9s //tensorflow/python/kernel_tests/image_ops:decode_raw_op_test PASSED in 9.0s //tensorflow/python/kernel_tests/image_ops:draw_bounding_box_op_test_cpu PASSED in 7.5s //tensorflow/python/kernel_tests/image_ops:extract_image_patches_op_test_cpu PASSED in 10.2s //tensorflow/python/kernel_tests/image_ops:extract_volume_patches_op_test_cpu PASSED in 10.0s //tensorflow/python/kernel_tests/io_ops:checkpoint_ops_test PASSED in 9.5s //tensorflow/python/kernel_tests/io_ops:decode_csv_op_test PASSED in 6.8s //tensorflow/python/kernel_tests/io_ops:io_ops_test PASSED in 7.0s //tensorflow/python/kernel_tests/io_ops:parse_single_example_op_test PASSED in 9.5s //tensorflow/python/kernel_tests/io_ops:parsing_ops_test PASSED in 21.0s //tensorflow/python/kernel_tests/io_ops:reader_ops_test PASSED in 11.5s //tensorflow/python/kernel_tests/io_ops:record_input_test PASSED in 68.7s //tensorflow/python/kernel_tests/io_ops:save_restore_ops_test PASSED in 8.2s //tensorflow/python/kernel_tests/linalg:determinant_op_test_cpu PASSED in 7.8s //tensorflow/python/kernel_tests/linalg:linear_operator_addition_test_cpu PASSED in 8.5s //tensorflow/python/kernel_tests/linalg:linear_operator_algebra_test_cpu PASSED in 7.0s //tensorflow/python/kernel_tests/linalg:linear_operator_test_cpu PASSED in 9.7s //tensorflow/python/kernel_tests/linalg:lu_op_test_cpu PASSED in 11.0s //tensorflow/python/kernel_tests/linalg:matrix_inverse_op_test_cpu PASSED in 8.8s //tensorflow/python/kernel_tests/linalg:matrix_logarithm_op_test PASSED in 67.4s //tensorflow/python/kernel_tests/linalg:matrix_solve_ls_op_test_cpu PASSED in 27.8s //tensorflow/python/kernel_tests/linalg:matrix_solve_op_test_cpu PASSED in 26.6s //tensorflow/python/kernel_tests/linalg:matrix_square_root_op_test_cpu PASSED in 18.9s //tensorflow/python/kernel_tests/linalg:slicing_test_cpu PASSED in 11.7s //tensorflow/python/kernel_tests/linalg/sparse:conjugate_gradient_test_cpu PASSED in 24.4s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_test_cpu PASSED in 7.4s //tensorflow/python/kernel_tests/math_ops:aggregate_ops_test_cpu PASSED in 12.9s //tensorflow/python/kernel_tests/math_ops:argmax_op_test_cpu PASSED in 12.0s //tensorflow/python/kernel_tests/math_ops:banded_triangular_solve_op_test_cpu PASSED in 13.9s //tensorflow/python/kernel_tests/math_ops:basic_gpu_test_cpu PASSED in 9.6s //tensorflow/python/kernel_tests/math_ops:bincount_op_test_cpu PASSED in 10.1s //tensorflow/python/kernel_tests/math_ops:bucketize_op_test_cpu PASSED in 7.1s //tensorflow/python/kernel_tests/math_ops:clip_ops_test PASSED in 12.8s //tensorflow/python/kernel_tests/math_ops:confusion_matrix_test PASSED in 13.0s //tensorflow/python/kernel_tests/math_ops:cross_grad_test_cpu PASSED in 7.3s //tensorflow/python/kernel_tests/math_ops:cumulative_logsumexp_test_cpu PASSED in 10.1s //tensorflow/python/kernel_tests/math_ops:in_topk_op_test_cpu PASSED in 8.9s //tensorflow/python/kernel_tests/math_ops:reduce_benchmark_test_cpu PASSED in 6.6s //tensorflow/python/kernel_tests/math_ops:segment_reduction_ops_d9m_test_cpu PASSED in 8.1s //tensorflow/python/kernel_tests/math_ops:sets_test PASSED in 24.6s //tensorflow/python/kernel_tests/math_ops:topk_op_test_cpu PASSED in 8.4s //tensorflow/python/kernel_tests/math_ops:zero_division_test_cpu PASSED in 7.4s //tensorflow/python/kernel_tests/nn_ops:betainc_op_test_cpu PASSED in 23.2s //tensorflow/python/kernel_tests/nn_ops:bias_op_test_cpu PASSED in 171.1s //tensorflow/python/kernel_tests/nn_ops:conv1d_test_cpu PASSED in 18.3s //tensorflow/python/kernel_tests/nn_ops:conv1d_transpose_test_cpu PASSED in 6.6s //tensorflow/python/kernel_tests/nn_ops:conv2d_transpose_test_cpu PASSED in 7.3s //tensorflow/python/kernel_tests/nn_ops:conv3d_backprop_filter_v2_grad_test_cpu PASSED in 39.8s //tensorflow/python/kernel_tests/nn_ops:conv3d_transpose_test_cpu PASSED in 15.0s //tensorflow/python/kernel_tests/nn_ops:ctc_decoder_ops_test PASSED in 9.0s //tensorflow/python/kernel_tests/nn_ops:ctc_loss_op_test_cpu PASSED in 77.1s //tensorflow/python/kernel_tests/nn_ops:cudnn_d9m_test_cpu PASSED in 6.4s //tensorflow/python/kernel_tests/nn_ops:cudnn_deterministic_ops_test_cpu PASSED in 8.2s //tensorflow/python/kernel_tests/nn_ops:losses_test PASSED in 43.3s //tensorflow/python/kernel_tests/nn_ops:lrn_op_test_cpu PASSED in 14.9s //tensorflow/python/kernel_tests/nn_ops:morphological_ops_test_cpu PASSED in 11.5s //tensorflow/python/kernel_tests/nn_ops:nth_element_op_test_cpu PASSED in 12.6s //tensorflow/python/kernel_tests/nn_ops:pool_test_cpu PASSED in 27.6s //tensorflow/python/kernel_tests/nn_ops:pooling_ops_3d_test_cpu PASSED in 37.0s //tensorflow/python/kernel_tests/nn_ops:relu_op_test_cpu PASSED in 9.2s //tensorflow/python/kernel_tests/nn_ops:softmax_op_test_cpu PASSED in 7.0s //tensorflow/python/kernel_tests/nn_ops:softplus_op_test_cpu PASSED in 7.3s //tensorflow/python/kernel_tests/nn_ops:softsign_op_test_cpu PASSED in 7.3s //tensorflow/python/kernel_tests/nn_ops:xent_op_d9m_test_cpu PASSED in 197.4s //tensorflow/python/kernel_tests/nn_ops:xent_op_test_cpu PASSED in 9.4s //tensorflow/python/kernel_tests/proto:descriptor_source_test PASSED in 7.8s //tensorflow/python/kernel_tests/proto:encode_proto_op_test PASSED in 6.8s //tensorflow/python/kernel_tests/quantization_ops:quantization_ops_test PASSED in 8.2s //tensorflow/python/kernel_tests/random:candidate_sampler_ops_test PASSED in 8.5s //tensorflow/python/kernel_tests/random:multinomial_op_test_cpu PASSED in 7.5s //tensorflow/python/kernel_tests/random:parameterized_truncated_normal_op_test_cpu PASSED in 26.9s //tensorflow/python/kernel_tests/random:random_crop_test_cpu PASSED in 20.7s //tensorflow/python/kernel_tests/random:random_grad_test_cpu PASSED in 8.7s //tensorflow/python/kernel_tests/random:random_ops_test_cpu PASSED in 14.8s //tensorflow/python/kernel_tests/random:random_poisson_test_cpu PASSED in 10.9s //tensorflow/python/kernel_tests/random:random_shuffle_queue_test PASSED in 6.7s //tensorflow/python/kernel_tests/random:stateful_random_ops_test_cpu PASSED in 25.6s //tensorflow/python/kernel_tests/signal:mel_ops_test_cpu PASSED in 12.2s //tensorflow/python/kernel_tests/signal:mfcc_ops_test_cpu PASSED in 7.2s //tensorflow/python/kernel_tests/signal:reconstruction_ops_test_cpu PASSED in 13.1s //tensorflow/python/kernel_tests/signal:shape_ops_test_cpu PASSED in 21.9s //tensorflow/python/kernel_tests/sparse_ops:sparse_add_op_test PASSED in 8.4s //tensorflow/python/kernel_tests/sparse_ops:sparse_concat_op_test PASSED in 6.9s //tensorflow/python/kernel_tests/sparse_ops:sparse_conditional_accumulator_test PASSED in 8.3s //tensorflow/python/kernel_tests/sparse_ops:sparse_cross_op_test PASSED in 26.7s //tensorflow/python/kernel_tests/sparse_ops:sparse_matmul_op_test_cpu PASSED in 36.7s //tensorflow/python/kernel_tests/sparse_ops:sparse_reorder_op_test PASSED in 8.7s //tensorflow/python/kernel_tests/sparse_ops:sparse_reshape_op_test PASSED in 7.6s //tensorflow/python/kernel_tests/sparse_ops:sparse_serialization_ops_test PASSED in 12.1s //tensorflow/python/kernel_tests/sparse_ops:sparse_slice_op_test PASSED in 10.1s //tensorflow/python/kernel_tests/sparse_ops:sparse_split_op_test_cpu PASSED in 20.7s //tensorflow/python/kernel_tests/sparse_ops:sparse_tensor_dense_matmul_grad_test_cpu PASSED in 15.7s //tensorflow/python/kernel_tests/sparse_ops:sparse_tensor_dense_matmul_op_d9m_test_cpu PASSED in 43.1s //tensorflow/python/kernel_tests/sparse_ops:sparse_tensor_dense_matmul_op_test_cpu PASSED in 28.5s //tensorflow/python/kernel_tests/sparse_ops:sparse_tensors_map_ops_test PASSED in 11.8s //tensorflow/python/kernel_tests/sparse_ops:sparse_to_dense_op_py_test_cpu PASSED in 6.7s //tensorflow/python/kernel_tests/sparse_ops:sparse_xent_op_d9m_test_cpu PASSED in 113.4s //tensorflow/python/kernel_tests/sparse_ops:sparse_xent_op_test_cpu PASSED in 9.3s //tensorflow/python/kernel_tests/sparse_ops:sparsemask_op_test PASSED in 8.1s //tensorflow/python/kernel_tests/strings_ops:as_string_op_test PASSED in 8.6s //tensorflow/python/kernel_tests/strings_ops:base64_ops_test PASSED in 10.9s //tensorflow/python/kernel_tests/strings_ops:reduce_join_op_test_cpu PASSED in 8.9s //tensorflow/python/kernel_tests/strings_ops:regex_full_match_op_test PASSED in 11.5s //tensorflow/python/kernel_tests/strings_ops:regex_replace_op_test PASSED in 7.7s //tensorflow/python/kernel_tests/strings_ops:string_bytes_split_op_test PASSED in 9.5s //tensorflow/python/kernel_tests/strings_ops:string_format_op_test PASSED in 10.2s //tensorflow/python/kernel_tests/strings_ops:string_join_op_test PASSED in 7.9s //tensorflow/python/kernel_tests/strings_ops:string_length_op_test PASSED in 6.9s //tensorflow/python/kernel_tests/strings_ops:string_lower_op_test PASSED in 9.0s //tensorflow/python/kernel_tests/strings_ops:string_split_op_test PASSED in 13.7s //tensorflow/python/kernel_tests/strings_ops:string_strip_op_test PASSED in 7.2s //tensorflow/python/kernel_tests/strings_ops:string_to_hash_bucket_op_test_cpu PASSED in 8.2s //tensorflow/python/kernel_tests/strings_ops:string_to_number_op_test_cpu PASSED in 12.9s //tensorflow/python/kernel_tests/strings_ops:string_upper_op_test PASSED in 8.0s //tensorflow/python/kernel_tests/strings_ops:substr_op_test PASSED in 8.9s //tensorflow/python/kernel_tests/strings_ops:unicode_decode_op_test PASSED in 16.8s //tensorflow/python/kernel_tests/strings_ops:unicode_encode_op_test PASSED in 8.7s //tensorflow/python/kernel_tests/strings_ops:unicode_script_op_test PASSED in 7.6s //tensorflow/python/kernel_tests/strings_ops:unicode_transcode_op_test PASSED in 10.1s //tensorflow/python/kernel_tests/strings_ops:unsorted_segment_join_op_test_cpu PASSED in 7.6s //tensorflow/python/kernel_tests/summary_ops:summary_ops_test_cpu PASSED in 13.8s //tensorflow/python/kernel_tests/summary_ops:summary_v1_audio_op_test_cpu PASSED in 7.1s //tensorflow/python/kernel_tests/summary_ops:summary_v1_image_op_test_cpu PASSED in 7.4s //tensorflow/python/kernel_tests/summary_ops:summary_v1_ops_test PASSED in 10.2s //tensorflow/python/kernel_tests/summary_ops:summary_v1_tensor_op_test PASSED in 7.8s //tensorflow/python/kernel_tests/v1_compat_tests:array_ops_test_cpu PASSED in 6.4s //tensorflow/python/kernel_tests/v1_compat_tests:dense_update_ops_test_cpu PASSED in 7.1s //tensorflow/python/kernel_tests/v1_compat_tests:identity_op_py_test PASSED in 9.1s //tensorflow/python/kernel_tests/v1_compat_tests:scatter_nd_ops_test_cpu PASSED in 8.7s //tensorflow/python/kernel_tests/v1_compat_tests:session_ops_test_cpu PASSED in 10.2s //tensorflow/python/kernel_tests/v1_compat_tests:stack_op_test_cpu PASSED in 8.4s //tensorflow/python/kernel_tests/variables:dense_update_ops_no_tsan_test_cpu PASSED in 7.6s //tensorflow/python/kernel_tests/variables:dense_update_ops_test_cpu PASSED in 11.0s //tensorflow/python/kernel_tests/variables:partitioned_variables_test PASSED in 14.0s //tensorflow/python/kernel_tests/variables:resource_variable_ops_test_cpu PASSED in 67.9s //tensorflow/python/kernel_tests/variables:variable_ops_test_cpu PASSED in 20.6s //tensorflow/python/kernel_tests/variables:variable_scope_test PASSED in 32.6s //tensorflow/python/kernel_tests/variables:variables_test PASSED in 10.9s //tensorflow/python/lib/core:custom_float_test PASSED in 11.3s //tensorflow/python/lib/io:file_io_test PASSED in 11.1s //tensorflow/python/lib/io:tf_record_test PASSED in 10.9s //tensorflow/python/module:module_test PASSED in 20.8s //tensorflow/python/ops:array_grad_test_cpu PASSED in 9.7s //tensorflow/python/ops:array_ops_shape_test PASSED in 6.3s //tensorflow/python/ops:array_ops_test PASSED in 6.8s //tensorflow/python/ops:autograph_ops_test PASSED in 6.5s //tensorflow/python/ops:batch_norm_benchmark_cpu PASSED in 6.2s //tensorflow/python/ops:bincount_ops_test_cpu PASSED in 8.6s //tensorflow/python/ops:bitwise_ops_test_cpu PASSED in 8.9s //tensorflow/python/ops:clip_ops_test PASSED in 11.8s //tensorflow/python/ops:clustering_ops_test PASSED in 22.4s //tensorflow/python/ops:collective_ops_benchmark_cpu PASSED in 6.5s //tensorflow/python/ops:collective_ops_gpu_test_2gpu PASSED in 9.0s //tensorflow/python/ops:collective_ops_gpu_test_cpu PASSED in 9.6s //tensorflow/python/ops:collective_ops_test PASSED in 14.3s //tensorflow/python/ops:collective_ops_xla_test PASSED in 10.2s //tensorflow/python/ops:compiled_collective_ops_gpu_test_2gpu PASSED in 11.5s //tensorflow/python/ops:compiled_collective_ops_gpu_test_cpu PASSED in 6.7s //tensorflow/python/ops:concat_benchmark_cpu PASSED in 8.3s //tensorflow/python/ops:control_flow_ops_benchmark_cpu PASSED in 8.0s //tensorflow/python/ops:control_flow_v2_enable_test PASSED in 13.3s //tensorflow/python/ops:control_flow_v2_toggles_test PASSED in 9.7s //tensorflow/python/ops:dequantize_op_test PASSED in 18.4s //tensorflow/python/ops:embedding_ops_test_cpu PASSED in 7.1s //tensorflow/python/ops:factory_ops_test_cpu PASSED in 8.1s //tensorflow/python/ops:functional_ops_test PASSED in 12.2s //tensorflow/python/ops:gradient_checker_v2_test_cpu PASSED in 27.2s //tensorflow/python/ops:gradients_test_cpu PASSED in 14.3s //tensorflow/python/ops:init_ops_test_cpu PASSED in 11.2s //tensorflow/python/ops:init_ops_v2_test_cpu PASSED in 11.4s //tensorflow/python/ops:math_grad_test_cpu PASSED in 21.9s //tensorflow/python/ops:math_ops_linspace_test_cpu PASSED in 8.5s //tensorflow/python/ops:math_ops_test_cpu PASSED in 24.0s //tensorflow/python/ops:matmul_benchmark_cpu PASSED in 7.7s //tensorflow/python/ops:nn_grad_test_cpu PASSED in 15.2s //tensorflow/python/ops:nn_loss_scaling_utilities_test PASSED in 10.3s //tensorflow/python/ops:nn_test_cpu PASSED in 66.6s //tensorflow/python/ops:nn_xent_test_cpu PASSED in 9.3s //tensorflow/python/ops:op_selector_test PASSED in 6.0s //tensorflow/python/ops:quantized_conv_ops_test PASSED in 7.5s //tensorflow/python/ops:quantized_ops_test PASSED in 8.3s //tensorflow/python/ops:raw_ops_test_cpu PASSED in 8.0s //tensorflow/python/ops:rnn_grad_test_cpu PASSED in 12.9s //tensorflow/python/ops:script_ops_test PASSED in 6.7s //tensorflow/python/ops:sort_ops_test PASSED in 9.8s //tensorflow/python/ops:sparse_bincount_ops_test_cpu PASSED in 7.4s //tensorflow/python/ops:sparse_ops_test PASSED in 14.6s //tensorflow/python/ops:split_benchmark_cpu PASSED in 7.8s //tensorflow/python/ops:tensor_array_ops_test PASSED in 7.7s //tensorflow/python/ops:transpose_benchmark_cpu PASSED in 12.5s //tensorflow/python/ops:variable_spec_test PASSED in 9.4s //tensorflow/python/ops/losses:util_test PASSED in 17.9s //tensorflow/python/ops/memory_tests:custom_gradient_memory_test_cpu PASSED in 12.0s //tensorflow/python/ops/numpy_ops:np_array_ops_test_cpu PASSED in 69.2s //tensorflow/python/ops/numpy_ops:np_arrays_test_cpu PASSED in 7.8s //tensorflow/python/ops/numpy_ops:np_dtypes_test_cpu PASSED in 8.4s //tensorflow/python/ops/numpy_ops:np_interop_test_cpu PASSED in 40.9s //tensorflow/python/ops/numpy_ops:np_logic_test_cpu PASSED in 12.7s //tensorflow/python/ops/numpy_ops:np_math_ops_test_cpu PASSED in 29.1s //tensorflow/python/ops/numpy_ops:np_random_test_cpu PASSED in 69.5s //tensorflow/python/ops/numpy_ops:np_utils_test_cpu PASSED in 9.5s //tensorflow/python/ops/numpy_ops/integration_test:np_config_test_cpu PASSED in 16.7s //tensorflow/python/ops/numpy_ops/integration_test:public_symbol_test PASSED in 26.4s //tensorflow/python/ops/parallel_for:array_test_cpu PASSED in 40.7s //tensorflow/python/ops/parallel_for:gradients_test_cpu PASSED in 11.6s //tensorflow/python/ops/parallel_for:xla_control_flow_ops_test_cpu PASSED in 63.6s //tensorflow/python/ops/ragged:convert_to_tensor_or_ragged_tensor_op_test PASSED in 18.6s //tensorflow/python/ops/ragged:ragged_batch_gather_op_test PASSED in 52.6s //tensorflow/python/ops/ragged:ragged_bincount_ops_test_cpu PASSED in 8.2s //tensorflow/python/ops/ragged:ragged_bitcast_op_test PASSED in 6.8s //tensorflow/python/ops/ragged:ragged_boolean_mask_op_test PASSED in 17.5s //tensorflow/python/ops/ragged:ragged_concat_op_test PASSED in 11.3s //tensorflow/python/ops/ragged:ragged_const_op_test PASSED in 11.7s //tensorflow/python/ops/ragged:ragged_constant_value_op_test PASSED in 7.4s //tensorflow/python/ops/ragged:ragged_dispatch_test PASSED in 132.2s //tensorflow/python/ops/ragged:ragged_dynamic_partition_op_test_cpu PASSED in 17.3s //tensorflow/python/ops/ragged:ragged_eager_test PASSED in 6.9s //tensorflow/python/ops/ragged:ragged_expand_dims_op_test PASSED in 9.9s //tensorflow/python/ops/ragged:ragged_factory_ops_test_cpu PASSED in 20.5s //tensorflow/python/ops/ragged:ragged_fill_empty_rows_op_test PASSED in 7.8s //tensorflow/python/ops/ragged:ragged_from_sparse_op_test PASSED in 8.0s //tensorflow/python/ops/ragged:ragged_from_tensor_op_test PASSED in 22.9s //tensorflow/python/ops/ragged:ragged_gather_nd_op_test PASSED in 13.1s //tensorflow/python/ops/ragged:ragged_map_flat_values_op_test PASSED in 9.2s //tensorflow/python/ops/ragged:ragged_map_fn_op_test PASSED in 11.6s //tensorflow/python/ops/ragged:ragged_math_ops_test PASSED in 11.9s //tensorflow/python/ops/ragged:ragged_matmul_op_test PASSED in 41.6s //tensorflow/python/ops/ragged:ragged_merge_dims_op_test PASSED in 28.1s //tensorflow/python/ops/ragged:ragged_one_hot_op_test PASSED in 9.6s //tensorflow/python/ops/ragged:ragged_operators_test PASSED in 19.7s //tensorflow/python/ops/ragged:ragged_placeholder_op_test PASSED in 11.2s //tensorflow/python/ops/ragged:ragged_print_op_test PASSED in 12.5s //tensorflow/python/ops/ragged:ragged_range_op_test PASSED in 8.5s //tensorflow/python/ops/ragged:ragged_rank_op_test PASSED in 7.1s //tensorflow/python/ops/ragged:ragged_reduce_op_test PASSED in 29.8s //tensorflow/python/ops/ragged:ragged_resize_image_op_test PASSED in 19.5s //tensorflow/python/ops/ragged:ragged_reverse_op_test PASSED in 8.7s //tensorflow/python/ops/ragged:ragged_row_lengths_op_test PASSED in 10.8s //tensorflow/python/ops/ragged:ragged_row_splits_to_segment_ids_op_test PASSED in 7.3s //tensorflow/python/ops/ragged:ragged_segment_ids_to_row_splits_op_test PASSED in 8.2s //tensorflow/python/ops/ragged:ragged_segment_op_test PASSED in 13.0s //tensorflow/python/ops/ragged:ragged_size_op_test PASSED in 10.5s //tensorflow/python/ops/ragged:ragged_split_op_test PASSED in 62.9s //tensorflow/python/ops/ragged:ragged_squeeze_op_test PASSED in 15.8s //tensorflow/python/ops/ragged:ragged_stack_op_test PASSED in 16.6s //tensorflow/python/ops/ragged:ragged_tensor_bounding_shape_op_test PASSED in 15.1s //tensorflow/python/ops/ragged:ragged_tensor_shape_test PASSED in 73.4s //tensorflow/python/ops/ragged:ragged_tile_op_test PASSED in 50.1s //tensorflow/python/ops/ragged:ragged_to_sparse_op_test PASSED in 7.2s //tensorflow/python/ops/ragged:ragged_to_tensor_op_test PASSED in 84.9s //tensorflow/python/ops/ragged:ragged_util_test PASSED in 33.1s //tensorflow/python/ops/ragged:ragged_where_op_test PASSED in 32.9s //tensorflow/python/ops/ragged:row_partition_test PASSED in 27.6s //tensorflow/python/ops/ragged:string_ngrams_op_test PASSED in 8.0s //tensorflow/python/ops/ragged:strings_reduce_join_op_test PASSED in 11.0s //tensorflow/python/ops/structured:structured_array_ops_test PASSED in 51.8s //tensorflow/python/ops/structured:structured_tensor_slice_test PASSED in 57.2s //tensorflow/python/ops/structured:structured_tensor_spec_test PASSED in 21.8s //tensorflow/python/ops/structured:structured_tensor_test PASSED in 49.9s //tensorflow/python/ops/v1_compat_tests:gradient_checker_test_cpu PASSED in 10.6s //tensorflow/python/platform:benchmark_test PASSED in 8.5s //tensorflow/python/platform:build_info_test PASSED in 7.8s //tensorflow/python/platform:resource_loader_test PASSED in 2.6s //tensorflow/python/profiler:pprof_profiler_test PASSED in 6.2s //tensorflow/python/profiler:profile_context_test_cpu PASSED in 25.8s //tensorflow/python/profiler:profiler_client_test_cpu PASSED in 6.7s //tensorflow/python/profiler:profiler_test_cpu PASSED in 19.1s //tensorflow/python/profiler:profiler_v2_test_cpu PASSED in 7.2s //tensorflow/python/profiler:profiler_wrapper_test PASSED in 9.5s //tensorflow/python/profiler:tfprof_logger_test PASSED in 7.5s //tensorflow/python/profiler/internal:flops_registry_test PASSED in 6.2s //tensorflow/python/profiler/internal:print_model_analysis_test PASSED in 7.0s //tensorflow/python/profiler/internal:run_metadata_test_cpu PASSED in 13.7s //tensorflow/python/saved_model:fingerprinting_test PASSED in 8.2s //tensorflow/python/saved_model:keras_injection_test PASSED in 15.3s //tensorflow/python/saved_model:load_v1_in_v2_test PASSED in 14.8s //tensorflow/python/saved_model:loader_test PASSED in 13.4s //tensorflow/python/saved_model:method_name_updater_test PASSED in 7.1s //tensorflow/python/saved_model:metrics_test PASSED in 9.2s //tensorflow/python/saved_model:nested_structure_coder_test PASSED in 7.1s //tensorflow/python/saved_model:pywrap_saved_model_fingerprinting_test PASSED in 8.5s //tensorflow/python/saved_model:pywrap_saved_model_metrics_test PASSED in 18.2s //tensorflow/python/saved_model:revived_types_test PASSED in 17.8s //tensorflow/python/saved_model:save_context_test PASSED in 6.5s //tensorflow/python/saved_model:save_test PASSED in 24.2s //tensorflow/python/saved_model:saved_model_test PASSED in 21.3s //tensorflow/python/saved_model:signature_def_utils_test PASSED in 7.6s //tensorflow/python/saved_model:simple_save_test PASSED in 7.4s //tensorflow/python/saved_model:tracing_utils_test PASSED in 8.2s //tensorflow/python/saved_model:utils_test PASSED in 7.6s //tensorflow/python/saved_model/model_utils:export_output_test PASSED in 7.7s //tensorflow/python/saved_model/model_utils:export_test PASSED in 10.5s //tensorflow/python/saved_model/model_utils:mode_keys_test PASSED in 6.4s //tensorflow/python/saved_model/registration:registration_saving_test PASSED in 24.6s //tensorflow/python/saved_model/registration:registration_test PASSED in 8.9s //tensorflow/python/saved_model/registration:tf_registration_test PASSED in 15.1s //tensorflow/python/summary:plugin_asset_test PASSED in 7.4s //tensorflow/python/summary:summary_iterator_test PASSED in 11.3s //tensorflow/python/summary:summary_test PASSED in 8.0s //tensorflow/python/summary:summary_v2_test PASSED in 6.8s //tensorflow/python/summary/writer:writer_test PASSED in 17.3s //tensorflow/python/tools:aot_compiled_test PASSED in 22.7s //tensorflow/python/tools:freeze_graph_test PASSED in 19.7s //tensorflow/python/tools:optimize_for_inference_test PASSED in 7.9s //tensorflow/python/tools:print_selective_registration_header_test PASSED in 16.8s //tensorflow/python/tools:saved_model_cli_test PASSED in 35.9s //tensorflow/python/tools:saved_model_utils_test PASSED in 10.9s //tensorflow/python/tools:strip_unused_test PASSED in 6.9s //tensorflow/python/tools/api/generator:create_python_api_test PASSED in 8.4s //tensorflow/python/tools/api/generator:output_init_files_test PASSED in 13.7s //tensorflow/python/tools/api/generator:tensorflow_doc_srcs_test PASSED in 24.9s //tensorflow/python/tpu:bfloat16_test PASSED in 7.6s //tensorflow/python/tpu:feature_column_test PASSED in 11.9s //tensorflow/python/tpu:topology_test PASSED in 7.0s //tensorflow/python/tpu:tpu_embedding_for_serving_test PASSED in 11.3s //tensorflow/python/tpu:tpu_embedding_v2_utils_test PASSED in 7.6s //tensorflow/python/tpu:tpu_infeed_test PASSED in 19.0s //tensorflow/python/tpu:tpu_sharding_test PASSED in 11.4s //tensorflow/python/tpu:tpu_test_wrapper_test PASSED in 7.2s //tensorflow/python/tpu/client:client_py_test PASSED in 7.1s //tensorflow/python/trackable:autotrackable_test PASSED in 8.4s //tensorflow/python/trackable:base_delegate_test PASSED in 11.5s //tensorflow/python/trackable:base_test PASSED in 10.3s //tensorflow/python/trackable:data_structures_test PASSED in 11.9s //tensorflow/python/trackable:python_state_test PASSED in 8.5s //tensorflow/python/trackable:resource_test PASSED in 7.6s //tensorflow/python/trackable:trackable_utils_test PASSED in 6.2s //tensorflow/python/training:adadelta_test_cpu PASSED in 26.7s //tensorflow/python/training:adagrad_da_test_cpu PASSED in 8.3s //tensorflow/python/training:adagrad_test_cpu PASSED in 13.2s //tensorflow/python/training:adam_test_cpu PASSED in 28.2s //tensorflow/python/training:basic_loops_test_cpu PASSED in 7.2s //tensorflow/python/training:basic_session_run_hooks_test PASSED in 30.5s //tensorflow/python/training:checkpoint_ops_test PASSED in 6.6s //tensorflow/python/training:coordinator_test_cpu PASSED in 14.0s //tensorflow/python/training:device_setter_test_cpu PASSED in 7.7s //tensorflow/python/training:ftrl_test_cpu PASSED in 13.2s //tensorflow/python/training:gradient_descent_test_cpu PASSED in 9.0s //tensorflow/python/training:input_test PASSED in 19.2s //tensorflow/python/training:momentum_test_cpu PASSED in 12.7s //tensorflow/python/training:monitored_session_test PASSED in 24.6s //tensorflow/python/training:moving_averages_test_cpu PASSED in 13.5s //tensorflow/python/training:optimizer_test_cpu PASSED in 22.7s //tensorflow/python/training:proximal_adagrad_test_cpu PASSED in 8.8s //tensorflow/python/training:proximal_gradient_descent_test_cpu PASSED in 10.4s //tensorflow/python/training:quantize_training_test_cpu PASSED in 13.9s //tensorflow/python/training:queue_runner_test_cpu PASSED in 8.4s //tensorflow/python/training:rmsprop_test_cpu PASSED in 37.3s //tensorflow/python/training:saver_large_partitioned_variable_test PASSED in 14.3s //tensorflow/python/training:saver_test_2gpu PASSED in 44.9s //tensorflow/python/training:saver_test_cpu PASSED in 29.4s //tensorflow/python/training:server_lib_multiple_containers_test PASSED in 8.3s //tensorflow/python/training:server_lib_same_variables_clear_container_test PASSED in 9.6s //tensorflow/python/training:server_lib_same_variables_clear_test PASSED in 8.2s //tensorflow/python/training:server_lib_same_variables_no_clear_test PASSED in 7.8s //tensorflow/python/training:server_lib_sparse_job_test PASSED in 8.5s //tensorflow/python/training:server_lib_test PASSED in 25.8s //tensorflow/python/training:session_manager_test_cpu PASSED in 74.8s //tensorflow/python/training:slot_creator_test_cpu PASSED in 10.1s //tensorflow/python/training:supervisor_test PASSED in 16.3s //tensorflow/python/training:training_ops_mlir_test_cpu PASSED in 8.2s //tensorflow/python/training:training_ops_test_cpu PASSED in 18.9s //tensorflow/python/training:training_util_test PASSED in 12.4s //tensorflow/python/training:warm_starting_util_test PASSED in 35.3s //tensorflow/python/training/experimental:loss_scale_optimizer_test PASSED in 13.4s //tensorflow/python/training/experimental:loss_scale_test PASSED in 42.8s //tensorflow/python/training/experimental:mixed_precision_test_cpu PASSED in 8.8s //tensorflow/python/training/saving:saveable_object_util_test PASSED in 6.6s //tensorflow/python/util:compat_test PASSED in 8.1s //tensorflow/python/util:decorator_utils_test PASSED in 8.8s //tensorflow/python/util:deprecation_test PASSED in 16.0s //tensorflow/python/util:dispatch_test PASSED in 9.2s //tensorflow/python/util:example_parser_configuration_test PASSED in 20.1s //tensorflow/python/util:fast_module_type_test PASSED in 19.2s //tensorflow/python/util:function_parameter_canonicalizer_test PASSED in 6.9s //tensorflow/python/util:function_utils_test PASSED in 7.7s //tensorflow/python/util:keyword_args_test PASSED in 9.1s //tensorflow/python/util:lazy_loader_test PASSED in 9.3s //tensorflow/python/util:lock_util_test PASSED in 9.6s //tensorflow/python/util:module_wrapper_test PASSED in 19.5s //tensorflow/python/util:nest_test PASSED in 12.5s //tensorflow/python/util:object_identity_test PASSED in 7.1s //tensorflow/python/util:pywrap_xla_ops_test PASSED in 1.8s //tensorflow/python/util:serialization_test PASSED in 7.5s //tensorflow/python/util:tf_contextlib_test PASSED in 8.1s //tensorflow/python/util:tf_decorator_test PASSED in 7.2s //tensorflow/python/util:tf_export_test PASSED in 7.1s //tensorflow/python/util:tf_inspect_test PASSED in 7.9s //tensorflow/python/util:tf_should_use_test PASSED in 12.1s //tensorflow/python/util:tf_stack_test PASSED in 7.9s //tensorflow/python/util:traceback_utils_test PASSED in 8.6s //tensorflow/python/util:type_annotations_test PASSED in 7.1s //tensorflow/python/util:variable_utils_test PASSED in 12.6s //tensorflow/python/util:vlog_test PASSED in 19.5s //tensorflow/tools/api/tests:module_test PASSED in 21.9s //tensorflow/tools/benchmark:benchmark_model_test PASSED in 2.5s //tensorflow/tools/common:public_api_test PASSED in 2.1s //tensorflow/tools/common:traverse_test PASSED in 1.5s //tensorflow/tools/compatibility:all_renames_v2_test PASSED in 12.3s //tensorflow/tools/compatibility:ast_edits_test PASSED in 7.9s //tensorflow/tools/compatibility:test_file_v1_0 PASSED in 21.4s //tensorflow/tools/compatibility:test_file_v2_0 PASSED in 15.9s //tensorflow/tools/compatibility:tf_upgrade_test PASSED in 7.3s //tensorflow/tools/compatibility:tf_upgrade_v2_safety_test PASSED in 7.9s //tensorflow/tools/docs:tf_doctest_test PASSED in 0.7s //tensorflow/tools/graph_transforms:file_utils_test PASSED in 1.0s //tensorflow/tools/graph_transforms:transform_graph_test PASSED in 3.0s //tensorflow/tools/graph_transforms:transform_utils_test PASSED in 2.5s //tensorflow/tools/graph_transforms:transforms_test PASSED in 4.6s //tensorflow/tools/proto_text:gen_proto_text_functions_lib_test PASSED in 0.2s //tensorflow/tools/tensorflow_builder/compat_checker:compat_checker_test PASSED in 0.3s //tensorflow/tsl/c:tsl_status_helper_test PASSED in 0.5s //tensorflow/tsl/c:tsl_status_test PASSED in 0.1s //tensorflow/tsl/concurrency:async_value_ref_test PASSED in 0.1s //tensorflow/tsl/concurrency:async_value_test PASSED in 0.1s //tensorflow/tsl/concurrency:concurrent_vector_test PASSED in 0.5s //tensorflow/tsl/cuda:cudnn_version_test PASSED in 0.1s //tensorflow/tsl/distributed_runtime/coordination:coordination_service_agent_test PASSED in 13.3s //tensorflow/tsl/distributed_runtime/coordination:coordination_service_error_util_test PASSED in 0.1s //tensorflow/tsl/distributed_runtime/coordination:coordination_service_recoverable_job_test PASSED in 0.3s //tensorflow/tsl/distributed_runtime/preemption:preemption_notifier_test PASSED in 5.3s //tensorflow/tsl/distributed_runtime/preemption:preemption_sync_manager_test PASSED in 5.9s //tensorflow/tsl/distributed_runtime/rpc:grpc_channel_test PASSED in 0.7s //tensorflow/tsl/distributed_runtime/rpc:grpc_util_test PASSED in 0.2s //tensorflow/tsl/framework:cancellation_test PASSED in 1.2s //tensorflow/tsl/framework:device_id_utils_test PASSED in 4.0s //tensorflow/tsl/framework/convolution:eigen_spatial_convolutions_test PASSED in 0.4s //tensorflow/tsl/lib/gtl:tsl_lib_gtl_tests PASSED in 0.3s //tensorflow/tsl/lib/hash:crc32c_test PASSED in 0.1s //tensorflow/tsl/lib/histogram:histogram_test PASSED in 0.3s //tensorflow/tsl/lib/io:buffered_file_test PASSED in 0.3s //tensorflow/tsl/lib/io:buffered_inputstream_test PASSED in 0.3s //tensorflow/tsl/lib/io:cache_test PASSED in 0.1s //tensorflow/tsl/lib/io:inputbuffer_test PASSED in 1.9s //tensorflow/tsl/lib/io:inputstream_interface_test PASSED in 1.0s //tensorflow/tsl/lib/io:random_inputstream_test PASSED in 0.4s //tensorflow/tsl/lib/io:record_reader_writer_test PASSED in 0.7s //tensorflow/tsl/lib/io:recordio_test PASSED in 2.1s //tensorflow/tsl/lib/io:table_test PASSED in 4.0s //tensorflow/tsl/lib/io:zlib_buffers_test PASSED in 41.4s //tensorflow/tsl/lib/io/snappy:snappy_test PASSED in 0.1s //tensorflow/tsl/lib/math:math_util_test PASSED in 0.6s //tensorflow/tsl/lib/random:distribution_sampler_test PASSED in 0.2s //tensorflow/tsl/lib/random:philox_random_test PASSED in 0.4s //tensorflow/tsl/lib/random:random_distributions_test PASSED in 18.5s //tensorflow/tsl/lib/random:simple_philox_test PASSED in 0.6s //tensorflow/tsl/lib/random:weighted_picker_test PASSED in 11.6s //tensorflow/tsl/platform:ctstring_test PASSED in 0.1s //tensorflow/tsl/platform:denormal_test PASSED in 0.2s //tensorflow/tsl/platform:errors_test PASSED in 0.1s //tensorflow/tsl/platform:fingerprint_test PASSED in 0.2s //tensorflow/tsl/platform:float8_test PASSED in 0.7s //tensorflow/tsl/platform:hash_test PASSED in 0.4s //tensorflow/tsl/platform:integral_types_test PASSED in 0.1s //tensorflow/tsl/platform:intrusive_ptr_test PASSED in 0.3s //tensorflow/tsl/platform:logging_test PASSED in 20.9s //tensorflow/tsl/platform:mutex_test PASSED in 0.5s //tensorflow/tsl/platform:net_test PASSED in 0.1s //tensorflow/tsl/platform:numbers_test PASSED in 0.1s //tensorflow/tsl/platform:path_test PASSED in 0.2s //tensorflow/tsl/platform:port_test PASSED in 8.1s //tensorflow/tsl/platform:random_test PASSED in 3.1s //tensorflow/tsl/platform:refcount_test PASSED in 0.2s //tensorflow/tsl/platform:retrying_file_system_test PASSED in 0.5s //tensorflow/tsl/platform:retrying_utils_test PASSED in 0.5s //tensorflow/tsl/platform:scanner_test PASSED in 0.2s //tensorflow/tsl/platform:setround_test PASSED in 0.4s //tensorflow/tsl/platform:stacktrace_handler_test PASSED in 2.3s //tensorflow/tsl/platform:stacktrace_test PASSED in 0.1s //tensorflow/tsl/platform:status_matchers_test PASSED in 0.5s //tensorflow/tsl/platform:status_test PASSED in 0.1s //tensorflow/tsl/platform:statusor_test PASSED in 2.1s //tensorflow/tsl/platform:str_util_test PASSED in 0.1s //tensorflow/tsl/platform:strcat_test PASSED in 0.7s //tensorflow/tsl/platform:stringpiece_test PASSED in 0.5s //tensorflow/tsl/platform:stringprintf_test PASSED in 0.1s //tensorflow/tsl/platform:subprocess_test PASSED in 0.2s //tensorflow/tsl/platform:tstring_test PASSED in 0.1s //tensorflow/tsl/platform:unbounded_work_queue_test PASSED in 0.3s //tensorflow/tsl/platform/cloud:compute_engine_metadata_client_test PASSED in 0.1s //tensorflow/tsl/platform/cloud:compute_engine_zone_provider_test PASSED in 0.2s //tensorflow/tsl/platform/cloud:curl_http_request_test PASSED in 9.9s //tensorflow/tsl/platform/cloud:expiring_lru_cache_test PASSED in 0.1s //tensorflow/tsl/platform/cloud:gcs_dns_cache_test PASSED in 0.1s //tensorflow/tsl/platform/cloud:gcs_file_system_test PASSED in 4.2s //tensorflow/tsl/platform/cloud:gcs_throttle_test PASSED in 0.7s //tensorflow/tsl/platform/cloud:google_auth_provider_test PASSED in 0.2s //tensorflow/tsl/platform/cloud:oauth_client_test PASSED in 0.1s //tensorflow/tsl/platform/cloud:ram_file_block_cache_test PASSED in 2.4s //tensorflow/tsl/platform/cloud:time_util_test PASSED in 0.3s //tensorflow/tsl/profiler/backends/cpu:traceme_recorder_test PASSED in 0.8s //tensorflow/tsl/profiler/convert:trace_container_test PASSED in 0.1s //tensorflow/tsl/profiler/convert:trace_events_to_json_test PASSED in 0.4s //tensorflow/tsl/profiler/convert:xla_op_utils_test PASSED in 0.2s //tensorflow/tsl/profiler/convert:xplane_to_trace_events_test PASSED in 0.3s //tensorflow/tsl/profiler/lib:profiler_factory_test PASSED in 0.3s //tensorflow/tsl/profiler/lib:profiler_lock_test PASSED in 0.3s //tensorflow/tsl/profiler/lib:scoped_annotation_test PASSED in 0.1s //tensorflow/tsl/profiler/lib:traceme_encode_test PASSED in 0.2s //tensorflow/tsl/profiler/rpc/client:profiler_client_test PASSED in 3.3s //tensorflow/tsl/profiler/rpc/client:remote_profiler_session_manager_test PASSED in 3.2s //tensorflow/tsl/profiler/utils:buffer_pool_test PASSED in 0.1s //tensorflow/tsl/profiler/utils:group_events_test PASSED in 0.2s //tensorflow/tsl/profiler/utils:parse_annotation_test PASSED in 0.1s //tensorflow/tsl/profiler/utils:preprocess_xplane_test PASSED in 0.1s //tensorflow/tsl/profiler/utils:tf_op_utils_test PASSED in 0.2s //tensorflow/tsl/profiler/utils:timespan_test PASSED in 0.1s //tensorflow/tsl/profiler/utils:tpu_xplane_utils_test PASSED in 0.1s //tensorflow/tsl/profiler/utils:xplane_builder_test PASSED in 0.3s //tensorflow/tsl/profiler/utils:xplane_utils_test PASSED in 0.1s //tensorflow/tsl/util:device_name_utils_test PASSED in 0.2s //tensorflow/tsl/util:stats_calculator_test PASSED in 0.6s //tensorflow/compiler/tests:complex_div_test_cpu PASSED in 14.2s Stats over 2 runs: max = 14.2s, min = 12.5s, avg = 13.3s, dev = 0.9s //tensorflow/compiler/tests:complex_div_test_cpu_mlir_bridge_test PASSED in 7.1s Stats over 2 runs: max = 7.1s, min = 5.8s, avg = 6.5s, dev = 0.7s //tensorflow/compiler/xla/tests:conditional_test_cpu PASSED in 16.5s Stats over 2 runs: max = 16.5s, min = 13.6s, avg = 15.1s, dev = 1.5s //tensorflow/python/data/experimental/kernel_tests/optimization:optimization_test PASSED in 18.7s Stats over 2 runs: max = 18.7s, min = 11.3s, avg = 15.0s, dev = 3.7s //tensorflow/python/data/experimental/kernel_tests/service:metadata_test PASSED in 21.5s Stats over 2 runs: max = 21.5s, min = 18.6s, avg = 20.1s, dev = 1.4s //tensorflow/python/data/kernel_tests:padded_batch_test PASSED in 34.4s Stats over 2 runs: max = 34.4s, min = 32.3s, avg = 33.4s, dev = 1.0s //tensorflow/python/data/kernel_tests:repeat_test PASSED in 55.5s Stats over 2 runs: max = 55.5s, min = 52.0s, avg = 53.8s, dev = 1.8s //tensorflow/python/data/kernel_tests:window_test PASSED in 64.0s Stats over 2 runs: max = 64.0s, min = 40.3s, avg = 52.2s, dev = 11.8s //tensorflow/python/kernel_tests/array_ops:scatter_nd_ops_test_cpu PASSED in 13.1s Stats over 2 runs: max = 13.1s, min = 11.9s, avg = 12.5s, dev = 0.6s //tensorflow/python/kernel_tests/control_flow:functional_ops_test_cpu PASSED in 12.9s Stats over 2 runs: max = 12.9s, min = 12.1s, avg = 12.5s, dev = 0.4s //tensorflow/python/kernel_tests/control_flow:map_fn_test_cpu PASSED in 10.5s Stats over 2 runs: max = 10.5s, min = 9.2s, avg = 9.9s, dev = 0.7s //tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu PASSED in 29.4s Stats over 2 runs: max = 29.4s, min = 19.3s, avg = 24.4s, dev = 5.0s //tensorflow/python/kernel_tests/nn_ops:bias_op_d9m_test_cpu PASSED in 99.2s Stats over 2 runs: max = 99.2s, min = 37.2s, avg = 68.2s, dev = 31.0s //tensorflow/python/kernel_tests/nn_ops:conv2d_backprop_filter_grad_test_cpu PASSED in 84.6s Stats over 2 runs: max = 84.6s, min = 7.0s, avg = 45.8s, dev = 38.8s //tensorflow/python/ops:control_flow_ops_test_cpu PASSED in 27.4s Stats over 2 runs: max = 27.4s, min = 23.5s, avg = 25.4s, dev = 2.0s //tensorflow/python/ops/ragged:ragged_cross_op_test FLAKY, failed in 1 out of 2 in 19.4s Stats over 2 runs: max = 19.4s, min = 19.1s, avg = 19.2s, dev = 0.1s /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/ops/ragged/ragged_cross_op_test/test_attempts/attempt_1.log //tensorflow/compiler/tests:spacetobatch_op_test_cpu PASSED in 11.7s Stats over 3 runs: max = 11.7s, min = 11.3s, avg = 11.5s, dev = 0.2s //tensorflow/compiler/tests:spacetobatch_op_test_cpu_mlir_bridge_test PASSED in 9.8s Stats over 3 runs: max = 9.8s, min = 9.4s, avg = 9.6s, dev = 0.2s //tensorflow/compiler/xla/tests:triangular_solve_test_cpu PASSED in 73.3s Stats over 3 runs: max = 73.3s, min = 71.1s, avg = 72.5s, dev = 1.0s //tensorflow/core/data/service:thread_safe_buffer_test PASSED in 0.3s Stats over 3 runs: max = 0.3s, min = 0.2s, avg = 0.3s, dev = 0.1s //tensorflow/python/data/experimental/kernel_tests/service:multi_process_cluster_test PASSED in 20.2s Stats over 3 runs: max = 20.2s, min = 13.3s, avg = 17.5s, dev = 3.0s //tensorflow/python/data/kernel_tests:unique_test PASSED in 12.7s Stats over 3 runs: max = 12.7s, min = 10.3s, avg = 11.4s, dev = 1.0s //tensorflow/python/distribute/coordinator:metric_utils_test PASSED in 19.3s Stats over 3 runs: max = 19.3s, min = 13.0s, avg = 15.8s, dev = 2.6s //tensorflow/python/kernel_tests/array_ops:gather_op_test_cpu PASSED in 41.5s Stats over 3 runs: max = 41.5s, min = 22.1s, avg = 29.3s, dev = 8.6s //tensorflow/python/kernel_tests/array_ops:weights_broadcast_test PASSED in 8.6s Stats over 3 runs: max = 8.6s, min = 7.8s, avg = 8.2s, dev = 0.3s //tensorflow/python/kernel_tests/distributions:util_test_cpu PASSED in 13.2s Stats over 3 runs: max = 13.2s, min = 10.1s, avg = 11.7s, dev = 1.3s //tensorflow/python/kernel_tests/linalg:matrix_triangular_solve_op_test_cpu PASSED in 687.3s Stats over 3 runs: max = 687.3s, min = 10.8s, avg = 236.4s, dev = 318.8s //tensorflow/python/kernel_tests/random:multinomial_op_big_test_cpu PASSED in 13.9s Stats over 3 runs: max = 13.9s, min = 9.9s, avg = 11.5s, dev = 1.7s //tensorflow/compiler/mlir/lite/debug:debug_test FAILED in 3 out of 3 in 1.6s Stats over 3 runs: max = 1.6s, min = 0.8s, avg = 1.3s, dev = 0.3s /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/compiler/mlir/lite/debug/debug_test/test.log /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/compiler/mlir/lite/debug/debug_test/test_attempts/attempt_1.log /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/compiler/mlir/lite/debug/debug_test/test_attempts/attempt_2.log //tensorflow/compiler/xla/tests:dynamic_ops_test_cpu PASSED in 12.5s Stats over 4 runs: max = 12.5s, min = 11.5s, avg = 11.8s, dev = 0.4s //tensorflow/core/kernels:example_parsing_ops_test PASSED in 0.6s Stats over 4 runs: max = 0.6s, min = 0.5s, avg = 0.5s, dev = 0.1s //tensorflow/python/data/experimental/kernel_tests:auto_shard_dataset_test PASSED in 55.5s Stats over 4 runs: max = 55.5s, min = 36.8s, avg = 47.1s, dev = 7.8s //tensorflow/python/data/experimental/kernel_tests:map_and_batch_test PASSED in 30.1s Stats over 4 runs: max = 30.1s, min = 20.5s, avg = 23.4s, dev = 3.9s //tensorflow/python/data/experimental/kernel_tests:parse_example_dataset_test PASSED in 36.7s Stats over 4 runs: max = 36.7s, min = 23.7s, avg = 30.1s, dev = 6.1s //tensorflow/python/data/experimental/kernel_tests:rebatch_dataset_test PASSED in 20.6s Stats over 4 runs: max = 20.6s, min = 8.0s, avg = 12.7s, dev = 4.8s //tensorflow/python/data/experimental/kernel_tests:sql_dataset_test PASSED in 99.5s Stats over 4 runs: max = 99.5s, min = 89.5s, avg = 93.8s, dev = 3.7s //tensorflow/python/data/experimental/kernel_tests/service:cross_trainer_cache_ft_test PASSED in 9.5s Stats over 4 runs: max = 9.5s, min = 7.1s, avg = 8.4s, dev = 1.0s //tensorflow/python/data/experimental/kernel_tests/service:distributed_save_test PASSED in 50.1s Stats over 4 runs: max = 50.1s, min = 20.7s, avg = 34.7s, dev = 12.4s //tensorflow/python/data/kernel_tests:batch_test PASSED in 34.2s Stats over 4 runs: max = 34.2s, min = 27.6s, avg = 29.9s, dev = 2.7s //tensorflow/python/data/kernel_tests:fixed_length_record_dataset_test PASSED in 28.0s Stats over 4 runs: max = 28.0s, min = 19.9s, avg = 24.1s, dev = 3.8s //tensorflow/python/data/kernel_tests:from_generator_test PASSED in 23.7s Stats over 4 runs: max = 23.7s, min = 13.8s, avg = 19.2s, dev = 3.8s //tensorflow/python/data/kernel_tests:group_by_window_test PASSED in 32.4s Stats over 4 runs: max = 32.4s, min = 8.8s, avg = 19.5s, dev = 9.7s //tensorflow/python/data/kernel_tests:ragged_batch_test PASSED in 31.8s Stats over 4 runs: max = 31.8s, min = 25.9s, avg = 28.8s, dev = 2.1s //tensorflow/python/data/kernel_tests:skip_test PASSED in 32.7s Stats over 4 runs: max = 32.7s, min = 17.7s, avg = 24.0s, dev = 6.0s //tensorflow/python/data/kernel_tests:take_test PASSED in 24.1s Stats over 4 runs: max = 24.1s, min = 24.0s, avg = 24.0s, dev = 0.1s //tensorflow/python/data/kernel_tests:take_while_test PASSED in 35.7s Stats over 4 runs: max = 35.7s, min = 30.1s, avg = 33.1s, dev = 2.0s //tensorflow/python/data/kernel_tests:text_line_dataset_test PASSED in 39.6s Stats over 4 runs: max = 39.6s, min = 17.8s, avg = 28.2s, dev = 8.8s //tensorflow/python/data/kernel_tests:zip_test PASSED in 15.0s Stats over 4 runs: max = 15.0s, min = 10.3s, avg = 11.9s, dev = 1.9s //tensorflow/python/debug/lib:dumping_callback_test_cpu PASSED in 20.8s Stats over 4 runs: max = 20.8s, min = 18.8s, avg = 19.4s, dev = 0.8s //tensorflow/python/distribute:cross_device_ops_test_2gpu PASSED in 28.6s Stats over 4 runs: max = 28.6s, min = 19.7s, avg = 24.2s, dev = 3.2s //tensorflow/python/distribute:cross_device_ops_test_cpu PASSED in 42.2s Stats over 4 runs: max = 42.2s, min = 31.3s, avg = 36.3s, dev = 4.0s //tensorflow/python/framework:convert_to_constants_test PASSED in 19.2s Stats over 4 runs: max = 19.2s, min = 13.1s, avg = 15.5s, dev = 2.6s //tensorflow/python/kernel_tests:collective_ops_test_2gpu PASSED in 34.6s Stats over 4 runs: max = 34.6s, min = 32.0s, avg = 33.4s, dev = 1.0s //tensorflow/python/kernel_tests:collective_ops_test_cpu PASSED in 52.0s Stats over 4 runs: max = 52.0s, min = 40.9s, avg = 47.3s, dev = 4.8s //tensorflow/python/kernel_tests/array_ops:concat_op_test_cpu PASSED in 26.3s Stats over 4 runs: max = 26.3s, min = 23.8s, avg = 25.3s, dev = 1.0s //tensorflow/python/kernel_tests/array_ops:init_ops_test_cpu PASSED in 73.4s Stats over 4 runs: max = 73.4s, min = 20.1s, avg = 43.5s, dev = 21.8s //tensorflow/python/kernel_tests/array_ops:split_op_test_cpu PASSED in 25.8s Stats over 4 runs: max = 25.8s, min = 7.0s, avg = 13.7s, dev = 7.6s //tensorflow/python/kernel_tests/linalg:einsum_op_test_cpu PASSED in 105.2s Stats over 4 runs: max = 105.2s, min = 14.9s, avg = 47.7s, dev = 36.4s //tensorflow/python/kernel_tests/linalg:linear_operator_lower_triangular_test_cpu PASSED in 33.8s Stats over 4 runs: max = 33.8s, min = 31.6s, avg = 32.6s, dev = 1.0s //tensorflow/python/kernel_tests/random:random_gamma_test_cpu PASSED in 72.1s Stats over 4 runs: max = 72.1s, min = 7.6s, avg = 36.3s, dev = 27.4s //tensorflow/python/kernel_tests/signal:window_ops_test_cpu PASSED in 14.0s Stats over 4 runs: max = 14.0s, min = 13.7s, avg = 13.9s, dev = 0.1s //tensorflow/python/ops:nn_batchnorm_test_cpu PASSED in 22.2s Stats over 4 runs: max = 22.2s, min = 16.3s, avg = 19.1s, dev = 2.3s //tensorflow/python/ops:nn_fused_batchnorm_d9m_test_cpu PASSED in 15.3s Stats over 4 runs: max = 15.3s, min = 14.3s, avg = 14.8s, dev = 0.4s //tensorflow/python/ops/ragged:ragged_gather_op_test PASSED in 81.6s Stats over 4 runs: max = 81.6s, min = 19.7s, avg = 49.4s, dev = 22.0s //tensorflow/python/ops/ragged:ragged_getitem_test PASSED in 44.3s Stats over 4 runs: max = 44.3s, min = 38.9s, avg = 40.8s, dev = 2.1s //tensorflow/compiler/tests:async_comp_test_cpu PASSED in 7.3s Stats over 5 runs: max = 7.3s, min = 5.8s, avg = 6.7s, dev = 0.5s //tensorflow/compiler/tests:conv3d_test_cpu PASSED in 9.4s Stats over 5 runs: max = 9.4s, min = 6.3s, avg = 7.7s, dev = 1.4s //tensorflow/compiler/tests:conv3d_test_cpu_mlir_bridge_test PASSED in 13.4s Stats over 5 runs: max = 13.4s, min = 5.9s, avg = 9.3s, dev = 3.2s //tensorflow/compiler/tests:depthwise_conv_op_test_cpu PASSED in 15.3s Stats over 5 runs: max = 15.3s, min = 8.5s, avg = 11.5s, dev = 2.7s //tensorflow/compiler/tests:depthwise_conv_op_test_cpu_mlir_bridge_test PASSED in 15.8s Stats over 5 runs: max = 15.8s, min = 8.7s, avg = 11.4s, dev = 2.9s //tensorflow/compiler/tests:fused_batchnorm_test_cpu PASSED in 7.1s Stats over 5 runs: max = 7.1s, min = 6.3s, avg = 6.8s, dev = 0.3s //tensorflow/compiler/tests:fused_batchnorm_test_cpu_mlir_bridge_test PASSED in 7.5s Stats over 5 runs: max = 7.5s, min = 6.4s, avg = 7.1s, dev = 0.4s //tensorflow/compiler/tests:image_ops_jit_compile_test_cpu PASSED in 7.3s Stats over 5 runs: max = 7.3s, min = 6.3s, avg = 6.7s, dev = 0.4s //tensorflow/compiler/tests:reduce_ops_test_cpu PASSED in 9.5s Stats over 5 runs: max = 9.5s, min = 8.7s, avg = 9.1s, dev = 0.4s //tensorflow/compiler/tests:reduce_ops_test_cpu_mlir_bridge_test PASSED in 10.9s Stats over 5 runs: max = 10.9s, min = 9.0s, avg = 10.1s, dev = 0.7s //tensorflow/compiler/tests:repeat_op_test_cpu PASSED in 8.1s Stats over 5 runs: max = 8.1s, min = 6.6s, avg = 7.0s, dev = 0.5s //tensorflow/compiler/tests:repeat_op_test_cpu_mlir_bridge_test PASSED in 7.7s Stats over 5 runs: max = 7.7s, min = 6.5s, avg = 6.8s, dev = 0.4s //tensorflow/compiler/tests:special_math_test_cpu PASSED in 142.9s Stats over 5 runs: max = 142.9s, min = 13.1s, avg = 62.7s, dev = 44.7s //tensorflow/compiler/tests:special_math_test_cpu_mlir_bridge_test PASSED in 122.3s Stats over 5 runs: max = 122.3s, min = 15.2s, avg = 55.2s, dev = 37.1s //tensorflow/compiler/xla/client/lib:self_adjoint_eig_test_cpu PASSED in 32.0s Stats over 5 runs: max = 32.0s, min = 15.4s, avg = 26.0s, dev = 6.5s //tensorflow/core/grappler/optimizers:constant_folding_test PASSED in 4.8s Stats over 5 runs: max = 4.8s, min = 3.1s, avg = 3.7s, dev = 0.7s //tensorflow/dtensor/python/tests:layout_propagation_test_cpu PASSED in 21.2s Stats over 5 runs: max = 21.2s, min = 9.0s, avg = 14.1s, dev = 5.6s //tensorflow/dtensor/python/tests:multi_mesh_test_cpu PASSED in 10.2s Stats over 5 runs: max = 10.2s, min = 8.1s, avg = 9.2s, dev = 0.8s //tensorflow/python/distribute:mirrored_strategy_test_2gpu PASSED in 9.9s Stats over 5 runs: max = 9.9s, min = 8.9s, avg = 9.6s, dev = 0.3s //tensorflow/python/distribute:mirrored_strategy_test_cpu PASSED in 10.4s Stats over 5 runs: max = 10.4s, min = 8.8s, avg = 9.7s, dev = 0.5s //tensorflow/python/distribute:moving_averages_test_2gpu PASSED in 18.4s Stats over 5 runs: max = 18.4s, min = 12.7s, avg = 15.9s, dev = 2.2s //tensorflow/python/distribute:moving_averages_test_cpu PASSED in 17.8s Stats over 5 runs: max = 17.8s, min = 14.3s, avg = 15.9s, dev = 1.2s //tensorflow/python/distribute:vars_test_2gpu PASSED in 19.1s Stats over 5 runs: max = 19.1s, min = 16.5s, avg = 17.9s, dev = 1.0s //tensorflow/python/distribute:vars_test_cpu PASSED in 27.3s Stats over 5 runs: max = 27.3s, min = 19.9s, avg = 23.0s, dev = 2.9s //tensorflow/python/eager:device_placement_test_cpu PASSED in 8.0s Stats over 5 runs: max = 8.0s, min = 5.9s, avg = 6.7s, dev = 0.7s //tensorflow/python/eager:forwardprop_test_cpu PASSED in 90.0s Stats over 5 runs: max = 90.0s, min = 13.8s, avg = 40.6s, dev = 26.1s //tensorflow/python/eager/polymorphic_function:gradients_test_cpu PASSED in 18.3s Stats over 5 runs: max = 18.3s, min = 10.8s, avg = 14.8s, dev = 2.8s //tensorflow/python/kernel_tests/linalg:cholesky_op_test_cpu PASSED in 116.5s Stats over 5 runs: max = 116.5s, min = 49.4s, avg = 72.5s, dev = 24.5s //tensorflow/python/kernel_tests/linalg:linear_operator_adjoint_test_cpu PASSED in 24.1s Stats over 5 runs: max = 24.1s, min = 22.0s, avg = 23.1s, dev = 0.8s //tensorflow/python/kernel_tests/linalg:linear_operator_composition_test_cpu PASSED in 37.1s Stats over 5 runs: max = 37.1s, min = 35.7s, avg = 36.4s, dev = 0.5s //tensorflow/python/kernel_tests/linalg:linear_operator_diag_test_cpu PASSED in 29.6s Stats over 5 runs: max = 29.6s, min = 22.1s, avg = 26.5s, dev = 2.6s //tensorflow/python/kernel_tests/linalg:linear_operator_full_matrix_test_cpu PASSED in 51.2s Stats over 5 runs: max = 51.2s, min = 34.1s, avg = 39.7s, dev = 6.4s //tensorflow/python/kernel_tests/linalg:linear_operator_householder_test_cpu PASSED in 24.9s Stats over 5 runs: max = 24.9s, min = 23.6s, avg = 24.2s, dev = 0.5s //tensorflow/python/kernel_tests/linalg:linear_operator_identity_test_cpu PASSED in 52.3s Stats over 5 runs: max = 52.3s, min = 43.3s, avg = 47.9s, dev = 3.0s //tensorflow/python/kernel_tests/linalg:linear_operator_inversion_test_cpu PASSED in 45.4s Stats over 5 runs: max = 45.4s, min = 42.7s, avg = 44.1s, dev = 1.0s //tensorflow/python/kernel_tests/linalg:linear_operator_permutation_test_cpu PASSED in 31.8s Stats over 5 runs: max = 31.8s, min = 30.1s, avg = 30.9s, dev = 0.6s //tensorflow/python/kernel_tests/linalg:linear_operator_toeplitz_test_cpu PASSED in 15.3s Stats over 5 runs: max = 15.3s, min = 13.2s, avg = 14.0s, dev = 0.7s //tensorflow/python/kernel_tests/linalg:linear_operator_tridiag_test_cpu PASSED in 101.8s Stats over 5 runs: max = 101.8s, min = 79.8s, avg = 90.8s, dev = 7.5s //tensorflow/python/kernel_tests/linalg:linear_operator_util_test_cpu PASSED in 8.3s Stats over 5 runs: max = 8.3s, min = 5.0s, avg = 6.6s, dev = 1.3s //tensorflow/python/kernel_tests/linalg:linear_operator_zeros_test_cpu PASSED in 18.0s Stats over 5 runs: max = 18.0s, min = 13.8s, avg = 15.1s, dev = 1.5s //tensorflow/python/kernel_tests/nn_ops:fractional_avg_pool_op_test PASSED in 16.4s Stats over 5 runs: max = 16.4s, min = 7.1s, avg = 10.0s, dev = 3.3s //tensorflow/python/kernel_tests/nn_ops:fractional_max_pool_op_test PASSED in 15.9s Stats over 5 runs: max = 15.9s, min = 6.3s, avg = 9.4s, dev = 3.4s //tensorflow/python/kernel_tests/sparse_ops:sparse_ops_test_cpu PASSED in 23.2s Stats over 5 runs: max = 23.2s, min = 7.0s, avg = 10.7s, dev = 6.3s //tensorflow/python/ops/parallel_for:math_test_cpu PASSED in 87.8s Stats over 5 runs: max = 87.8s, min = 27.0s, avg = 49.4s, dev = 21.6s //tensorflow/compiler/tests:scan_ops_test_cpu PASSED in 18.4s Stats over 6 runs: max = 18.4s, min = 12.9s, avg = 16.7s, dev = 1.8s //tensorflow/compiler/tests:scan_ops_test_cpu_mlir_bridge_test PASSED in 21.0s Stats over 6 runs: max = 21.0s, min = 11.5s, avg = 16.4s, dev = 2.9s //tensorflow/python/data/experimental/kernel_tests:make_batched_features_dataset_test PASSED in 34.4s Stats over 6 runs: max = 34.4s, min = 6.6s, avg = 16.0s, dev = 10.3s //tensorflow/python/kernel_tests/array_ops:diag_op_test_cpu PASSED in 52.3s Stats over 6 runs: max = 52.3s, min = 8.6s, avg = 18.2s, dev = 15.4s //tensorflow/python/kernel_tests/math_ops:reduction_ops_test_cpu PASSED in 60.4s Stats over 6 runs: max = 60.4s, min = 33.7s, avg = 46.0s, dev = 8.3s //tensorflow/python/ops:accumulate_n_benchmark_cpu PASSED in 7.1s Stats over 6 runs: max = 7.1s, min = 4.4s, avg = 5.4s, dev = 0.9s //tensorflow/python/distribute/experimental/rpc:rpc_ops_test PASSED in 11.9s Stats over 7 runs: max = 11.9s, min = 7.7s, avg = 9.1s, dev = 1.6s //tensorflow/compiler/tests:matrix_diag_ops_test_cpu PASSED in 60.6s Stats over 8 runs: max = 60.6s, min = 5.1s, avg = 24.0s, dev = 19.1s //tensorflow/compiler/tests:matrix_diag_ops_test_cpu_mlir_bridge_test PASSED in 111.0s Stats over 8 runs: max = 111.0s, min = 6.2s, avg = 41.6s, dev = 37.0s //tensorflow/dtensor/python/tests:input_util_test PASSED in 30.6s Stats over 8 runs: max = 30.6s, min = 16.8s, avg = 23.3s, dev = 4.3s //tensorflow/python/data/experimental/kernel_tests:csv_dataset_test PASSED in 41.5s Stats over 8 runs: max = 41.5s, min = 11.9s, avg = 21.8s, dev = 10.1s //tensorflow/python/data/experimental/kernel_tests:parallel_interleave_test PASSED in 34.1s Stats over 8 runs: max = 34.1s, min = 12.0s, avg = 23.5s, dev = 7.5s //tensorflow/python/data/experimental/kernel_tests/service:coordinated_read_ft_test PASSED in 38.3s Stats over 8 runs: max = 38.3s, min = 4.2s, avg = 21.1s, dev = 13.6s //tensorflow/python/data/experimental/kernel_tests/service:coordinated_read_test PASSED in 28.1s Stats over 8 runs: max = 28.1s, min = 8.0s, avg = 16.4s, dev = 8.3s //tensorflow/python/data/experimental/kernel_tests/service:cross_trainer_cache_test PASSED in 21.6s Stats over 8 runs: max = 21.6s, min = 5.9s, avg = 11.8s, dev = 5.9s //tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test PASSED in 24.0s Stats over 8 runs: max = 24.0s, min = 7.3s, avg = 10.9s, dev = 5.5s //tensorflow/python/data/kernel_tests:filter_test PASSED in 15.5s Stats over 8 runs: max = 15.5s, min = 11.1s, avg = 13.0s, dev = 1.3s //tensorflow/python/data/kernel_tests:flat_map_test PASSED in 27.2s Stats over 8 runs: max = 27.2s, min = 14.3s, avg = 19.0s, dev = 4.4s //tensorflow/python/data/kernel_tests:shard_test PASSED in 49.2s Stats over 8 runs: max = 49.2s, min = 26.1s, avg = 36.8s, dev = 8.4s //tensorflow/python/data/kernel_tests:shuffle_test PASSED in 55.4s Stats over 8 runs: max = 55.4s, min = 28.7s, avg = 32.6s, dev = 8.6s //tensorflow/python/data/kernel_tests:tf_record_dataset_test PASSED in 24.6s Stats over 8 runs: max = 24.6s, min = 10.9s, avg = 19.1s, dev = 3.9s //tensorflow/python/distribute/failure_handling:gce_failure_handler_test PASSED in 54.0s Stats over 8 runs: max = 54.0s, min = 10.4s, avg = 24.2s, dev = 17.4s //tensorflow/python/kernel_tests/linalg:linalg_ops_test_cpu PASSED in 53.0s Stats over 8 runs: max = 53.0s, min = 30.3s, avg = 42.0s, dev = 8.3s //tensorflow/python/kernel_tests/linalg:linear_operator_block_diag_test_cpu PASSED in 59.6s Stats over 8 runs: max = 59.6s, min = 45.1s, avg = 53.5s, dev = 5.5s //tensorflow/python/kernel_tests/linalg:linear_operator_block_lower_triangular_test_cpu PASSED in 48.7s Stats over 8 runs: max = 48.7s, min = 32.8s, avg = 38.8s, dev = 5.6s //tensorflow/python/kernel_tests/nn_ops:depthwise_conv_op_d9m_test_cpu PASSED in 95.8s Stats over 8 runs: max = 95.8s, min = 6.0s, avg = 24.2s, dev = 30.0s //tensorflow/python/kernel_tests/nn_ops:depthwise_conv_op_test_cpu PASSED in 7.6s Stats over 8 runs: max = 7.6s, min = 6.8s, avg = 7.2s, dev = 0.2s //tensorflow/python/kernel_tests/signal:fft_ops_test_cpu PASSED in 21.5s Stats over 8 runs: max = 21.5s, min = 8.4s, avg = 13.6s, dev = 5.1s //tensorflow/python/ops/ragged:dynamic_ragged_shape_test PASSED in 63.6s Stats over 8 runs: max = 63.6s, min = 30.5s, avg = 39.1s, dev = 10.2s //tensorflow/python/ops/ragged:ragged_tensor_test PASSED in 22.9s Stats over 8 runs: max = 22.9s, min = 10.2s, avg = 14.0s, dev = 3.6s //tensorflow/python/distribute/failure_handling:failure_handler_test FLAKY, failed in 1 out of 9 in 56.8s Stats over 9 runs: max = 56.8s, min = 29.1s, avg = 46.4s, dev = 8.6s /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/distribute/failure_handling/failure_handler_test/shard_2_of_8/test_attempts/attempt_1.log //tensorflow/compiler/tests:bincount_op_test_cpu PASSED in 13.1s Stats over 10 runs: max = 13.1s, min = 10.8s, avg = 11.7s, dev = 0.7s //tensorflow/compiler/tests:conv2d_test_cpu PASSED in 8.1s Stats over 10 runs: max = 8.1s, min = 6.3s, avg = 7.3s, dev = 0.5s //tensorflow/compiler/tests:conv2d_test_cpu_mlir_bridge_test PASSED in 8.4s Stats over 10 runs: max = 8.4s, min = 4.8s, avg = 7.5s, dev = 1.1s //tensorflow/compiler/tests:random_ops_test_cpu PASSED in 11.8s Stats over 10 runs: max = 11.8s, min = 4.6s, avg = 8.4s, dev = 2.2s //tensorflow/compiler/tests:random_ops_test_cpu_mlir_bridge_test PASSED in 13.5s Stats over 10 runs: max = 13.5s, min = 5.2s, avg = 9.5s, dev = 2.5s //tensorflow/compiler/tests:stateless_random_ops_test_cpu PASSED in 80.9s Stats over 10 runs: max = 80.9s, min = 44.9s, avg = 64.2s, dev = 12.5s //tensorflow/compiler/tests:stateless_random_ops_test_cpu_mlir_bridge_test PASSED in 61.6s Stats over 10 runs: max = 61.6s, min = 37.7s, avg = 51.0s, dev = 8.8s //tensorflow/compiler/xla/client/lib:svd_test_cpu PASSED in 96.4s Stats over 10 runs: max = 96.4s, min = 8.1s, avg = 31.8s, dev = 31.5s //tensorflow/compiler/xla/client/lib:tridiagonal_test_cpu PASSED in 8.7s Stats over 10 runs: max = 8.7s, min = 7.9s, avg = 8.3s, dev = 0.2s //tensorflow/compiler/xla/service/cpu:cpu_runtime_test PASSED in 17.0s Stats over 10 runs: max = 17.0s, min = 0.8s, avg = 12.2s, dev = 5.7s //tensorflow/python/data/kernel_tests:rejection_resample_test PASSED in 25.9s Stats over 10 runs: max = 25.9s, min = 8.5s, avg = 13.2s, dev = 4.9s //tensorflow/python/distribute:input_lib_type_spec_test_2gpu PASSED in 25.3s Stats over 10 runs: max = 25.3s, min = 10.8s, avg = 17.3s, dev = 5.4s //tensorflow/python/distribute:input_lib_type_spec_test_cpu PASSED in 16.6s Stats over 10 runs: max = 16.6s, min = 8.5s, avg = 12.0s, dev = 3.0s //tensorflow/python/framework:config_vgpu_test_2gpu PASSED in 6.7s Stats over 10 runs: max = 6.7s, min = 5.3s, avg = 5.9s, dev = 0.5s //tensorflow/python/framework:config_vgpu_test_cpu PASSED in 6.3s Stats over 10 runs: max = 6.3s, min = 6.1s, avg = 6.2s, dev = 0.0s //tensorflow/python/framework:function_test_cpu PASSED in 64.4s Stats over 10 runs: max = 64.4s, min = 7.5s, avg = 14.4s, dev = 16.8s //tensorflow/python/grappler:cluster_test_cpu PASSED in 8.7s Stats over 10 runs: max = 8.7s, min = 3.3s, avg = 6.0s, dev = 1.8s //tensorflow/python/kernel_tests/array_ops:array_ops_test_cpu PASSED in 16.7s Stats over 10 runs: max = 16.7s, min = 8.3s, avg = 11.4s, dev = 2.1s //tensorflow/python/kernel_tests/array_ops:inplace_ops_test_cpu PASSED in 8.1s Stats over 10 runs: max = 8.1s, min = 3.8s, avg = 5.5s, dev = 1.4s //tensorflow/python/kernel_tests/data_structures:tensor_array_ops_test_cpu PASSED in 11.7s Stats over 10 runs: max = 11.7s, min = 6.1s, avg = 8.0s, dev = 1.6s //tensorflow/python/kernel_tests/linalg:linear_operator_low_rank_update_test_cpu PASSED in 118.9s Stats over 10 runs: max = 118.9s, min = 103.2s, avg = 111.6s, dev = 5.2s //tensorflow/python/kernel_tests/linalg:tridiagonal_matmul_op_test_cpu PASSED in 123.4s Stats over 10 runs: max = 123.4s, min = 4.2s, avg = 18.0s, dev = 35.1s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_ops_test_cpu PASSED in 47.6s Stats over 10 runs: max = 47.6s, min = 10.5s, avg = 32.2s, dev = 12.4s //tensorflow/python/kernel_tests/math_ops:segment_reduction_ops_test_cpu PASSED in 29.3s Stats over 10 runs: max = 29.3s, min = 6.5s, avg = 15.4s, dev = 8.8s //tensorflow/python/kernel_tests/nn_ops:pooling_ops_test_cpu PASSED in 31.8s Stats over 10 runs: max = 31.8s, min = 7.3s, avg = 13.9s, dev = 9.0s //tensorflow/python/kernel_tests/nn_ops:rnn_test_cpu PASSED in 16.3s Stats over 10 runs: max = 16.3s, min = 7.4s, avg = 12.6s, dev = 2.9s //tensorflow/python/kernel_tests/random:random_index_shuffle_test PASSED in 9.7s Stats over 10 runs: max = 9.7s, min = 5.6s, avg = 7.2s, dev = 1.2s //tensorflow/python/kernel_tests/random:stateless_random_ops_test_cpu PASSED in 161.9s Stats over 10 runs: max = 161.9s, min = 23.6s, avg = 89.8s, dev = 63.7s //tensorflow/python/ops:special_math_ops_test_cpu PASSED in 59.9s Stats over 10 runs: max = 59.9s, min = 9.1s, avg = 18.0s, dev = 15.0s //tensorflow/python/ops/numpy_ops/tests:np_indexing_test PASSED in 98.5s Stats over 10 runs: max = 98.5s, min = 82.2s, avg = 90.2s, dev = 5.4s //tensorflow/python/ops/ragged:ragged_tensor_supported_values_test PASSED in 16.1s Stats over 10 runs: max = 16.1s, min = 14.1s, avg = 15.5s, dev = 0.5s //tensorflow/python/saved_model:load_test_cpu PASSED in 36.7s Stats over 10 runs: max = 36.7s, min = 23.8s, avg = 27.6s, dev = 3.7s //tensorflow/compiler/tests:fft_test_cpu PASSED in 23.8s Stats over 12 runs: max = 23.8s, min = 7.8s, avg = 15.3s, dev = 6.4s //tensorflow/compiler/xla/service:triangular_solve_expander_test PASSED in 9.3s Stats over 12 runs: max = 9.3s, min = 1.8s, avg = 5.1s, dev = 1.9s //tensorflow/python/data/experimental/kernel_tests:group_by_reducer_test PASSED in 19.6s Stats over 12 runs: max = 19.6s, min = 5.1s, avg = 10.8s, dev = 4.7s //tensorflow/python/data/kernel_tests:choose_from_datasets_test PASSED in 11.7s Stats over 12 runs: max = 11.7s, min = 7.0s, avg = 9.0s, dev = 1.5s //tensorflow/python/data/kernel_tests:memory_cleanup_test_cpu PASSED in 16.5s Stats over 12 runs: max = 16.5s, min = 5.5s, avg = 10.1s, dev = 3.5s //tensorflow/python/distribute:multi_process_runner_test_2gpu PASSED in 224.9s Stats over 12 runs: max = 224.9s, min = 12.4s, avg = 49.0s, dev = 58.6s //tensorflow/python/distribute:multi_process_runner_test_cpu PASSED in 236.5s Stats over 12 runs: max = 236.5s, min = 25.4s, avg = 62.8s, dev = 58.4s //tensorflow/python/eager/polymorphic_function:polymorphic_function_test_cpu PASSED in 15.8s Stats over 15 runs: max = 15.8s, min = 12.7s, avg = 14.1s, dev = 0.9s //tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test_cpu PASSED in 63.3s Stats over 15 runs: max = 63.3s, min = 55.3s, avg = 59.3s, dev = 2.2s //tensorflow/python/kernel_tests/nn_ops:rnn_cell_test_cpu PASSED in 39.3s Stats over 15 runs: max = 39.3s, min = 9.7s, avg = 13.8s, dev = 7.5s //tensorflow/compiler/tests:ftrl_test_cpu PASSED in 8.4s Stats over 16 runs: max = 8.4s, min = 3.1s, avg = 5.5s, dev = 1.5s //tensorflow/compiler/tests:ternary_ops_test_cpu PASSED in 9.8s Stats over 16 runs: max = 9.8s, min = 3.4s, avg = 6.6s, dev = 1.7s //tensorflow/compiler/tests:ternary_ops_test_cpu_mlir_bridge_test PASSED in 14.9s Stats over 16 runs: max = 14.9s, min = 7.0s, avg = 9.2s, dev = 1.9s //tensorflow/python/data/experimental/kernel_tests/service:dynamic_sharding_test PASSED in 23.6s Stats over 16 runs: max = 23.6s, min = 6.7s, avg = 13.8s, dev = 5.5s //tensorflow/python/data/experimental/kernel_tests/service:worker_tags_test PASSED in 17.2s Stats over 16 runs: max = 17.2s, min = 6.3s, avg = 11.9s, dev = 3.7s //tensorflow/python/kernel_tests/control_flow:control_flow_ops_py_test_cpu PASSED in 28.4s Stats over 16 runs: max = 28.4s, min = 4.6s, avg = 9.0s, dev = 5.3s //tensorflow/python/kernel_tests/linalg:matrix_exponential_op_test PASSED in 9.4s Stats over 16 runs: max = 9.4s, min = 4.1s, avg = 6.2s, dev = 1.7s //tensorflow/python/kernel_tests/signal:dct_ops_test_cpu PASSED in 10.9s Stats over 16 runs: max = 10.9s, min = 7.9s, avg = 9.3s, dev = 0.9s //tensorflow/python/ops:image_ops_test_cpu PASSED in 15.8s Stats over 16 runs: max = 15.8s, min = 9.8s, avg = 12.2s, dev = 2.0s //tensorflow/python/data/experimental/kernel_tests/service:distributed_save_ft_test PASSED in 19.4s Stats over 17 runs: max = 19.4s, min = 4.3s, avg = 10.0s, dev = 3.7s //tensorflow/python/data/kernel_tests:snapshot_test FLAKY, failed in 1 out of 17 in 23.9s Stats over 17 runs: max = 23.9s, min = 8.5s, avg = 14.9s, dev = 3.8s /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/data/kernel_tests/snapshot_test/shard_6_of_16/test_attempts/attempt_1.log //tensorflow/python/data/kernel_tests:map_test PASSED in 38.8s Stats over 19 runs: max = 38.8s, min = 12.1s, avg = 18.0s, dev = 5.9s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 7.6s Stats over 20 runs: max = 7.6s, min = 3.9s, avg = 5.5s, dev = 1.3s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 9.2s Stats over 20 runs: max = 9.2s, min = 3.3s, avg = 6.0s, dev = 1.5s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 11.2s Stats over 20 runs: max = 11.2s, min = 3.0s, avg = 5.8s, dev = 2.0s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 12.9s Stats over 20 runs: max = 12.9s, min = 4.2s, avg = 6.6s, dev = 1.9s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 13.4s Stats over 20 runs: max = 13.4s, min = 8.2s, avg = 10.3s, dev = 1.6s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 13.5s Stats over 20 runs: max = 13.5s, min = 10.9s, avg = 12.3s, dev = 0.7s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 22.0s Stats over 20 runs: max = 22.0s, min = 14.5s, avg = 18.2s, dev = 2.3s //tensorflow/compiler/xla/tests:prng_test_cpu PASSED in 12.1s Stats over 20 runs: max = 12.1s, min = 10.6s, avg = 11.1s, dev = 0.4s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 47.3s Stats over 20 runs: max = 47.3s, min = 8.9s, avg = 20.0s, dev = 11.9s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 18.1s Stats over 20 runs: max = 18.1s, min = 10.8s, avg = 14.3s, dev = 2.5s //tensorflow/python/kernel_tests:metrics_test PASSED in 45.1s Stats over 20 runs: max = 45.1s, min = 9.0s, avg = 20.5s, dev = 9.9s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 7.3s Stats over 20 runs: max = 7.3s, min = 3.2s, avg = 5.3s, dev = 1.4s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 15.7s Stats over 20 runs: max = 15.7s, min = 5.3s, avg = 7.9s, dev = 2.8s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 46.4s Stats over 20 runs: max = 46.4s, min = 4.9s, avg = 16.8s, dev = 15.3s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 175.9s Stats over 20 runs: max = 175.9s, min = 39.1s, avg = 88.9s, dev = 37.5s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 9.4s Stats over 20 runs: max = 9.4s, min = 3.4s, avg = 6.4s, dev = 1.7s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 12.2s Stats over 20 runs: max = 12.2s, min = 7.5s, avg = 10.1s, dev = 1.7s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 280.3s Stats over 20 runs: max = 280.3s, min = 31.1s, avg = 119.5s, dev = 69.9s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 23.6s Stats over 20 runs: max = 23.6s, min = 4.7s, avg = 11.5s, dev = 6.3s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 30.8s Stats over 20 runs: max = 30.8s, min = 8.5s, avg = 17.1s, dev = 7.8s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 22.4s Stats over 20 runs: max = 22.4s, min = 15.6s, avg = 18.3s, dev = 2.0s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 91.9s Stats over 20 runs: max = 91.9s, min = 8.8s, avg = 34.2s, dev = 26.4s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 21.0s Stats over 20 runs: max = 21.0s, min = 10.5s, avg = 13.0s, dev = 2.2s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 28.8s Stats over 24 runs: max = 28.8s, min = 10.8s, avg = 21.0s, dev = 5.4s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 32.6s Stats over 24 runs: max = 32.6s, min = 9.5s, avg = 19.2s, dev = 6.2s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 24.8s Stats over 24 runs: max = 24.8s, min = 4.0s, avg = 10.8s, dev = 6.0s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 10.8s Stats over 25 runs: max = 10.8s, min = 7.9s, avg = 9.5s, dev = 0.9s //tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 46.1s Stats over 25 runs: max = 46.1s, min = 8.4s, avg = 15.5s, dev = 8.8s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 15.1s Stats over 30 runs: max = 15.1s, min = 8.9s, avg = 11.7s, dev = 1.5s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 28.4s Stats over 30 runs: max = 28.4s, min = 13.4s, avg = 16.9s, dev = 3.2s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 11.8s Stats over 30 runs: max = 11.8s, min = 9.2s, avg = 10.0s, dev = 0.5s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 10.6s Stats over 30 runs: max = 10.6s, min = 8.9s, avg = 9.8s, dev = 0.5s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 31.8s Stats over 30 runs: max = 31.8s, min = 3.5s, avg = 16.0s, dev = 8.6s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 11.6s Stats over 31 runs: max = 11.6s, min = 9.9s, avg = 10.7s, dev = 0.4s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 18.3s Stats over 32 runs: max = 18.3s, min = 8.2s, avg = 12.3s, dev = 2.6s //tensorflow/python/data/experimental/kernel_tests/service:auto_shard_test PASSED in 15.8s Stats over 32 runs: max = 15.8s, min = 4.0s, avg = 10.9s, dev = 2.8s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 18.7s Stats over 32 runs: max = 18.7s, min = 4.0s, avg = 8.8s, dev = 3.5s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 12.3s Stats over 40 runs: max = 12.3s, min = 8.4s, avg = 10.2s, dev = 0.9s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 15.0s Stats over 40 runs: max = 15.0s, min = 8.4s, avg = 10.5s, dev = 1.5s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 13.9s Stats over 40 runs: max = 13.9s, min = 8.1s, avg = 9.8s, dev = 1.6s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 14.7s Stats over 40 runs: max = 14.7s, min = 10.5s, avg = 12.0s, dev = 0.9s //tensorflow/core/kernels:stochastic_cast_op_test PASSED in 1.7s Stats over 48 runs: max = 1.7s, min = 0.4s, avg = 0.6s, dev = 0.3s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 61.5s Stats over 50 runs: max = 61.5s, min = 21.0s, avg = 37.2s, dev = 10.4s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 57.3s Stats over 50 runs: max = 57.3s, min = 3.2s, avg = 16.6s, dev = 11.1s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 37.7s Stats over 50 runs: max = 37.7s, min = 3.0s, avg = 10.1s, dev = 7.7s //tensorflow/compiler/tests:unary_ops_test_cpu PASSED in 15.0s Stats over 50 runs: max = 15.0s, min = 2.8s, avg = 5.0s, dev = 2.4s //tensorflow/compiler/tests:unary_ops_test_cpu_mlir_bridge_test PASSED in 28.8s Stats over 50 runs: max = 28.8s, min = 3.0s, avg = 6.0s, dev = 4.7s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 19.9s Stats over 50 runs: max = 19.9s, min = 9.0s, avg = 12.9s, dev = 2.1s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 16.4s Stats over 50 runs: max = 16.4s, min = 11.6s, avg = 14.5s, dev = 1.0s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 18.7s Stats over 50 runs: max = 18.7s, min = 12.8s, avg = 15.6s, dev = 1.5s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 17.8s Stats over 50 runs: max = 17.8s, min = 5.4s, avg = 10.6s, dev = 3.4s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 7.9s Stats over 50 runs: max = 7.9s, min = 2.9s, avg = 3.6s, dev = 0.9s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 7.2s Stats over 50 runs: max = 7.2s, min = 3.1s, avg = 4.6s, dev = 1.3s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 28.5s Stats over 50 runs: max = 28.5s, min = 6.9s, avg = 15.0s, dev = 5.5s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 8.9s Stats over 50 runs: max = 8.9s, min = 3.2s, avg = 5.1s, dev = 1.6s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 13.7s Stats over 50 runs: max = 13.7s, min = 3.2s, avg = 5.5s, dev = 2.3s Executed 3769 out of 3769 tests: 3768 tests pass and 1 fails locally. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are.