==================== Test output for //tensorflow/python/kernel_tests/proto:decode_proto_op_test: 2023-02-19 03:50:45.884327: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. Running tests under Python 3.9.16: /usr/bin/python3 [ RUN ] DecodeProtoOpTest.testBinaryDisordereddefaults 2023-02-19 03:50:50.172409: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.286239: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.301862: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisordereddefaults): 0.16s I0219 03:50:50.330958 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisordereddefaults): 0.16s [ FAILED ] DecodeProtoOpTest.testBinaryDisordereddefaults [ RUN ] DecodeProtoOpTest.testBinaryDisorderedextension 2023-02-19 03:50:50.334737: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.336837: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedextension): 0.01s I0219 03:50:50.338608 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedextension): 0.01s [ OK ] DecodeProtoOpTest.testBinaryDisorderedextension [ RUN ] DecodeProtoOpTest.testBinaryDisorderedminmax 2023-02-19 03:50:50.340948: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.343438: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedminmax): 0.01s I0219 03:50:50.346105 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedminmax): 0.01s [ FAILED ] DecodeProtoOpTest.testBinaryDisorderedminmax [ RUN ] DecodeProtoOpTest.testBinaryDisorderednested 2023-02-19 03:50:50.349333: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.351440: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderednested): 0.01s I0219 03:50:50.353242 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderednested): 0.01s [ OK ] DecodeProtoOpTest.testBinaryDisorderednested [ RUN ] DecodeProtoOpTest.testBinaryDisorderedoptional 2023-02-19 03:50:50.355687: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.358029: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedoptional): 0.01s I0219 03:50:50.359912 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedoptional): 0.01s [ FAILED ] DecodeProtoOpTest.testBinaryDisorderedoptional [ RUN ] DecodeProtoOpTest.testBinaryDisorderedpromote 2023-02-19 03:50:50.362973: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.365426: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedpromote): 0.01s I0219 03:50:50.367599 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedpromote): 0.01s [ FAILED ] DecodeProtoOpTest.testBinaryDisorderedpromote [ RUN ] DecodeProtoOpTest.testBinaryDisorderedragged 2023-02-19 03:50:50.370641: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.372842: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedragged): 0.01s I0219 03:50:50.374695 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedragged): 0.01s [ FAILED ] DecodeProtoOpTest.testBinaryDisorderedragged [ RUN ] DecodeProtoOpTest.testBinaryDisorderedshaped_batch 2023-02-19 03:50:50.377665: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.379816: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedshaped_batch): 0.01s I0219 03:50:50.381822 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedshaped_batch): 0.01s [ FAILED ] DecodeProtoOpTest.testBinaryDisorderedshaped_batch [ RUN ] DecodeProtoOpTest.testBinaryDisorderedsimple 2023-02-19 03:50:50.384841: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.387215: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedsimple): 0.01s I0219 03:50:50.389097 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedsimple): 0.01s [ FAILED ] DecodeProtoOpTest.testBinaryDisorderedsimple [ RUN ] DecodeProtoOpTest.testBinarydefaults 2023-02-19 03:50:50.392036: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.394824: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinarydefaults): 0.01s I0219 03:50:50.397771 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinarydefaults): 0.01s [ FAILED ] DecodeProtoOpTest.testBinarydefaults [ RUN ] DecodeProtoOpTest.testBinaryextension 2023-02-19 03:50:50.401039: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.403464: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryextension): 0.01s I0219 03:50:50.405219 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryextension): 0.01s [ OK ] DecodeProtoOpTest.testBinaryextension [ RUN ] DecodeProtoOpTest.testBinaryminmax 2023-02-19 03:50:50.407613: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.410217: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryminmax): 0.01s I0219 03:50:50.412853 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryminmax): 0.01s [ FAILED ] DecodeProtoOpTest.testBinaryminmax [ RUN ] DecodeProtoOpTest.testBinarynested 2023-02-19 03:50:50.415798: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.418133: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinarynested): 0.01s I0219 03:50:50.419883 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinarynested): 0.01s [ OK ] DecodeProtoOpTest.testBinarynested [ RUN ] DecodeProtoOpTest.testBinaryoptional 2023-02-19 03:50:50.422145: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.424273: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryoptional): 0.01s I0219 03:50:50.426052 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryoptional): 0.01s [ FAILED ] DecodeProtoOpTest.testBinaryoptional [ RUN ] DecodeProtoOpTest.testBinarypromote 2023-02-19 03:50:50.429054: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.431583: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinarypromote): 0.01s I0219 03:50:50.433787 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinarypromote): 0.01s [ FAILED ] DecodeProtoOpTest.testBinarypromote [ RUN ] DecodeProtoOpTest.testBinaryragged 2023-02-19 03:50:50.436845: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.439377: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryragged): 0.01s I0219 03:50:50.441297 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryragged): 0.01s [ FAILED ] DecodeProtoOpTest.testBinaryragged [ RUN ] DecodeProtoOpTest.testBinaryshaped_batch 2023-02-19 03:50:50.444336: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.446818: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryshaped_batch): 0.01s I0219 03:50:50.448797 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryshaped_batch): 0.01s [ FAILED ] DecodeProtoOpTest.testBinaryshaped_batch [ RUN ] DecodeProtoOpTest.testBinarysimple 2023-02-19 03:50:50.451755: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.454102: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinarysimple): 0.01s I0219 03:50:50.456007 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinarysimple): 0.01s [ FAILED ] DecodeProtoOpTest.testBinarysimple [ RUN ] DecodeProtoOpTest.testCorruptProtobuf0 (False) 2023-02-19 03:50:50.459498: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.461829: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.462848: W tensorflow/core/framework/op_kernel.cc:1830] OP_REQUIRES failed at decode_proto_op.cc:853 : DATA_LOSS: CountFields: Failed to consume entire buffer INFO:tensorflow:time(__main__.DecodeProtoOpTest.testCorruptProtobuf0 (False)): 0.01s I0219 03:50:50.463242 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testCorruptProtobuf0 (False)): 0.01s [ OK ] DecodeProtoOpTest.testCorruptProtobuf0 (False) [ RUN ] DecodeProtoOpTest.testCorruptProtobuf1 (True) 2023-02-19 03:50:50.465448: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.467347: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testCorruptProtobuf1 (True)): 0.0s I0219 03:50:50.468489 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testCorruptProtobuf1 (True)): 0.0s [ OK ] DecodeProtoOpTest.testCorruptProtobuf1 (True) [ RUN ] DecodeProtoOpTest.testOutOfOrderRepeated 2023-02-19 03:50:50.470803: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.472462: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.474796: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.489166: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testOutOfOrderRepeated): 0.03s I0219 03:50:50.502390 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testOutOfOrderRepeated): 0.03s [ OK ] DecodeProtoOpTest.testOutOfOrderRepeated [ RUN ] DecodeProtoOpTest.testPackeddefaults 2023-02-19 03:50:50.505071: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.518388: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackeddefaults): 0.03s I0219 03:50:50.537879 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackeddefaults): 0.03s [ FAILED ] DecodeProtoOpTest.testPackeddefaults [ RUN ] DecodeProtoOpTest.testPackedminmax 2023-02-19 03:50:50.542617: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.545058: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackedminmax): 0.01s I0219 03:50:50.547766 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackedminmax): 0.01s [ FAILED ] DecodeProtoOpTest.testPackedminmax [ RUN ] DecodeProtoOpTest.testPackednested 2023-02-19 03:50:50.550705: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.560773: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackednested): 0.01s I0219 03:50:50.562506 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackednested): 0.01s [ OK ] DecodeProtoOpTest.testPackednested [ RUN ] DecodeProtoOpTest.testPackedoptional 2023-02-19 03:50:50.564873: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.566951: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackedoptional): 0.01s I0219 03:50:50.568619 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackedoptional): 0.01s [ FAILED ] DecodeProtoOpTest.testPackedoptional [ RUN ] DecodeProtoOpTest.testPackedpromote 2023-02-19 03:50:50.571481: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.758140: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackedpromote): 0.19s I0219 03:50:50.760118 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackedpromote): 0.19s [ FAILED ] DecodeProtoOpTest.testPackedpromote [ RUN ] DecodeProtoOpTest.testPackedragged 2023-02-19 03:50:50.763132: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.764896: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackedragged): 0.0s I0219 03:50:50.766347 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackedragged): 0.0s [ FAILED ] DecodeProtoOpTest.testPackedragged [ RUN ] DecodeProtoOpTest.testPackedshaped_batch 2023-02-19 03:50:50.769285: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.770871: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackedshaped_batch): 0.0s I0219 03:50:50.772234 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackedshaped_batch): 0.0s [ FAILED ] DecodeProtoOpTest.testPackedshaped_batch [ RUN ] DecodeProtoOpTest.testPackedsimple 2023-02-19 03:50:50.774423: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.776038: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackedsimple): 0.0s I0219 03:50:50.777444 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackedsimple): 0.0s [ FAILED ] DecodeProtoOpTest.testPackedsimple [ RUN ] DecodeProtoOpTest.testSanitizerGooddefaults 2023-02-19 03:50:50.779388: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.781431: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGooddefaults): 0.01s I0219 03:50:50.783742 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGooddefaults): 0.01s [ FAILED ] DecodeProtoOpTest.testSanitizerGooddefaults [ RUN ] DecodeProtoOpTest.testSanitizerGoodextension 2023-02-19 03:50:50.785752: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.818111: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodextension): 0.04s I0219 03:50:50.819941 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodextension): 0.04s [ OK ] DecodeProtoOpTest.testSanitizerGoodextension [ RUN ] DecodeProtoOpTest.testSanitizerGoodminmax 2023-02-19 03:50:50.822152: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.824473: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodminmax): 0.01s I0219 03:50:50.827085 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodminmax): 0.01s [ FAILED ] DecodeProtoOpTest.testSanitizerGoodminmax [ RUN ] DecodeProtoOpTest.testSanitizerGoodnested 2023-02-19 03:50:50.829563: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.831217: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodnested): 0.0s I0219 03:50:50.832598 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodnested): 0.0s [ OK ] DecodeProtoOpTest.testSanitizerGoodnested [ RUN ] DecodeProtoOpTest.testSanitizerGoodoptional 2023-02-19 03:50:50.834297: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.835836: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodoptional): 0.0s I0219 03:50:50.837219 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodoptional): 0.0s [ FAILED ] DecodeProtoOpTest.testSanitizerGoodoptional [ RUN ] DecodeProtoOpTest.testSanitizerGoodpromote 2023-02-19 03:50:50.839276: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.840920: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodpromote): 0.0s I0219 03:50:50.842486 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodpromote): 0.0s [ FAILED ] DecodeProtoOpTest.testSanitizerGoodpromote [ RUN ] DecodeProtoOpTest.testSanitizerGoodragged 2023-02-19 03:50:50.844468: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.846008: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodragged): 0.0s I0219 03:50:50.847401 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodragged): 0.0s [ FAILED ] DecodeProtoOpTest.testSanitizerGoodragged [ RUN ] DecodeProtoOpTest.testSanitizerGoodshaped_batch 2023-02-19 03:50:50.849395: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.850942: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodshaped_batch): 0.0s I0219 03:50:50.852500 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodshaped_batch): 0.0s [ FAILED ] DecodeProtoOpTest.testSanitizerGoodshaped_batch [ RUN ] DecodeProtoOpTest.testSanitizerGoodsimple 2023-02-19 03:50:50.854446: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.856021: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodsimple): 0.0s I0219 03:50:50.857506 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodsimple): 0.0s [ FAILED ] DecodeProtoOpTest.testSanitizerGoodsimple [ RUN ] DecodeProtoOpTest.testTextdefaults 2023-02-19 03:50:50.859668: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.861762: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextdefaults): 0.01s I0219 03:50:50.864179 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextdefaults): 0.01s [ FAILED ] DecodeProtoOpTest.testTextdefaults [ RUN ] DecodeProtoOpTest.testTextextension 2023-02-19 03:50:50.868551: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.870096: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextextension): 0.01s I0219 03:50:50.871534 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextextension): 0.01s [ OK ] DecodeProtoOpTest.testTextextension [ RUN ] DecodeProtoOpTest.testTextminmax 2023-02-19 03:50:50.873608: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.875548: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextminmax): 0.01s I0219 03:50:50.877952 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextminmax): 0.01s [ FAILED ] DecodeProtoOpTest.testTextminmax [ RUN ] DecodeProtoOpTest.testTextnested 2023-02-19 03:50:50.880366: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.881959: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextnested): 0.0s I0219 03:50:50.883493 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextnested): 0.0s [ OK ] DecodeProtoOpTest.testTextnested [ RUN ] DecodeProtoOpTest.testTextoptional 2023-02-19 03:50:50.885408: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.887226: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextoptional): 0.0s I0219 03:50:50.888826 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextoptional): 0.0s [ FAILED ] DecodeProtoOpTest.testTextoptional [ RUN ] DecodeProtoOpTest.testTextpromote 2023-02-19 03:50:50.891521: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.896459: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextpromote): 0.01s I0219 03:50:50.898446 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextpromote): 0.01s [ FAILED ] DecodeProtoOpTest.testTextpromote [ RUN ] DecodeProtoOpTest.testTextragged 2023-02-19 03:50:50.901190: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.903092: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextragged): 0.0s I0219 03:50:50.904665 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextragged): 0.0s [ FAILED ] DecodeProtoOpTest.testTextragged [ RUN ] DecodeProtoOpTest.testTextshaped_batch 2023-02-19 03:50:50.907229: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.909041: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextshaped_batch): 0.0s I0219 03:50:50.910724 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextshaped_batch): 0.0s [ FAILED ] DecodeProtoOpTest.testTextshaped_batch [ RUN ] DecodeProtoOpTest.testTextsimple 2023-02-19 03:50:50.913220: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 2023-02-19 03:50:50.915011: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x40d7a320, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextsimple): 0.0s I0219 03:50:50.916665 281473705800576 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextsimple): 0.0s [ FAILED ] DecodeProtoOpTest.testTextsimple [ RUN ] DecodeProtoOpTest.test_session [ SKIPPED ] DecodeProtoOpTest.test_session ====================================================================== ERROR: testBinaryDisordereddefaults (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisordereddefaults testBinaryDisordereddefaults(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryDisorderedminmax (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisorderedminmax testBinaryDisorderedminmax(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryDisorderedoptional (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisorderedoptional testBinaryDisorderedoptional(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryDisorderedpromote (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisorderedpromote testBinaryDisorderedpromote(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryDisorderedragged (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisorderedragged testBinaryDisorderedragged(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryDisorderedshaped_batch (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisorderedshaped_batch testBinaryDisorderedshaped_batch(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryDisorderedsimple (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisorderedsimple testBinaryDisorderedsimple(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinarydefaults (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinarydefaults testBinarydefaults(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryminmax (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryminmax testBinaryminmax(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryoptional (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryoptional testBinaryoptional(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinarypromote (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinarypromote testBinarypromote(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryragged (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryragged testBinaryragged(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryshaped_batch (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryshaped_batch testBinaryshaped_batch(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinarysimple (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinarysimple testBinarysimple(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackeddefaults (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackeddefaults testPackeddefaults(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackedminmax (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackedminmax testPackedminmax(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackedoptional (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackedoptional testPackedoptional(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackedpromote (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackedpromote testPackedpromote(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackedragged (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackedragged testPackedragged(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackedshaped_batch (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackedshaped_batch testPackedshaped_batch(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackedsimple (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackedsimple testPackedsimple(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGooddefaults (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGooddefaults testSanitizerGooddefaults(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGoodminmax (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGoodminmax testSanitizerGoodminmax(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGoodoptional (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGoodoptional testSanitizerGoodoptional(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGoodpromote (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGoodpromote testSanitizerGoodpromote(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGoodragged (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGoodragged testSanitizerGoodragged(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGoodshaped_batch (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGoodshaped_batch testSanitizerGoodshaped_batch(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGoodsimple (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGoodsimple testSanitizerGoodsimple(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextdefaults (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextdefaults testTextdefaults(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextminmax (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextminmax testTextminmax(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextoptional (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextoptional testTextoptional(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextpromote (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextpromote testTextpromote(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextragged (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextragged testTextragged(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextshaped_batch (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextshaped_batch testTextshaped_batch(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextsimple (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextsimple testTextsimple(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ---------------------------------------------------------------------- Ran 48 tests in 0.752s FAILED (errors=35, skipped=1) ================================================================================ ==================== Test output for //tensorflow/python/kernel_tests/proto:decode_proto_op_test: 2023-02-19 03:50:52.888541: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. Running tests under Python 3.9.16: /usr/bin/python3 [ RUN ] DecodeProtoOpTest.testBinaryDisordereddefaults 2023-02-19 03:50:54.601786: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.654598: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.661808: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisordereddefaults): 0.08s I0219 03:50:54.670721 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisordereddefaults): 0.08s [ FAILED ] DecodeProtoOpTest.testBinaryDisordereddefaults [ RUN ] DecodeProtoOpTest.testBinaryDisorderedextension 2023-02-19 03:50:54.674275: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.676820: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedextension): 0.01s I0219 03:50:54.678467 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedextension): 0.01s [ OK ] DecodeProtoOpTest.testBinaryDisorderedextension [ RUN ] DecodeProtoOpTest.testBinaryDisorderedminmax 2023-02-19 03:50:54.680430: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.682939: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedminmax): 0.01s I0219 03:50:54.685307 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedminmax): 0.01s [ FAILED ] DecodeProtoOpTest.testBinaryDisorderedminmax [ RUN ] DecodeProtoOpTest.testBinaryDisorderednested 2023-02-19 03:50:54.687763: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.689748: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderednested): 0.0s I0219 03:50:54.691246 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderednested): 0.0s [ OK ] DecodeProtoOpTest.testBinaryDisorderednested [ RUN ] DecodeProtoOpTest.testBinaryDisorderedoptional 2023-02-19 03:50:54.693037: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.694891: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedoptional): 0.0s I0219 03:50:54.696383 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedoptional): 0.0s [ FAILED ] DecodeProtoOpTest.testBinaryDisorderedoptional [ RUN ] DecodeProtoOpTest.testBinaryDisorderedpromote 2023-02-19 03:50:54.698611: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.700489: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedpromote): 0.0s I0219 03:50:54.702123 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedpromote): 0.0s [ FAILED ] DecodeProtoOpTest.testBinaryDisorderedpromote [ RUN ] DecodeProtoOpTest.testBinaryDisorderedragged 2023-02-19 03:50:54.704464: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.706327: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedragged): 0.0s I0219 03:50:54.707882 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedragged): 0.0s [ FAILED ] DecodeProtoOpTest.testBinaryDisorderedragged [ RUN ] DecodeProtoOpTest.testBinaryDisorderedshaped_batch 2023-02-19 03:50:54.710116: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.711869: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedshaped_batch): 0.0s I0219 03:50:54.713340 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedshaped_batch): 0.0s [ FAILED ] DecodeProtoOpTest.testBinaryDisorderedshaped_batch [ RUN ] DecodeProtoOpTest.testBinaryDisorderedsimple 2023-02-19 03:50:54.715555: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.717555: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedsimple): 0.0s I0219 03:50:54.719115 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedsimple): 0.0s [ FAILED ] DecodeProtoOpTest.testBinaryDisorderedsimple [ RUN ] DecodeProtoOpTest.testBinarydefaults 2023-02-19 03:50:54.721564: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.723765: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinarydefaults): 0.01s I0219 03:50:54.726297 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinarydefaults): 0.01s [ FAILED ] DecodeProtoOpTest.testBinarydefaults [ RUN ] DecodeProtoOpTest.testBinaryextension 2023-02-19 03:50:54.728626: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.730248: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryextension): 0.0s I0219 03:50:54.731673 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryextension): 0.0s [ OK ] DecodeProtoOpTest.testBinaryextension [ RUN ] DecodeProtoOpTest.testBinaryminmax 2023-02-19 03:50:54.733413: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.736925: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryminmax): 0.01s I0219 03:50:54.739230 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryminmax): 0.01s [ FAILED ] DecodeProtoOpTest.testBinaryminmax [ RUN ] DecodeProtoOpTest.testBinarynested 2023-02-19 03:50:54.741576: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.743177: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinarynested): 0.0s I0219 03:50:54.744622 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinarynested): 0.0s [ OK ] DecodeProtoOpTest.testBinarynested [ RUN ] DecodeProtoOpTest.testBinaryoptional 2023-02-19 03:50:54.746448: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.748073: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryoptional): 0.0s I0219 03:50:54.749570 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryoptional): 0.0s [ FAILED ] DecodeProtoOpTest.testBinaryoptional [ RUN ] DecodeProtoOpTest.testBinarypromote 2023-02-19 03:50:54.751827: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.753488: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinarypromote): 0.0s I0219 03:50:54.755114 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinarypromote): 0.0s [ FAILED ] DecodeProtoOpTest.testBinarypromote [ RUN ] DecodeProtoOpTest.testBinaryragged 2023-02-19 03:50:54.757347: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.758936: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryragged): 0.0s I0219 03:50:54.760358 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryragged): 0.0s [ FAILED ] DecodeProtoOpTest.testBinaryragged [ RUN ] DecodeProtoOpTest.testBinaryshaped_batch 2023-02-19 03:50:54.762536: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.764109: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryshaped_batch): 0.0s I0219 03:50:54.765538 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryshaped_batch): 0.0s [ FAILED ] DecodeProtoOpTest.testBinaryshaped_batch [ RUN ] DecodeProtoOpTest.testBinarysimple 2023-02-19 03:50:54.767799: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.769509: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinarysimple): 0.0s I0219 03:50:54.771034 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinarysimple): 0.0s [ FAILED ] DecodeProtoOpTest.testBinarysimple [ RUN ] DecodeProtoOpTest.testCorruptProtobuf0 (False) 2023-02-19 03:50:54.773634: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.775347: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.776411: W tensorflow/core/framework/op_kernel.cc:1830] OP_REQUIRES failed at decode_proto_op.cc:853 : DATA_LOSS: CountFields: Failed to consume entire buffer INFO:tensorflow:time(__main__.DecodeProtoOpTest.testCorruptProtobuf0 (False)): 0.0s I0219 03:50:54.776750 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testCorruptProtobuf0 (False)): 0.0s [ OK ] DecodeProtoOpTest.testCorruptProtobuf0 (False) [ RUN ] DecodeProtoOpTest.testCorruptProtobuf1 (True) 2023-02-19 03:50:54.778624: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.780252: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testCorruptProtobuf1 (True)): 0.0s I0219 03:50:54.781307 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testCorruptProtobuf1 (True)): 0.0s [ OK ] DecodeProtoOpTest.testCorruptProtobuf1 (True) [ RUN ] DecodeProtoOpTest.testOutOfOrderRepeated 2023-02-19 03:50:54.783597: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.785382: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.787978: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.793273: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testOutOfOrderRepeated): 0.02s I0219 03:50:54.806821 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testOutOfOrderRepeated): 0.02s [ OK ] DecodeProtoOpTest.testOutOfOrderRepeated [ RUN ] DecodeProtoOpTest.testPackeddefaults 2023-02-19 03:50:54.809354: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.811840: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackeddefaults): 0.01s I0219 03:50:54.814278 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackeddefaults): 0.01s [ FAILED ] DecodeProtoOpTest.testPackeddefaults [ RUN ] DecodeProtoOpTest.testPackedminmax 2023-02-19 03:50:54.818629: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.820710: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackedminmax): 0.01s I0219 03:50:54.822963 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackedminmax): 0.01s [ FAILED ] DecodeProtoOpTest.testPackedminmax [ RUN ] DecodeProtoOpTest.testPackednested 2023-02-19 03:50:54.825520: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.827134: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackednested): 0.0s I0219 03:50:54.828520 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackednested): 0.0s [ OK ] DecodeProtoOpTest.testPackednested [ RUN ] DecodeProtoOpTest.testPackedoptional 2023-02-19 03:50:54.830445: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.832053: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackedoptional): 0.0s I0219 03:50:54.833514 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackedoptional): 0.0s [ FAILED ] DecodeProtoOpTest.testPackedoptional [ RUN ] DecodeProtoOpTest.testPackedpromote 2023-02-19 03:50:54.836315: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.838100: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackedpromote): 0.01s I0219 03:50:54.839805 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackedpromote): 0.01s [ FAILED ] DecodeProtoOpTest.testPackedpromote [ RUN ] DecodeProtoOpTest.testPackedragged 2023-02-19 03:50:54.842593: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.844250: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackedragged): 0.0s I0219 03:50:54.845743 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackedragged): 0.0s [ FAILED ] DecodeProtoOpTest.testPackedragged [ RUN ] DecodeProtoOpTest.testPackedshaped_batch 2023-02-19 03:50:54.849062: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.850774: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackedshaped_batch): 0.01s I0219 03:50:54.852276 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackedshaped_batch): 0.01s [ FAILED ] DecodeProtoOpTest.testPackedshaped_batch [ RUN ] DecodeProtoOpTest.testPackedsimple 2023-02-19 03:50:54.854877: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.856658: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackedsimple): 0.0s I0219 03:50:54.858272 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackedsimple): 0.0s [ FAILED ] DecodeProtoOpTest.testPackedsimple [ RUN ] DecodeProtoOpTest.testSanitizerGooddefaults 2023-02-19 03:50:54.860544: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.862767: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGooddefaults): 0.01s I0219 03:50:54.865213 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGooddefaults): 0.01s [ FAILED ] DecodeProtoOpTest.testSanitizerGooddefaults [ RUN ] DecodeProtoOpTest.testSanitizerGoodextension 2023-02-19 03:50:54.867973: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.870038: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodextension): 0.0s I0219 03:50:54.871552 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodextension): 0.0s [ OK ] DecodeProtoOpTest.testSanitizerGoodextension [ RUN ] DecodeProtoOpTest.testSanitizerGoodminmax 2023-02-19 03:50:54.873356: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.875548: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodminmax): 0.01s I0219 03:50:54.878171 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodminmax): 0.01s [ FAILED ] DecodeProtoOpTest.testSanitizerGoodminmax [ RUN ] DecodeProtoOpTest.testSanitizerGoodnested 2023-02-19 03:50:54.880437: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.882034: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodnested): 0.0s I0219 03:50:54.883440 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodnested): 0.0s [ OK ] DecodeProtoOpTest.testSanitizerGoodnested [ RUN ] DecodeProtoOpTest.testSanitizerGoodoptional 2023-02-19 03:50:54.885056: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:54.937703: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodoptional): 0.06s I0219 03:50:54.939383 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodoptional): 0.06s [ FAILED ] DecodeProtoOpTest.testSanitizerGoodoptional [ RUN ] DecodeProtoOpTest.testSanitizerGoodpromote 2023-02-19 03:50:54.941607: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:55.038222: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodpromote): 0.1s I0219 03:50:55.040253 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodpromote): 0.1s [ FAILED ] DecodeProtoOpTest.testSanitizerGoodpromote [ RUN ] DecodeProtoOpTest.testSanitizerGoodragged 2023-02-19 03:50:55.042476: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:55.044058: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodragged): 0.0s I0219 03:50:55.045402 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodragged): 0.0s [ FAILED ] DecodeProtoOpTest.testSanitizerGoodragged [ RUN ] DecodeProtoOpTest.testSanitizerGoodshaped_batch 2023-02-19 03:50:55.047362: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:55.157471: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodshaped_batch): 0.11s I0219 03:50:55.159236 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodshaped_batch): 0.11s [ FAILED ] DecodeProtoOpTest.testSanitizerGoodshaped_batch [ RUN ] DecodeProtoOpTest.testSanitizerGoodsimple 2023-02-19 03:50:55.161476: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:55.163221: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodsimple): 0.0s I0219 03:50:55.164815 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodsimple): 0.0s [ FAILED ] DecodeProtoOpTest.testSanitizerGoodsimple [ RUN ] DecodeProtoOpTest.testTextdefaults 2023-02-19 03:50:55.167050: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:55.169166: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextdefaults): 0.01s I0219 03:50:55.171722 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextdefaults): 0.01s [ FAILED ] DecodeProtoOpTest.testTextdefaults [ RUN ] DecodeProtoOpTest.testTextextension 2023-02-19 03:50:55.175962: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:55.181838: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextextension): 0.01s I0219 03:50:55.183397 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextextension): 0.01s [ OK ] DecodeProtoOpTest.testTextextension [ RUN ] DecodeProtoOpTest.testTextminmax 2023-02-19 03:50:55.185535: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:55.187600: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextminmax): 0.01s I0219 03:50:55.190007 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextminmax): 0.01s [ FAILED ] DecodeProtoOpTest.testTextminmax [ RUN ] DecodeProtoOpTest.testTextnested 2023-02-19 03:50:55.192533: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:55.194381: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextnested): 0.0s I0219 03:50:55.195825 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextnested): 0.0s [ OK ] DecodeProtoOpTest.testTextnested [ RUN ] DecodeProtoOpTest.testTextoptional 2023-02-19 03:50:55.197661: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:55.199401: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextoptional): 0.0s I0219 03:50:55.200855 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextoptional): 0.0s [ FAILED ] DecodeProtoOpTest.testTextoptional [ RUN ] DecodeProtoOpTest.testTextpromote 2023-02-19 03:50:55.203155: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:55.205007: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextpromote): 0.0s I0219 03:50:55.206707 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextpromote): 0.0s [ FAILED ] DecodeProtoOpTest.testTextpromote [ RUN ] DecodeProtoOpTest.testTextragged 2023-02-19 03:50:55.208999: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:55.210726: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextragged): 0.0s I0219 03:50:55.212159 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextragged): 0.0s [ FAILED ] DecodeProtoOpTest.testTextragged [ RUN ] DecodeProtoOpTest.testTextshaped_batch 2023-02-19 03:50:55.214428: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:55.216080: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextshaped_batch): 0.0s I0219 03:50:55.217567 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextshaped_batch): 0.0s [ FAILED ] DecodeProtoOpTest.testTextshaped_batch [ RUN ] DecodeProtoOpTest.testTextsimple 2023-02-19 03:50:55.219564: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 2023-02-19 03:50:55.221161: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x23a184b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextsimple): 0.0s I0219 03:50:55.222599 281473605333888 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextsimple): 0.0s [ FAILED ] DecodeProtoOpTest.testTextsimple [ RUN ] DecodeProtoOpTest.test_session [ SKIPPED ] DecodeProtoOpTest.test_session ====================================================================== ERROR: testBinaryDisordereddefaults (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisordereddefaults testBinaryDisordereddefaults(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryDisorderedminmax (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisorderedminmax testBinaryDisorderedminmax(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryDisorderedoptional (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisorderedoptional testBinaryDisorderedoptional(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryDisorderedpromote (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisorderedpromote testBinaryDisorderedpromote(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryDisorderedragged (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisorderedragged testBinaryDisorderedragged(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryDisorderedshaped_batch (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisorderedshaped_batch testBinaryDisorderedshaped_batch(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryDisorderedsimple (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisorderedsimple testBinaryDisorderedsimple(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinarydefaults (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinarydefaults testBinarydefaults(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryminmax (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryminmax testBinaryminmax(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryoptional (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryoptional testBinaryoptional(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinarypromote (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinarypromote testBinarypromote(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryragged (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryragged testBinaryragged(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryshaped_batch (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryshaped_batch testBinaryshaped_batch(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinarysimple (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinarysimple testBinarysimple(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackeddefaults (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackeddefaults testPackeddefaults(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackedminmax (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackedminmax testPackedminmax(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackedoptional (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackedoptional testPackedoptional(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackedpromote (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackedpromote testPackedpromote(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackedragged (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackedragged testPackedragged(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackedshaped_batch (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackedshaped_batch testPackedshaped_batch(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackedsimple (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackedsimple testPackedsimple(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGooddefaults (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGooddefaults testSanitizerGooddefaults(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGoodminmax (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGoodminmax testSanitizerGoodminmax(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGoodoptional (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGoodoptional testSanitizerGoodoptional(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGoodpromote (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGoodpromote testSanitizerGoodpromote(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGoodragged (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGoodragged testSanitizerGoodragged(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGoodshaped_batch (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGoodshaped_batch testSanitizerGoodshaped_batch(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGoodsimple (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGoodsimple testSanitizerGoodsimple(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextdefaults (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextdefaults testTextdefaults(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextminmax (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextminmax testTextminmax(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextoptional (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextoptional testTextoptional(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextpromote (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextpromote testTextpromote(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextragged (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextragged testTextragged(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextshaped_batch (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextshaped_batch testTextshaped_batch(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextsimple (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextsimple testTextsimple(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ---------------------------------------------------------------------- Ran 48 tests in 0.629s FAILED (errors=35, skipped=1) ================================================================================ ==================== Test output for //tensorflow/python/kernel_tests/proto:decode_proto_op_test: 2023-02-19 03:50:57.177217: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. Running tests under Python 3.9.16: /usr/bin/python3 [ RUN ] DecodeProtoOpTest.testBinaryDisordereddefaults 2023-02-19 03:50:58.485402: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.692476: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.700266: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisordereddefaults): 0.23s I0219 03:50:58.709805 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisordereddefaults): 0.23s [ FAILED ] DecodeProtoOpTest.testBinaryDisordereddefaults [ RUN ] DecodeProtoOpTest.testBinaryDisorderedextension 2023-02-19 03:50:58.712891: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.714746: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedextension): 0.02s I0219 03:50:58.736330 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedextension): 0.02s [ OK ] DecodeProtoOpTest.testBinaryDisorderedextension [ RUN ] DecodeProtoOpTest.testBinaryDisorderedminmax 2023-02-19 03:50:58.738387: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.740649: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedminmax): 0.01s I0219 03:50:58.742988 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedminmax): 0.01s [ FAILED ] DecodeProtoOpTest.testBinaryDisorderedminmax [ RUN ] DecodeProtoOpTest.testBinaryDisorderednested 2023-02-19 03:50:58.745554: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.747279: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderednested): 0.0s I0219 03:50:58.748809 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderednested): 0.0s [ OK ] DecodeProtoOpTest.testBinaryDisorderednested [ RUN ] DecodeProtoOpTest.testBinaryDisorderedoptional 2023-02-19 03:50:58.750716: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.752674: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedoptional): 0.0s I0219 03:50:58.754278 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedoptional): 0.0s [ FAILED ] DecodeProtoOpTest.testBinaryDisorderedoptional [ RUN ] DecodeProtoOpTest.testBinaryDisorderedpromote 2023-02-19 03:50:58.756645: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.758599: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedpromote): 0.0s I0219 03:50:58.760414 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedpromote): 0.0s [ FAILED ] DecodeProtoOpTest.testBinaryDisorderedpromote [ RUN ] DecodeProtoOpTest.testBinaryDisorderedragged 2023-02-19 03:50:58.762781: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.767874: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedragged): 0.01s I0219 03:50:58.769510 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedragged): 0.01s [ FAILED ] DecodeProtoOpTest.testBinaryDisorderedragged [ RUN ] DecodeProtoOpTest.testBinaryDisorderedshaped_batch 2023-02-19 03:50:58.772009: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.773693: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedshaped_batch): 0.0s I0219 03:50:58.775220 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedshaped_batch): 0.0s [ FAILED ] DecodeProtoOpTest.testBinaryDisorderedshaped_batch [ RUN ] DecodeProtoOpTest.testBinaryDisorderedsimple 2023-02-19 03:50:58.777872: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.779734: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryDisorderedsimple): 0.0s I0219 03:50:58.781326 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryDisorderedsimple): 0.0s [ FAILED ] DecodeProtoOpTest.testBinaryDisorderedsimple [ RUN ] DecodeProtoOpTest.testBinarydefaults 2023-02-19 03:50:58.784018: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.786378: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinarydefaults): 0.01s I0219 03:50:58.788883 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinarydefaults): 0.01s [ FAILED ] DecodeProtoOpTest.testBinarydefaults [ RUN ] DecodeProtoOpTest.testBinaryextension 2023-02-19 03:50:58.791356: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.793160: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryextension): 0.0s I0219 03:50:58.794650 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryextension): 0.0s [ OK ] DecodeProtoOpTest.testBinaryextension [ RUN ] DecodeProtoOpTest.testBinaryminmax 2023-02-19 03:50:58.796615: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.798761: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryminmax): 0.01s I0219 03:50:58.801079 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryminmax): 0.01s [ FAILED ] DecodeProtoOpTest.testBinaryminmax [ RUN ] DecodeProtoOpTest.testBinarynested 2023-02-19 03:50:58.803532: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.805570: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinarynested): 0.0s I0219 03:50:58.807098 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinarynested): 0.0s [ OK ] DecodeProtoOpTest.testBinarynested [ RUN ] DecodeProtoOpTest.testBinaryoptional 2023-02-19 03:50:58.809031: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.810834: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryoptional): 0.0s I0219 03:50:58.812358 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryoptional): 0.0s [ FAILED ] DecodeProtoOpTest.testBinaryoptional [ RUN ] DecodeProtoOpTest.testBinarypromote 2023-02-19 03:50:58.814695: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.816559: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinarypromote): 0.0s I0219 03:50:58.818295 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinarypromote): 0.0s [ FAILED ] DecodeProtoOpTest.testBinarypromote [ RUN ] DecodeProtoOpTest.testBinaryragged 2023-02-19 03:50:58.820732: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.822619: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryragged): 0.0s I0219 03:50:58.824179 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryragged): 0.0s [ FAILED ] DecodeProtoOpTest.testBinaryragged [ RUN ] DecodeProtoOpTest.testBinaryshaped_batch 2023-02-19 03:50:58.826798: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.828657: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinaryshaped_batch): 0.0s I0219 03:50:58.830201 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinaryshaped_batch): 0.0s [ FAILED ] DecodeProtoOpTest.testBinaryshaped_batch [ RUN ] DecodeProtoOpTest.testBinarysimple 2023-02-19 03:50:58.832529: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.834278: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testBinarysimple): 0.0s I0219 03:50:58.835919 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testBinarysimple): 0.0s [ FAILED ] DecodeProtoOpTest.testBinarysimple [ RUN ] DecodeProtoOpTest.testCorruptProtobuf0 (False) 2023-02-19 03:50:58.838752: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.840559: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.841412: W tensorflow/core/framework/op_kernel.cc:1830] OP_REQUIRES failed at decode_proto_op.cc:853 : DATA_LOSS: CountFields: Failed to consume entire buffer INFO:tensorflow:time(__main__.DecodeProtoOpTest.testCorruptProtobuf0 (False)): 0.0s I0219 03:50:58.841751 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testCorruptProtobuf0 (False)): 0.0s [ OK ] DecodeProtoOpTest.testCorruptProtobuf0 (False) [ RUN ] DecodeProtoOpTest.testCorruptProtobuf1 (True) 2023-02-19 03:50:58.843777: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.845661: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testCorruptProtobuf1 (True)): 0.0s I0219 03:50:58.846834 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testCorruptProtobuf1 (True)): 0.0s [ OK ] DecodeProtoOpTest.testCorruptProtobuf1 (True) [ RUN ] DecodeProtoOpTest.testOutOfOrderRepeated 2023-02-19 03:50:58.849200: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.851160: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.853782: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.859358: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testOutOfOrderRepeated): 0.03s I0219 03:50:58.873119 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testOutOfOrderRepeated): 0.03s [ OK ] DecodeProtoOpTest.testOutOfOrderRepeated [ RUN ] DecodeProtoOpTest.testPackeddefaults 2023-02-19 03:50:58.875318: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.878109: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackeddefaults): 0.01s I0219 03:50:58.880640 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackeddefaults): 0.01s [ FAILED ] DecodeProtoOpTest.testPackeddefaults [ RUN ] DecodeProtoOpTest.testPackedminmax 2023-02-19 03:50:58.884893: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.887181: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackedminmax): 0.01s I0219 03:50:58.889692 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackedminmax): 0.01s [ FAILED ] DecodeProtoOpTest.testPackedminmax [ RUN ] DecodeProtoOpTest.testPackednested 2023-02-19 03:50:58.892509: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.894278: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackednested): 0.0s I0219 03:50:58.895843 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackednested): 0.0s [ OK ] DecodeProtoOpTest.testPackednested [ RUN ] DecodeProtoOpTest.testPackedoptional 2023-02-19 03:50:58.898340: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.900098: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackedoptional): 0.0s I0219 03:50:58.901648 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackedoptional): 0.0s [ FAILED ] DecodeProtoOpTest.testPackedoptional [ RUN ] DecodeProtoOpTest.testPackedpromote 2023-02-19 03:50:58.904561: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.906527: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackedpromote): 0.01s I0219 03:50:58.908346 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackedpromote): 0.01s [ FAILED ] DecodeProtoOpTest.testPackedpromote [ RUN ] DecodeProtoOpTest.testPackedragged 2023-02-19 03:50:58.911192: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.912936: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackedragged): 0.0s I0219 03:50:58.914537 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackedragged): 0.0s [ FAILED ] DecodeProtoOpTest.testPackedragged [ RUN ] DecodeProtoOpTest.testPackedshaped_batch 2023-02-19 03:50:58.918046: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.919784: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackedshaped_batch): 0.01s I0219 03:50:58.921357 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackedshaped_batch): 0.01s [ FAILED ] DecodeProtoOpTest.testPackedshaped_batch [ RUN ] DecodeProtoOpTest.testPackedsimple 2023-02-19 03:50:58.924024: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.925765: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testPackedsimple): 0.0s I0219 03:50:58.927409 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testPackedsimple): 0.0s [ FAILED ] DecodeProtoOpTest.testPackedsimple [ RUN ] DecodeProtoOpTest.testSanitizerGooddefaults 2023-02-19 03:50:58.929956: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.932327: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGooddefaults): 0.01s I0219 03:50:58.934843 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGooddefaults): 0.01s [ FAILED ] DecodeProtoOpTest.testSanitizerGooddefaults [ RUN ] DecodeProtoOpTest.testSanitizerGoodextension 2023-02-19 03:50:58.937424: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.939401: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodextension): 0.0s I0219 03:50:58.940936 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodextension): 0.0s [ OK ] DecodeProtoOpTest.testSanitizerGoodextension [ RUN ] DecodeProtoOpTest.testSanitizerGoodminmax 2023-02-19 03:50:58.942893: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.945046: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodminmax): 0.01s I0219 03:50:58.947506 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodminmax): 0.01s [ FAILED ] DecodeProtoOpTest.testSanitizerGoodminmax [ RUN ] DecodeProtoOpTest.testSanitizerGoodnested 2023-02-19 03:50:58.949935: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.951839: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodnested): 0.0s I0219 03:50:58.953430 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodnested): 0.0s [ OK ] DecodeProtoOpTest.testSanitizerGoodnested [ RUN ] DecodeProtoOpTest.testSanitizerGoodoptional 2023-02-19 03:50:58.955365: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.957219: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodoptional): 0.0s I0219 03:50:58.958811 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodoptional): 0.0s [ FAILED ] DecodeProtoOpTest.testSanitizerGoodoptional [ RUN ] DecodeProtoOpTest.testSanitizerGoodpromote 2023-02-19 03:50:58.961279: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.963243: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodpromote): 0.0s I0219 03:50:58.965015 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodpromote): 0.0s [ FAILED ] DecodeProtoOpTest.testSanitizerGoodpromote [ RUN ] DecodeProtoOpTest.testSanitizerGoodragged 2023-02-19 03:50:58.967460: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.969521: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodragged): 0.0s I0219 03:50:58.971188 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodragged): 0.0s [ FAILED ] DecodeProtoOpTest.testSanitizerGoodragged [ RUN ] DecodeProtoOpTest.testSanitizerGoodshaped_batch 2023-02-19 03:50:58.973729: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.975491: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodshaped_batch): 0.0s I0219 03:50:58.977324 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodshaped_batch): 0.0s [ FAILED ] DecodeProtoOpTest.testSanitizerGoodshaped_batch [ RUN ] DecodeProtoOpTest.testSanitizerGoodsimple 2023-02-19 03:50:58.979749: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.981638: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testSanitizerGoodsimple): 0.0s I0219 03:50:58.983300 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testSanitizerGoodsimple): 0.0s [ FAILED ] DecodeProtoOpTest.testSanitizerGoodsimple [ RUN ] DecodeProtoOpTest.testTextdefaults 2023-02-19 03:50:58.985848: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.988235: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextdefaults): 0.01s I0219 03:50:58.990806 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextdefaults): 0.01s [ FAILED ] DecodeProtoOpTest.testTextdefaults [ RUN ] DecodeProtoOpTest.testTextextension 2023-02-19 03:50:58.995502: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:58.997387: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextextension): 0.01s I0219 03:50:58.999070 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextextension): 0.01s [ OK ] DecodeProtoOpTest.testTextextension [ RUN ] DecodeProtoOpTest.testTextminmax 2023-02-19 03:50:59.001367: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:59.003783: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextminmax): 0.01s I0219 03:50:59.006669 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextminmax): 0.01s [ FAILED ] DecodeProtoOpTest.testTextminmax [ RUN ] DecodeProtoOpTest.testTextnested 2023-02-19 03:50:59.009679: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:59.011554: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextnested): 0.01s I0219 03:50:59.013240 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextnested): 0.01s [ OK ] DecodeProtoOpTest.testTextnested [ RUN ] DecodeProtoOpTest.testTextoptional 2023-02-19 03:50:59.015610: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:59.017736: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextoptional): 0.01s I0219 03:50:59.019535 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextoptional): 0.01s [ FAILED ] DecodeProtoOpTest.testTextoptional [ RUN ] DecodeProtoOpTest.testTextpromote 2023-02-19 03:50:59.022322: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:59.024279: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextpromote): 0.01s I0219 03:50:59.026220 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextpromote): 0.01s [ FAILED ] DecodeProtoOpTest.testTextpromote [ RUN ] DecodeProtoOpTest.testTextragged 2023-02-19 03:50:59.028801: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:59.030548: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextragged): 0.0s I0219 03:50:59.032216 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextragged): 0.0s [ FAILED ] DecodeProtoOpTest.testTextragged [ RUN ] DecodeProtoOpTest.testTextshaped_batch 2023-02-19 03:50:59.034869: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:59.042409: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextshaped_batch): 0.01s I0219 03:50:59.044240 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextshaped_batch): 0.01s [ FAILED ] DecodeProtoOpTest.testTextshaped_batch [ RUN ] DecodeProtoOpTest.testTextsimple 2023-02-19 03:50:59.046843: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 2023-02-19 03:50:59.049463: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0xd3f84b0, num_threads=56 INFO:tensorflow:time(__main__.DecodeProtoOpTest.testTextsimple): 0.01s I0219 03:50:59.051213 281473570403200 test_util.py:2467] time(__main__.DecodeProtoOpTest.testTextsimple): 0.01s [ FAILED ] DecodeProtoOpTest.testTextsimple [ RUN ] DecodeProtoOpTest.test_session [ SKIPPED ] DecodeProtoOpTest.test_session ====================================================================== ERROR: testBinaryDisordereddefaults (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisordereddefaults testBinaryDisordereddefaults(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryDisorderedminmax (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisorderedminmax testBinaryDisorderedminmax(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryDisorderedoptional (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisorderedoptional testBinaryDisorderedoptional(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryDisorderedpromote (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisorderedpromote testBinaryDisorderedpromote(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryDisorderedragged (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisorderedragged testBinaryDisorderedragged(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryDisorderedshaped_batch (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisorderedshaped_batch testBinaryDisorderedshaped_batch(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryDisorderedsimple (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryDisorderedsimple testBinaryDisorderedsimple(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 223, in testBinaryDisordered self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinarydefaults (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinarydefaults testBinarydefaults(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryminmax (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryminmax testBinaryminmax(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryoptional (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryoptional testBinaryoptional(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinarypromote (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinarypromote testBinarypromote(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryragged (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryragged testBinaryragged(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinaryshaped_batch (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinaryshaped_batch testBinaryshaped_batch(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testBinarysimple (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testBinarysimple testBinarysimple(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 211, in testBinary self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackeddefaults (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackeddefaults testPackeddefaults(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackedminmax (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackedminmax testPackedminmax(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackedoptional (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackedoptional testPackedoptional(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackedpromote (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackedpromote testPackedpromote(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackedragged (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackedragged testPackedragged(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackedshaped_batch (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackedshaped_batch testPackedshaped_batch(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testPackedsimple (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testPackedsimple testPackedsimple(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 251, in testPacked self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGooddefaults (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGooddefaults testSanitizerGooddefaults(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGoodminmax (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGoodminmax testSanitizerGoodminmax(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGoodoptional (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGoodoptional testSanitizerGoodoptional(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGoodpromote (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGoodpromote testSanitizerGoodpromote(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGoodragged (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGoodragged testSanitizerGoodragged(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGoodshaped_batch (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGoodshaped_batch testSanitizerGoodshaped_batch(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testSanitizerGoodsimple (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testSanitizerGoodsimple testSanitizerGoodsimple(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 281, in testSanitizerGood self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextdefaults (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextdefaults testTextdefaults(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextminmax (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextminmax testTextminmax(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextoptional (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextoptional testTextoptional(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextpromote (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextpromote testTextpromote(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextragged (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextragged testTextragged(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextshaped_batch (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextshaped_batch testTextshaped_batch(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ====================================================================== ERROR: testTextsimple (__main__.DecodeProtoOpTest) DecodeProtoOpTest.testTextsimple testTextsimple(values { ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/absl_py/absl/testing/parameterized.py", line 316, in bound_param_test return test_method(self, *testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 269, in testText self._runDecodeProtoTests( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 206, in _runDecodeProtoTests self._compareProtos(batch_shape, sizes, fields, field_dict) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 142, in _compareProtos self._compareValues(fd, values.flat, File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/proto/decode_proto_op_test.runfiles/org_tensorflow/tensorflow/python/kernel_tests/proto/decode_proto_op_test_base.py", line 57, in _compareValues if fd.cpp_type == fd.CPPTYPE_FLOAT: AttributeError: 'google._upb._message.FieldDescriptor' object has no attribute 'CPPTYPE_FLOAT' ---------------------------------------------------------------------- Ran 48 tests in 0.573s FAILED (errors=35, skipped=1) ================================================================================ ==================== Test output for //tensorflow/tools/api/tests:api_compatibility_test: 2023-02-19 03:50:26.207133: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. Running tests under Python 3.9.16: /usr/bin/python3 [ RUN ] ApiCompatibilityTest.testAPIBackwardsCompatibility ERROR:tensorflow:TensorFlow API backwards compatibility test This test ensures all changes to the public API of TensorFlow are intended. If this test fails, it means a change has been made to the public API. Backwards incompatible changes are not allowed. You can run the test as follows to update test goldens and package them with your change. $ bazel run tensorflow/tools/api/tests:api_compatibility_test \ # -- --update_goldens True You will need an API approval to make changes to the public TensorFlow API. This includes additions to the API. E0219 03:50:42.508565 281473808233344 api_compatibility_test.py:370] TensorFlow API backwards compatibility test This test ensures all changes to the public API of TensorFlow are intended. If this test fails, it means a change has been made to the public API. Backwards incompatible changes are not allowed. You can run the test as follows to update test goldens and package them with your change. $ bazel run tensorflow/tools/api/tests:api_compatibility_test \ # -- --update_goldens True You will need an API approval to make changes to the public TensorFlow API. This includes additions to the API. ERROR:tensorflow:1 differences found between API and golden. E0219 03:50:42.508921 281473808233344 api_compatibility_test.py:371] 1 differences found between API and golden. ERROR:tensorflow: Change detected in python object: tensorflow.train. E0219 03:50:42.509084 281473808233344 api_compatibility_test.py:392] Change detected in python object: tensorflow.train. ERROR:tensorflow: path: "tensorflow.train" tf_module { member { name: "BytesList" - mtype: "" + mtype: "" } member { name: "Checkpoint" mtype: "" } member { name: "CheckpointManager" mtype: "" } member { name: "CheckpointOptions" mtype: "" } member { name: "CheckpointView" mtype: "" } member { name: "ClusterDef" - mtype: "" + mtype: "" } member { name: "ClusterSpec" mtype: "" } member { name: "Coordinator" mtype: "" } member { name: "Example" - mtype: "" + mtype: "" } member { name: "ExponentialMovingAverage" mtype: "" } member { name: "Feature" - mtype: "" + mtype: "" } member { name: "FeatureList" - mtype: "" + mtype: "" } member { name: "FeatureLists" - mtype: "" + mtype: "" } member { name: "Features" - mtype: "" + mtype: "" } member { name: "FloatList" - mtype: "" + mtype: "" } member { name: "Int64List" - mtype: "" + mtype: "" } member { name: "JobDef" - mtype: "" + mtype: "" } member { name: "SequenceExample" - mtype: "" + mtype: "" } member { name: "ServerDef" - mtype: "" + mtype: "" } member { name: "TrackableView" mtype: "" } member { name: "experimental" mtype: "" } member_method { name: "checkpoints_iterator" argspec: "args=[\'checkpoint_dir\', \'min_interval_secs\', \'timeout\', \'timeout_fn\'], varargs=None, keywords=None, defaults=[\'0\', \'None\', \'None\'], " } member_method { name: "get_checkpoint_state" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "latest_checkpoint" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "list_variables" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_checkpoint" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_variable" argspec: "args=[\'ckpt_dir_or_file\', \'name\'], varargs=None, keywords=None, defaults=None" } } E0219 03:50:42.509227 281473808233344 api_compatibility_test.py:393] path: "tensorflow.train" tf_module { member { name: "BytesList" - mtype: "" + mtype: "" } member { name: "Checkpoint" mtype: "" } member { name: "CheckpointManager" mtype: "" } member { name: "CheckpointOptions" mtype: "" } member { name: "CheckpointView" mtype: "" } member { name: "ClusterDef" - mtype: "" + mtype: "" } member { name: "ClusterSpec" mtype: "" } member { name: "Coordinator" mtype: "" } member { name: "Example" - mtype: "" + mtype: "" } member { name: "ExponentialMovingAverage" mtype: "" } member { name: "Feature" - mtype: "" + mtype: "" } member { name: "FeatureList" - mtype: "" + mtype: "" } member { name: "FeatureLists" - mtype: "" + mtype: "" } member { name: "Features" - mtype: "" + mtype: "" } member { name: "FloatList" - mtype: "" + mtype: "" } member { name: "Int64List" - mtype: "" + mtype: "" } member { name: "JobDef" - mtype: "" + mtype: "" } member { name: "SequenceExample" - mtype: "" + mtype: "" } member { name: "ServerDef" - mtype: "" + mtype: "" } member { name: "TrackableView" mtype: "" } member { name: "experimental" mtype: "" } member_method { name: "checkpoints_iterator" argspec: "args=[\'checkpoint_dir\', \'min_interval_secs\', \'timeout\', \'timeout_fn\'], varargs=None, keywords=None, defaults=[\'0\', \'None\', \'None\'], " } member_method { name: "get_checkpoint_state" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "latest_checkpoint" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "list_variables" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_checkpoint" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_variable" argspec: "args=[\'ckpt_dir_or_file\', \'name\'], varargs=None, keywords=None, defaults=None" } } INFO:tensorflow:time(__main__.ApiCompatibilityTest.testAPIBackwardsCompatibility): 2.63s I0219 03:50:42.509505 281473808233344 test_util.py:2467] time(__main__.ApiCompatibilityTest.testAPIBackwardsCompatibility): 2.63s [ FAILED ] ApiCompatibilityTest.testAPIBackwardsCompatibility [ RUN ] ApiCompatibilityTest.testAPIBackwardsCompatibilityV1 WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/python/util/decorator_utils.py:153: GraphKeys.VARIABLES (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.GraphKeys.GLOBAL_VARIABLES` instead. W0219 03:50:42.630860 281473808233344 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/python/util/decorator_utils.py:153: GraphKeys.VARIABLES (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.GraphKeys.GLOBAL_VARIABLES` instead. ERROR:tensorflow:TensorFlow API backwards compatibility test This test ensures all changes to the public API of TensorFlow are intended. If this test fails, it means a change has been made to the public API. Backwards incompatible changes are not allowed. You can run the test as follows to update test goldens and package them with your change. $ bazel run tensorflow/tools/api/tests:api_compatibility_test \ # -- --update_goldens True You will need an API approval to make changes to the public TensorFlow API. This includes additions to the API. E0219 03:50:45.721025 281473808233344 api_compatibility_test.py:370] TensorFlow API backwards compatibility test This test ensures all changes to the public API of TensorFlow are intended. If this test fails, it means a change has been made to the public API. Backwards incompatible changes are not allowed. You can run the test as follows to update test goldens and package them with your change. $ bazel run tensorflow/tools/api/tests:api_compatibility_test \ # -- --update_goldens True You will need an API approval to make changes to the public TensorFlow API. This includes additions to the API. ERROR:tensorflow:4 differences found between API and golden. E0219 03:50:45.721386 281473808233344 api_compatibility_test.py:371] 4 differences found between API and golden. ERROR:tensorflow: Change detected in python object: tensorflow.train. E0219 03:50:45.721553 281473808233344 api_compatibility_test.py:392] Change detected in python object: tensorflow.train. ERROR:tensorflow: path: "tensorflow.train" tf_module { member { name: "AdadeltaOptimizer" mtype: "" } member { name: "AdagradDAOptimizer" mtype: "" } member { name: "AdagradOptimizer" mtype: "" } member { name: "AdamOptimizer" mtype: "" } member { name: "BytesList" - mtype: "" + mtype: "" } member { name: "Checkpoint" mtype: "" } member { name: "CheckpointManager" mtype: "" } member { name: "CheckpointOptions" mtype: "" } member { name: "CheckpointSaverHook" mtype: "" } member { name: "CheckpointSaverListener" mtype: "" } member { name: "ChiefSessionCreator" mtype: "" } member { name: "ClusterDef" - mtype: "" + mtype: "" } member { name: "ClusterSpec" mtype: "" } member { name: "Coordinator" mtype: "" } member { name: "Example" - mtype: "" + mtype: "" } member { name: "ExponentialMovingAverage" mtype: "" } member { name: "Feature" - mtype: "" + mtype: "" } member { name: "FeatureList" - mtype: "" + mtype: "" } member { name: "FeatureLists" - mtype: "" + mtype: "" } member { name: "Features" - mtype: "" + mtype: "" } member { name: "FeedFnHook" mtype: "" } member { name: "FinalOpsHook" mtype: "" } member { name: "FloatList" - mtype: "" + mtype: "" } member { name: "FtrlOptimizer" mtype: "" } member { name: "GlobalStepWaiterHook" mtype: "" } member { name: "GradientDescentOptimizer" mtype: "" } member { name: "Int64List" - mtype: "" + mtype: "" } member { name: "JobDef" - mtype: "" + mtype: "" } member { name: "LoggingTensorHook" mtype: "" } member { name: "LooperThread" mtype: "" } member { name: "MomentumOptimizer" mtype: "" } member { name: "MonitoredSession" mtype: "" } member { name: "NanLossDuringTrainingError" mtype: "" } member { name: "NanTensorHook" mtype: "" } member { name: "Optimizer" mtype: "" } member { name: "ProfilerHook" mtype: "" } member { name: "ProximalAdagradOptimizer" mtype: "" } member { name: "ProximalGradientDescentOptimizer" mtype: "" } member { name: "QueueRunner" mtype: "" } member { name: "RMSPropOptimizer" mtype: "" } member { name: "Saver" mtype: "" } member { name: "SaverDef" - mtype: "" + mtype: "" } member { name: "Scaffold" mtype: "" } member { name: "SecondOrStepTimer" mtype: "" } member { name: "SequenceExample" - mtype: "" + mtype: "" } member { name: "Server" mtype: "" } member { name: "ServerDef" - mtype: "" + mtype: "" } member { name: "SessionCreator" mtype: "" } member { name: "SessionManager" mtype: "" } member { name: "SessionRunArgs" mtype: "" } member { name: "SessionRunContext" mtype: "" } member { name: "SessionRunHook" mtype: "" } member { name: "SessionRunValues" mtype: "" } member { name: "SingularMonitoredSession" mtype: "" } member { name: "StepCounterHook" mtype: "" } member { name: "StopAtStepHook" mtype: "" } member { name: "SummarySaverHook" mtype: "" } member { name: "Supervisor" mtype: "" } member { name: "SyncReplicasOptimizer" mtype: "" } member { name: "VocabInfo" mtype: "" } member { name: "WorkerSessionCreator" mtype: "" } member { name: "experimental" mtype: "" } member { name: "queue_runner" mtype: "" } member_method { name: "MonitoredTrainingSession" argspec: "args=[\'master\', \'is_chief\', \'checkpoint_dir\', \'scaffold\', \'hooks\', \'chief_only_hooks\', \'save_checkpoint_secs\', \'save_summaries_steps\', \'save_summaries_secs\', \'config\', \'stop_grace_period_secs\', \'log_step_count_steps\', \'max_wait_secs\', \'save_checkpoint_steps\', \'summary_dir\', \'save_graph_def\'], varargs=None, keywords=None, defaults=[\'\', \'True\', \'None\', \'None\', \'None\', \'None\', \'\', \'\', \'\', \'None\', \'120\', \'100\', \'7200\', \'\', \'None\', \'True\'], " } member_method { name: "NewCheckpointReader" argspec: "args=[\'filepattern\'], varargs=None, keywords=None, defaults=None" } member_method { name: "add_queue_runner" argspec: "args=[\'qr\', \'collection\'], varargs=None, keywords=None, defaults=[\'queue_runners\'], " } member_method { name: "assert_global_step" argspec: "args=[\'global_step_tensor\'], varargs=None, keywords=None, defaults=None" } member_method { name: "basic_train_loop" argspec: "args=[\'supervisor\', \'train_step_fn\', \'args\', \'kwargs\', \'master\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'\'], " } member_method { name: "batch" argspec: "args=[\'tensors\', \'batch_size\', \'num_threads\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "batch_join" argspec: "args=[\'tensors_list\', \'batch_size\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "checkpoint_exists" argspec: "args=[\'checkpoint_prefix\'], varargs=None, keywords=None, defaults=None" } member_method { name: "checkpoints_iterator" argspec: "args=[\'checkpoint_dir\', \'min_interval_secs\', \'timeout\', \'timeout_fn\'], varargs=None, keywords=None, defaults=[\'0\', \'None\', \'None\'], " } member_method { name: "cosine_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'alpha\', \'name\'], varargs=None, keywords=None, defaults=[\'0.0\', \'None\'], " } member_method { name: "cosine_decay_restarts" argspec: "args=[\'learning_rate\', \'global_step\', \'first_decay_steps\', \'t_mul\', \'m_mul\', \'alpha\', \'name\'], varargs=None, keywords=None, defaults=[\'2.0\', \'1.0\', \'0.0\', \'None\'], " } member_method { name: "create_global_step" argspec: "args=[\'graph\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "do_quantize_training_on_graphdef" argspec: "args=[\'input_graph\', \'num_bits\'], varargs=None, keywords=None, defaults=None" } member_method { name: "exponential_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'decay_rate\', \'staircase\', \'name\'], varargs=None, keywords=None, defaults=[\'False\', \'None\'], " } member_method { name: "export_meta_graph" argspec: "args=[\'filename\', \'meta_info_def\', \'graph_def\', \'saver_def\', \'collection_list\', \'as_text\', \'graph\', \'export_scope\', \'clear_devices\', \'clear_extraneous_savers\', \'strip_default_attrs\', \'save_debug_info\'], varargs=None, keywords=kwargs, defaults=[\'None\', \'None\', \'None\', \'None\', \'None\', \'False\', \'None\', \'None\', \'False\', \'False\', \'False\', \'False\'], " } member_method { name: "generate_checkpoint_state_proto" argspec: "args=[\'save_dir\', \'model_checkpoint_path\', \'all_model_checkpoint_paths\', \'all_model_checkpoint_timestamps\', \'last_preserved_timestamp\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\'], " } member_method { name: "get_checkpoint_mtimes" argspec: "args=[\'checkpoint_prefixes\'], varargs=None, keywords=None, defaults=None" } member_method { name: "get_checkpoint_state" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "get_global_step" argspec: "args=[\'graph\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "get_or_create_global_step" argspec: "args=[\'graph\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "global_step" argspec: "args=[\'sess\', \'global_step_tensor\'], varargs=None, keywords=None, defaults=None" } member_method { name: "import_meta_graph" argspec: "args=[\'meta_graph_or_file\', \'clear_devices\', \'import_scope\'], varargs=None, keywords=kwargs, defaults=[\'False\', \'None\'], " } member_method { name: "init_from_checkpoint" argspec: "args=[\'ckpt_dir_or_file\', \'assignment_map\'], varargs=None, keywords=None, defaults=None" } member_method { name: "input_producer" argspec: "args=[\'input_tensor\', \'element_shape\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'summary_name\', \'name\', \'cancel_op\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'True\', \'None\', \'32\', \'None\', \'None\', \'None\', \'None\'], " } member_method { name: "inverse_time_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'decay_rate\', \'staircase\', \'name\'], varargs=None, keywords=None, defaults=[\'False\', \'None\'], " } member_method { name: "latest_checkpoint" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "limit_epochs" argspec: "args=[\'tensor\', \'num_epochs\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "linear_cosine_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'num_periods\', \'alpha\', \'beta\', \'name\'], varargs=None, keywords=None, defaults=[\'0.5\', \'0.0\', \'0.001\', \'None\'], " } member_method { name: "list_variables" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_checkpoint" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_variable" argspec: "args=[\'ckpt_dir_or_file\', \'name\'], varargs=None, keywords=None, defaults=None" } member_method { name: "match_filenames_once" argspec: "args=[\'pattern\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "maybe_batch" argspec: "args=[\'tensors\', \'keep_input\', \'batch_size\', \'num_threads\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "maybe_batch_join" argspec: "args=[\'tensors_list\', \'keep_input\', \'batch_size\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "maybe_shuffle_batch" argspec: "args=[\'tensors\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'keep_input\', \'num_threads\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "maybe_shuffle_batch_join" argspec: "args=[\'tensors_list\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'keep_input\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "natural_exp_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'decay_rate\', \'staircase\', \'name\'], varargs=None, keywords=None, defaults=[\'False\', \'None\'], " } member_method { name: "noisy_linear_cosine_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'initial_variance\', \'variance_decay\', \'num_periods\', \'alpha\', \'beta\', \'name\'], varargs=None, keywords=None, defaults=[\'1.0\', \'0.55\', \'0.5\', \'0.0\', \'0.001\', \'None\'], " } member_method { name: "piecewise_constant" argspec: "args=[\'x\', \'boundaries\', \'values\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "piecewise_constant_decay" argspec: "args=[\'x\', \'boundaries\', \'values\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "polynomial_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'end_learning_rate\', \'power\', \'cycle\', \'name\'], varargs=None, keywords=None, defaults=[\'0.0001\', \'1.0\', \'False\', \'None\'], " } member_method { name: "range_input_producer" argspec: "args=[\'limit\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'True\', \'None\', \'32\', \'None\', \'None\'], " } member_method { name: "remove_checkpoint" argspec: "args=[\'checkpoint_prefix\', \'checkpoint_format_version\', \'meta_graph_suffix\'], varargs=None, keywords=None, defaults=[\'2\', \'meta\'], " } member_method { name: "replica_device_setter" argspec: "args=[\'ps_tasks\', \'ps_device\', \'worker_device\', \'merge_devices\', \'cluster\', \'ps_ops\', \'ps_strategy\'], varargs=None, keywords=None, defaults=[\'0\', \'/job:ps\', \'/job:worker\', \'True\', \'None\', \'None\', \'None\'], " } member_method { name: "sdca_fprint" argspec: "args=[\'input\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "sdca_optimizer" argspec: "args=[\'sparse_example_indices\', \'sparse_feature_indices\', \'sparse_feature_values\', \'dense_features\', \'example_weights\', \'example_labels\', \'sparse_indices\', \'sparse_weights\', \'dense_weights\', \'example_state_data\', \'loss_type\', \'l1\', \'l2\', \'num_loss_partitions\', \'num_inner_iterations\', \'adaptative\', \'name\'], varargs=None, keywords=None, defaults=[\'True\', \'None\'], " } member_method { name: "sdca_shrink_l1" argspec: "args=[\'weights\', \'l1\', \'l2\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "shuffle_batch" argspec: "args=[\'tensors\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'num_threads\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "shuffle_batch_join" argspec: "args=[\'tensors_list\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "slice_input_producer" argspec: "args=[\'tensor_list\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'True\', \'None\', \'32\', \'None\', \'None\'], " } member_method { name: "start_queue_runners" argspec: "args=[\'sess\', \'coord\', \'daemon\', \'start\', \'collection\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'True\', \'True\', \'queue_runners\'], " } member_method { name: "string_input_producer" argspec: "args=[\'string_tensor\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'name\', \'cancel_op\'], varargs=None, keywords=None, defaults=[\'None\', \'True\', \'None\', \'32\', \'None\', \'None\', \'None\'], " } member_method { name: "summary_iterator" argspec: "args=[\'path\'], varargs=None, keywords=None, defaults=None" } member_method { name: "update_checkpoint_state" argspec: "args=[\'save_dir\', \'model_checkpoint_path\', \'all_model_checkpoint_paths\', \'latest_filename\', \'all_model_checkpoint_timestamps\', \'last_preserved_timestamp\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\', \'None\'], " } member_method { name: "warm_start" argspec: "args=[\'ckpt_to_initialize_from\', \'vars_to_warm_start\', \'var_name_to_vocab_info\', \'var_name_to_prev_var_name\'], varargs=None, keywords=None, defaults=[\'.*\', \'None\', \'None\'], " } member_method { name: "write_graph" argspec: "args=[\'graph_or_graph_def\', \'logdir\', \'name\', \'as_text\'], varargs=None, keywords=None, defaults=[\'True\'], " } } E0219 03:50:45.721697 281473808233344 api_compatibility_test.py:393] path: "tensorflow.train" tf_module { member { name: "AdadeltaOptimizer" mtype: "" } member { name: "AdagradDAOptimizer" mtype: "" } member { name: "AdagradOptimizer" mtype: "" } member { name: "AdamOptimizer" mtype: "" } member { name: "BytesList" - mtype: "" + mtype: "" } member { name: "Checkpoint" mtype: "" } member { name: "CheckpointManager" mtype: "" } member { name: "CheckpointOptions" mtype: "" } member { name: "CheckpointSaverHook" mtype: "" } member { name: "CheckpointSaverListener" mtype: "" } member { name: "ChiefSessionCreator" mtype: "" } member { name: "ClusterDef" - mtype: "" + mtype: "" } member { name: "ClusterSpec" mtype: "" } member { name: "Coordinator" mtype: "" } member { name: "Example" - mtype: "" + mtype: "" } member { name: "ExponentialMovingAverage" mtype: "" } member { name: "Feature" - mtype: "" + mtype: "" } member { name: "FeatureList" - mtype: "" + mtype: "" } member { name: "FeatureLists" - mtype: "" + mtype: "" } member { name: "Features" - mtype: "" + mtype: "" } member { name: "FeedFnHook" mtype: "" } member { name: "FinalOpsHook" mtype: "" } member { name: "FloatList" - mtype: "" + mtype: "" } member { name: "FtrlOptimizer" mtype: "" } member { name: "GlobalStepWaiterHook" mtype: "" } member { name: "GradientDescentOptimizer" mtype: "" } member { name: "Int64List" - mtype: "" + mtype: "" } member { name: "JobDef" - mtype: "" + mtype: "" } member { name: "LoggingTensorHook" mtype: "" } member { name: "LooperThread" mtype: "" } member { name: "MomentumOptimizer" mtype: "" } member { name: "MonitoredSession" mtype: "" } member { name: "NanLossDuringTrainingError" mtype: "" } member { name: "NanTensorHook" mtype: "" } member { name: "Optimizer" mtype: "" } member { name: "ProfilerHook" mtype: "" } member { name: "ProximalAdagradOptimizer" mtype: "" } member { name: "ProximalGradientDescentOptimizer" mtype: "" } member { name: "QueueRunner" mtype: "" } member { name: "RMSPropOptimizer" mtype: "" } member { name: "Saver" mtype: "" } member { name: "SaverDef" - mtype: "" + mtype: "" } member { name: "Scaffold" mtype: "" } member { name: "SecondOrStepTimer" mtype: "" } member { name: "SequenceExample" - mtype: "" + mtype: "" } member { name: "Server" mtype: "" } member { name: "ServerDef" - mtype: "" + mtype: "" } member { name: "SessionCreator" mtype: "" } member { name: "SessionManager" mtype: "" } member { name: "SessionRunArgs" mtype: "" } member { name: "SessionRunContext" mtype: "" } member { name: "SessionRunHook" mtype: "" } member { name: "SessionRunValues" mtype: "" } member { name: "SingularMonitoredSession" mtype: "" } member { name: "StepCounterHook" mtype: "" } member { name: "StopAtStepHook" mtype: "" } member { name: "SummarySaverHook" mtype: "" } member { name: "Supervisor" mtype: "" } member { name: "SyncReplicasOptimizer" mtype: "" } member { name: "VocabInfo" mtype: "" } member { name: "WorkerSessionCreator" mtype: "" } member { name: "experimental" mtype: "" } member { name: "queue_runner" mtype: "" } member_method { name: "MonitoredTrainingSession" argspec: "args=[\'master\', \'is_chief\', \'checkpoint_dir\', \'scaffold\', \'hooks\', \'chief_only_hooks\', \'save_checkpoint_secs\', \'save_summaries_steps\', \'save_summaries_secs\', \'config\', \'stop_grace_period_secs\', \'log_step_count_steps\', \'max_wait_secs\', \'save_checkpoint_steps\', \'summary_dir\', \'save_graph_def\'], varargs=None, keywords=None, defaults=[\'\', \'True\', \'None\', \'None\', \'None\', \'None\', \'\', \'\', \'\', \'None\', \'120\', \'100\', \'7200\', \'\', \'None\', \'True\'], " } member_method { name: "NewCheckpointReader" argspec: "args=[\'filepattern\'], varargs=None, keywords=None, defaults=None" } member_method { name: "add_queue_runner" argspec: "args=[\'qr\', \'collection\'], varargs=None, keywords=None, defaults=[\'queue_runners\'], " } member_method { name: "assert_global_step" argspec: "args=[\'global_step_tensor\'], varargs=None, keywords=None, defaults=None" } member_method { name: "basic_train_loop" argspec: "args=[\'supervisor\', \'train_step_fn\', \'args\', \'kwargs\', \'master\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'\'], " } member_method { name: "batch" argspec: "args=[\'tensors\', \'batch_size\', \'num_threads\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "batch_join" argspec: "args=[\'tensors_list\', \'batch_size\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "checkpoint_exists" argspec: "args=[\'checkpoint_prefix\'], varargs=None, keywords=None, defaults=None" } member_method { name: "checkpoints_iterator" argspec: "args=[\'checkpoint_dir\', \'min_interval_secs\', \'timeout\', \'timeout_fn\'], varargs=None, keywords=None, defaults=[\'0\', \'None\', \'None\'], " } member_method { name: "cosine_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'alpha\', \'name\'], varargs=None, keywords=None, defaults=[\'0.0\', \'None\'], " } member_method { name: "cosine_decay_restarts" argspec: "args=[\'learning_rate\', \'global_step\', \'first_decay_steps\', \'t_mul\', \'m_mul\', \'alpha\', \'name\'], varargs=None, keywords=None, defaults=[\'2.0\', \'1.0\', \'0.0\', \'None\'], " } member_method { name: "create_global_step" argspec: "args=[\'graph\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "do_quantize_training_on_graphdef" argspec: "args=[\'input_graph\', \'num_bits\'], varargs=None, keywords=None, defaults=None" } member_method { name: "exponential_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'decay_rate\', \'staircase\', \'name\'], varargs=None, keywords=None, defaults=[\'False\', \'None\'], " } member_method { name: "export_meta_graph" argspec: "args=[\'filename\', \'meta_info_def\', \'graph_def\', \'saver_def\', \'collection_list\', \'as_text\', \'graph\', \'export_scope\', \'clear_devices\', \'clear_extraneous_savers\', \'strip_default_attrs\', \'save_debug_info\'], varargs=None, keywords=kwargs, defaults=[\'None\', \'None\', \'None\', \'None\', \'None\', \'False\', \'None\', \'None\', \'False\', \'False\', \'False\', \'False\'], " } member_method { name: "generate_checkpoint_state_proto" argspec: "args=[\'save_dir\', \'model_checkpoint_path\', \'all_model_checkpoint_paths\', \'all_model_checkpoint_timestamps\', \'last_preserved_timestamp\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\'], " } member_method { name: "get_checkpoint_mtimes" argspec: "args=[\'checkpoint_prefixes\'], varargs=None, keywords=None, defaults=None" } member_method { name: "get_checkpoint_state" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "get_global_step" argspec: "args=[\'graph\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "get_or_create_global_step" argspec: "args=[\'graph\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "global_step" argspec: "args=[\'sess\', \'global_step_tensor\'], varargs=None, keywords=None, defaults=None" } member_method { name: "import_meta_graph" argspec: "args=[\'meta_graph_or_file\', \'clear_devices\', \'import_scope\'], varargs=None, keywords=kwargs, defaults=[\'False\', \'None\'], " } member_method { name: "init_from_checkpoint" argspec: "args=[\'ckpt_dir_or_file\', \'assignment_map\'], varargs=None, keywords=None, defaults=None" } member_method { name: "input_producer" argspec: "args=[\'input_tensor\', \'element_shape\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'summary_name\', \'name\', \'cancel_op\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'True\', \'None\', \'32\', \'None\', \'None\', \'None\', \'None\'], " } member_method { name: "inverse_time_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'decay_rate\', \'staircase\', \'name\'], varargs=None, keywords=None, defaults=[\'False\', \'None\'], " } member_method { name: "latest_checkpoint" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "limit_epochs" argspec: "args=[\'tensor\', \'num_epochs\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "linear_cosine_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'num_periods\', \'alpha\', \'beta\', \'name\'], varargs=None, keywords=None, defaults=[\'0.5\', \'0.0\', \'0.001\', \'None\'], " } member_method { name: "list_variables" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_checkpoint" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_variable" argspec: "args=[\'ckpt_dir_or_file\', \'name\'], varargs=None, keywords=None, defaults=None" } member_method { name: "match_filenames_once" argspec: "args=[\'pattern\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "maybe_batch" argspec: "args=[\'tensors\', \'keep_input\', \'batch_size\', \'num_threads\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "maybe_batch_join" argspec: "args=[\'tensors_list\', \'keep_input\', \'batch_size\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "maybe_shuffle_batch" argspec: "args=[\'tensors\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'keep_input\', \'num_threads\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "maybe_shuffle_batch_join" argspec: "args=[\'tensors_list\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'keep_input\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "natural_exp_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'decay_rate\', \'staircase\', \'name\'], varargs=None, keywords=None, defaults=[\'False\', \'None\'], " } member_method { name: "noisy_linear_cosine_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'initial_variance\', \'variance_decay\', \'num_periods\', \'alpha\', \'beta\', \'name\'], varargs=None, keywords=None, defaults=[\'1.0\', \'0.55\', \'0.5\', \'0.0\', \'0.001\', \'None\'], " } member_method { name: "piecewise_constant" argspec: "args=[\'x\', \'boundaries\', \'values\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "piecewise_constant_decay" argspec: "args=[\'x\', \'boundaries\', \'values\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "polynomial_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'end_learning_rate\', \'power\', \'cycle\', \'name\'], varargs=None, keywords=None, defaults=[\'0.0001\', \'1.0\', \'False\', \'None\'], " } member_method { name: "range_input_producer" argspec: "args=[\'limit\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'True\', \'None\', \'32\', \'None\', \'None\'], " } member_method { name: "remove_checkpoint" argspec: "args=[\'checkpoint_prefix\', \'checkpoint_format_version\', \'meta_graph_suffix\'], varargs=None, keywords=None, defaults=[\'2\', \'meta\'], " } member_method { name: "replica_device_setter" argspec: "args=[\'ps_tasks\', \'ps_device\', \'worker_device\', \'merge_devices\', \'cluster\', \'ps_ops\', \'ps_strategy\'], varargs=None, keywords=None, defaults=[\'0\', \'/job:ps\', \'/job:worker\', \'True\', \'None\', \'None\', \'None\'], " } member_method { name: "sdca_fprint" argspec: "args=[\'input\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "sdca_optimizer" argspec: "args=[\'sparse_example_indices\', \'sparse_feature_indices\', \'sparse_feature_values\', \'dense_features\', \'example_weights\', \'example_labels\', \'sparse_indices\', \'sparse_weights\', \'dense_weights\', \'example_state_data\', \'loss_type\', \'l1\', \'l2\', \'num_loss_partitions\', \'num_inner_iterations\', \'adaptative\', \'name\'], varargs=None, keywords=None, defaults=[\'True\', \'None\'], " } member_method { name: "sdca_shrink_l1" argspec: "args=[\'weights\', \'l1\', \'l2\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "shuffle_batch" argspec: "args=[\'tensors\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'num_threads\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "shuffle_batch_join" argspec: "args=[\'tensors_list\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "slice_input_producer" argspec: "args=[\'tensor_list\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'True\', \'None\', \'32\', \'None\', \'None\'], " } member_method { name: "start_queue_runners" argspec: "args=[\'sess\', \'coord\', \'daemon\', \'start\', \'collection\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'True\', \'True\', \'queue_runners\'], " } member_method { name: "string_input_producer" argspec: "args=[\'string_tensor\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'name\', \'cancel_op\'], varargs=None, keywords=None, defaults=[\'None\', \'True\', \'None\', \'32\', \'None\', \'None\', \'None\'], " } member_method { name: "summary_iterator" argspec: "args=[\'path\'], varargs=None, keywords=None, defaults=None" } member_method { name: "update_checkpoint_state" argspec: "args=[\'save_dir\', \'model_checkpoint_path\', \'all_model_checkpoint_paths\', \'latest_filename\', \'all_model_checkpoint_timestamps\', \'last_preserved_timestamp\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\', \'None\'], " } member_method { name: "warm_start" argspec: "args=[\'ckpt_to_initialize_from\', \'vars_to_warm_start\', \'var_name_to_vocab_info\', \'var_name_to_prev_var_name\'], varargs=None, keywords=None, defaults=[\'.*\', \'None\', \'None\'], " } member_method { name: "write_graph" argspec: "args=[\'graph_or_graph_def\', \'logdir\', \'name\', \'as_text\'], varargs=None, keywords=None, defaults=[\'True\'], " } } ERROR:tensorflow: Change detected in python object: tensorflow.profiler. E0219 03:50:45.721901 281473808233344 api_compatibility_test.py:392] Change detected in python object: tensorflow.profiler. ERROR:tensorflow: path: "tensorflow.profiler" tf_module { member { name: "AdviceProto" - mtype: "" + mtype: "" } member { name: "GraphNodeProto" - mtype: "" + mtype: "" } member { name: "MultiGraphNodeProto" - mtype: "" + mtype: "" } member { name: "OpLogProto" - mtype: "" + mtype: "" } member { name: "ProfileOptionBuilder" mtype: "" } member { name: "Profiler" mtype: "" } member_method { name: "advise" argspec: "args=[\'graph\', \'run_meta\', \'options\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'0\'], " } member_method { name: "profile" argspec: "args=[\'graph\', \'run_meta\', \'op_log\', \'cmd\', \'options\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\', \'scope\', \'0\'], " } member_method { name: "write_op_log" argspec: "args=[\'graph\', \'log_dir\', \'op_log\', \'run_meta\', \'add_trace\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'True\'], " } } E0219 03:50:45.722040 281473808233344 api_compatibility_test.py:393] path: "tensorflow.profiler" tf_module { member { name: "AdviceProto" - mtype: "" + mtype: "" } member { name: "GraphNodeProto" - mtype: "" + mtype: "" } member { name: "MultiGraphNodeProto" - mtype: "" + mtype: "" } member { name: "OpLogProto" - mtype: "" + mtype: "" } member { name: "ProfileOptionBuilder" mtype: "" } member { name: "Profiler" mtype: "" } member_method { name: "advise" argspec: "args=[\'graph\', \'run_meta\', \'options\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'0\'], " } member_method { name: "profile" argspec: "args=[\'graph\', \'run_meta\', \'op_log\', \'cmd\', \'options\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\', \'scope\', \'0\'], " } member_method { name: "write_op_log" argspec: "args=[\'graph\', \'log_dir\', \'op_log\', \'run_meta\', \'add_trace\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'True\'], " } } ERROR:tensorflow: Change detected in python object: tensorflow. E0219 03:50:45.722193 281473808233344 api_compatibility_test.py:392] Change detected in python object: tensorflow. ERROR:tensorflow: None : --- +++ @@ -10,7 +10,7 @@ } member { name: "AttrValue" - mtype: "" + mtype: "" } member { name: "COMPILER_VERSION" @@ -34,7 +34,7 @@ } member { name: "ConfigProto" - mtype: "" + mtype: "" } member { name: "CriticalSection" @@ -54,7 +54,7 @@ } member { name: "Event" - mtype: "" + mtype: "" } member { name: "FIFOQueue" @@ -78,7 +78,7 @@ } member { name: "GPUOptions" - mtype: "" + mtype: "" } member { name: "GRAPH_DEF_VERSION" @@ -102,7 +102,7 @@ } member { name: "GraphDef" - mtype: "" + mtype: "" } member { name: "GraphKeys" @@ -110,11 +110,11 @@ } member { name: "GraphOptions" - mtype: "" + mtype: "" } member { name: "HistogramProto" - mtype: "" + mtype: "" } member { name: "IdentityReader" @@ -138,7 +138,7 @@ } member { name: "LogMessage" - mtype: "" + mtype: "" } member { name: "MONOLITHIC_BUILD" @@ -146,7 +146,7 @@ } member { name: "MetaGraphDef" - mtype: "" + mtype: "" } member { name: "Module" @@ -154,11 +154,11 @@ } member { name: "NameAttrList" - mtype: "" + mtype: "" } member { name: "NodeDef" - mtype: "" + mtype: "" } member { name: "OpError" @@ -170,7 +170,7 @@ } member { name: "OptimizerOptions" - mtype: "" + mtype: "" } member { name: "OptionalSpec" @@ -214,11 +214,11 @@ } member { name: "RunMetadata" - mtype: "" + mtype: "" } member { name: "RunOptions" - mtype: "" + mtype: "" } member { name: "Session" @@ -226,7 +226,7 @@ } member { name: "SessionLog" - mtype: "" + mtype: "" } member { name: "SparseConditionalAccumulator" @@ -250,11 +250,11 @@ } member { name: "Summary" - mtype: "" + mtype: "" } member { name: "SummaryMetadata" - mtype: "" + mtype: "" } member { name: "TFRecordReader" @@ -274,7 +274,7 @@ } member { name: "TensorInfo" - mtype: "" + mtype: "" } member { name: "TensorShape" E0219 03:50:45.722329 281473808233344 api_compatibility_test.py:393] None : --- +++ @@ -10,7 +10,7 @@ } member { name: "AttrValue" - mtype: "" + mtype: "" } member { name: "COMPILER_VERSION" @@ -34,7 +34,7 @@ } member { name: "ConfigProto" - mtype: "" + mtype: "" } member { name: "CriticalSection" @@ -54,7 +54,7 @@ } member { name: "Event" - mtype: "" + mtype: "" } member { name: "FIFOQueue" @@ -78,7 +78,7 @@ } member { name: "GPUOptions" - mtype: "" + mtype: "" } member { name: "GRAPH_DEF_VERSION" @@ -102,7 +102,7 @@ } member { name: "GraphDef" - mtype: "" + mtype: "" } member { name: "GraphKeys" @@ -110,11 +110,11 @@ } member { name: "GraphOptions" - mtype: "" + mtype: "" } member { name: "HistogramProto" - mtype: "" + mtype: "" } member { name: "IdentityReader" @@ -138,7 +138,7 @@ } member { name: "LogMessage" - mtype: "" + mtype: "" } member { name: "MONOLITHIC_BUILD" @@ -146,7 +146,7 @@ } member { name: "MetaGraphDef" - mtype: "" + mtype: "" } member { name: "Module" @@ -154,11 +154,11 @@ } member { name: "NameAttrList" - mtype: "" + mtype: "" } member { name: "NodeDef" - mtype: "" + mtype: "" } member { name: "OpError" @@ -170,7 +170,7 @@ } member { name: "OptimizerOptions" - mtype: "" + mtype: "" } member { name: "OptionalSpec" @@ -214,11 +214,11 @@ } member { name: "RunMetadata" - mtype: "" + mtype: "" } member { name: "RunOptions" - mtype: "" + mtype: "" } member { name: "Session" @@ -226,7 +226,7 @@ } member { name: "SessionLog" - mtype: "" + mtype: "" } member { name: "SparseConditionalAccumulator" @@ -250,11 +250,11 @@ } member { name: "Summary" - mtype: "" + mtype: "" } member { name: "SummaryMetadata" - mtype: "" + mtype: "" } member { name: "TFRecordReader" @@ -274,7 +274,7 @@ } member { name: "TensorInfo" - mtype: "" + mtype: "" } member { name: "TensorShape" ERROR:tensorflow: Change detected in python object: tensorflow.summary. E0219 03:50:45.722513 281473808233344 api_compatibility_test.py:392] Change detected in python object: tensorflow.summary. ERROR:tensorflow: path: "tensorflow.summary" tf_module { member { name: "Event" - mtype: "" + mtype: "" } member { name: "FileWriter" mtype: "" } member { name: "FileWriterCache" mtype: "" } member { name: "SessionLog" - mtype: "" + mtype: "" } member { name: "Summary" - mtype: "" + mtype: "" } member { name: "SummaryDescription" - mtype: "" + mtype: "" } member { name: "TaggedRunMetadata" - mtype: "" + mtype: "" } member_method { name: "all_v2_summary_ops" argspec: "args=[], varargs=None, keywords=None, defaults=None" } member_method { name: "audio" argspec: "args=[\'name\', \'tensor\', \'sample_rate\', \'max_outputs\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'3\', \'None\', \'None\'], " } member_method { name: "get_summary_description" argspec: "args=[\'node_def\'], varargs=None, keywords=None, defaults=None" } member_method { name: "histogram" argspec: "args=[\'name\', \'values\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "image" argspec: "args=[\'name\', \'tensor\', \'max_outputs\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'3\', \'None\', \'None\'], " } member_method { name: "initialize" argspec: "args=[\'graph\', \'session\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "merge" argspec: "args=[\'inputs\', \'collections\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "merge_all" argspec: "args=[\'key\', \'scope\', \'name\'], varargs=None, keywords=None, defaults=[\'summaries\', \'None\', \'None\'], " } member_method { name: "scalar" argspec: "args=[\'name\', \'tensor\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "tensor_summary" argspec: "args=[\'name\', \'tensor\', \'summary_description\', \'collections\', \'summary_metadata\', \'family\', \'display_name\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\', \'None\', \'None\'], " } member_method { name: "text" argspec: "args=[\'name\', \'tensor\', \'collections\'], varargs=None, keywords=None, defaults=[\'None\'], " } } E0219 03:50:45.722649 281473808233344 api_compatibility_test.py:393] path: "tensorflow.summary" tf_module { member { name: "Event" - mtype: "" + mtype: "" } member { name: "FileWriter" mtype: "" } member { name: "FileWriterCache" mtype: "" } member { name: "SessionLog" - mtype: "" + mtype: "" } member { name: "Summary" - mtype: "" + mtype: "" } member { name: "SummaryDescription" - mtype: "" + mtype: "" } member { name: "TaggedRunMetadata" - mtype: "" + mtype: "" } member_method { name: "all_v2_summary_ops" argspec: "args=[], varargs=None, keywords=None, defaults=None" } member_method { name: "audio" argspec: "args=[\'name\', \'tensor\', \'sample_rate\', \'max_outputs\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'3\', \'None\', \'None\'], " } member_method { name: "get_summary_description" argspec: "args=[\'node_def\'], varargs=None, keywords=None, defaults=None" } member_method { name: "histogram" argspec: "args=[\'name\', \'values\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "image" argspec: "args=[\'name\', \'tensor\', \'max_outputs\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'3\', \'None\', \'None\'], " } member_method { name: "initialize" argspec: "args=[\'graph\', \'session\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "merge" argspec: "args=[\'inputs\', \'collections\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "merge_all" argspec: "args=[\'key\', \'scope\', \'name\'], varargs=None, keywords=None, defaults=[\'summaries\', \'None\', \'None\'], " } member_method { name: "scalar" argspec: "args=[\'name\', \'tensor\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "tensor_summary" argspec: "args=[\'name\', \'tensor\', \'summary_description\', \'collections\', \'summary_metadata\', \'family\', \'display_name\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\', \'None\', \'None\'], " } member_method { name: "text" argspec: "args=[\'name\', \'tensor\', \'collections\'], varargs=None, keywords=None, defaults=[\'None\'], " } } INFO:tensorflow:time(__main__.ApiCompatibilityTest.testAPIBackwardsCompatibilityV1): 3.21s I0219 03:50:45.722890 281473808233344 test_util.py:2467] time(__main__.ApiCompatibilityTest.testAPIBackwardsCompatibilityV1): 3.21s [ FAILED ] ApiCompatibilityTest.testAPIBackwardsCompatibilityV1 [ RUN ] ApiCompatibilityTest.testAPIBackwardsCompatibilityV2 ERROR:tensorflow:TensorFlow API backwards compatibility test This test ensures all changes to the public API of TensorFlow are intended. If this test fails, it means a change has been made to the public API. Backwards incompatible changes are not allowed. You can run the test as follows to update test goldens and package them with your change. $ bazel run tensorflow/tools/api/tests:api_compatibility_test \ # -- --update_goldens True You will need an API approval to make changes to the public TensorFlow API. This includes additions to the API. E0219 03:50:47.987244 281473808233344 api_compatibility_test.py:370] TensorFlow API backwards compatibility test This test ensures all changes to the public API of TensorFlow are intended. If this test fails, it means a change has been made to the public API. Backwards incompatible changes are not allowed. You can run the test as follows to update test goldens and package them with your change. $ bazel run tensorflow/tools/api/tests:api_compatibility_test \ # -- --update_goldens True You will need an API approval to make changes to the public TensorFlow API. This includes additions to the API. ERROR:tensorflow:1 differences found between API and golden. E0219 03:50:47.987564 281473808233344 api_compatibility_test.py:371] 1 differences found between API and golden. ERROR:tensorflow: Change detected in python object: tensorflow.train. E0219 03:50:47.987723 281473808233344 api_compatibility_test.py:392] Change detected in python object: tensorflow.train. ERROR:tensorflow: path: "tensorflow.train" tf_module { member { name: "BytesList" - mtype: "" + mtype: "" } member { name: "Checkpoint" mtype: "" } member { name: "CheckpointManager" mtype: "" } member { name: "CheckpointOptions" mtype: "" } member { name: "CheckpointView" mtype: "" } member { name: "ClusterDef" - mtype: "" + mtype: "" } member { name: "ClusterSpec" mtype: "" } member { name: "Coordinator" mtype: "" } member { name: "Example" - mtype: "" + mtype: "" } member { name: "ExponentialMovingAverage" mtype: "" } member { name: "Feature" - mtype: "" + mtype: "" } member { name: "FeatureList" - mtype: "" + mtype: "" } member { name: "FeatureLists" - mtype: "" + mtype: "" } member { name: "Features" - mtype: "" + mtype: "" } member { name: "FloatList" - mtype: "" + mtype: "" } member { name: "Int64List" - mtype: "" + mtype: "" } member { name: "JobDef" - mtype: "" + mtype: "" } member { name: "SequenceExample" - mtype: "" + mtype: "" } member { name: "ServerDef" - mtype: "" + mtype: "" } member { name: "TrackableView" mtype: "" } member { name: "experimental" mtype: "" } member_method { name: "checkpoints_iterator" argspec: "args=[\'checkpoint_dir\', \'min_interval_secs\', \'timeout\', \'timeout_fn\'], varargs=None, keywords=None, defaults=[\'0\', \'None\', \'None\'], " } member_method { name: "get_checkpoint_state" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "latest_checkpoint" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "list_variables" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_checkpoint" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_variable" argspec: "args=[\'ckpt_dir_or_file\', \'name\'], varargs=None, keywords=None, defaults=None" } } E0219 03:50:47.987864 281473808233344 api_compatibility_test.py:393] path: "tensorflow.train" tf_module { member { name: "BytesList" - mtype: "" + mtype: "" } member { name: "Checkpoint" mtype: "" } member { name: "CheckpointManager" mtype: "" } member { name: "CheckpointOptions" mtype: "" } member { name: "CheckpointView" mtype: "" } member { name: "ClusterDef" - mtype: "" + mtype: "" } member { name: "ClusterSpec" mtype: "" } member { name: "Coordinator" mtype: "" } member { name: "Example" - mtype: "" + mtype: "" } member { name: "ExponentialMovingAverage" mtype: "" } member { name: "Feature" - mtype: "" + mtype: "" } member { name: "FeatureList" - mtype: "" + mtype: "" } member { name: "FeatureLists" - mtype: "" + mtype: "" } member { name: "Features" - mtype: "" + mtype: "" } member { name: "FloatList" - mtype: "" + mtype: "" } member { name: "Int64List" - mtype: "" + mtype: "" } member { name: "JobDef" - mtype: "" + mtype: "" } member { name: "SequenceExample" - mtype: "" + mtype: "" } member { name: "ServerDef" - mtype: "" + mtype: "" } member { name: "TrackableView" mtype: "" } member { name: "experimental" mtype: "" } member_method { name: "checkpoints_iterator" argspec: "args=[\'checkpoint_dir\', \'min_interval_secs\', \'timeout\', \'timeout_fn\'], varargs=None, keywords=None, defaults=[\'0\', \'None\', \'None\'], " } member_method { name: "get_checkpoint_state" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "latest_checkpoint" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "list_variables" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_checkpoint" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_variable" argspec: "args=[\'ckpt_dir_or_file\', \'name\'], varargs=None, keywords=None, defaults=None" } } INFO:tensorflow:time(__main__.ApiCompatibilityTest.testAPIBackwardsCompatibilityV2): 2.26s I0219 03:50:47.988110 281473808233344 test_util.py:2467] time(__main__.ApiCompatibilityTest.testAPIBackwardsCompatibilityV2): 2.26s [ FAILED ] ApiCompatibilityTest.testAPIBackwardsCompatibilityV2 [ RUN ] ApiCompatibilityTest.testNoSubclassOfMessage INFO:tensorflow:time(__main__.ApiCompatibilityTest.testNoSubclassOfMessage): 0.86s I0219 03:50:48.848494 281473808233344 test_util.py:2467] time(__main__.ApiCompatibilityTest.testNoSubclassOfMessage): 0.86s [ OK ] ApiCompatibilityTest.testNoSubclassOfMessage [ RUN ] ApiCompatibilityTest.testNoSubclassOfMessageV1 INFO:tensorflow:time(__main__.ApiCompatibilityTest.testNoSubclassOfMessageV1): 0.29s I0219 03:50:49.138099 281473808233344 test_util.py:2467] time(__main__.ApiCompatibilityTest.testNoSubclassOfMessageV1): 0.29s [ OK ] ApiCompatibilityTest.testNoSubclassOfMessageV1 [ RUN ] ApiCompatibilityTest.testNoSubclassOfMessageV2 INFO:tensorflow:time(__main__.ApiCompatibilityTest.testNoSubclassOfMessageV2): 0.3s I0219 03:50:49.441405 281473808233344 test_util.py:2467] time(__main__.ApiCompatibilityTest.testNoSubclassOfMessageV2): 0.3s [ OK ] ApiCompatibilityTest.testNoSubclassOfMessageV2 [ RUN ] ApiCompatibilityTest.test_session [ SKIPPED ] ApiCompatibilityTest.test_session ====================================================================== FAIL: testAPIBackwardsCompatibility (__main__.ApiCompatibilityTest) ApiCompatibilityTest.testAPIBackwardsCompatibility ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 511, in testAPIBackwardsCompatibility self._checkBackwardsCompatibility( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 488, in _checkBackwardsCompatibility self._AssertProtoDictEquals( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 395, in _AssertProtoDictEquals self.fail('%d differences found between API and golden.' % diff_count) AssertionError: 1 differences found between API and golden. ====================================================================== FAIL: testAPIBackwardsCompatibilityV1 (__main__.ApiCompatibilityTest) ApiCompatibilityTest.testAPIBackwardsCompatibilityV1 ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 528, in testAPIBackwardsCompatibilityV1 self._checkBackwardsCompatibility( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 488, in _checkBackwardsCompatibility self._AssertProtoDictEquals( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 395, in _AssertProtoDictEquals self.fail('%d differences found between API and golden.' % diff_count) AssertionError: 4 differences found between API and golden. ====================================================================== FAIL: testAPIBackwardsCompatibilityV2 (__main__.ApiCompatibilityTest) ApiCompatibilityTest.testAPIBackwardsCompatibilityV2 ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 550, in testAPIBackwardsCompatibilityV2 self._checkBackwardsCompatibility( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 488, in _checkBackwardsCompatibility self._AssertProtoDictEquals( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 395, in _AssertProtoDictEquals self.fail('%d differences found between API and golden.' % diff_count) AssertionError: 1 differences found between API and golden. ---------------------------------------------------------------------- Ran 7 tests in 9.562s FAILED (failures=3, skipped=1) ================================================================================ ==================== Test output for //tensorflow/tools/api/tests:api_compatibility_test: 2023-02-19 03:50:51.669625: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. Running tests under Python 3.9.16: /usr/bin/python3 [ RUN ] ApiCompatibilityTest.testAPIBackwardsCompatibility ERROR:tensorflow:TensorFlow API backwards compatibility test This test ensures all changes to the public API of TensorFlow are intended. If this test fails, it means a change has been made to the public API. Backwards incompatible changes are not allowed. You can run the test as follows to update test goldens and package them with your change. $ bazel run tensorflow/tools/api/tests:api_compatibility_test \ # -- --update_goldens True You will need an API approval to make changes to the public TensorFlow API. This includes additions to the API. E0219 03:50:59.164390 281473863414656 api_compatibility_test.py:370] TensorFlow API backwards compatibility test This test ensures all changes to the public API of TensorFlow are intended. If this test fails, it means a change has been made to the public API. Backwards incompatible changes are not allowed. You can run the test as follows to update test goldens and package them with your change. $ bazel run tensorflow/tools/api/tests:api_compatibility_test \ # -- --update_goldens True You will need an API approval to make changes to the public TensorFlow API. This includes additions to the API. ERROR:tensorflow:1 differences found between API and golden. E0219 03:50:59.164741 281473863414656 api_compatibility_test.py:371] 1 differences found between API and golden. ERROR:tensorflow: Change detected in python object: tensorflow.train. E0219 03:50:59.164902 281473863414656 api_compatibility_test.py:392] Change detected in python object: tensorflow.train. ERROR:tensorflow: path: "tensorflow.train" tf_module { member { name: "BytesList" - mtype: "" + mtype: "" } member { name: "Checkpoint" mtype: "" } member { name: "CheckpointManager" mtype: "" } member { name: "CheckpointOptions" mtype: "" } member { name: "CheckpointView" mtype: "" } member { name: "ClusterDef" - mtype: "" + mtype: "" } member { name: "ClusterSpec" mtype: "" } member { name: "Coordinator" mtype: "" } member { name: "Example" - mtype: "" + mtype: "" } member { name: "ExponentialMovingAverage" mtype: "" } member { name: "Feature" - mtype: "" + mtype: "" } member { name: "FeatureList" - mtype: "" + mtype: "" } member { name: "FeatureLists" - mtype: "" + mtype: "" } member { name: "Features" - mtype: "" + mtype: "" } member { name: "FloatList" - mtype: "" + mtype: "" } member { name: "Int64List" - mtype: "" + mtype: "" } member { name: "JobDef" - mtype: "" + mtype: "" } member { name: "SequenceExample" - mtype: "" + mtype: "" } member { name: "ServerDef" - mtype: "" + mtype: "" } member { name: "TrackableView" mtype: "" } member { name: "experimental" mtype: "" } member_method { name: "checkpoints_iterator" argspec: "args=[\'checkpoint_dir\', \'min_interval_secs\', \'timeout\', \'timeout_fn\'], varargs=None, keywords=None, defaults=[\'0\', \'None\', \'None\'], " } member_method { name: "get_checkpoint_state" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "latest_checkpoint" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "list_variables" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_checkpoint" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_variable" argspec: "args=[\'ckpt_dir_or_file\', \'name\'], varargs=None, keywords=None, defaults=None" } } E0219 03:50:59.165046 281473863414656 api_compatibility_test.py:393] path: "tensorflow.train" tf_module { member { name: "BytesList" - mtype: "" + mtype: "" } member { name: "Checkpoint" mtype: "" } member { name: "CheckpointManager" mtype: "" } member { name: "CheckpointOptions" mtype: "" } member { name: "CheckpointView" mtype: "" } member { name: "ClusterDef" - mtype: "" + mtype: "" } member { name: "ClusterSpec" mtype: "" } member { name: "Coordinator" mtype: "" } member { name: "Example" - mtype: "" + mtype: "" } member { name: "ExponentialMovingAverage" mtype: "" } member { name: "Feature" - mtype: "" + mtype: "" } member { name: "FeatureList" - mtype: "" + mtype: "" } member { name: "FeatureLists" - mtype: "" + mtype: "" } member { name: "Features" - mtype: "" + mtype: "" } member { name: "FloatList" - mtype: "" + mtype: "" } member { name: "Int64List" - mtype: "" + mtype: "" } member { name: "JobDef" - mtype: "" + mtype: "" } member { name: "SequenceExample" - mtype: "" + mtype: "" } member { name: "ServerDef" - mtype: "" + mtype: "" } member { name: "TrackableView" mtype: "" } member { name: "experimental" mtype: "" } member_method { name: "checkpoints_iterator" argspec: "args=[\'checkpoint_dir\', \'min_interval_secs\', \'timeout\', \'timeout_fn\'], varargs=None, keywords=None, defaults=[\'0\', \'None\', \'None\'], " } member_method { name: "get_checkpoint_state" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "latest_checkpoint" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "list_variables" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_checkpoint" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_variable" argspec: "args=[\'ckpt_dir_or_file\', \'name\'], varargs=None, keywords=None, defaults=None" } } INFO:tensorflow:time(__main__.ApiCompatibilityTest.testAPIBackwardsCompatibility): 2.34s I0219 03:50:59.165316 281473863414656 test_util.py:2467] time(__main__.ApiCompatibilityTest.testAPIBackwardsCompatibility): 2.34s [ FAILED ] ApiCompatibilityTest.testAPIBackwardsCompatibility [ RUN ] ApiCompatibilityTest.testAPIBackwardsCompatibilityV1 WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/python/util/decorator_utils.py:153: GraphKeys.VARIABLES (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.GraphKeys.GLOBAL_VARIABLES` instead. W0219 03:50:59.262114 281473863414656 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/python/util/decorator_utils.py:153: GraphKeys.VARIABLES (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.GraphKeys.GLOBAL_VARIABLES` instead. ERROR:tensorflow:TensorFlow API backwards compatibility test This test ensures all changes to the public API of TensorFlow are intended. If this test fails, it means a change has been made to the public API. Backwards incompatible changes are not allowed. You can run the test as follows to update test goldens and package them with your change. $ bazel run tensorflow/tools/api/tests:api_compatibility_test \ # -- --update_goldens True You will need an API approval to make changes to the public TensorFlow API. This includes additions to the API. E0219 03:51:03.325659 281473863414656 api_compatibility_test.py:370] TensorFlow API backwards compatibility test This test ensures all changes to the public API of TensorFlow are intended. If this test fails, it means a change has been made to the public API. Backwards incompatible changes are not allowed. You can run the test as follows to update test goldens and package them with your change. $ bazel run tensorflow/tools/api/tests:api_compatibility_test \ # -- --update_goldens True You will need an API approval to make changes to the public TensorFlow API. This includes additions to the API. ERROR:tensorflow:4 differences found between API and golden. E0219 03:51:03.325962 281473863414656 api_compatibility_test.py:371] 4 differences found between API and golden. ERROR:tensorflow: Change detected in python object: tensorflow.train. E0219 03:51:03.326130 281473863414656 api_compatibility_test.py:392] Change detected in python object: tensorflow.train. ERROR:tensorflow: path: "tensorflow.train" tf_module { member { name: "AdadeltaOptimizer" mtype: "" } member { name: "AdagradDAOptimizer" mtype: "" } member { name: "AdagradOptimizer" mtype: "" } member { name: "AdamOptimizer" mtype: "" } member { name: "BytesList" - mtype: "" + mtype: "" } member { name: "Checkpoint" mtype: "" } member { name: "CheckpointManager" mtype: "" } member { name: "CheckpointOptions" mtype: "" } member { name: "CheckpointSaverHook" mtype: "" } member { name: "CheckpointSaverListener" mtype: "" } member { name: "ChiefSessionCreator" mtype: "" } member { name: "ClusterDef" - mtype: "" + mtype: "" } member { name: "ClusterSpec" mtype: "" } member { name: "Coordinator" mtype: "" } member { name: "Example" - mtype: "" + mtype: "" } member { name: "ExponentialMovingAverage" mtype: "" } member { name: "Feature" - mtype: "" + mtype: "" } member { name: "FeatureList" - mtype: "" + mtype: "" } member { name: "FeatureLists" - mtype: "" + mtype: "" } member { name: "Features" - mtype: "" + mtype: "" } member { name: "FeedFnHook" mtype: "" } member { name: "FinalOpsHook" mtype: "" } member { name: "FloatList" - mtype: "" + mtype: "" } member { name: "FtrlOptimizer" mtype: "" } member { name: "GlobalStepWaiterHook" mtype: "" } member { name: "GradientDescentOptimizer" mtype: "" } member { name: "Int64List" - mtype: "" + mtype: "" } member { name: "JobDef" - mtype: "" + mtype: "" } member { name: "LoggingTensorHook" mtype: "" } member { name: "LooperThread" mtype: "" } member { name: "MomentumOptimizer" mtype: "" } member { name: "MonitoredSession" mtype: "" } member { name: "NanLossDuringTrainingError" mtype: "" } member { name: "NanTensorHook" mtype: "" } member { name: "Optimizer" mtype: "" } member { name: "ProfilerHook" mtype: "" } member { name: "ProximalAdagradOptimizer" mtype: "" } member { name: "ProximalGradientDescentOptimizer" mtype: "" } member { name: "QueueRunner" mtype: "" } member { name: "RMSPropOptimizer" mtype: "" } member { name: "Saver" mtype: "" } member { name: "SaverDef" - mtype: "" + mtype: "" } member { name: "Scaffold" mtype: "" } member { name: "SecondOrStepTimer" mtype: "" } member { name: "SequenceExample" - mtype: "" + mtype: "" } member { name: "Server" mtype: "" } member { name: "ServerDef" - mtype: "" + mtype: "" } member { name: "SessionCreator" mtype: "" } member { name: "SessionManager" mtype: "" } member { name: "SessionRunArgs" mtype: "" } member { name: "SessionRunContext" mtype: "" } member { name: "SessionRunHook" mtype: "" } member { name: "SessionRunValues" mtype: "" } member { name: "SingularMonitoredSession" mtype: "" } member { name: "StepCounterHook" mtype: "" } member { name: "StopAtStepHook" mtype: "" } member { name: "SummarySaverHook" mtype: "" } member { name: "Supervisor" mtype: "" } member { name: "SyncReplicasOptimizer" mtype: "" } member { name: "VocabInfo" mtype: "" } member { name: "WorkerSessionCreator" mtype: "" } member { name: "experimental" mtype: "" } member { name: "queue_runner" mtype: "" } member_method { name: "MonitoredTrainingSession" argspec: "args=[\'master\', \'is_chief\', \'checkpoint_dir\', \'scaffold\', \'hooks\', \'chief_only_hooks\', \'save_checkpoint_secs\', \'save_summaries_steps\', \'save_summaries_secs\', \'config\', \'stop_grace_period_secs\', \'log_step_count_steps\', \'max_wait_secs\', \'save_checkpoint_steps\', \'summary_dir\', \'save_graph_def\'], varargs=None, keywords=None, defaults=[\'\', \'True\', \'None\', \'None\', \'None\', \'None\', \'\', \'\', \'\', \'None\', \'120\', \'100\', \'7200\', \'\', \'None\', \'True\'], " } member_method { name: "NewCheckpointReader" argspec: "args=[\'filepattern\'], varargs=None, keywords=None, defaults=None" } member_method { name: "add_queue_runner" argspec: "args=[\'qr\', \'collection\'], varargs=None, keywords=None, defaults=[\'queue_runners\'], " } member_method { name: "assert_global_step" argspec: "args=[\'global_step_tensor\'], varargs=None, keywords=None, defaults=None" } member_method { name: "basic_train_loop" argspec: "args=[\'supervisor\', \'train_step_fn\', \'args\', \'kwargs\', \'master\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'\'], " } member_method { name: "batch" argspec: "args=[\'tensors\', \'batch_size\', \'num_threads\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "batch_join" argspec: "args=[\'tensors_list\', \'batch_size\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "checkpoint_exists" argspec: "args=[\'checkpoint_prefix\'], varargs=None, keywords=None, defaults=None" } member_method { name: "checkpoints_iterator" argspec: "args=[\'checkpoint_dir\', \'min_interval_secs\', \'timeout\', \'timeout_fn\'], varargs=None, keywords=None, defaults=[\'0\', \'None\', \'None\'], " } member_method { name: "cosine_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'alpha\', \'name\'], varargs=None, keywords=None, defaults=[\'0.0\', \'None\'], " } member_method { name: "cosine_decay_restarts" argspec: "args=[\'learning_rate\', \'global_step\', \'first_decay_steps\', \'t_mul\', \'m_mul\', \'alpha\', \'name\'], varargs=None, keywords=None, defaults=[\'2.0\', \'1.0\', \'0.0\', \'None\'], " } member_method { name: "create_global_step" argspec: "args=[\'graph\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "do_quantize_training_on_graphdef" argspec: "args=[\'input_graph\', \'num_bits\'], varargs=None, keywords=None, defaults=None" } member_method { name: "exponential_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'decay_rate\', \'staircase\', \'name\'], varargs=None, keywords=None, defaults=[\'False\', \'None\'], " } member_method { name: "export_meta_graph" argspec: "args=[\'filename\', \'meta_info_def\', \'graph_def\', \'saver_def\', \'collection_list\', \'as_text\', \'graph\', \'export_scope\', \'clear_devices\', \'clear_extraneous_savers\', \'strip_default_attrs\', \'save_debug_info\'], varargs=None, keywords=kwargs, defaults=[\'None\', \'None\', \'None\', \'None\', \'None\', \'False\', \'None\', \'None\', \'False\', \'False\', \'False\', \'False\'], " } member_method { name: "generate_checkpoint_state_proto" argspec: "args=[\'save_dir\', \'model_checkpoint_path\', \'all_model_checkpoint_paths\', \'all_model_checkpoint_timestamps\', \'last_preserved_timestamp\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\'], " } member_method { name: "get_checkpoint_mtimes" argspec: "args=[\'checkpoint_prefixes\'], varargs=None, keywords=None, defaults=None" } member_method { name: "get_checkpoint_state" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "get_global_step" argspec: "args=[\'graph\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "get_or_create_global_step" argspec: "args=[\'graph\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "global_step" argspec: "args=[\'sess\', \'global_step_tensor\'], varargs=None, keywords=None, defaults=None" } member_method { name: "import_meta_graph" argspec: "args=[\'meta_graph_or_file\', \'clear_devices\', \'import_scope\'], varargs=None, keywords=kwargs, defaults=[\'False\', \'None\'], " } member_method { name: "init_from_checkpoint" argspec: "args=[\'ckpt_dir_or_file\', \'assignment_map\'], varargs=None, keywords=None, defaults=None" } member_method { name: "input_producer" argspec: "args=[\'input_tensor\', \'element_shape\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'summary_name\', \'name\', \'cancel_op\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'True\', \'None\', \'32\', \'None\', \'None\', \'None\', \'None\'], " } member_method { name: "inverse_time_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'decay_rate\', \'staircase\', \'name\'], varargs=None, keywords=None, defaults=[\'False\', \'None\'], " } member_method { name: "latest_checkpoint" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "limit_epochs" argspec: "args=[\'tensor\', \'num_epochs\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "linear_cosine_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'num_periods\', \'alpha\', \'beta\', \'name\'], varargs=None, keywords=None, defaults=[\'0.5\', \'0.0\', \'0.001\', \'None\'], " } member_method { name: "list_variables" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_checkpoint" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_variable" argspec: "args=[\'ckpt_dir_or_file\', \'name\'], varargs=None, keywords=None, defaults=None" } member_method { name: "match_filenames_once" argspec: "args=[\'pattern\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "maybe_batch" argspec: "args=[\'tensors\', \'keep_input\', \'batch_size\', \'num_threads\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "maybe_batch_join" argspec: "args=[\'tensors_list\', \'keep_input\', \'batch_size\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "maybe_shuffle_batch" argspec: "args=[\'tensors\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'keep_input\', \'num_threads\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "maybe_shuffle_batch_join" argspec: "args=[\'tensors_list\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'keep_input\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "natural_exp_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'decay_rate\', \'staircase\', \'name\'], varargs=None, keywords=None, defaults=[\'False\', \'None\'], " } member_method { name: "noisy_linear_cosine_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'initial_variance\', \'variance_decay\', \'num_periods\', \'alpha\', \'beta\', \'name\'], varargs=None, keywords=None, defaults=[\'1.0\', \'0.55\', \'0.5\', \'0.0\', \'0.001\', \'None\'], " } member_method { name: "piecewise_constant" argspec: "args=[\'x\', \'boundaries\', \'values\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "piecewise_constant_decay" argspec: "args=[\'x\', \'boundaries\', \'values\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "polynomial_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'end_learning_rate\', \'power\', \'cycle\', \'name\'], varargs=None, keywords=None, defaults=[\'0.0001\', \'1.0\', \'False\', \'None\'], " } member_method { name: "range_input_producer" argspec: "args=[\'limit\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'True\', \'None\', \'32\', \'None\', \'None\'], " } member_method { name: "remove_checkpoint" argspec: "args=[\'checkpoint_prefix\', \'checkpoint_format_version\', \'meta_graph_suffix\'], varargs=None, keywords=None, defaults=[\'2\', \'meta\'], " } member_method { name: "replica_device_setter" argspec: "args=[\'ps_tasks\', \'ps_device\', \'worker_device\', \'merge_devices\', \'cluster\', \'ps_ops\', \'ps_strategy\'], varargs=None, keywords=None, defaults=[\'0\', \'/job:ps\', \'/job:worker\', \'True\', \'None\', \'None\', \'None\'], " } member_method { name: "sdca_fprint" argspec: "args=[\'input\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "sdca_optimizer" argspec: "args=[\'sparse_example_indices\', \'sparse_feature_indices\', \'sparse_feature_values\', \'dense_features\', \'example_weights\', \'example_labels\', \'sparse_indices\', \'sparse_weights\', \'dense_weights\', \'example_state_data\', \'loss_type\', \'l1\', \'l2\', \'num_loss_partitions\', \'num_inner_iterations\', \'adaptative\', \'name\'], varargs=None, keywords=None, defaults=[\'True\', \'None\'], " } member_method { name: "sdca_shrink_l1" argspec: "args=[\'weights\', \'l1\', \'l2\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "shuffle_batch" argspec: "args=[\'tensors\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'num_threads\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "shuffle_batch_join" argspec: "args=[\'tensors_list\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "slice_input_producer" argspec: "args=[\'tensor_list\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'True\', \'None\', \'32\', \'None\', \'None\'], " } member_method { name: "start_queue_runners" argspec: "args=[\'sess\', \'coord\', \'daemon\', \'start\', \'collection\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'True\', \'True\', \'queue_runners\'], " } member_method { name: "string_input_producer" argspec: "args=[\'string_tensor\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'name\', \'cancel_op\'], varargs=None, keywords=None, defaults=[\'None\', \'True\', \'None\', \'32\', \'None\', \'None\', \'None\'], " } member_method { name: "summary_iterator" argspec: "args=[\'path\'], varargs=None, keywords=None, defaults=None" } member_method { name: "update_checkpoint_state" argspec: "args=[\'save_dir\', \'model_checkpoint_path\', \'all_model_checkpoint_paths\', \'latest_filename\', \'all_model_checkpoint_timestamps\', \'last_preserved_timestamp\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\', \'None\'], " } member_method { name: "warm_start" argspec: "args=[\'ckpt_to_initialize_from\', \'vars_to_warm_start\', \'var_name_to_vocab_info\', \'var_name_to_prev_var_name\'], varargs=None, keywords=None, defaults=[\'.*\', \'None\', \'None\'], " } member_method { name: "write_graph" argspec: "args=[\'graph_or_graph_def\', \'logdir\', \'name\', \'as_text\'], varargs=None, keywords=None, defaults=[\'True\'], " } } E0219 03:51:03.326282 281473863414656 api_compatibility_test.py:393] path: "tensorflow.train" tf_module { member { name: "AdadeltaOptimizer" mtype: "" } member { name: "AdagradDAOptimizer" mtype: "" } member { name: "AdagradOptimizer" mtype: "" } member { name: "AdamOptimizer" mtype: "" } member { name: "BytesList" - mtype: "" + mtype: "" } member { name: "Checkpoint" mtype: "" } member { name: "CheckpointManager" mtype: "" } member { name: "CheckpointOptions" mtype: "" } member { name: "CheckpointSaverHook" mtype: "" } member { name: "CheckpointSaverListener" mtype: "" } member { name: "ChiefSessionCreator" mtype: "" } member { name: "ClusterDef" - mtype: "" + mtype: "" } member { name: "ClusterSpec" mtype: "" } member { name: "Coordinator" mtype: "" } member { name: "Example" - mtype: "" + mtype: "" } member { name: "ExponentialMovingAverage" mtype: "" } member { name: "Feature" - mtype: "" + mtype: "" } member { name: "FeatureList" - mtype: "" + mtype: "" } member { name: "FeatureLists" - mtype: "" + mtype: "" } member { name: "Features" - mtype: "" + mtype: "" } member { name: "FeedFnHook" mtype: "" } member { name: "FinalOpsHook" mtype: "" } member { name: "FloatList" - mtype: "" + mtype: "" } member { name: "FtrlOptimizer" mtype: "" } member { name: "GlobalStepWaiterHook" mtype: "" } member { name: "GradientDescentOptimizer" mtype: "" } member { name: "Int64List" - mtype: "" + mtype: "" } member { name: "JobDef" - mtype: "" + mtype: "" } member { name: "LoggingTensorHook" mtype: "" } member { name: "LooperThread" mtype: "" } member { name: "MomentumOptimizer" mtype: "" } member { name: "MonitoredSession" mtype: "" } member { name: "NanLossDuringTrainingError" mtype: "" } member { name: "NanTensorHook" mtype: "" } member { name: "Optimizer" mtype: "" } member { name: "ProfilerHook" mtype: "" } member { name: "ProximalAdagradOptimizer" mtype: "" } member { name: "ProximalGradientDescentOptimizer" mtype: "" } member { name: "QueueRunner" mtype: "" } member { name: "RMSPropOptimizer" mtype: "" } member { name: "Saver" mtype: "" } member { name: "SaverDef" - mtype: "" + mtype: "" } member { name: "Scaffold" mtype: "" } member { name: "SecondOrStepTimer" mtype: "" } member { name: "SequenceExample" - mtype: "" + mtype: "" } member { name: "Server" mtype: "" } member { name: "ServerDef" - mtype: "" + mtype: "" } member { name: "SessionCreator" mtype: "" } member { name: "SessionManager" mtype: "" } member { name: "SessionRunArgs" mtype: "" } member { name: "SessionRunContext" mtype: "" } member { name: "SessionRunHook" mtype: "" } member { name: "SessionRunValues" mtype: "" } member { name: "SingularMonitoredSession" mtype: "" } member { name: "StepCounterHook" mtype: "" } member { name: "StopAtStepHook" mtype: "" } member { name: "SummarySaverHook" mtype: "" } member { name: "Supervisor" mtype: "" } member { name: "SyncReplicasOptimizer" mtype: "" } member { name: "VocabInfo" mtype: "" } member { name: "WorkerSessionCreator" mtype: "" } member { name: "experimental" mtype: "" } member { name: "queue_runner" mtype: "" } member_method { name: "MonitoredTrainingSession" argspec: "args=[\'master\', \'is_chief\', \'checkpoint_dir\', \'scaffold\', \'hooks\', \'chief_only_hooks\', \'save_checkpoint_secs\', \'save_summaries_steps\', \'save_summaries_secs\', \'config\', \'stop_grace_period_secs\', \'log_step_count_steps\', \'max_wait_secs\', \'save_checkpoint_steps\', \'summary_dir\', \'save_graph_def\'], varargs=None, keywords=None, defaults=[\'\', \'True\', \'None\', \'None\', \'None\', \'None\', \'\', \'\', \'\', \'None\', \'120\', \'100\', \'7200\', \'\', \'None\', \'True\'], " } member_method { name: "NewCheckpointReader" argspec: "args=[\'filepattern\'], varargs=None, keywords=None, defaults=None" } member_method { name: "add_queue_runner" argspec: "args=[\'qr\', \'collection\'], varargs=None, keywords=None, defaults=[\'queue_runners\'], " } member_method { name: "assert_global_step" argspec: "args=[\'global_step_tensor\'], varargs=None, keywords=None, defaults=None" } member_method { name: "basic_train_loop" argspec: "args=[\'supervisor\', \'train_step_fn\', \'args\', \'kwargs\', \'master\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'\'], " } member_method { name: "batch" argspec: "args=[\'tensors\', \'batch_size\', \'num_threads\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "batch_join" argspec: "args=[\'tensors_list\', \'batch_size\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "checkpoint_exists" argspec: "args=[\'checkpoint_prefix\'], varargs=None, keywords=None, defaults=None" } member_method { name: "checkpoints_iterator" argspec: "args=[\'checkpoint_dir\', \'min_interval_secs\', \'timeout\', \'timeout_fn\'], varargs=None, keywords=None, defaults=[\'0\', \'None\', \'None\'], " } member_method { name: "cosine_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'alpha\', \'name\'], varargs=None, keywords=None, defaults=[\'0.0\', \'None\'], " } member_method { name: "cosine_decay_restarts" argspec: "args=[\'learning_rate\', \'global_step\', \'first_decay_steps\', \'t_mul\', \'m_mul\', \'alpha\', \'name\'], varargs=None, keywords=None, defaults=[\'2.0\', \'1.0\', \'0.0\', \'None\'], " } member_method { name: "create_global_step" argspec: "args=[\'graph\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "do_quantize_training_on_graphdef" argspec: "args=[\'input_graph\', \'num_bits\'], varargs=None, keywords=None, defaults=None" } member_method { name: "exponential_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'decay_rate\', \'staircase\', \'name\'], varargs=None, keywords=None, defaults=[\'False\', \'None\'], " } member_method { name: "export_meta_graph" argspec: "args=[\'filename\', \'meta_info_def\', \'graph_def\', \'saver_def\', \'collection_list\', \'as_text\', \'graph\', \'export_scope\', \'clear_devices\', \'clear_extraneous_savers\', \'strip_default_attrs\', \'save_debug_info\'], varargs=None, keywords=kwargs, defaults=[\'None\', \'None\', \'None\', \'None\', \'None\', \'False\', \'None\', \'None\', \'False\', \'False\', \'False\', \'False\'], " } member_method { name: "generate_checkpoint_state_proto" argspec: "args=[\'save_dir\', \'model_checkpoint_path\', \'all_model_checkpoint_paths\', \'all_model_checkpoint_timestamps\', \'last_preserved_timestamp\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\'], " } member_method { name: "get_checkpoint_mtimes" argspec: "args=[\'checkpoint_prefixes\'], varargs=None, keywords=None, defaults=None" } member_method { name: "get_checkpoint_state" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "get_global_step" argspec: "args=[\'graph\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "get_or_create_global_step" argspec: "args=[\'graph\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "global_step" argspec: "args=[\'sess\', \'global_step_tensor\'], varargs=None, keywords=None, defaults=None" } member_method { name: "import_meta_graph" argspec: "args=[\'meta_graph_or_file\', \'clear_devices\', \'import_scope\'], varargs=None, keywords=kwargs, defaults=[\'False\', \'None\'], " } member_method { name: "init_from_checkpoint" argspec: "args=[\'ckpt_dir_or_file\', \'assignment_map\'], varargs=None, keywords=None, defaults=None" } member_method { name: "input_producer" argspec: "args=[\'input_tensor\', \'element_shape\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'summary_name\', \'name\', \'cancel_op\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'True\', \'None\', \'32\', \'None\', \'None\', \'None\', \'None\'], " } member_method { name: "inverse_time_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'decay_rate\', \'staircase\', \'name\'], varargs=None, keywords=None, defaults=[\'False\', \'None\'], " } member_method { name: "latest_checkpoint" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "limit_epochs" argspec: "args=[\'tensor\', \'num_epochs\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "linear_cosine_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'num_periods\', \'alpha\', \'beta\', \'name\'], varargs=None, keywords=None, defaults=[\'0.5\', \'0.0\', \'0.001\', \'None\'], " } member_method { name: "list_variables" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_checkpoint" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_variable" argspec: "args=[\'ckpt_dir_or_file\', \'name\'], varargs=None, keywords=None, defaults=None" } member_method { name: "match_filenames_once" argspec: "args=[\'pattern\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "maybe_batch" argspec: "args=[\'tensors\', \'keep_input\', \'batch_size\', \'num_threads\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "maybe_batch_join" argspec: "args=[\'tensors_list\', \'keep_input\', \'batch_size\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "maybe_shuffle_batch" argspec: "args=[\'tensors\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'keep_input\', \'num_threads\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "maybe_shuffle_batch_join" argspec: "args=[\'tensors_list\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'keep_input\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "natural_exp_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'decay_rate\', \'staircase\', \'name\'], varargs=None, keywords=None, defaults=[\'False\', \'None\'], " } member_method { name: "noisy_linear_cosine_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'initial_variance\', \'variance_decay\', \'num_periods\', \'alpha\', \'beta\', \'name\'], varargs=None, keywords=None, defaults=[\'1.0\', \'0.55\', \'0.5\', \'0.0\', \'0.001\', \'None\'], " } member_method { name: "piecewise_constant" argspec: "args=[\'x\', \'boundaries\', \'values\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "piecewise_constant_decay" argspec: "args=[\'x\', \'boundaries\', \'values\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "polynomial_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'end_learning_rate\', \'power\', \'cycle\', \'name\'], varargs=None, keywords=None, defaults=[\'0.0001\', \'1.0\', \'False\', \'None\'], " } member_method { name: "range_input_producer" argspec: "args=[\'limit\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'True\', \'None\', \'32\', \'None\', \'None\'], " } member_method { name: "remove_checkpoint" argspec: "args=[\'checkpoint_prefix\', \'checkpoint_format_version\', \'meta_graph_suffix\'], varargs=None, keywords=None, defaults=[\'2\', \'meta\'], " } member_method { name: "replica_device_setter" argspec: "args=[\'ps_tasks\', \'ps_device\', \'worker_device\', \'merge_devices\', \'cluster\', \'ps_ops\', \'ps_strategy\'], varargs=None, keywords=None, defaults=[\'0\', \'/job:ps\', \'/job:worker\', \'True\', \'None\', \'None\', \'None\'], " } member_method { name: "sdca_fprint" argspec: "args=[\'input\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "sdca_optimizer" argspec: "args=[\'sparse_example_indices\', \'sparse_feature_indices\', \'sparse_feature_values\', \'dense_features\', \'example_weights\', \'example_labels\', \'sparse_indices\', \'sparse_weights\', \'dense_weights\', \'example_state_data\', \'loss_type\', \'l1\', \'l2\', \'num_loss_partitions\', \'num_inner_iterations\', \'adaptative\', \'name\'], varargs=None, keywords=None, defaults=[\'True\', \'None\'], " } member_method { name: "sdca_shrink_l1" argspec: "args=[\'weights\', \'l1\', \'l2\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "shuffle_batch" argspec: "args=[\'tensors\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'num_threads\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "shuffle_batch_join" argspec: "args=[\'tensors_list\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "slice_input_producer" argspec: "args=[\'tensor_list\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'True\', \'None\', \'32\', \'None\', \'None\'], " } member_method { name: "start_queue_runners" argspec: "args=[\'sess\', \'coord\', \'daemon\', \'start\', \'collection\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'True\', \'True\', \'queue_runners\'], " } member_method { name: "string_input_producer" argspec: "args=[\'string_tensor\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'name\', \'cancel_op\'], varargs=None, keywords=None, defaults=[\'None\', \'True\', \'None\', \'32\', \'None\', \'None\', \'None\'], " } member_method { name: "summary_iterator" argspec: "args=[\'path\'], varargs=None, keywords=None, defaults=None" } member_method { name: "update_checkpoint_state" argspec: "args=[\'save_dir\', \'model_checkpoint_path\', \'all_model_checkpoint_paths\', \'latest_filename\', \'all_model_checkpoint_timestamps\', \'last_preserved_timestamp\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\', \'None\'], " } member_method { name: "warm_start" argspec: "args=[\'ckpt_to_initialize_from\', \'vars_to_warm_start\', \'var_name_to_vocab_info\', \'var_name_to_prev_var_name\'], varargs=None, keywords=None, defaults=[\'.*\', \'None\', \'None\'], " } member_method { name: "write_graph" argspec: "args=[\'graph_or_graph_def\', \'logdir\', \'name\', \'as_text\'], varargs=None, keywords=None, defaults=[\'True\'], " } } ERROR:tensorflow: Change detected in python object: tensorflow. E0219 03:51:03.326495 281473863414656 api_compatibility_test.py:392] Change detected in python object: tensorflow. ERROR:tensorflow: None : --- +++ @@ -10,7 +10,7 @@ } member { name: "AttrValue" - mtype: "" + mtype: "" } member { name: "COMPILER_VERSION" @@ -34,7 +34,7 @@ } member { name: "ConfigProto" - mtype: "" + mtype: "" } member { name: "CriticalSection" @@ -54,7 +54,7 @@ } member { name: "Event" - mtype: "" + mtype: "" } member { name: "FIFOQueue" @@ -78,7 +78,7 @@ } member { name: "GPUOptions" - mtype: "" + mtype: "" } member { name: "GRAPH_DEF_VERSION" @@ -102,7 +102,7 @@ } member { name: "GraphDef" - mtype: "" + mtype: "" } member { name: "GraphKeys" @@ -110,11 +110,11 @@ } member { name: "GraphOptions" - mtype: "" + mtype: "" } member { name: "HistogramProto" - mtype: "" + mtype: "" } member { name: "IdentityReader" @@ -138,7 +138,7 @@ } member { name: "LogMessage" - mtype: "" + mtype: "" } member { name: "MONOLITHIC_BUILD" @@ -146,7 +146,7 @@ } member { name: "MetaGraphDef" - mtype: "" + mtype: "" } member { name: "Module" @@ -154,11 +154,11 @@ } member { name: "NameAttrList" - mtype: "" + mtype: "" } member { name: "NodeDef" - mtype: "" + mtype: "" } member { name: "OpError" @@ -170,7 +170,7 @@ } member { name: "OptimizerOptions" - mtype: "" + mtype: "" } member { name: "OptionalSpec" @@ -214,11 +214,11 @@ } member { name: "RunMetadata" - mtype: "" + mtype: "" } member { name: "RunOptions" - mtype: "" + mtype: "" } member { name: "Session" @@ -226,7 +226,7 @@ } member { name: "SessionLog" - mtype: "" + mtype: "" } member { name: "SparseConditionalAccumulator" @@ -250,11 +250,11 @@ } member { name: "Summary" - mtype: "" + mtype: "" } member { name: "SummaryMetadata" - mtype: "" + mtype: "" } member { name: "TFRecordReader" @@ -274,7 +274,7 @@ } member { name: "TensorInfo" - mtype: "" + mtype: "" } member { name: "TensorShape" E0219 03:51:03.326633 281473863414656 api_compatibility_test.py:393] None : --- +++ @@ -10,7 +10,7 @@ } member { name: "AttrValue" - mtype: "" + mtype: "" } member { name: "COMPILER_VERSION" @@ -34,7 +34,7 @@ } member { name: "ConfigProto" - mtype: "" + mtype: "" } member { name: "CriticalSection" @@ -54,7 +54,7 @@ } member { name: "Event" - mtype: "" + mtype: "" } member { name: "FIFOQueue" @@ -78,7 +78,7 @@ } member { name: "GPUOptions" - mtype: "" + mtype: "" } member { name: "GRAPH_DEF_VERSION" @@ -102,7 +102,7 @@ } member { name: "GraphDef" - mtype: "" + mtype: "" } member { name: "GraphKeys" @@ -110,11 +110,11 @@ } member { name: "GraphOptions" - mtype: "" + mtype: "" } member { name: "HistogramProto" - mtype: "" + mtype: "" } member { name: "IdentityReader" @@ -138,7 +138,7 @@ } member { name: "LogMessage" - mtype: "" + mtype: "" } member { name: "MONOLITHIC_BUILD" @@ -146,7 +146,7 @@ } member { name: "MetaGraphDef" - mtype: "" + mtype: "" } member { name: "Module" @@ -154,11 +154,11 @@ } member { name: "NameAttrList" - mtype: "" + mtype: "" } member { name: "NodeDef" - mtype: "" + mtype: "" } member { name: "OpError" @@ -170,7 +170,7 @@ } member { name: "OptimizerOptions" - mtype: "" + mtype: "" } member { name: "OptionalSpec" @@ -214,11 +214,11 @@ } member { name: "RunMetadata" - mtype: "" + mtype: "" } member { name: "RunOptions" - mtype: "" + mtype: "" } member { name: "Session" @@ -226,7 +226,7 @@ } member { name: "SessionLog" - mtype: "" + mtype: "" } member { name: "SparseConditionalAccumulator" @@ -250,11 +250,11 @@ } member { name: "Summary" - mtype: "" + mtype: "" } member { name: "SummaryMetadata" - mtype: "" + mtype: "" } member { name: "TFRecordReader" @@ -274,7 +274,7 @@ } member { name: "TensorInfo" - mtype: "" + mtype: "" } member { name: "TensorShape" ERROR:tensorflow: Change detected in python object: tensorflow.profiler. E0219 03:51:03.326792 281473863414656 api_compatibility_test.py:392] Change detected in python object: tensorflow.profiler. ERROR:tensorflow: path: "tensorflow.profiler" tf_module { member { name: "AdviceProto" - mtype: "" + mtype: "" } member { name: "GraphNodeProto" - mtype: "" + mtype: "" } member { name: "MultiGraphNodeProto" - mtype: "" + mtype: "" } member { name: "OpLogProto" - mtype: "" + mtype: "" } member { name: "ProfileOptionBuilder" mtype: "" } member { name: "Profiler" mtype: "" } member_method { name: "advise" argspec: "args=[\'graph\', \'run_meta\', \'options\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'0\'], " } member_method { name: "profile" argspec: "args=[\'graph\', \'run_meta\', \'op_log\', \'cmd\', \'options\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\', \'scope\', \'0\'], " } member_method { name: "write_op_log" argspec: "args=[\'graph\', \'log_dir\', \'op_log\', \'run_meta\', \'add_trace\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'True\'], " } } E0219 03:51:03.326925 281473863414656 api_compatibility_test.py:393] path: "tensorflow.profiler" tf_module { member { name: "AdviceProto" - mtype: "" + mtype: "" } member { name: "GraphNodeProto" - mtype: "" + mtype: "" } member { name: "MultiGraphNodeProto" - mtype: "" + mtype: "" } member { name: "OpLogProto" - mtype: "" + mtype: "" } member { name: "ProfileOptionBuilder" mtype: "" } member { name: "Profiler" mtype: "" } member_method { name: "advise" argspec: "args=[\'graph\', \'run_meta\', \'options\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'0\'], " } member_method { name: "profile" argspec: "args=[\'graph\', \'run_meta\', \'op_log\', \'cmd\', \'options\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\', \'scope\', \'0\'], " } member_method { name: "write_op_log" argspec: "args=[\'graph\', \'log_dir\', \'op_log\', \'run_meta\', \'add_trace\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'True\'], " } } ERROR:tensorflow: Change detected in python object: tensorflow.summary. E0219 03:51:03.327085 281473863414656 api_compatibility_test.py:392] Change detected in python object: tensorflow.summary. ERROR:tensorflow: path: "tensorflow.summary" tf_module { member { name: "Event" - mtype: "" + mtype: "" } member { name: "FileWriter" mtype: "" } member { name: "FileWriterCache" mtype: "" } member { name: "SessionLog" - mtype: "" + mtype: "" } member { name: "Summary" - mtype: "" + mtype: "" } member { name: "SummaryDescription" - mtype: "" + mtype: "" } member { name: "TaggedRunMetadata" - mtype: "" + mtype: "" } member_method { name: "all_v2_summary_ops" argspec: "args=[], varargs=None, keywords=None, defaults=None" } member_method { name: "audio" argspec: "args=[\'name\', \'tensor\', \'sample_rate\', \'max_outputs\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'3\', \'None\', \'None\'], " } member_method { name: "get_summary_description" argspec: "args=[\'node_def\'], varargs=None, keywords=None, defaults=None" } member_method { name: "histogram" argspec: "args=[\'name\', \'values\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "image" argspec: "args=[\'name\', \'tensor\', \'max_outputs\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'3\', \'None\', \'None\'], " } member_method { name: "initialize" argspec: "args=[\'graph\', \'session\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "merge" argspec: "args=[\'inputs\', \'collections\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "merge_all" argspec: "args=[\'key\', \'scope\', \'name\'], varargs=None, keywords=None, defaults=[\'summaries\', \'None\', \'None\'], " } member_method { name: "scalar" argspec: "args=[\'name\', \'tensor\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "tensor_summary" argspec: "args=[\'name\', \'tensor\', \'summary_description\', \'collections\', \'summary_metadata\', \'family\', \'display_name\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\', \'None\', \'None\'], " } member_method { name: "text" argspec: "args=[\'name\', \'tensor\', \'collections\'], varargs=None, keywords=None, defaults=[\'None\'], " } } E0219 03:51:03.327219 281473863414656 api_compatibility_test.py:393] path: "tensorflow.summary" tf_module { member { name: "Event" - mtype: "" + mtype: "" } member { name: "FileWriter" mtype: "" } member { name: "FileWriterCache" mtype: "" } member { name: "SessionLog" - mtype: "" + mtype: "" } member { name: "Summary" - mtype: "" + mtype: "" } member { name: "SummaryDescription" - mtype: "" + mtype: "" } member { name: "TaggedRunMetadata" - mtype: "" + mtype: "" } member_method { name: "all_v2_summary_ops" argspec: "args=[], varargs=None, keywords=None, defaults=None" } member_method { name: "audio" argspec: "args=[\'name\', \'tensor\', \'sample_rate\', \'max_outputs\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'3\', \'None\', \'None\'], " } member_method { name: "get_summary_description" argspec: "args=[\'node_def\'], varargs=None, keywords=None, defaults=None" } member_method { name: "histogram" argspec: "args=[\'name\', \'values\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "image" argspec: "args=[\'name\', \'tensor\', \'max_outputs\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'3\', \'None\', \'None\'], " } member_method { name: "initialize" argspec: "args=[\'graph\', \'session\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "merge" argspec: "args=[\'inputs\', \'collections\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "merge_all" argspec: "args=[\'key\', \'scope\', \'name\'], varargs=None, keywords=None, defaults=[\'summaries\', \'None\', \'None\'], " } member_method { name: "scalar" argspec: "args=[\'name\', \'tensor\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "tensor_summary" argspec: "args=[\'name\', \'tensor\', \'summary_description\', \'collections\', \'summary_metadata\', \'family\', \'display_name\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\', \'None\', \'None\'], " } member_method { name: "text" argspec: "args=[\'name\', \'tensor\', \'collections\'], varargs=None, keywords=None, defaults=[\'None\'], " } } INFO:tensorflow:time(__main__.ApiCompatibilityTest.testAPIBackwardsCompatibilityV1): 4.16s I0219 03:51:03.327443 281473863414656 test_util.py:2467] time(__main__.ApiCompatibilityTest.testAPIBackwardsCompatibilityV1): 4.16s [ FAILED ] ApiCompatibilityTest.testAPIBackwardsCompatibilityV1 [ RUN ] ApiCompatibilityTest.testAPIBackwardsCompatibilityV2 ERROR:tensorflow:TensorFlow API backwards compatibility test This test ensures all changes to the public API of TensorFlow are intended. If this test fails, it means a change has been made to the public API. Backwards incompatible changes are not allowed. You can run the test as follows to update test goldens and package them with your change. $ bazel run tensorflow/tools/api/tests:api_compatibility_test \ # -- --update_goldens True You will need an API approval to make changes to the public TensorFlow API. This includes additions to the API. E0219 03:51:06.585892 281473863414656 api_compatibility_test.py:370] TensorFlow API backwards compatibility test This test ensures all changes to the public API of TensorFlow are intended. If this test fails, it means a change has been made to the public API. Backwards incompatible changes are not allowed. You can run the test as follows to update test goldens and package them with your change. $ bazel run tensorflow/tools/api/tests:api_compatibility_test \ # -- --update_goldens True You will need an API approval to make changes to the public TensorFlow API. This includes additions to the API. ERROR:tensorflow:1 differences found between API and golden. E0219 03:51:06.606327 281473863414656 api_compatibility_test.py:371] 1 differences found between API and golden. ERROR:tensorflow: Change detected in python object: tensorflow.train. E0219 03:51:06.606538 281473863414656 api_compatibility_test.py:392] Change detected in python object: tensorflow.train. ERROR:tensorflow: path: "tensorflow.train" tf_module { member { name: "BytesList" - mtype: "" + mtype: "" } member { name: "Checkpoint" mtype: "" } member { name: "CheckpointManager" mtype: "" } member { name: "CheckpointOptions" mtype: "" } member { name: "CheckpointView" mtype: "" } member { name: "ClusterDef" - mtype: "" + mtype: "" } member { name: "ClusterSpec" mtype: "" } member { name: "Coordinator" mtype: "" } member { name: "Example" - mtype: "" + mtype: "" } member { name: "ExponentialMovingAverage" mtype: "" } member { name: "Feature" - mtype: "" + mtype: "" } member { name: "FeatureList" - mtype: "" + mtype: "" } member { name: "FeatureLists" - mtype: "" + mtype: "" } member { name: "Features" - mtype: "" + mtype: "" } member { name: "FloatList" - mtype: "" + mtype: "" } member { name: "Int64List" - mtype: "" + mtype: "" } member { name: "JobDef" - mtype: "" + mtype: "" } member { name: "SequenceExample" - mtype: "" + mtype: "" } member { name: "ServerDef" - mtype: "" + mtype: "" } member { name: "TrackableView" mtype: "" } member { name: "experimental" mtype: "" } member_method { name: "checkpoints_iterator" argspec: "args=[\'checkpoint_dir\', \'min_interval_secs\', \'timeout\', \'timeout_fn\'], varargs=None, keywords=None, defaults=[\'0\', \'None\', \'None\'], " } member_method { name: "get_checkpoint_state" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "latest_checkpoint" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "list_variables" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_checkpoint" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_variable" argspec: "args=[\'ckpt_dir_or_file\', \'name\'], varargs=None, keywords=None, defaults=None" } } E0219 03:51:06.606681 281473863414656 api_compatibility_test.py:393] path: "tensorflow.train" tf_module { member { name: "BytesList" - mtype: "" + mtype: "" } member { name: "Checkpoint" mtype: "" } member { name: "CheckpointManager" mtype: "" } member { name: "CheckpointOptions" mtype: "" } member { name: "CheckpointView" mtype: "" } member { name: "ClusterDef" - mtype: "" + mtype: "" } member { name: "ClusterSpec" mtype: "" } member { name: "Coordinator" mtype: "" } member { name: "Example" - mtype: "" + mtype: "" } member { name: "ExponentialMovingAverage" mtype: "" } member { name: "Feature" - mtype: "" + mtype: "" } member { name: "FeatureList" - mtype: "" + mtype: "" } member { name: "FeatureLists" - mtype: "" + mtype: "" } member { name: "Features" - mtype: "" + mtype: "" } member { name: "FloatList" - mtype: "" + mtype: "" } member { name: "Int64List" - mtype: "" + mtype: "" } member { name: "JobDef" - mtype: "" + mtype: "" } member { name: "SequenceExample" - mtype: "" + mtype: "" } member { name: "ServerDef" - mtype: "" + mtype: "" } member { name: "TrackableView" mtype: "" } member { name: "experimental" mtype: "" } member_method { name: "checkpoints_iterator" argspec: "args=[\'checkpoint_dir\', \'min_interval_secs\', \'timeout\', \'timeout_fn\'], varargs=None, keywords=None, defaults=[\'0\', \'None\', \'None\'], " } member_method { name: "get_checkpoint_state" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "latest_checkpoint" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "list_variables" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_checkpoint" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_variable" argspec: "args=[\'ckpt_dir_or_file\', \'name\'], varargs=None, keywords=None, defaults=None" } } INFO:tensorflow:time(__main__.ApiCompatibilityTest.testAPIBackwardsCompatibilityV2): 3.28s I0219 03:51:06.606930 281473863414656 test_util.py:2467] time(__main__.ApiCompatibilityTest.testAPIBackwardsCompatibilityV2): 3.28s [ FAILED ] ApiCompatibilityTest.testAPIBackwardsCompatibilityV2 [ RUN ] ApiCompatibilityTest.testNoSubclassOfMessage INFO:tensorflow:time(__main__.ApiCompatibilityTest.testNoSubclassOfMessage): 0.78s I0219 03:51:07.392115 281473863414656 test_util.py:2467] time(__main__.ApiCompatibilityTest.testNoSubclassOfMessage): 0.78s [ OK ] ApiCompatibilityTest.testNoSubclassOfMessage [ RUN ] ApiCompatibilityTest.testNoSubclassOfMessageV1 INFO:tensorflow:time(__main__.ApiCompatibilityTest.testNoSubclassOfMessageV1): 0.29s I0219 03:51:07.684567 281473863414656 test_util.py:2467] time(__main__.ApiCompatibilityTest.testNoSubclassOfMessageV1): 0.29s [ OK ] ApiCompatibilityTest.testNoSubclassOfMessageV1 [ RUN ] ApiCompatibilityTest.testNoSubclassOfMessageV2 INFO:tensorflow:time(__main__.ApiCompatibilityTest.testNoSubclassOfMessageV2): 0.31s I0219 03:51:07.992267 281473863414656 test_util.py:2467] time(__main__.ApiCompatibilityTest.testNoSubclassOfMessageV2): 0.31s [ OK ] ApiCompatibilityTest.testNoSubclassOfMessageV2 [ RUN ] ApiCompatibilityTest.test_session [ SKIPPED ] ApiCompatibilityTest.test_session ====================================================================== FAIL: testAPIBackwardsCompatibility (__main__.ApiCompatibilityTest) ApiCompatibilityTest.testAPIBackwardsCompatibility ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 511, in testAPIBackwardsCompatibility self._checkBackwardsCompatibility( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 488, in _checkBackwardsCompatibility self._AssertProtoDictEquals( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 395, in _AssertProtoDictEquals self.fail('%d differences found between API and golden.' % diff_count) AssertionError: 1 differences found between API and golden. ====================================================================== FAIL: testAPIBackwardsCompatibilityV1 (__main__.ApiCompatibilityTest) ApiCompatibilityTest.testAPIBackwardsCompatibilityV1 ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 528, in testAPIBackwardsCompatibilityV1 self._checkBackwardsCompatibility( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 488, in _checkBackwardsCompatibility self._AssertProtoDictEquals( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 395, in _AssertProtoDictEquals self.fail('%d differences found between API and golden.' % diff_count) AssertionError: 4 differences found between API and golden. ====================================================================== FAIL: testAPIBackwardsCompatibilityV2 (__main__.ApiCompatibilityTest) ApiCompatibilityTest.testAPIBackwardsCompatibilityV2 ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 550, in testAPIBackwardsCompatibilityV2 self._checkBackwardsCompatibility( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 488, in _checkBackwardsCompatibility self._AssertProtoDictEquals( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 395, in _AssertProtoDictEquals self.fail('%d differences found between API and golden.' % diff_count) AssertionError: 1 differences found between API and golden. ---------------------------------------------------------------------- Ran 7 tests in 11.171s FAILED (failures=3, skipped=1) ================================================================================ ==================== Test output for //tensorflow/tools/api/tests:api_compatibility_test: 2023-02-19 03:51:10.622109: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. Running tests under Python 3.9.16: /usr/bin/python3 [ RUN ] ApiCompatibilityTest.testAPIBackwardsCompatibility ERROR:tensorflow:TensorFlow API backwards compatibility test This test ensures all changes to the public API of TensorFlow are intended. If this test fails, it means a change has been made to the public API. Backwards incompatible changes are not allowed. You can run the test as follows to update test goldens and package them with your change. $ bazel run tensorflow/tools/api/tests:api_compatibility_test \ # -- --update_goldens True You will need an API approval to make changes to the public TensorFlow API. This includes additions to the API. E0219 03:51:20.489464 281472951153536 api_compatibility_test.py:370] TensorFlow API backwards compatibility test This test ensures all changes to the public API of TensorFlow are intended. If this test fails, it means a change has been made to the public API. Backwards incompatible changes are not allowed. You can run the test as follows to update test goldens and package them with your change. $ bazel run tensorflow/tools/api/tests:api_compatibility_test \ # -- --update_goldens True You will need an API approval to make changes to the public TensorFlow API. This includes additions to the API. ERROR:tensorflow:1 differences found between API and golden. E0219 03:51:20.489799 281472951153536 api_compatibility_test.py:371] 1 differences found between API and golden. ERROR:tensorflow: Change detected in python object: tensorflow.train. E0219 03:51:20.489961 281472951153536 api_compatibility_test.py:392] Change detected in python object: tensorflow.train. ERROR:tensorflow: path: "tensorflow.train" tf_module { member { name: "BytesList" - mtype: "" + mtype: "" } member { name: "Checkpoint" mtype: "" } member { name: "CheckpointManager" mtype: "" } member { name: "CheckpointOptions" mtype: "" } member { name: "CheckpointView" mtype: "" } member { name: "ClusterDef" - mtype: "" + mtype: "" } member { name: "ClusterSpec" mtype: "" } member { name: "Coordinator" mtype: "" } member { name: "Example" - mtype: "" + mtype: "" } member { name: "ExponentialMovingAverage" mtype: "" } member { name: "Feature" - mtype: "" + mtype: "" } member { name: "FeatureList" - mtype: "" + mtype: "" } member { name: "FeatureLists" - mtype: "" + mtype: "" } member { name: "Features" - mtype: "" + mtype: "" } member { name: "FloatList" - mtype: "" + mtype: "" } member { name: "Int64List" - mtype: "" + mtype: "" } member { name: "JobDef" - mtype: "" + mtype: "" } member { name: "SequenceExample" - mtype: "" + mtype: "" } member { name: "ServerDef" - mtype: "" + mtype: "" } member { name: "TrackableView" mtype: "" } member { name: "experimental" mtype: "" } member_method { name: "checkpoints_iterator" argspec: "args=[\'checkpoint_dir\', \'min_interval_secs\', \'timeout\', \'timeout_fn\'], varargs=None, keywords=None, defaults=[\'0\', \'None\', \'None\'], " } member_method { name: "get_checkpoint_state" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "latest_checkpoint" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "list_variables" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_checkpoint" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_variable" argspec: "args=[\'ckpt_dir_or_file\', \'name\'], varargs=None, keywords=None, defaults=None" } } E0219 03:51:20.490105 281472951153536 api_compatibility_test.py:393] path: "tensorflow.train" tf_module { member { name: "BytesList" - mtype: "" + mtype: "" } member { name: "Checkpoint" mtype: "" } member { name: "CheckpointManager" mtype: "" } member { name: "CheckpointOptions" mtype: "" } member { name: "CheckpointView" mtype: "" } member { name: "ClusterDef" - mtype: "" + mtype: "" } member { name: "ClusterSpec" mtype: "" } member { name: "Coordinator" mtype: "" } member { name: "Example" - mtype: "" + mtype: "" } member { name: "ExponentialMovingAverage" mtype: "" } member { name: "Feature" - mtype: "" + mtype: "" } member { name: "FeatureList" - mtype: "" + mtype: "" } member { name: "FeatureLists" - mtype: "" + mtype: "" } member { name: "Features" - mtype: "" + mtype: "" } member { name: "FloatList" - mtype: "" + mtype: "" } member { name: "Int64List" - mtype: "" + mtype: "" } member { name: "JobDef" - mtype: "" + mtype: "" } member { name: "SequenceExample" - mtype: "" + mtype: "" } member { name: "ServerDef" - mtype: "" + mtype: "" } member { name: "TrackableView" mtype: "" } member { name: "experimental" mtype: "" } member_method { name: "checkpoints_iterator" argspec: "args=[\'checkpoint_dir\', \'min_interval_secs\', \'timeout\', \'timeout_fn\'], varargs=None, keywords=None, defaults=[\'0\', \'None\', \'None\'], " } member_method { name: "get_checkpoint_state" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "latest_checkpoint" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "list_variables" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_checkpoint" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_variable" argspec: "args=[\'ckpt_dir_or_file\', \'name\'], varargs=None, keywords=None, defaults=None" } } INFO:tensorflow:time(__main__.ApiCompatibilityTest.testAPIBackwardsCompatibility): 3.99s I0219 03:51:20.490381 281472951153536 test_util.py:2467] time(__main__.ApiCompatibilityTest.testAPIBackwardsCompatibility): 3.99s [ FAILED ] ApiCompatibilityTest.testAPIBackwardsCompatibility [ RUN ] ApiCompatibilityTest.testAPIBackwardsCompatibilityV1 WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/python/util/decorator_utils.py:153: GraphKeys.VARIABLES (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.GraphKeys.GLOBAL_VARIABLES` instead. W0219 03:51:20.587309 281472951153536 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/python/util/decorator_utils.py:153: GraphKeys.VARIABLES (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.GraphKeys.GLOBAL_VARIABLES` instead. ERROR:tensorflow:TensorFlow API backwards compatibility test This test ensures all changes to the public API of TensorFlow are intended. If this test fails, it means a change has been made to the public API. Backwards incompatible changes are not allowed. You can run the test as follows to update test goldens and package them with your change. $ bazel run tensorflow/tools/api/tests:api_compatibility_test \ # -- --update_goldens True You will need an API approval to make changes to the public TensorFlow API. This includes additions to the API. E0219 03:51:23.399223 281472951153536 api_compatibility_test.py:370] TensorFlow API backwards compatibility test This test ensures all changes to the public API of TensorFlow are intended. If this test fails, it means a change has been made to the public API. Backwards incompatible changes are not allowed. You can run the test as follows to update test goldens and package them with your change. $ bazel run tensorflow/tools/api/tests:api_compatibility_test \ # -- --update_goldens True You will need an API approval to make changes to the public TensorFlow API. This includes additions to the API. ERROR:tensorflow:4 differences found between API and golden. E0219 03:51:23.399546 281472951153536 api_compatibility_test.py:371] 4 differences found between API and golden. ERROR:tensorflow: Change detected in python object: tensorflow.train. E0219 03:51:23.399708 281472951153536 api_compatibility_test.py:392] Change detected in python object: tensorflow.train. ERROR:tensorflow: path: "tensorflow.train" tf_module { member { name: "AdadeltaOptimizer" mtype: "" } member { name: "AdagradDAOptimizer" mtype: "" } member { name: "AdagradOptimizer" mtype: "" } member { name: "AdamOptimizer" mtype: "" } member { name: "BytesList" - mtype: "" + mtype: "" } member { name: "Checkpoint" mtype: "" } member { name: "CheckpointManager" mtype: "" } member { name: "CheckpointOptions" mtype: "" } member { name: "CheckpointSaverHook" mtype: "" } member { name: "CheckpointSaverListener" mtype: "" } member { name: "ChiefSessionCreator" mtype: "" } member { name: "ClusterDef" - mtype: "" + mtype: "" } member { name: "ClusterSpec" mtype: "" } member { name: "Coordinator" mtype: "" } member { name: "Example" - mtype: "" + mtype: "" } member { name: "ExponentialMovingAverage" mtype: "" } member { name: "Feature" - mtype: "" + mtype: "" } member { name: "FeatureList" - mtype: "" + mtype: "" } member { name: "FeatureLists" - mtype: "" + mtype: "" } member { name: "Features" - mtype: "" + mtype: "" } member { name: "FeedFnHook" mtype: "" } member { name: "FinalOpsHook" mtype: "" } member { name: "FloatList" - mtype: "" + mtype: "" } member { name: "FtrlOptimizer" mtype: "" } member { name: "GlobalStepWaiterHook" mtype: "" } member { name: "GradientDescentOptimizer" mtype: "" } member { name: "Int64List" - mtype: "" + mtype: "" } member { name: "JobDef" - mtype: "" + mtype: "" } member { name: "LoggingTensorHook" mtype: "" } member { name: "LooperThread" mtype: "" } member { name: "MomentumOptimizer" mtype: "" } member { name: "MonitoredSession" mtype: "" } member { name: "NanLossDuringTrainingError" mtype: "" } member { name: "NanTensorHook" mtype: "" } member { name: "Optimizer" mtype: "" } member { name: "ProfilerHook" mtype: "" } member { name: "ProximalAdagradOptimizer" mtype: "" } member { name: "ProximalGradientDescentOptimizer" mtype: "" } member { name: "QueueRunner" mtype: "" } member { name: "RMSPropOptimizer" mtype: "" } member { name: "Saver" mtype: "" } member { name: "SaverDef" - mtype: "" + mtype: "" } member { name: "Scaffold" mtype: "" } member { name: "SecondOrStepTimer" mtype: "" } member { name: "SequenceExample" - mtype: "" + mtype: "" } member { name: "Server" mtype: "" } member { name: "ServerDef" - mtype: "" + mtype: "" } member { name: "SessionCreator" mtype: "" } member { name: "SessionManager" mtype: "" } member { name: "SessionRunArgs" mtype: "" } member { name: "SessionRunContext" mtype: "" } member { name: "SessionRunHook" mtype: "" } member { name: "SessionRunValues" mtype: "" } member { name: "SingularMonitoredSession" mtype: "" } member { name: "StepCounterHook" mtype: "" } member { name: "StopAtStepHook" mtype: "" } member { name: "SummarySaverHook" mtype: "" } member { name: "Supervisor" mtype: "" } member { name: "SyncReplicasOptimizer" mtype: "" } member { name: "VocabInfo" mtype: "" } member { name: "WorkerSessionCreator" mtype: "" } member { name: "experimental" mtype: "" } member { name: "queue_runner" mtype: "" } member_method { name: "MonitoredTrainingSession" argspec: "args=[\'master\', \'is_chief\', \'checkpoint_dir\', \'scaffold\', \'hooks\', \'chief_only_hooks\', \'save_checkpoint_secs\', \'save_summaries_steps\', \'save_summaries_secs\', \'config\', \'stop_grace_period_secs\', \'log_step_count_steps\', \'max_wait_secs\', \'save_checkpoint_steps\', \'summary_dir\', \'save_graph_def\'], varargs=None, keywords=None, defaults=[\'\', \'True\', \'None\', \'None\', \'None\', \'None\', \'\', \'\', \'\', \'None\', \'120\', \'100\', \'7200\', \'\', \'None\', \'True\'], " } member_method { name: "NewCheckpointReader" argspec: "args=[\'filepattern\'], varargs=None, keywords=None, defaults=None" } member_method { name: "add_queue_runner" argspec: "args=[\'qr\', \'collection\'], varargs=None, keywords=None, defaults=[\'queue_runners\'], " } member_method { name: "assert_global_step" argspec: "args=[\'global_step_tensor\'], varargs=None, keywords=None, defaults=None" } member_method { name: "basic_train_loop" argspec: "args=[\'supervisor\', \'train_step_fn\', \'args\', \'kwargs\', \'master\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'\'], " } member_method { name: "batch" argspec: "args=[\'tensors\', \'batch_size\', \'num_threads\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "batch_join" argspec: "args=[\'tensors_list\', \'batch_size\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "checkpoint_exists" argspec: "args=[\'checkpoint_prefix\'], varargs=None, keywords=None, defaults=None" } member_method { name: "checkpoints_iterator" argspec: "args=[\'checkpoint_dir\', \'min_interval_secs\', \'timeout\', \'timeout_fn\'], varargs=None, keywords=None, defaults=[\'0\', \'None\', \'None\'], " } member_method { name: "cosine_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'alpha\', \'name\'], varargs=None, keywords=None, defaults=[\'0.0\', \'None\'], " } member_method { name: "cosine_decay_restarts" argspec: "args=[\'learning_rate\', \'global_step\', \'first_decay_steps\', \'t_mul\', \'m_mul\', \'alpha\', \'name\'], varargs=None, keywords=None, defaults=[\'2.0\', \'1.0\', \'0.0\', \'None\'], " } member_method { name: "create_global_step" argspec: "args=[\'graph\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "do_quantize_training_on_graphdef" argspec: "args=[\'input_graph\', \'num_bits\'], varargs=None, keywords=None, defaults=None" } member_method { name: "exponential_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'decay_rate\', \'staircase\', \'name\'], varargs=None, keywords=None, defaults=[\'False\', \'None\'], " } member_method { name: "export_meta_graph" argspec: "args=[\'filename\', \'meta_info_def\', \'graph_def\', \'saver_def\', \'collection_list\', \'as_text\', \'graph\', \'export_scope\', \'clear_devices\', \'clear_extraneous_savers\', \'strip_default_attrs\', \'save_debug_info\'], varargs=None, keywords=kwargs, defaults=[\'None\', \'None\', \'None\', \'None\', \'None\', \'False\', \'None\', \'None\', \'False\', \'False\', \'False\', \'False\'], " } member_method { name: "generate_checkpoint_state_proto" argspec: "args=[\'save_dir\', \'model_checkpoint_path\', \'all_model_checkpoint_paths\', \'all_model_checkpoint_timestamps\', \'last_preserved_timestamp\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\'], " } member_method { name: "get_checkpoint_mtimes" argspec: "args=[\'checkpoint_prefixes\'], varargs=None, keywords=None, defaults=None" } member_method { name: "get_checkpoint_state" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "get_global_step" argspec: "args=[\'graph\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "get_or_create_global_step" argspec: "args=[\'graph\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "global_step" argspec: "args=[\'sess\', \'global_step_tensor\'], varargs=None, keywords=None, defaults=None" } member_method { name: "import_meta_graph" argspec: "args=[\'meta_graph_or_file\', \'clear_devices\', \'import_scope\'], varargs=None, keywords=kwargs, defaults=[\'False\', \'None\'], " } member_method { name: "init_from_checkpoint" argspec: "args=[\'ckpt_dir_or_file\', \'assignment_map\'], varargs=None, keywords=None, defaults=None" } member_method { name: "input_producer" argspec: "args=[\'input_tensor\', \'element_shape\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'summary_name\', \'name\', \'cancel_op\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'True\', \'None\', \'32\', \'None\', \'None\', \'None\', \'None\'], " } member_method { name: "inverse_time_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'decay_rate\', \'staircase\', \'name\'], varargs=None, keywords=None, defaults=[\'False\', \'None\'], " } member_method { name: "latest_checkpoint" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "limit_epochs" argspec: "args=[\'tensor\', \'num_epochs\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "linear_cosine_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'num_periods\', \'alpha\', \'beta\', \'name\'], varargs=None, keywords=None, defaults=[\'0.5\', \'0.0\', \'0.001\', \'None\'], " } member_method { name: "list_variables" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_checkpoint" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_variable" argspec: "args=[\'ckpt_dir_or_file\', \'name\'], varargs=None, keywords=None, defaults=None" } member_method { name: "match_filenames_once" argspec: "args=[\'pattern\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "maybe_batch" argspec: "args=[\'tensors\', \'keep_input\', \'batch_size\', \'num_threads\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "maybe_batch_join" argspec: "args=[\'tensors_list\', \'keep_input\', \'batch_size\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "maybe_shuffle_batch" argspec: "args=[\'tensors\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'keep_input\', \'num_threads\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "maybe_shuffle_batch_join" argspec: "args=[\'tensors_list\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'keep_input\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "natural_exp_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'decay_rate\', \'staircase\', \'name\'], varargs=None, keywords=None, defaults=[\'False\', \'None\'], " } member_method { name: "noisy_linear_cosine_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'initial_variance\', \'variance_decay\', \'num_periods\', \'alpha\', \'beta\', \'name\'], varargs=None, keywords=None, defaults=[\'1.0\', \'0.55\', \'0.5\', \'0.0\', \'0.001\', \'None\'], " } member_method { name: "piecewise_constant" argspec: "args=[\'x\', \'boundaries\', \'values\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "piecewise_constant_decay" argspec: "args=[\'x\', \'boundaries\', \'values\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "polynomial_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'end_learning_rate\', \'power\', \'cycle\', \'name\'], varargs=None, keywords=None, defaults=[\'0.0001\', \'1.0\', \'False\', \'None\'], " } member_method { name: "range_input_producer" argspec: "args=[\'limit\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'True\', \'None\', \'32\', \'None\', \'None\'], " } member_method { name: "remove_checkpoint" argspec: "args=[\'checkpoint_prefix\', \'checkpoint_format_version\', \'meta_graph_suffix\'], varargs=None, keywords=None, defaults=[\'2\', \'meta\'], " } member_method { name: "replica_device_setter" argspec: "args=[\'ps_tasks\', \'ps_device\', \'worker_device\', \'merge_devices\', \'cluster\', \'ps_ops\', \'ps_strategy\'], varargs=None, keywords=None, defaults=[\'0\', \'/job:ps\', \'/job:worker\', \'True\', \'None\', \'None\', \'None\'], " } member_method { name: "sdca_fprint" argspec: "args=[\'input\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "sdca_optimizer" argspec: "args=[\'sparse_example_indices\', \'sparse_feature_indices\', \'sparse_feature_values\', \'dense_features\', \'example_weights\', \'example_labels\', \'sparse_indices\', \'sparse_weights\', \'dense_weights\', \'example_state_data\', \'loss_type\', \'l1\', \'l2\', \'num_loss_partitions\', \'num_inner_iterations\', \'adaptative\', \'name\'], varargs=None, keywords=None, defaults=[\'True\', \'None\'], " } member_method { name: "sdca_shrink_l1" argspec: "args=[\'weights\', \'l1\', \'l2\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "shuffle_batch" argspec: "args=[\'tensors\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'num_threads\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "shuffle_batch_join" argspec: "args=[\'tensors_list\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "slice_input_producer" argspec: "args=[\'tensor_list\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'True\', \'None\', \'32\', \'None\', \'None\'], " } member_method { name: "start_queue_runners" argspec: "args=[\'sess\', \'coord\', \'daemon\', \'start\', \'collection\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'True\', \'True\', \'queue_runners\'], " } member_method { name: "string_input_producer" argspec: "args=[\'string_tensor\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'name\', \'cancel_op\'], varargs=None, keywords=None, defaults=[\'None\', \'True\', \'None\', \'32\', \'None\', \'None\', \'None\'], " } member_method { name: "summary_iterator" argspec: "args=[\'path\'], varargs=None, keywords=None, defaults=None" } member_method { name: "update_checkpoint_state" argspec: "args=[\'save_dir\', \'model_checkpoint_path\', \'all_model_checkpoint_paths\', \'latest_filename\', \'all_model_checkpoint_timestamps\', \'last_preserved_timestamp\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\', \'None\'], " } member_method { name: "warm_start" argspec: "args=[\'ckpt_to_initialize_from\', \'vars_to_warm_start\', \'var_name_to_vocab_info\', \'var_name_to_prev_var_name\'], varargs=None, keywords=None, defaults=[\'.*\', \'None\', \'None\'], " } member_method { name: "write_graph" argspec: "args=[\'graph_or_graph_def\', \'logdir\', \'name\', \'as_text\'], varargs=None, keywords=None, defaults=[\'True\'], " } } E0219 03:51:23.399854 281472951153536 api_compatibility_test.py:393] path: "tensorflow.train" tf_module { member { name: "AdadeltaOptimizer" mtype: "" } member { name: "AdagradDAOptimizer" mtype: "" } member { name: "AdagradOptimizer" mtype: "" } member { name: "AdamOptimizer" mtype: "" } member { name: "BytesList" - mtype: "" + mtype: "" } member { name: "Checkpoint" mtype: "" } member { name: "CheckpointManager" mtype: "" } member { name: "CheckpointOptions" mtype: "" } member { name: "CheckpointSaverHook" mtype: "" } member { name: "CheckpointSaverListener" mtype: "" } member { name: "ChiefSessionCreator" mtype: "" } member { name: "ClusterDef" - mtype: "" + mtype: "" } member { name: "ClusterSpec" mtype: "" } member { name: "Coordinator" mtype: "" } member { name: "Example" - mtype: "" + mtype: "" } member { name: "ExponentialMovingAverage" mtype: "" } member { name: "Feature" - mtype: "" + mtype: "" } member { name: "FeatureList" - mtype: "" + mtype: "" } member { name: "FeatureLists" - mtype: "" + mtype: "" } member { name: "Features" - mtype: "" + mtype: "" } member { name: "FeedFnHook" mtype: "" } member { name: "FinalOpsHook" mtype: "" } member { name: "FloatList" - mtype: "" + mtype: "" } member { name: "FtrlOptimizer" mtype: "" } member { name: "GlobalStepWaiterHook" mtype: "" } member { name: "GradientDescentOptimizer" mtype: "" } member { name: "Int64List" - mtype: "" + mtype: "" } member { name: "JobDef" - mtype: "" + mtype: "" } member { name: "LoggingTensorHook" mtype: "" } member { name: "LooperThread" mtype: "" } member { name: "MomentumOptimizer" mtype: "" } member { name: "MonitoredSession" mtype: "" } member { name: "NanLossDuringTrainingError" mtype: "" } member { name: "NanTensorHook" mtype: "" } member { name: "Optimizer" mtype: "" } member { name: "ProfilerHook" mtype: "" } member { name: "ProximalAdagradOptimizer" mtype: "" } member { name: "ProximalGradientDescentOptimizer" mtype: "" } member { name: "QueueRunner" mtype: "" } member { name: "RMSPropOptimizer" mtype: "" } member { name: "Saver" mtype: "" } member { name: "SaverDef" - mtype: "" + mtype: "" } member { name: "Scaffold" mtype: "" } member { name: "SecondOrStepTimer" mtype: "" } member { name: "SequenceExample" - mtype: "" + mtype: "" } member { name: "Server" mtype: "" } member { name: "ServerDef" - mtype: "" + mtype: "" } member { name: "SessionCreator" mtype: "" } member { name: "SessionManager" mtype: "" } member { name: "SessionRunArgs" mtype: "" } member { name: "SessionRunContext" mtype: "" } member { name: "SessionRunHook" mtype: "" } member { name: "SessionRunValues" mtype: "" } member { name: "SingularMonitoredSession" mtype: "" } member { name: "StepCounterHook" mtype: "" } member { name: "StopAtStepHook" mtype: "" } member { name: "SummarySaverHook" mtype: "" } member { name: "Supervisor" mtype: "" } member { name: "SyncReplicasOptimizer" mtype: "" } member { name: "VocabInfo" mtype: "" } member { name: "WorkerSessionCreator" mtype: "" } member { name: "experimental" mtype: "" } member { name: "queue_runner" mtype: "" } member_method { name: "MonitoredTrainingSession" argspec: "args=[\'master\', \'is_chief\', \'checkpoint_dir\', \'scaffold\', \'hooks\', \'chief_only_hooks\', \'save_checkpoint_secs\', \'save_summaries_steps\', \'save_summaries_secs\', \'config\', \'stop_grace_period_secs\', \'log_step_count_steps\', \'max_wait_secs\', \'save_checkpoint_steps\', \'summary_dir\', \'save_graph_def\'], varargs=None, keywords=None, defaults=[\'\', \'True\', \'None\', \'None\', \'None\', \'None\', \'\', \'\', \'\', \'None\', \'120\', \'100\', \'7200\', \'\', \'None\', \'True\'], " } member_method { name: "NewCheckpointReader" argspec: "args=[\'filepattern\'], varargs=None, keywords=None, defaults=None" } member_method { name: "add_queue_runner" argspec: "args=[\'qr\', \'collection\'], varargs=None, keywords=None, defaults=[\'queue_runners\'], " } member_method { name: "assert_global_step" argspec: "args=[\'global_step_tensor\'], varargs=None, keywords=None, defaults=None" } member_method { name: "basic_train_loop" argspec: "args=[\'supervisor\', \'train_step_fn\', \'args\', \'kwargs\', \'master\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'\'], " } member_method { name: "batch" argspec: "args=[\'tensors\', \'batch_size\', \'num_threads\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "batch_join" argspec: "args=[\'tensors_list\', \'batch_size\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "checkpoint_exists" argspec: "args=[\'checkpoint_prefix\'], varargs=None, keywords=None, defaults=None" } member_method { name: "checkpoints_iterator" argspec: "args=[\'checkpoint_dir\', \'min_interval_secs\', \'timeout\', \'timeout_fn\'], varargs=None, keywords=None, defaults=[\'0\', \'None\', \'None\'], " } member_method { name: "cosine_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'alpha\', \'name\'], varargs=None, keywords=None, defaults=[\'0.0\', \'None\'], " } member_method { name: "cosine_decay_restarts" argspec: "args=[\'learning_rate\', \'global_step\', \'first_decay_steps\', \'t_mul\', \'m_mul\', \'alpha\', \'name\'], varargs=None, keywords=None, defaults=[\'2.0\', \'1.0\', \'0.0\', \'None\'], " } member_method { name: "create_global_step" argspec: "args=[\'graph\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "do_quantize_training_on_graphdef" argspec: "args=[\'input_graph\', \'num_bits\'], varargs=None, keywords=None, defaults=None" } member_method { name: "exponential_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'decay_rate\', \'staircase\', \'name\'], varargs=None, keywords=None, defaults=[\'False\', \'None\'], " } member_method { name: "export_meta_graph" argspec: "args=[\'filename\', \'meta_info_def\', \'graph_def\', \'saver_def\', \'collection_list\', \'as_text\', \'graph\', \'export_scope\', \'clear_devices\', \'clear_extraneous_savers\', \'strip_default_attrs\', \'save_debug_info\'], varargs=None, keywords=kwargs, defaults=[\'None\', \'None\', \'None\', \'None\', \'None\', \'False\', \'None\', \'None\', \'False\', \'False\', \'False\', \'False\'], " } member_method { name: "generate_checkpoint_state_proto" argspec: "args=[\'save_dir\', \'model_checkpoint_path\', \'all_model_checkpoint_paths\', \'all_model_checkpoint_timestamps\', \'last_preserved_timestamp\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\'], " } member_method { name: "get_checkpoint_mtimes" argspec: "args=[\'checkpoint_prefixes\'], varargs=None, keywords=None, defaults=None" } member_method { name: "get_checkpoint_state" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "get_global_step" argspec: "args=[\'graph\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "get_or_create_global_step" argspec: "args=[\'graph\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "global_step" argspec: "args=[\'sess\', \'global_step_tensor\'], varargs=None, keywords=None, defaults=None" } member_method { name: "import_meta_graph" argspec: "args=[\'meta_graph_or_file\', \'clear_devices\', \'import_scope\'], varargs=None, keywords=kwargs, defaults=[\'False\', \'None\'], " } member_method { name: "init_from_checkpoint" argspec: "args=[\'ckpt_dir_or_file\', \'assignment_map\'], varargs=None, keywords=None, defaults=None" } member_method { name: "input_producer" argspec: "args=[\'input_tensor\', \'element_shape\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'summary_name\', \'name\', \'cancel_op\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'True\', \'None\', \'32\', \'None\', \'None\', \'None\', \'None\'], " } member_method { name: "inverse_time_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'decay_rate\', \'staircase\', \'name\'], varargs=None, keywords=None, defaults=[\'False\', \'None\'], " } member_method { name: "latest_checkpoint" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "limit_epochs" argspec: "args=[\'tensor\', \'num_epochs\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "linear_cosine_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'num_periods\', \'alpha\', \'beta\', \'name\'], varargs=None, keywords=None, defaults=[\'0.5\', \'0.0\', \'0.001\', \'None\'], " } member_method { name: "list_variables" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_checkpoint" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_variable" argspec: "args=[\'ckpt_dir_or_file\', \'name\'], varargs=None, keywords=None, defaults=None" } member_method { name: "match_filenames_once" argspec: "args=[\'pattern\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "maybe_batch" argspec: "args=[\'tensors\', \'keep_input\', \'batch_size\', \'num_threads\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "maybe_batch_join" argspec: "args=[\'tensors_list\', \'keep_input\', \'batch_size\', \'capacity\', \'enqueue_many\', \'shapes\', \'dynamic_pad\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'32\', \'False\', \'None\', \'False\', \'False\', \'None\', \'None\'], " } member_method { name: "maybe_shuffle_batch" argspec: "args=[\'tensors\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'keep_input\', \'num_threads\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "maybe_shuffle_batch_join" argspec: "args=[\'tensors_list\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'keep_input\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "natural_exp_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'decay_rate\', \'staircase\', \'name\'], varargs=None, keywords=None, defaults=[\'False\', \'None\'], " } member_method { name: "noisy_linear_cosine_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'initial_variance\', \'variance_decay\', \'num_periods\', \'alpha\', \'beta\', \'name\'], varargs=None, keywords=None, defaults=[\'1.0\', \'0.55\', \'0.5\', \'0.0\', \'0.001\', \'None\'], " } member_method { name: "piecewise_constant" argspec: "args=[\'x\', \'boundaries\', \'values\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "piecewise_constant_decay" argspec: "args=[\'x\', \'boundaries\', \'values\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "polynomial_decay" argspec: "args=[\'learning_rate\', \'global_step\', \'decay_steps\', \'end_learning_rate\', \'power\', \'cycle\', \'name\'], varargs=None, keywords=None, defaults=[\'0.0001\', \'1.0\', \'False\', \'None\'], " } member_method { name: "range_input_producer" argspec: "args=[\'limit\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'True\', \'None\', \'32\', \'None\', \'None\'], " } member_method { name: "remove_checkpoint" argspec: "args=[\'checkpoint_prefix\', \'checkpoint_format_version\', \'meta_graph_suffix\'], varargs=None, keywords=None, defaults=[\'2\', \'meta\'], " } member_method { name: "replica_device_setter" argspec: "args=[\'ps_tasks\', \'ps_device\', \'worker_device\', \'merge_devices\', \'cluster\', \'ps_ops\', \'ps_strategy\'], varargs=None, keywords=None, defaults=[\'0\', \'/job:ps\', \'/job:worker\', \'True\', \'None\', \'None\', \'None\'], " } member_method { name: "sdca_fprint" argspec: "args=[\'input\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "sdca_optimizer" argspec: "args=[\'sparse_example_indices\', \'sparse_feature_indices\', \'sparse_feature_values\', \'dense_features\', \'example_weights\', \'example_labels\', \'sparse_indices\', \'sparse_weights\', \'dense_weights\', \'example_state_data\', \'loss_type\', \'l1\', \'l2\', \'num_loss_partitions\', \'num_inner_iterations\', \'adaptative\', \'name\'], varargs=None, keywords=None, defaults=[\'True\', \'None\'], " } member_method { name: "sdca_shrink_l1" argspec: "args=[\'weights\', \'l1\', \'l2\', \'name\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "shuffle_batch" argspec: "args=[\'tensors\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'num_threads\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'1\', \'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "shuffle_batch_join" argspec: "args=[\'tensors_list\', \'batch_size\', \'capacity\', \'min_after_dequeue\', \'seed\', \'enqueue_many\', \'shapes\', \'allow_smaller_final_batch\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'False\', \'None\', \'False\', \'None\', \'None\'], " } member_method { name: "slice_input_producer" argspec: "args=[\'tensor_list\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'True\', \'None\', \'32\', \'None\', \'None\'], " } member_method { name: "start_queue_runners" argspec: "args=[\'sess\', \'coord\', \'daemon\', \'start\', \'collection\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'True\', \'True\', \'queue_runners\'], " } member_method { name: "string_input_producer" argspec: "args=[\'string_tensor\', \'num_epochs\', \'shuffle\', \'seed\', \'capacity\', \'shared_name\', \'name\', \'cancel_op\'], varargs=None, keywords=None, defaults=[\'None\', \'True\', \'None\', \'32\', \'None\', \'None\', \'None\'], " } member_method { name: "summary_iterator" argspec: "args=[\'path\'], varargs=None, keywords=None, defaults=None" } member_method { name: "update_checkpoint_state" argspec: "args=[\'save_dir\', \'model_checkpoint_path\', \'all_model_checkpoint_paths\', \'latest_filename\', \'all_model_checkpoint_timestamps\', \'last_preserved_timestamp\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\', \'None\'], " } member_method { name: "warm_start" argspec: "args=[\'ckpt_to_initialize_from\', \'vars_to_warm_start\', \'var_name_to_vocab_info\', \'var_name_to_prev_var_name\'], varargs=None, keywords=None, defaults=[\'.*\', \'None\', \'None\'], " } member_method { name: "write_graph" argspec: "args=[\'graph_or_graph_def\', \'logdir\', \'name\', \'as_text\'], varargs=None, keywords=None, defaults=[\'True\'], " } } ERROR:tensorflow: Change detected in python object: tensorflow. E0219 03:51:23.400055 281472951153536 api_compatibility_test.py:392] Change detected in python object: tensorflow. ERROR:tensorflow: None : --- +++ @@ -10,7 +10,7 @@ } member { name: "AttrValue" - mtype: "" + mtype: "" } member { name: "COMPILER_VERSION" @@ -34,7 +34,7 @@ } member { name: "ConfigProto" - mtype: "" + mtype: "" } member { name: "CriticalSection" @@ -54,7 +54,7 @@ } member { name: "Event" - mtype: "" + mtype: "" } member { name: "FIFOQueue" @@ -78,7 +78,7 @@ } member { name: "GPUOptions" - mtype: "" + mtype: "" } member { name: "GRAPH_DEF_VERSION" @@ -102,7 +102,7 @@ } member { name: "GraphDef" - mtype: "" + mtype: "" } member { name: "GraphKeys" @@ -110,11 +110,11 @@ } member { name: "GraphOptions" - mtype: "" + mtype: "" } member { name: "HistogramProto" - mtype: "" + mtype: "" } member { name: "IdentityReader" @@ -138,7 +138,7 @@ } member { name: "LogMessage" - mtype: "" + mtype: "" } member { name: "MONOLITHIC_BUILD" @@ -146,7 +146,7 @@ } member { name: "MetaGraphDef" - mtype: "" + mtype: "" } member { name: "Module" @@ -154,11 +154,11 @@ } member { name: "NameAttrList" - mtype: "" + mtype: "" } member { name: "NodeDef" - mtype: "" + mtype: "" } member { name: "OpError" @@ -170,7 +170,7 @@ } member { name: "OptimizerOptions" - mtype: "" + mtype: "" } member { name: "OptionalSpec" @@ -214,11 +214,11 @@ } member { name: "RunMetadata" - mtype: "" + mtype: "" } member { name: "RunOptions" - mtype: "" + mtype: "" } member { name: "Session" @@ -226,7 +226,7 @@ } member { name: "SessionLog" - mtype: "" + mtype: "" } member { name: "SparseConditionalAccumulator" @@ -250,11 +250,11 @@ } member { name: "Summary" - mtype: "" + mtype: "" } member { name: "SummaryMetadata" - mtype: "" + mtype: "" } member { name: "TFRecordReader" @@ -274,7 +274,7 @@ } member { name: "TensorInfo" - mtype: "" + mtype: "" } member { name: "TensorShape" E0219 03:51:23.400196 281472951153536 api_compatibility_test.py:393] None : --- +++ @@ -10,7 +10,7 @@ } member { name: "AttrValue" - mtype: "" + mtype: "" } member { name: "COMPILER_VERSION" @@ -34,7 +34,7 @@ } member { name: "ConfigProto" - mtype: "" + mtype: "" } member { name: "CriticalSection" @@ -54,7 +54,7 @@ } member { name: "Event" - mtype: "" + mtype: "" } member { name: "FIFOQueue" @@ -78,7 +78,7 @@ } member { name: "GPUOptions" - mtype: "" + mtype: "" } member { name: "GRAPH_DEF_VERSION" @@ -102,7 +102,7 @@ } member { name: "GraphDef" - mtype: "" + mtype: "" } member { name: "GraphKeys" @@ -110,11 +110,11 @@ } member { name: "GraphOptions" - mtype: "" + mtype: "" } member { name: "HistogramProto" - mtype: "" + mtype: "" } member { name: "IdentityReader" @@ -138,7 +138,7 @@ } member { name: "LogMessage" - mtype: "" + mtype: "" } member { name: "MONOLITHIC_BUILD" @@ -146,7 +146,7 @@ } member { name: "MetaGraphDef" - mtype: "" + mtype: "" } member { name: "Module" @@ -154,11 +154,11 @@ } member { name: "NameAttrList" - mtype: "" + mtype: "" } member { name: "NodeDef" - mtype: "" + mtype: "" } member { name: "OpError" @@ -170,7 +170,7 @@ } member { name: "OptimizerOptions" - mtype: "" + mtype: "" } member { name: "OptionalSpec" @@ -214,11 +214,11 @@ } member { name: "RunMetadata" - mtype: "" + mtype: "" } member { name: "RunOptions" - mtype: "" + mtype: "" } member { name: "Session" @@ -226,7 +226,7 @@ } member { name: "SessionLog" - mtype: "" + mtype: "" } member { name: "SparseConditionalAccumulator" @@ -250,11 +250,11 @@ } member { name: "Summary" - mtype: "" + mtype: "" } member { name: "SummaryMetadata" - mtype: "" + mtype: "" } member { name: "TFRecordReader" @@ -274,7 +274,7 @@ } member { name: "TensorInfo" - mtype: "" + mtype: "" } member { name: "TensorShape" ERROR:tensorflow: Change detected in python object: tensorflow.profiler. E0219 03:51:23.400359 281472951153536 api_compatibility_test.py:392] Change detected in python object: tensorflow.profiler. ERROR:tensorflow: path: "tensorflow.profiler" tf_module { member { name: "AdviceProto" - mtype: "" + mtype: "" } member { name: "GraphNodeProto" - mtype: "" + mtype: "" } member { name: "MultiGraphNodeProto" - mtype: "" + mtype: "" } member { name: "OpLogProto" - mtype: "" + mtype: "" } member { name: "ProfileOptionBuilder" mtype: "" } member { name: "Profiler" mtype: "" } member_method { name: "advise" argspec: "args=[\'graph\', \'run_meta\', \'options\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'0\'], " } member_method { name: "profile" argspec: "args=[\'graph\', \'run_meta\', \'op_log\', \'cmd\', \'options\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\', \'scope\', \'0\'], " } member_method { name: "write_op_log" argspec: "args=[\'graph\', \'log_dir\', \'op_log\', \'run_meta\', \'add_trace\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'True\'], " } } E0219 03:51:23.400494 281472951153536 api_compatibility_test.py:393] path: "tensorflow.profiler" tf_module { member { name: "AdviceProto" - mtype: "" + mtype: "" } member { name: "GraphNodeProto" - mtype: "" + mtype: "" } member { name: "MultiGraphNodeProto" - mtype: "" + mtype: "" } member { name: "OpLogProto" - mtype: "" + mtype: "" } member { name: "ProfileOptionBuilder" mtype: "" } member { name: "Profiler" mtype: "" } member_method { name: "advise" argspec: "args=[\'graph\', \'run_meta\', \'options\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'0\'], " } member_method { name: "profile" argspec: "args=[\'graph\', \'run_meta\', \'op_log\', \'cmd\', \'options\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\', \'scope\', \'0\'], " } member_method { name: "write_op_log" argspec: "args=[\'graph\', \'log_dir\', \'op_log\', \'run_meta\', \'add_trace\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'True\'], " } } ERROR:tensorflow: Change detected in python object: tensorflow.summary. E0219 03:51:23.400664 281472951153536 api_compatibility_test.py:392] Change detected in python object: tensorflow.summary. ERROR:tensorflow: path: "tensorflow.summary" tf_module { member { name: "Event" - mtype: "" + mtype: "" } member { name: "FileWriter" mtype: "" } member { name: "FileWriterCache" mtype: "" } member { name: "SessionLog" - mtype: "" + mtype: "" } member { name: "Summary" - mtype: "" + mtype: "" } member { name: "SummaryDescription" - mtype: "" + mtype: "" } member { name: "TaggedRunMetadata" - mtype: "" + mtype: "" } member_method { name: "all_v2_summary_ops" argspec: "args=[], varargs=None, keywords=None, defaults=None" } member_method { name: "audio" argspec: "args=[\'name\', \'tensor\', \'sample_rate\', \'max_outputs\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'3\', \'None\', \'None\'], " } member_method { name: "get_summary_description" argspec: "args=[\'node_def\'], varargs=None, keywords=None, defaults=None" } member_method { name: "histogram" argspec: "args=[\'name\', \'values\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "image" argspec: "args=[\'name\', \'tensor\', \'max_outputs\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'3\', \'None\', \'None\'], " } member_method { name: "initialize" argspec: "args=[\'graph\', \'session\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "merge" argspec: "args=[\'inputs\', \'collections\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "merge_all" argspec: "args=[\'key\', \'scope\', \'name\'], varargs=None, keywords=None, defaults=[\'summaries\', \'None\', \'None\'], " } member_method { name: "scalar" argspec: "args=[\'name\', \'tensor\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "tensor_summary" argspec: "args=[\'name\', \'tensor\', \'summary_description\', \'collections\', \'summary_metadata\', \'family\', \'display_name\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\', \'None\', \'None\'], " } member_method { name: "text" argspec: "args=[\'name\', \'tensor\', \'collections\'], varargs=None, keywords=None, defaults=[\'None\'], " } } E0219 03:51:23.400799 281472951153536 api_compatibility_test.py:393] path: "tensorflow.summary" tf_module { member { name: "Event" - mtype: "" + mtype: "" } member { name: "FileWriter" mtype: "" } member { name: "FileWriterCache" mtype: "" } member { name: "SessionLog" - mtype: "" + mtype: "" } member { name: "Summary" - mtype: "" + mtype: "" } member { name: "SummaryDescription" - mtype: "" + mtype: "" } member { name: "TaggedRunMetadata" - mtype: "" + mtype: "" } member_method { name: "all_v2_summary_ops" argspec: "args=[], varargs=None, keywords=None, defaults=None" } member_method { name: "audio" argspec: "args=[\'name\', \'tensor\', \'sample_rate\', \'max_outputs\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'3\', \'None\', \'None\'], " } member_method { name: "get_summary_description" argspec: "args=[\'node_def\'], varargs=None, keywords=None, defaults=None" } member_method { name: "histogram" argspec: "args=[\'name\', \'values\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "image" argspec: "args=[\'name\', \'tensor\', \'max_outputs\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'3\', \'None\', \'None\'], " } member_method { name: "initialize" argspec: "args=[\'graph\', \'session\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "merge" argspec: "args=[\'inputs\', \'collections\', \'name\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "merge_all" argspec: "args=[\'key\', \'scope\', \'name\'], varargs=None, keywords=None, defaults=[\'summaries\', \'None\', \'None\'], " } member_method { name: "scalar" argspec: "args=[\'name\', \'tensor\', \'collections\', \'family\'], varargs=None, keywords=None, defaults=[\'None\', \'None\'], " } member_method { name: "tensor_summary" argspec: "args=[\'name\', \'tensor\', \'summary_description\', \'collections\', \'summary_metadata\', \'family\', \'display_name\'], varargs=None, keywords=None, defaults=[\'None\', \'None\', \'None\', \'None\', \'None\'], " } member_method { name: "text" argspec: "args=[\'name\', \'tensor\', \'collections\'], varargs=None, keywords=None, defaults=[\'None\'], " } } INFO:tensorflow:time(__main__.ApiCompatibilityTest.testAPIBackwardsCompatibilityV1): 2.91s I0219 03:51:23.401052 281472951153536 test_util.py:2467] time(__main__.ApiCompatibilityTest.testAPIBackwardsCompatibilityV1): 2.91s [ FAILED ] ApiCompatibilityTest.testAPIBackwardsCompatibilityV1 [ RUN ] ApiCompatibilityTest.testAPIBackwardsCompatibilityV2 ERROR:tensorflow:TensorFlow API backwards compatibility test This test ensures all changes to the public API of TensorFlow are intended. If this test fails, it means a change has been made to the public API. Backwards incompatible changes are not allowed. You can run the test as follows to update test goldens and package them with your change. $ bazel run tensorflow/tools/api/tests:api_compatibility_test \ # -- --update_goldens True You will need an API approval to make changes to the public TensorFlow API. This includes additions to the API. E0219 03:51:25.468930 281472951153536 api_compatibility_test.py:370] TensorFlow API backwards compatibility test This test ensures all changes to the public API of TensorFlow are intended. If this test fails, it means a change has been made to the public API. Backwards incompatible changes are not allowed. You can run the test as follows to update test goldens and package them with your change. $ bazel run tensorflow/tools/api/tests:api_compatibility_test \ # -- --update_goldens True You will need an API approval to make changes to the public TensorFlow API. This includes additions to the API. ERROR:tensorflow:1 differences found between API and golden. E0219 03:51:25.469257 281472951153536 api_compatibility_test.py:371] 1 differences found between API and golden. ERROR:tensorflow: Change detected in python object: tensorflow.train. E0219 03:51:25.469416 281472951153536 api_compatibility_test.py:392] Change detected in python object: tensorflow.train. ERROR:tensorflow: path: "tensorflow.train" tf_module { member { name: "BytesList" - mtype: "" + mtype: "" } member { name: "Checkpoint" mtype: "" } member { name: "CheckpointManager" mtype: "" } member { name: "CheckpointOptions" mtype: "" } member { name: "CheckpointView" mtype: "" } member { name: "ClusterDef" - mtype: "" + mtype: "" } member { name: "ClusterSpec" mtype: "" } member { name: "Coordinator" mtype: "" } member { name: "Example" - mtype: "" + mtype: "" } member { name: "ExponentialMovingAverage" mtype: "" } member { name: "Feature" - mtype: "" + mtype: "" } member { name: "FeatureList" - mtype: "" + mtype: "" } member { name: "FeatureLists" - mtype: "" + mtype: "" } member { name: "Features" - mtype: "" + mtype: "" } member { name: "FloatList" - mtype: "" + mtype: "" } member { name: "Int64List" - mtype: "" + mtype: "" } member { name: "JobDef" - mtype: "" + mtype: "" } member { name: "SequenceExample" - mtype: "" + mtype: "" } member { name: "ServerDef" - mtype: "" + mtype: "" } member { name: "TrackableView" mtype: "" } member { name: "experimental" mtype: "" } member_method { name: "checkpoints_iterator" argspec: "args=[\'checkpoint_dir\', \'min_interval_secs\', \'timeout\', \'timeout_fn\'], varargs=None, keywords=None, defaults=[\'0\', \'None\', \'None\'], " } member_method { name: "get_checkpoint_state" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "latest_checkpoint" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "list_variables" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_checkpoint" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_variable" argspec: "args=[\'ckpt_dir_or_file\', \'name\'], varargs=None, keywords=None, defaults=None" } } E0219 03:51:25.469559 281472951153536 api_compatibility_test.py:393] path: "tensorflow.train" tf_module { member { name: "BytesList" - mtype: "" + mtype: "" } member { name: "Checkpoint" mtype: "" } member { name: "CheckpointManager" mtype: "" } member { name: "CheckpointOptions" mtype: "" } member { name: "CheckpointView" mtype: "" } member { name: "ClusterDef" - mtype: "" + mtype: "" } member { name: "ClusterSpec" mtype: "" } member { name: "Coordinator" mtype: "" } member { name: "Example" - mtype: "" + mtype: "" } member { name: "ExponentialMovingAverage" mtype: "" } member { name: "Feature" - mtype: "" + mtype: "" } member { name: "FeatureList" - mtype: "" + mtype: "" } member { name: "FeatureLists" - mtype: "" + mtype: "" } member { name: "Features" - mtype: "" + mtype: "" } member { name: "FloatList" - mtype: "" + mtype: "" } member { name: "Int64List" - mtype: "" + mtype: "" } member { name: "JobDef" - mtype: "" + mtype: "" } member { name: "SequenceExample" - mtype: "" + mtype: "" } member { name: "ServerDef" - mtype: "" + mtype: "" } member { name: "TrackableView" mtype: "" } member { name: "experimental" mtype: "" } member_method { name: "checkpoints_iterator" argspec: "args=[\'checkpoint_dir\', \'min_interval_secs\', \'timeout\', \'timeout_fn\'], varargs=None, keywords=None, defaults=[\'0\', \'None\', \'None\'], " } member_method { name: "get_checkpoint_state" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "latest_checkpoint" argspec: "args=[\'checkpoint_dir\', \'latest_filename\'], varargs=None, keywords=None, defaults=[\'None\'], " } member_method { name: "list_variables" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_checkpoint" argspec: "args=[\'ckpt_dir_or_file\'], varargs=None, keywords=None, defaults=None" } member_method { name: "load_variable" argspec: "args=[\'ckpt_dir_or_file\', \'name\'], varargs=None, keywords=None, defaults=None" } } INFO:tensorflow:time(__main__.ApiCompatibilityTest.testAPIBackwardsCompatibilityV2): 2.07s I0219 03:51:25.469815 281472951153536 test_util.py:2467] time(__main__.ApiCompatibilityTest.testAPIBackwardsCompatibilityV2): 2.07s [ FAILED ] ApiCompatibilityTest.testAPIBackwardsCompatibilityV2 [ RUN ] ApiCompatibilityTest.testNoSubclassOfMessage INFO:tensorflow:time(__main__.ApiCompatibilityTest.testNoSubclassOfMessage): 0.71s I0219 03:51:26.180979 281472951153536 test_util.py:2467] time(__main__.ApiCompatibilityTest.testNoSubclassOfMessage): 0.71s [ OK ] ApiCompatibilityTest.testNoSubclassOfMessage [ RUN ] ApiCompatibilityTest.testNoSubclassOfMessageV1 INFO:tensorflow:time(__main__.ApiCompatibilityTest.testNoSubclassOfMessageV1): 0.43s I0219 03:51:26.615822 281472951153536 test_util.py:2467] time(__main__.ApiCompatibilityTest.testNoSubclassOfMessageV1): 0.43s [ OK ] ApiCompatibilityTest.testNoSubclassOfMessageV1 [ RUN ] ApiCompatibilityTest.testNoSubclassOfMessageV2 INFO:tensorflow:time(__main__.ApiCompatibilityTest.testNoSubclassOfMessageV2): 0.49s I0219 03:51:27.163463 281472951153536 test_util.py:2467] time(__main__.ApiCompatibilityTest.testNoSubclassOfMessageV2): 0.49s [ OK ] ApiCompatibilityTest.testNoSubclassOfMessageV2 [ RUN ] ApiCompatibilityTest.test_session [ SKIPPED ] ApiCompatibilityTest.test_session ====================================================================== FAIL: testAPIBackwardsCompatibility (__main__.ApiCompatibilityTest) ApiCompatibilityTest.testAPIBackwardsCompatibility ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 511, in testAPIBackwardsCompatibility self._checkBackwardsCompatibility( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 488, in _checkBackwardsCompatibility self._AssertProtoDictEquals( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 395, in _AssertProtoDictEquals self.fail('%d differences found between API and golden.' % diff_count) AssertionError: 1 differences found between API and golden. ====================================================================== FAIL: testAPIBackwardsCompatibilityV1 (__main__.ApiCompatibilityTest) ApiCompatibilityTest.testAPIBackwardsCompatibilityV1 ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 528, in testAPIBackwardsCompatibilityV1 self._checkBackwardsCompatibility( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 488, in _checkBackwardsCompatibility self._AssertProtoDictEquals( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 395, in _AssertProtoDictEquals self.fail('%d differences found between API and golden.' % diff_count) AssertionError: 4 differences found between API and golden. ====================================================================== FAIL: testAPIBackwardsCompatibilityV2 (__main__.ApiCompatibilityTest) ApiCompatibilityTest.testAPIBackwardsCompatibilityV2 ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 550, in testAPIBackwardsCompatibilityV2 self._checkBackwardsCompatibility( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 488, in _checkBackwardsCompatibility self._AssertProtoDictEquals( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/tools/api/tests/api_compatibility_test.runfiles/org_tensorflow/tensorflow/tools/api/tests/api_compatibility_test.py", line 395, in _AssertProtoDictEquals self.fail('%d differences found between API and golden.' % diff_count) AssertionError: 1 differences found between API and golden. ---------------------------------------------------------------------- Ran 7 tests in 10.669s FAILED (failures=3, skipped=1) ================================================================================ ==================== Test output for //tensorflow/python/util/protobuf:protobuf_compare_test: 2023-02-19 03:55:23.589461: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. Running tests under Python 3.9.16: /usr/bin/python3 [ RUN ] AssertTest.testAssertEqualWithStringArg [ OK ] AssertTest.testAssertEqualWithStringArg [ RUN ] AssertTest.testCheckInitialized [ FAILED ] AssertTest.testCheckInitialized [ RUN ] AssertTest.testLargeProtoData [ OK ] AssertTest.testLargeProtoData [ RUN ] AssertTest.testMessage [ OK ] AssertTest.testMessage [ RUN ] AssertTest.testMsgPassdown [ OK ] AssertTest.testMsgPassdown [ RUN ] AssertTest.testNormalizesFloat [ OK ] AssertTest.testNormalizesFloat [ RUN ] AssertTest.testNormalizesNumbers [ OK ] AssertTest.testNormalizesNumbers [ RUN ] AssertTest.testPrimitives [ OK ] AssertTest.testPrimitives [ RUN ] AssertTest.testRepeatedMessage [ OK ] AssertTest.testRepeatedMessage [ RUN ] AssertTest.testRepeatedPrimitives [ OK ] AssertTest.testRepeatedPrimitives [ RUN ] MixinTests.testAssertEqualWithStringArg [ OK ] MixinTests.testAssertEqualWithStringArg [ RUN ] NormalizeNumbersTest.testNormalizesDoubles [ OK ] NormalizeNumbersTest.testNormalizesDoubles [ RUN ] NormalizeNumbersTest.testNormalizesFloats [ OK ] NormalizeNumbersTest.testNormalizesFloats [ RUN ] NormalizeNumbersTest.testNormalizesInts [ OK ] NormalizeNumbersTest.testNormalizesInts [ RUN ] NormalizeNumbersTest.testNormalizesMaps [ OK ] NormalizeNumbersTest.testNormalizesMaps [ RUN ] NormalizeNumbersTest.testNormalizesRepeatedFloats [ OK ] NormalizeNumbersTest.testNormalizesRepeatedFloats [ RUN ] NormalizeNumbersTest.testNormalizesRepeatedInts [ OK ] NormalizeNumbersTest.testNormalizesRepeatedInts [ RUN ] ProtoEqTest.testEmpty [ OK ] ProtoEqTest.testEmpty [ RUN ] ProtoEqTest.testMessage [ OK ] ProtoEqTest.testMessage [ RUN ] ProtoEqTest.testNestedMessage [ OK ] ProtoEqTest.testNestedMessage [ RUN ] ProtoEqTest.testPrimitiveFields [ OK ] ProtoEqTest.testPrimitiveFields [ RUN ] ProtoEqTest.testPrimitives [ OK ] ProtoEqTest.testPrimitives [ RUN ] ProtoEqTest.testRepeatedPrimitives [ OK ] ProtoEqTest.testRepeatedPrimitives [ RUN ] ProtoEqTest.testTagOrder [ OK ] ProtoEqTest.testTagOrder ====================================================================== ERROR: testCheckInitialized (__main__.AssertTest) AssertTest.testCheckInitialized ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/util/protobuf/protobuf_compare_test.runfiles/org_tensorflow/tensorflow/python/util/protobuf/compare_test.py", line 296, in testCheckInitialized b = copy.deepcopy(a) File "/usr/lib/python3.9/copy.py", line 153, in deepcopy y = copier(memo) File "/usr/local/lib/python3.9/dist-packages/google/protobuf/message.py", line 82, in __deepcopy__ clone.MergeFrom(self) google.protobuf.message.EncodeError: Message compare_test.Labeled is missing required fields: required ---------------------------------------------------------------------- Ran 24 tests in 1.195s FAILED (errors=1) ================================================================================ ==================== Test output for //tensorflow/python/util/protobuf:protobuf_compare_test: 2023-02-19 03:55:27.385514: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. Running tests under Python 3.9.16: /usr/bin/python3 [ RUN ] AssertTest.testAssertEqualWithStringArg [ OK ] AssertTest.testAssertEqualWithStringArg [ RUN ] AssertTest.testCheckInitialized [ FAILED ] AssertTest.testCheckInitialized [ RUN ] AssertTest.testLargeProtoData [ OK ] AssertTest.testLargeProtoData [ RUN ] AssertTest.testMessage [ OK ] AssertTest.testMessage [ RUN ] AssertTest.testMsgPassdown [ OK ] AssertTest.testMsgPassdown [ RUN ] AssertTest.testNormalizesFloat [ OK ] AssertTest.testNormalizesFloat [ RUN ] AssertTest.testNormalizesNumbers [ OK ] AssertTest.testNormalizesNumbers [ RUN ] AssertTest.testPrimitives [ OK ] AssertTest.testPrimitives [ RUN ] AssertTest.testRepeatedMessage [ OK ] AssertTest.testRepeatedMessage [ RUN ] AssertTest.testRepeatedPrimitives [ OK ] AssertTest.testRepeatedPrimitives [ RUN ] MixinTests.testAssertEqualWithStringArg [ OK ] MixinTests.testAssertEqualWithStringArg [ RUN ] NormalizeNumbersTest.testNormalizesDoubles [ OK ] NormalizeNumbersTest.testNormalizesDoubles [ RUN ] NormalizeNumbersTest.testNormalizesFloats [ OK ] NormalizeNumbersTest.testNormalizesFloats [ RUN ] NormalizeNumbersTest.testNormalizesInts [ OK ] NormalizeNumbersTest.testNormalizesInts [ RUN ] NormalizeNumbersTest.testNormalizesMaps [ OK ] NormalizeNumbersTest.testNormalizesMaps [ RUN ] NormalizeNumbersTest.testNormalizesRepeatedFloats [ OK ] NormalizeNumbersTest.testNormalizesRepeatedFloats [ RUN ] NormalizeNumbersTest.testNormalizesRepeatedInts [ OK ] NormalizeNumbersTest.testNormalizesRepeatedInts [ RUN ] ProtoEqTest.testEmpty [ OK ] ProtoEqTest.testEmpty [ RUN ] ProtoEqTest.testMessage [ OK ] ProtoEqTest.testMessage [ RUN ] ProtoEqTest.testNestedMessage [ OK ] ProtoEqTest.testNestedMessage [ RUN ] ProtoEqTest.testPrimitiveFields [ OK ] ProtoEqTest.testPrimitiveFields [ RUN ] ProtoEqTest.testPrimitives [ OK ] ProtoEqTest.testPrimitives [ RUN ] ProtoEqTest.testRepeatedPrimitives [ OK ] ProtoEqTest.testRepeatedPrimitives [ RUN ] ProtoEqTest.testTagOrder [ OK ] ProtoEqTest.testTagOrder ====================================================================== ERROR: testCheckInitialized (__main__.AssertTest) AssertTest.testCheckInitialized ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/util/protobuf/protobuf_compare_test.runfiles/org_tensorflow/tensorflow/python/util/protobuf/compare_test.py", line 296, in testCheckInitialized b = copy.deepcopy(a) File "/usr/lib/python3.9/copy.py", line 153, in deepcopy y = copier(memo) File "/usr/local/lib/python3.9/dist-packages/google/protobuf/message.py", line 82, in __deepcopy__ clone.MergeFrom(self) google.protobuf.message.EncodeError: Message compare_test.Labeled is missing required fields: required ---------------------------------------------------------------------- Ran 24 tests in 1.328s FAILED (errors=1) ================================================================================ ==================== Test output for //tensorflow/python/util/protobuf:protobuf_compare_test: 2023-02-19 03:55:30.120831: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. Running tests under Python 3.9.16: /usr/bin/python3 [ RUN ] AssertTest.testAssertEqualWithStringArg [ OK ] AssertTest.testAssertEqualWithStringArg [ RUN ] AssertTest.testCheckInitialized [ FAILED ] AssertTest.testCheckInitialized [ RUN ] AssertTest.testLargeProtoData [ OK ] AssertTest.testLargeProtoData [ RUN ] AssertTest.testMessage [ OK ] AssertTest.testMessage [ RUN ] AssertTest.testMsgPassdown [ OK ] AssertTest.testMsgPassdown [ RUN ] AssertTest.testNormalizesFloat [ OK ] AssertTest.testNormalizesFloat [ RUN ] AssertTest.testNormalizesNumbers [ OK ] AssertTest.testNormalizesNumbers [ RUN ] AssertTest.testPrimitives [ OK ] AssertTest.testPrimitives [ RUN ] AssertTest.testRepeatedMessage [ OK ] AssertTest.testRepeatedMessage [ RUN ] AssertTest.testRepeatedPrimitives [ OK ] AssertTest.testRepeatedPrimitives [ RUN ] MixinTests.testAssertEqualWithStringArg [ OK ] MixinTests.testAssertEqualWithStringArg [ RUN ] NormalizeNumbersTest.testNormalizesDoubles [ OK ] NormalizeNumbersTest.testNormalizesDoubles [ RUN ] NormalizeNumbersTest.testNormalizesFloats [ OK ] NormalizeNumbersTest.testNormalizesFloats [ RUN ] NormalizeNumbersTest.testNormalizesInts [ OK ] NormalizeNumbersTest.testNormalizesInts [ RUN ] NormalizeNumbersTest.testNormalizesMaps [ OK ] NormalizeNumbersTest.testNormalizesMaps [ RUN ] NormalizeNumbersTest.testNormalizesRepeatedFloats [ OK ] NormalizeNumbersTest.testNormalizesRepeatedFloats [ RUN ] NormalizeNumbersTest.testNormalizesRepeatedInts [ OK ] NormalizeNumbersTest.testNormalizesRepeatedInts [ RUN ] ProtoEqTest.testEmpty [ OK ] ProtoEqTest.testEmpty [ RUN ] ProtoEqTest.testMessage [ OK ] ProtoEqTest.testMessage [ RUN ] ProtoEqTest.testNestedMessage [ OK ] ProtoEqTest.testNestedMessage [ RUN ] ProtoEqTest.testPrimitiveFields [ OK ] ProtoEqTest.testPrimitiveFields [ RUN ] ProtoEqTest.testPrimitives [ OK ] ProtoEqTest.testPrimitives [ RUN ] ProtoEqTest.testRepeatedPrimitives [ OK ] ProtoEqTest.testRepeatedPrimitives [ RUN ] ProtoEqTest.testTagOrder [ OK ] ProtoEqTest.testTagOrder ====================================================================== ERROR: testCheckInitialized (__main__.AssertTest) AssertTest.testCheckInitialized ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/util/protobuf/protobuf_compare_test.runfiles/org_tensorflow/tensorflow/python/util/protobuf/compare_test.py", line 296, in testCheckInitialized b = copy.deepcopy(a) File "/usr/lib/python3.9/copy.py", line 153, in deepcopy y = copier(memo) File "/usr/local/lib/python3.9/dist-packages/google/protobuf/message.py", line 82, in __deepcopy__ clone.MergeFrom(self) google.protobuf.message.EncodeError: Message compare_test.Labeled is missing required fields: required ---------------------------------------------------------------------- Ran 24 tests in 0.983s FAILED (errors=1) ================================================================================ ==================== Test output for //tensorflow/python/kernel_tests/nn_ops:pooling_ops_test_cpu (shard 8 of 10): 2023-02-19 03:56:50.324692: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. Running tests under Python 3.9.16: /usr/bin/python3 [ RUN ] PoolingTest.testAvgPoolEmpty5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test_cpu.runfiles/org_tensorflow/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test.py:225: is_gpu_available (from tensorflow.python.framework.test_util) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.config.list_physical_devices('GPU')` instead. W0219 03:56:53.076660 281473381987200 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test_cpu.runfiles/org_tensorflow/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test.py:225: is_gpu_available (from tensorflow.python.framework.test_util) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.config.list_physical_devices('GPU')` instead. 2023-02-19 03:56:53.082000: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolEmpty5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.01s I0219 03:56:53.082441 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolEmpty5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.01s [ SKIPPED ] PoolingTest.testAvgPoolEmpty5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolEmptyInput3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [0, 8, 8, 8] 0 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:56:53.083427 281473381987200 pooling_ops_test.py:247] Running NHWC test. False [0, 8, 8, 8] 0 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:56:53.118798: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.165958: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:353] MLIR V1 optimization pass is not enabled 2023-02-19 03:56:53.177415: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.180407: E ./tensorflow/core/graph/mkl_graph_util.h:182] oneDNN BFloat16 support are only on platforms with AVX512. Falling back to default implementation if present. INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolEmptyInput3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.11s I0219 03:56:53.196736 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolEmptyInput3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.11s [ OK ] PoolingTest.testAvgPoolEmptyInput3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testAvgPoolGradOutputMemoryOutOfBounds 2023-02-19 03:56:53.199876: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.223446: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.235674: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.243785: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.251367: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolGradOutputMemoryOutOfBounds): 0.07s I0219 03:56:53.264648 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolGradOutputMemoryOutOfBounds): 0.07s [ FAILED ] PoolingTest.testAvgPoolGradOutputMemoryOutOfBounds [ RUN ] PoolingTest.testAvgPoolKernelSmallerThanStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:53.267138: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolKernelSmallerThanStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.267338 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolKernelSmallerThanStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolKernelSmallerThanStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:53.268192: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.268346 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolSamePadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingNonSquareWindow3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 2, 2, 1] 4 [1, 1, 2, 1] [1, 1, 1, 1] I0219 03:56:53.269063 281473381987200 pooling_ops_test.py:247] Running NHWC test. False [1, 2, 2, 1] 4 [1, 1, 2, 1] [1, 1, 1, 1] 2023-02-19 03:56:53.269858: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.278831: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindow3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s I0219 03:56:53.280884 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindow3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testAvgPoolSamePaddingNonSquareWindow3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch11 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:53.282085: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch11 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.282251 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch11 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch11 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_21 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [2, 2, 2, 2] 16 [1, 2, 1, 1] [1, 1, 1, 1] I0219 03:56:53.282907 281473381987200 pooling_ops_test.py:247] Running NHWC test. False [2, 2, 2, 2] 16 [1, 2, 1, 1] [1, 1, 1, 1] 2023-02-19 03:56:53.283622: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.291988: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_21 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.02s I0219 03:56:53.301894 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_21 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.02s [ OK ] PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_21 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:53.303207: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.303390 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingNonSquareWindow_27 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:53.304108: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindow_27 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.304248 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindow_27 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolSamePaddingNonSquareWindow_27 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingPacket_45 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:53.304839: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingPacket_45 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.304961 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingPacket_45 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolSamePaddingPacket_45 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingPacket_83 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 8, 8, 8] 512 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:56:53.305515 281473381987200 pooling_ops_test.py:247] Running NHWC test. False [1, 8, 8, 8] 512 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:56:53.306403: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.318465: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingPacket_83 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s I0219 03:56:53.320438 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingPacket_83 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testAvgPoolSamePaddingPacket_83 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePadding_211 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:53.321633: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePadding_211 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.321809 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePadding_211 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolSamePadding_211 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolValidPadding1 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 3, 3, 3] 27 [1, 2, 2, 1] [1, 2, 2, 1] I0219 03:56:53.322497 281473381987200 pooling_ops_test.py:247] Running NHWC test. False [1, 3, 3, 3] 27 [1, 2, 2, 1] [1, 2, 2, 1] 2023-02-19 03:56:53.323240: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.332351: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolValidPadding1 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.01s I0219 03:56:53.334379 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolValidPadding1 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testAvgPoolValidPadding1 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testAvgPoolValidPadding9 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:53.335600: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolValidPadding9 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.335772 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolValidPadding9 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolValidPadding9 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolValidPaddingUnevenStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:53.336528: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolValidPaddingUnevenStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.336663 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolValidPaddingUnevenStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolValidPaddingUnevenStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolValidPaddingUnevenStride_25 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:53.337270: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolValidPaddingUnevenStride_25 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.337394 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolValidPaddingUnevenStride_25 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolValidPaddingUnevenStride_25 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testDepthwiseMaxPool1x1DepthWindow3 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 1, 1, 10] 10 [1, 1, 1, 2] [1, 1, 1, 2] I0219 03:56:53.337956 281473381987200 pooling_ops_test.py:247] Running NHWC test. False [1, 1, 1, 10] 10 [1, 1, 1, 2] [1, 1, 1, 2] 2023-02-19 03:56:53.338693: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.347522: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testDepthwiseMaxPool1x1DepthWindow3 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.02s I0219 03:56:53.353604 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testDepthwiseMaxPool1x1DepthWindow3 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.02s [ OK ] PoolingTest.testDepthwiseMaxPool1x1DepthWindow3 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testDepthwiseMaxPool2x2DepthWindow11 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=True) INFO:tensorflow:Running NHWC test. True [1, 2, 2, 6] 24 [1, 1, 1, 3] [1, 1, 1, 3] I0219 03:56:53.354809 281473381987200 pooling_ops_test.py:247] Running NHWC test. True [1, 2, 2, 6] 24 [1, 1, 1, 3] [1, 1, 1, 3] 2023-02-19 03:56:53.355605: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.360019: I tensorflow/core/common_runtime/executor.cc:1214] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder' with dtype int32 and shape [4] [[{{node Placeholder}}]] 2023-02-19 03:56:53.369116: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testDepthwiseMaxPool2x2DepthWindow11 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=True)): 0.02s I0219 03:56:53.374850 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testDepthwiseMaxPool2x2DepthWindow11 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=True)): 0.02s [ OK ] PoolingTest.testDepthwiseMaxPool2x2DepthWindow11 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=True) [ RUN ] PoolingTest.testDepthwiseMaxPoolingWithArgmax 2023-02-19 03:56:53.378348: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.388444: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.397262: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.399825: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.401311: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testDepthwiseMaxPoolingWithArgmax): 0.03s I0219 03:56:53.402661 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testDepthwiseMaxPoolingWithArgmax): 0.03s [ OK ] PoolingTest.testDepthwiseMaxPoolingWithArgmax [ RUN ] PoolingTest.testKernelSmallerThanStrideSame1_14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True) 2023-02-19 03:56:53.403869: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s I0219 03:56:53.404034 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame1_14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame1_23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True) 2023-02-19 03:56:53.404845: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True)): 0.0s I0219 03:56:53.404986 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame1_23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame1_32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True) 2023-02-19 03:56:53.405601: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True)): 0.0s I0219 03:56:53.405724 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame1_32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame1_41 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 3, 3, 1] 9 [1, 1, 1, 1] [1, 2, 2, 1] I0219 03:56:53.406329 281473381987200 pooling_ops_test.py:247] Running NHWC test. False [1, 3, 3, 1] 9 [1, 1, 1, 1] [1, 2, 2, 1] 2023-02-19 03:56:53.407092: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.415402: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_41 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.02s I0219 03:56:53.425314 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_41 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.02s [ OK ] PoolingTest.testKernelSmallerThanStrideSame1_41 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame1_50 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:53.426687: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_50 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.426877 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_50 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame1_50 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame2_13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:53.427661: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.427801 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame2_13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame2_22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:53.428430: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.428555 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame2_22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame2_31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:56:53.429128: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.429250 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame2_31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame2_40 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 4, 4, 1] 16 [1, 1, 1, 1] [1, 2, 2, 1] I0219 03:56:53.429803 281473381987200 pooling_ops_test.py:247] Running NHWC test. False [1, 4, 4, 1] 16 [1, 1, 1, 1] [1, 2, 2, 1] 2023-02-19 03:56:53.430521: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.439571: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_40 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.01s I0219 03:56:53.441542 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_40 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testKernelSmallerThanStrideSame2_40 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame2_5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True) INFO:tensorflow:Running NHWC test. True [1, 4, 4, 1] 16 [1, 1, 1, 1] [1, 2, 2, 1] I0219 03:56:53.442702 281473381987200 pooling_ops_test.py:247] Running NHWC test. True [1, 4, 4, 1] 16 [1, 1, 1, 1] [1, 2, 2, 1] 2023-02-19 03:56:53.443466: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.447457: I tensorflow/core/common_runtime/executor.cc:1214] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder' with dtype int32 and shape [4] [[{{node Placeholder}}]] 2023-02-19 03:56:53.455774: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True)): 0.02s I0219 03:56:53.461619 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True)): 0.02s [ OK ] PoolingTest.testKernelSmallerThanStrideSame2_5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolEmptyInput12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:53.462930: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolEmptyInput12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.463105 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolEmptyInput12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolEmptyInput12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolEmptyInput21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:53.463830: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolEmptyInput21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.463961 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolEmptyInput21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolEmptyInput21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolEmptyInput30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:56:53.464553: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolEmptyInput30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.464678 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolEmptyInput30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolEmptyInput30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolEmptyInput5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True) INFO:tensorflow:Running NHWC test. True [0, 8, 8, 8] 0 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:56:53.465236 281473381987200 pooling_ops_test.py:247] Running NHWC test. True [0, 8, 8, 8] 0 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:56:53.465993: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.470347: I tensorflow/core/common_runtime/executor.cc:1214] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder' with dtype int32 and shape [4] [[{{node Placeholder}}]] 2023-02-19 03:56:53.479738: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolEmptyInput5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True)): 0.02s I0219 03:56:53.481376 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolEmptyInput5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True)): 0.02s [ OK ] PoolingTest.testMaxPoolEmptyInput5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolExplicitPadding13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:53.482635: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.482812 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPadding22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:53.483530: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.483665 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPadding2_10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 3, 3, 1] 9 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:56:53.484242 281473381987200 pooling_ops_test.py:247] Running NHWC test. False [1, 3, 3, 1] 9 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:56:53.484997: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.493807: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding2_10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s I0219 03:56:53.495806 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding2_10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolExplicitPadding2_10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPadding2_2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True) INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding2_2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True)): 0.0s I0219 03:56:53.497129 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding2_2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding2_2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolExplicitPadding2_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True) 2023-02-19 03:56:53.497930: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding2_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True)): 0.0s I0219 03:56:53.498088 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding2_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding2_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolExplicitPadding2_38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True) 2023-02-19 03:56:53.498733: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding2_38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s I0219 03:56:53.498881 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding2_38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding2_38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolExplicitPadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True) 2023-02-19 03:56:53.499459: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True)): 0.0s I0219 03:56:53.499583 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolExplicitPadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 3, 3, 1] 9 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:56:53.500130 281473381987200 pooling_ops_test.py:247] Running NHWC test. False [1, 3, 3, 1] 9 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:56:53.500855: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.509597: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.01s I0219 03:56:53.511574 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolExplicitPadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPaddingAdvanced15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:53.512822: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.513000 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPaddingAdvanced15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPaddingAdvanced24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:53.513798: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.513948 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPaddingAdvanced24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPaddingAdvanced33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:53.514626: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.514760 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPaddingAdvanced33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPaddingAdvanced8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True) INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True)): 0.0s I0219 03:56:53.515393 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPaddingAdvanced8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolExplicitPadding_1D16 (pool_func=, data_format='NWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:53.515957: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding_1D16 (pool_func=, data_format='NWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.516080 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding_1D16 (pool_func=, data_format='NWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding_1D16 (pool_func=, data_format='NWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPadding_1D25 (pool_func=, data_format='NCW', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:53.516684: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding_1D25 (pool_func=, data_format='NCW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.516805 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding_1D25 (pool_func=, data_format='NCW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding_1D25 (pool_func=, data_format='NCW', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPadding_1D34 (pool_func=, data_format='NCW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:53.517360: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding_1D34 (pool_func=, data_format='NCW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.517479 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding_1D34 (pool_func=, data_format='NCW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding_1D34 (pool_func=, data_format='NCW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolFwd_maxpool4 2023-02-19 03:56:53.518002: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolFwd_maxpool4): 0.0s I0219 03:56:53.518098 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolFwd_maxpool4): 0.0s [ OK ] PoolingTest.testMaxPoolFwd_maxpool4 [ RUN ] PoolingTest.testMaxPoolGradWithArgmaxEagerShapeErrors 2023-02-19 03:56:53.519945: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.521732: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.523655: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.530392: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.540572: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.547673: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.553010: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.554791: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolGradWithArgmaxEagerShapeErrors): 0.04s I0219 03:56:53.555013 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolGradWithArgmaxEagerShapeErrors): 0.04s [ OK ] PoolingTest.testMaxPoolGradWithArgmaxEagerShapeErrors [ RUN ] PoolingTest.testMaxPoolInvalidFilterSize13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:53.556512: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.557236: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolInvalidFilterSize13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.560593 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolInvalidFilterSize13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ OK ] PoolingTest.testMaxPoolInvalidFilterSize13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolInvalidFilterSize22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:53.561634: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.562156: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolInvalidFilterSize22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.565012 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolInvalidFilterSize22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ OK ] PoolingTest.testMaxPoolInvalidFilterSize22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolInvalidFilterSize31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:56:53.565998: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.566534: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolInvalidFilterSize31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.569941 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolInvalidFilterSize31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ OK ] PoolingTest.testMaxPoolInvalidFilterSize31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolInvalidFilterSize6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) 2023-02-19 03:56:53.570984: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.571509: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolInvalidFilterSize6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.0s I0219 03:56:53.574303 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolInvalidFilterSize6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.0s [ OK ] PoolingTest.testMaxPoolInvalidFilterSize6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolKernelSmallerThanStrideValid4 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 7, 7, 1] 49 [1, 2, 2, 1] [1, 3, 3, 1] I0219 03:56:53.575331 281473381987200 pooling_ops_test.py:247] Running NHWC test. False [1, 7, 7, 1] 49 [1, 2, 2, 1] [1, 3, 3, 1] 2023-02-19 03:56:53.576087: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.589024: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolKernelSmallerThanStrideValid4 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.02s I0219 03:56:53.591029 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolKernelSmallerThanStrideValid4 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.02s [ OK ] PoolingTest.testMaxPoolKernelSmallerThanStrideValid4 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPadding12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:53.592212: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.592377 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPadding12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPadding21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:53.593102: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.593240 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPadding21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPadding30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:56:53.593847: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.593969 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPadding30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True) INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True)): 0.0s I0219 03:56:53.594601 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:53.595153: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.595275 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:53.595830: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.595951 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:56:53.596547: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.596668 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 6, 6, 1] 36 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:56:53.597217 281473381987200 pooling_ops_test.py:247] Running NHWC test. False [1, 6, 6, 1] 36 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:56:53.597985: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.607425: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.01s I0219 03:56:53.609510 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePadding14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True) 2023-02-19 03:56:53.610766: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePadding14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s I0219 03:56:53.610935 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePadding14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePadding14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolSamePadding23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True) 2023-02-19 03:56:53.611632: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePadding23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True)): 0.0s I0219 03:56:53.611769 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePadding23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePadding23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolSamePadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True) 2023-02-19 03:56:53.612367: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True)): 0.0s I0219 03:56:53.612491 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolSamePadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 2, 3, 3] 18 [1, 2, 2, 1] [1, 2, 2, 1] I0219 03:56:53.613043 281473381987200 pooling_ops_test.py:247] Running NHWC test. False [1, 2, 3, 3] 18 [1, 2, 2, 1] [1, 2, 2, 1] 2023-02-19 03:56:53.613791: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.624516: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.02s I0219 03:56:53.630654 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.02s [ OK ] PoolingTest.testMaxPoolSamePadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:53.631932: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.632107 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:53.632832: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.632969 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:53.633574: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.633699 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True) INFO:tensorflow:Running NHWC test. True [1, 2, 2, 1] 4 [1, 1, 2, 1] [1, 1, 1, 1] I0219 03:56:53.634259 281473381987200 pooling_ops_test.py:247] Running NHWC test. True [1, 2, 2, 1] 4 [1, 1, 2, 1] [1, 1, 1, 1] 2023-02-19 03:56:53.634987: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.639179: I tensorflow/core/common_runtime/executor.cc:1214] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder' with dtype int32 and shape [4] [[{{node Placeholder}}]] 2023-02-19 03:56:53.647711: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True)): 0.02s I0219 03:56:53.649339 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True)): 0.02s [ OK ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket4_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:53.650609: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.650791 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingPacket4_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket4_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:53.651586: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.651735 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingPacket4_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket4_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:53.652371: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.652496 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingPacket4_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket4_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 4, 4, 4] 64 [1, 2, 2, 1] [1, 2, 2, 1] I0219 03:56:53.653053 281473381987200 pooling_ops_test.py:247] Running NHWC test. False [1, 4, 4, 4] 64 [1, 2, 2, 1] [1, 2, 2, 1] 2023-02-19 03:56:53.653819: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.662652: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.02s I0219 03:56:53.668928 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.02s [ OK ] PoolingTest.testMaxPoolSamePaddingPacket4_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket8_17 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=True) 2023-02-19 03:56:53.670193: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket8_17 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=True)): 0.0s I0219 03:56:53.670369 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket8_17 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingPacket8_17 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket8_26 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=True) 2023-02-19 03:56:53.671127: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket8_26 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s I0219 03:56:53.671270 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket8_26 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingPacket8_26 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket8_35 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=True) 2023-02-19 03:56:53.671898: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket8_35 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=True)): 0.0s I0219 03:56:53.672027 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket8_35 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingPacket8_35 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolValidPadding0 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 3, 3, 3] 27 [1, 2, 2, 1] [1, 2, 2, 1] I0219 03:56:53.672607 281473381987200 pooling_ops_test.py:247] Running NHWC test. False [1, 3, 3, 3] 27 [1, 2, 2, 1] [1, 2, 2, 1] 2023-02-19 03:56:53.673366: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.682997: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPadding0 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False)): 0.02s I0219 03:56:53.694332 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPadding0 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False)): 0.02s [ OK ] PoolingTest.testMaxPoolValidPadding0 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPadding18 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:56:53.695689: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPadding18 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.695866 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPadding18 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPadding18 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPadding27 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:53.696667: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPadding27 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.696817 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPadding27 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPadding27 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPadding36 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:53.697481: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPadding36 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.697613 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPadding36 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPadding36 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride1 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 4, 4, 1] 16 [1, 2, 2, 1] [1, 1, 2, 1] I0219 03:56:53.698193 281473381987200 pooling_ops_test.py:247] Running NHWC test. False [1, 4, 4, 1] 16 [1, 2, 2, 1] [1, 1, 2, 1] 2023-02-19 03:56:53.698927: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.712423: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride1 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False)): 0.02s I0219 03:56:53.718507 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride1 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False)): 0.02s [ OK ] PoolingTest.testMaxPoolValidPaddingUnevenStride1 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride19 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:56:53.719823: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride19 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.720000 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride19 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPaddingUnevenStride19 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride28 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:53.720728: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride28 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.720864 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride28 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPaddingUnevenStride28 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:53.721478: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.721616 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:53.722182: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.722301 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:53.722854: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:53.722971 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 4, 4, 1] 16 [1, 2, 2, 1] [1, 2, 1, 1] I0219 03:56:53.723510 281473381987200 pooling_ops_test.py:247] Running NHWC test. False [1, 4, 4, 1] 16 [1, 2, 2, 1] [1, 2, 1, 1] 2023-02-19 03:56:53.724248: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.732989: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s I0219 03:56:53.734936 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True) 2023-02-19 03:56:53.736149: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s I0219 03:56:53.736328 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPaddingUnevenStride38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolZeroExplicitPadding10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 3, 3, 1] 9 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:56:53.737010 281473381987200 pooling_ops_test.py:247] Running NHWC test. False [1, 3, 3, 1] 9 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:56:53.737737: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.747732: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s I0219 03:56:53.749871 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolZeroExplicitPadding10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolZeroExplicitPadding2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True) INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True)): 0.0s I0219 03:56:53.751170 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolZeroExplicitPadding2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolZeroExplicitPadding29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True) 2023-02-19 03:56:53.751894: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True)): 0.0s I0219 03:56:53.752049 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolZeroExplicitPadding29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolZeroExplicitPadding38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True) 2023-02-19 03:56:53.752651: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s I0219 03:56:53.752776 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolZeroExplicitPadding38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolingWithArgmax 2023-02-19 03:56:53.755680: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.762480: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.771557: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.776424: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.781204: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.783834: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 2023-02-19 03:56:53.785994: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x2bd49970, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolingWithArgmax): 0.03s I0219 03:56:53.788093 281473381987200 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolingWithArgmax): 0.03s [ OK ] PoolingTest.testMaxPoolingWithArgmax ====================================================================== FAIL: testAvgPoolGradOutputMemoryOutOfBounds (__main__.PoolingTest) PoolingTest.testAvgPoolGradOutputMemoryOutOfBounds ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test_cpu.runfiles/org_tensorflow/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test.py", line 2348, in testAvgPoolGradOutputMemoryOutOfBounds self.evaluate( AssertionError: InvalidArgumentError not raised ---------------------------------------------------------------------- Ran 96 tests in 0.713s FAILED (failures=1, skipped=65) ================================================================================ ==================== Test output for //tensorflow/python/kernel_tests/nn_ops:pooling_ops_test_cpu (shard 8 of 10): 2023-02-19 03:56:56.266563: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. Running tests under Python 3.9.16: /usr/bin/python3 [ RUN ] PoolingTest.testAvgPoolEmpty5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test_cpu.runfiles/org_tensorflow/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test.py:225: is_gpu_available (from tensorflow.python.framework.test_util) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.config.list_physical_devices('GPU')` instead. W0219 03:56:57.746737 281473515877248 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test_cpu.runfiles/org_tensorflow/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test.py:225: is_gpu_available (from tensorflow.python.framework.test_util) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.config.list_physical_devices('GPU')` instead. 2023-02-19 03:56:57.751990: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolEmpty5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.01s I0219 03:56:57.752372 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolEmpty5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.01s [ SKIPPED ] PoolingTest.testAvgPoolEmpty5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolEmptyInput3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [0, 8, 8, 8] 0 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:56:57.753152 281473515877248 pooling_ops_test.py:247] Running NHWC test. False [0, 8, 8, 8] 0 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:56:57.779705: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:57.824803: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:353] MLIR V1 optimization pass is not enabled 2023-02-19 03:56:57.835449: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:57.997302: E ./tensorflow/core/graph/mkl_graph_util.h:182] oneDNN BFloat16 support are only on platforms with AVX512. Falling back to default implementation if present. INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolEmptyInput3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.25s I0219 03:56:58.007589 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolEmptyInput3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.25s [ OK ] PoolingTest.testAvgPoolEmptyInput3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testAvgPoolGradOutputMemoryOutOfBounds 2023-02-19 03:56:58.010019: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.077929: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.083347: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.088489: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.092667: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolGradOutputMemoryOutOfBounds): 0.09s I0219 03:56:58.103390 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolGradOutputMemoryOutOfBounds): 0.09s [ FAILED ] PoolingTest.testAvgPoolGradOutputMemoryOutOfBounds [ RUN ] PoolingTest.testAvgPoolKernelSmallerThanStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:58.105520: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolKernelSmallerThanStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.105712 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolKernelSmallerThanStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolKernelSmallerThanStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:58.106491: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.106637 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolSamePadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingNonSquareWindow3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 2, 2, 1] 4 [1, 1, 2, 1] [1, 1, 1, 1] I0219 03:56:58.107251 281473515877248 pooling_ops_test.py:247] Running NHWC test. False [1, 2, 2, 1] 4 [1, 1, 2, 1] [1, 1, 1, 1] 2023-02-19 03:56:58.107954: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.117300: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindow3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s I0219 03:56:58.119132 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindow3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testAvgPoolSamePaddingNonSquareWindow3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch11 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:58.120144: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch11 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.120297 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch11 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch11 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_21 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [2, 2, 2, 2] 16 [1, 2, 1, 1] [1, 1, 1, 1] I0219 03:56:58.120878 281473515877248 pooling_ops_test.py:247] Running NHWC test. False [2, 2, 2, 2] 16 [1, 2, 1, 1] [1, 1, 1, 1] 2023-02-19 03:56:58.121511: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.129869: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_21 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.01s I0219 03:56:58.134139 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_21 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_21 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:58.135209: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.135390 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingNonSquareWindow_27 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:58.135991: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindow_27 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.136149 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindow_27 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolSamePaddingNonSquareWindow_27 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingPacket_45 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:58.136730: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingPacket_45 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.136848 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingPacket_45 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolSamePaddingPacket_45 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingPacket_83 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 8, 8, 8] 512 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:56:58.137389 281473515877248 pooling_ops_test.py:247] Running NHWC test. False [1, 8, 8, 8] 512 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:56:58.138146: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.148109: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingPacket_83 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s I0219 03:56:58.149996 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingPacket_83 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testAvgPoolSamePaddingPacket_83 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePadding_211 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:58.150986: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePadding_211 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.151140 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePadding_211 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolSamePadding_211 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolValidPadding1 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 3, 3, 3] 27 [1, 2, 2, 1] [1, 2, 2, 1] I0219 03:56:58.151739 281473515877248 pooling_ops_test.py:247] Running NHWC test. False [1, 3, 3, 3] 27 [1, 2, 2, 1] [1, 2, 2, 1] 2023-02-19 03:56:58.152382: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.160628: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolValidPadding1 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.01s I0219 03:56:58.162275 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolValidPadding1 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testAvgPoolValidPadding1 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testAvgPoolValidPadding9 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:58.163250: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolValidPadding9 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.163404 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolValidPadding9 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolValidPadding9 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolValidPaddingUnevenStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:58.164005: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolValidPaddingUnevenStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.164128 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolValidPaddingUnevenStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolValidPaddingUnevenStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolValidPaddingUnevenStride_25 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:58.164682: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolValidPaddingUnevenStride_25 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.164800 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolValidPaddingUnevenStride_25 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolValidPaddingUnevenStride_25 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testDepthwiseMaxPool1x1DepthWindow3 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 1, 1, 10] 10 [1, 1, 1, 2] [1, 1, 1, 2] I0219 03:56:58.165341 281473515877248 pooling_ops_test.py:247] Running NHWC test. False [1, 1, 1, 10] 10 [1, 1, 1, 2] [1, 1, 1, 2] 2023-02-19 03:56:58.165969: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.175133: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testDepthwiseMaxPool1x1DepthWindow3 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.01s I0219 03:56:58.178781 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testDepthwiseMaxPool1x1DepthWindow3 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testDepthwiseMaxPool1x1DepthWindow3 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testDepthwiseMaxPool2x2DepthWindow11 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=True) INFO:tensorflow:Running NHWC test. True [1, 2, 2, 6] 24 [1, 1, 1, 3] [1, 1, 1, 3] I0219 03:56:58.179785 281473515877248 pooling_ops_test.py:247] Running NHWC test. True [1, 2, 2, 6] 24 [1, 1, 1, 3] [1, 1, 1, 3] 2023-02-19 03:56:58.180455: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.184305: I tensorflow/core/common_runtime/executor.cc:1214] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder' with dtype int32 and shape [4] [[{{node Placeholder}}]] 2023-02-19 03:56:58.193974: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testDepthwiseMaxPool2x2DepthWindow11 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=True)): 0.02s I0219 03:56:58.197265 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testDepthwiseMaxPool2x2DepthWindow11 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=True)): 0.02s [ OK ] PoolingTest.testDepthwiseMaxPool2x2DepthWindow11 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=True) [ RUN ] PoolingTest.testDepthwiseMaxPoolingWithArgmax 2023-02-19 03:56:58.200459: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.205639: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.212392: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.214387: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.215754: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testDepthwiseMaxPoolingWithArgmax): 0.02s I0219 03:56:58.217012 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testDepthwiseMaxPoolingWithArgmax): 0.02s [ OK ] PoolingTest.testDepthwiseMaxPoolingWithArgmax [ RUN ] PoolingTest.testKernelSmallerThanStrideSame1_14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True) 2023-02-19 03:56:58.217998: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s I0219 03:56:58.218143 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame1_14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame1_23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True) 2023-02-19 03:56:58.218786: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True)): 0.0s I0219 03:56:58.218911 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame1_23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame1_32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True) 2023-02-19 03:56:58.219464: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True)): 0.0s I0219 03:56:58.219582 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame1_32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame1_41 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 3, 3, 1] 9 [1, 1, 1, 1] [1, 2, 2, 1] I0219 03:56:58.220118 281473515877248 pooling_ops_test.py:247] Running NHWC test. False [1, 3, 3, 1] 9 [1, 1, 1, 1] [1, 2, 2, 1] 2023-02-19 03:56:58.220751: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.229705: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_41 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.03s I0219 03:56:58.247330 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_41 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.03s [ OK ] PoolingTest.testKernelSmallerThanStrideSame1_41 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame1_50 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:58.248416: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_50 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.248593 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_50 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame1_50 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame2_13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:58.249193: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.249320 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame2_13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame2_22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:58.249871: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.249991 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame2_22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame2_31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:56:58.250533: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.250651 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame2_31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame2_40 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 4, 4, 1] 16 [1, 1, 1, 1] [1, 2, 2, 1] I0219 03:56:58.251201 281473515877248 pooling_ops_test.py:247] Running NHWC test. False [1, 4, 4, 1] 16 [1, 1, 1, 1] [1, 2, 2, 1] 2023-02-19 03:56:58.251849: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.261177: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_40 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.01s I0219 03:56:58.263129 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_40 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testKernelSmallerThanStrideSame2_40 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame2_5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True) INFO:tensorflow:Running NHWC test. True [1, 4, 4, 1] 16 [1, 1, 1, 1] [1, 2, 2, 1] I0219 03:56:58.264101 281473515877248 pooling_ops_test.py:247] Running NHWC test. True [1, 4, 4, 1] 16 [1, 1, 1, 1] [1, 2, 2, 1] 2023-02-19 03:56:58.264795: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.269021: I tensorflow/core/common_runtime/executor.cc:1214] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder' with dtype int32 and shape [4] [[{{node Placeholder}}]] 2023-02-19 03:56:58.278400: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True)): 0.02s I0219 03:56:58.281961 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True)): 0.02s [ OK ] PoolingTest.testKernelSmallerThanStrideSame2_5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolEmptyInput12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:58.283010: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolEmptyInput12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.283186 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolEmptyInput12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolEmptyInput12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolEmptyInput21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:58.283788: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolEmptyInput21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.283913 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolEmptyInput21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolEmptyInput21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolEmptyInput30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:56:58.284463: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolEmptyInput30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.284583 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolEmptyInput30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolEmptyInput30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolEmptyInput5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True) INFO:tensorflow:Running NHWC test. True [0, 8, 8, 8] 0 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:56:58.285116 281473515877248 pooling_ops_test.py:247] Running NHWC test. True [0, 8, 8, 8] 0 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:56:58.285730: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.289329: I tensorflow/core/common_runtime/executor.cc:1214] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder' with dtype int32 and shape [4] [[{{node Placeholder}}]] 2023-02-19 03:56:58.298187: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolEmptyInput5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True)): 0.01s I0219 03:56:58.299706 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolEmptyInput5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True)): 0.01s [ OK ] PoolingTest.testMaxPoolEmptyInput5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolExplicitPadding13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:58.300714: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.300877 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPadding22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:58.301473: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.301599 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPadding2_10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 3, 3, 1] 9 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:56:58.302145 281473515877248 pooling_ops_test.py:247] Running NHWC test. False [1, 3, 3, 1] 9 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:56:58.302761: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.311683: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding2_10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s I0219 03:56:58.313584 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding2_10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolExplicitPadding2_10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPadding2_2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True) INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding2_2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True)): 0.0s I0219 03:56:58.314611 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding2_2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding2_2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolExplicitPadding2_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True) 2023-02-19 03:56:58.315206: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding2_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True)): 0.0s I0219 03:56:58.315347 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding2_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding2_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolExplicitPadding2_38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True) 2023-02-19 03:56:58.315908: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding2_38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s I0219 03:56:58.316033 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding2_38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding2_38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolExplicitPadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True) 2023-02-19 03:56:58.316610: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True)): 0.0s I0219 03:56:58.316731 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolExplicitPadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 3, 3, 1] 9 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:56:58.317267 281473515877248 pooling_ops_test.py:247] Running NHWC test. False [1, 3, 3, 1] 9 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:56:58.317880: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.346901: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.03s I0219 03:56:58.348675 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.03s [ OK ] PoolingTest.testMaxPoolExplicitPadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPaddingAdvanced15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:58.349641: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.349796 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPaddingAdvanced15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPaddingAdvanced24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:58.350371: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.350493 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPaddingAdvanced24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPaddingAdvanced33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:58.351038: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.351156 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPaddingAdvanced33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPaddingAdvanced8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True) INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True)): 0.0s I0219 03:56:58.351725 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPaddingAdvanced8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolExplicitPadding_1D16 (pool_func=, data_format='NWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:58.352257: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding_1D16 (pool_func=, data_format='NWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.352375 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding_1D16 (pool_func=, data_format='NWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding_1D16 (pool_func=, data_format='NWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPadding_1D25 (pool_func=, data_format='NCW', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:58.352914: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding_1D25 (pool_func=, data_format='NCW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.353030 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding_1D25 (pool_func=, data_format='NCW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding_1D25 (pool_func=, data_format='NCW', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPadding_1D34 (pool_func=, data_format='NCW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:58.353563: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding_1D34 (pool_func=, data_format='NCW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.353680 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding_1D34 (pool_func=, data_format='NCW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding_1D34 (pool_func=, data_format='NCW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolFwd_maxpool4 2023-02-19 03:56:58.354181: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolFwd_maxpool4): 0.0s I0219 03:56:58.354274 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolFwd_maxpool4): 0.0s [ OK ] PoolingTest.testMaxPoolFwd_maxpool4 [ RUN ] PoolingTest.testMaxPoolGradWithArgmaxEagerShapeErrors 2023-02-19 03:56:58.356122: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.357824: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.359578: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.363433: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.386786: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.390738: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.392455: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.393914: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolGradWithArgmaxEagerShapeErrors): 0.04s I0219 03:56:58.394092 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolGradWithArgmaxEagerShapeErrors): 0.04s [ OK ] PoolingTest.testMaxPoolGradWithArgmaxEagerShapeErrors [ RUN ] PoolingTest.testMaxPoolInvalidFilterSize13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:58.395083: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.395591: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolInvalidFilterSize13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.398290 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolInvalidFilterSize13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ OK ] PoolingTest.testMaxPoolInvalidFilterSize13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolInvalidFilterSize22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:58.410958: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.411451: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolInvalidFilterSize22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.414030 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolInvalidFilterSize22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ OK ] PoolingTest.testMaxPoolInvalidFilterSize22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolInvalidFilterSize31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:56:58.414816: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.415234: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolInvalidFilterSize31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.417621 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolInvalidFilterSize31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ OK ] PoolingTest.testMaxPoolInvalidFilterSize31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolInvalidFilterSize6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) 2023-02-19 03:56:58.418407: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.418821: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolInvalidFilterSize6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.0s I0219 03:56:58.421589 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolInvalidFilterSize6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.0s [ OK ] PoolingTest.testMaxPoolInvalidFilterSize6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolKernelSmallerThanStrideValid4 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 7, 7, 1] 49 [1, 2, 2, 1] [1, 3, 3, 1] I0219 03:56:58.422365 281473515877248 pooling_ops_test.py:247] Running NHWC test. False [1, 7, 7, 1] 49 [1, 2, 2, 1] [1, 3, 3, 1] 2023-02-19 03:56:58.422923: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.435291: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolKernelSmallerThanStrideValid4 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.01s I0219 03:56:58.437170 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolKernelSmallerThanStrideValid4 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolKernelSmallerThanStrideValid4 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPadding12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:58.438175: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.438326 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPadding12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPadding21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:58.438919: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.439043 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPadding21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPadding30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:56:58.439595: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.439713 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPadding30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True) INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True)): 0.0s I0219 03:56:58.440314 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:58.440854: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.440972 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:58.441513: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.441632 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:56:58.442172: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.442288 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 6, 6, 1] 36 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:56:58.442817 281473515877248 pooling_ops_test.py:247] Running NHWC test. False [1, 6, 6, 1] 36 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:56:58.443434: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.452270: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.01s I0219 03:56:58.453925 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePadding14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True) 2023-02-19 03:56:58.454890: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePadding14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s I0219 03:56:58.455035 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePadding14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePadding14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolSamePadding23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True) 2023-02-19 03:56:58.455615: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePadding23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True)): 0.0s I0219 03:56:58.455738 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePadding23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePadding23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolSamePadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True) 2023-02-19 03:56:58.456307: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True)): 0.0s I0219 03:56:58.456434 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolSamePadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 2, 3, 3] 18 [1, 2, 2, 1] [1, 2, 2, 1] I0219 03:56:58.456971 281473515877248 pooling_ops_test.py:247] Running NHWC test. False [1, 2, 3, 3] 18 [1, 2, 2, 1] [1, 2, 2, 1] 2023-02-19 03:56:58.457566: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.467670: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.01s I0219 03:56:58.470831 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolSamePadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:58.471788: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.471931 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:58.472505: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.472628 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:58.473178: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.473295 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True) INFO:tensorflow:Running NHWC test. True [1, 2, 2, 1] 4 [1, 1, 2, 1] [1, 1, 1, 1] I0219 03:56:58.473830 281473515877248 pooling_ops_test.py:247] Running NHWC test. True [1, 2, 2, 1] 4 [1, 1, 2, 1] [1, 1, 1, 1] 2023-02-19 03:56:58.474411: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.477894: I tensorflow/core/common_runtime/executor.cc:1214] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder' with dtype int32 and shape [4] [[{{node Placeholder}}]] 2023-02-19 03:56:58.487289: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True)): 0.02s I0219 03:56:58.489000 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True)): 0.02s [ OK ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket4_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:58.489970: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.490112 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingPacket4_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket4_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:58.490679: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.490798 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingPacket4_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket4_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:58.491342: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.491460 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingPacket4_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket4_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 4, 4, 4] 64 [1, 2, 2, 1] [1, 2, 2, 1] I0219 03:56:58.491988 281473515877248 pooling_ops_test.py:247] Running NHWC test. False [1, 4, 4, 4] 64 [1, 2, 2, 1] [1, 2, 2, 1] 2023-02-19 03:56:58.492589: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.501544: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s I0219 03:56:58.504788 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolSamePaddingPacket4_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket8_17 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=True) 2023-02-19 03:56:58.505742: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket8_17 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=True)): 0.0s I0219 03:56:58.505888 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket8_17 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingPacket8_17 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket8_26 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=True) 2023-02-19 03:56:58.506504: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket8_26 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s I0219 03:56:58.506625 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket8_26 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingPacket8_26 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket8_35 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=True) 2023-02-19 03:56:58.507176: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket8_35 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=True)): 0.0s I0219 03:56:58.507294 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket8_35 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingPacket8_35 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolValidPadding0 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 3, 3, 3] 27 [1, 2, 2, 1] [1, 2, 2, 1] I0219 03:56:58.507828 281473515877248 pooling_ops_test.py:247] Running NHWC test. False [1, 3, 3, 3] 27 [1, 2, 2, 1] [1, 2, 2, 1] 2023-02-19 03:56:58.508419: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.517362: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPadding0 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False)): 0.02s I0219 03:56:58.527281 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPadding0 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False)): 0.02s [ OK ] PoolingTest.testMaxPoolValidPadding0 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPadding18 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:56:58.528312: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPadding18 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.528467 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPadding18 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPadding18 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPadding27 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:58.529037: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPadding27 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.529157 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPadding27 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPadding27 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPadding36 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:58.529702: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPadding36 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.529819 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPadding36 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPadding36 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride1 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 4, 4, 1] 16 [1, 2, 2, 1] [1, 1, 2, 1] I0219 03:56:58.530350 281473515877248 pooling_ops_test.py:247] Running NHWC test. False [1, 4, 4, 1] 16 [1, 2, 2, 1] [1, 1, 2, 1] 2023-02-19 03:56:58.530966: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.542957: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride1 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False)): 0.02s I0219 03:56:58.546263 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride1 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False)): 0.02s [ OK ] PoolingTest.testMaxPoolValidPaddingUnevenStride1 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride19 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:56:58.547266: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride19 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.547417 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride19 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPaddingUnevenStride19 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride28 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:58.547991: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride28 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.548113 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride28 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPaddingUnevenStride28 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:56:58.548662: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.548781 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:56:58.549320: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.549436 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:56:58.549970: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:56:58.550086 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 4, 4, 1] 16 [1, 2, 2, 1] [1, 2, 1, 1] I0219 03:56:58.550618 281473515877248 pooling_ops_test.py:247] Running NHWC test. False [1, 4, 4, 1] 16 [1, 2, 2, 1] [1, 2, 1, 1] 2023-02-19 03:56:58.551239: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.559463: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s I0219 03:56:58.561124 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True) 2023-02-19 03:56:58.562087: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s I0219 03:56:58.562234 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPaddingUnevenStride38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolZeroExplicitPadding10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 3, 3, 1] 9 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:56:58.562806 281473515877248 pooling_ops_test.py:247] Running NHWC test. False [1, 3, 3, 1] 9 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:56:58.563417: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.572332: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s I0219 03:56:58.574132 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolZeroExplicitPadding10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolZeroExplicitPadding2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True) INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True)): 0.0s I0219 03:56:58.575153 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolZeroExplicitPadding2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolZeroExplicitPadding29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True) 2023-02-19 03:56:58.575759: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True)): 0.0s I0219 03:56:58.575905 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolZeroExplicitPadding29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolZeroExplicitPadding38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True) 2023-02-19 03:56:58.576503: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s I0219 03:56:58.576628 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolZeroExplicitPadding38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolingWithArgmax 2023-02-19 03:56:58.578758: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.582029: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.586764: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.590324: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.593916: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.596030: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 2023-02-19 03:56:58.597917: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1d824ef0, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolingWithArgmax): 0.02s I0219 03:56:58.599806 281473515877248 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolingWithArgmax): 0.02s [ OK ] PoolingTest.testMaxPoolingWithArgmax ====================================================================== FAIL: testAvgPoolGradOutputMemoryOutOfBounds (__main__.PoolingTest) PoolingTest.testAvgPoolGradOutputMemoryOutOfBounds ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test_cpu.runfiles/org_tensorflow/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test.py", line 2348, in testAvgPoolGradOutputMemoryOutOfBounds self.evaluate( AssertionError: InvalidArgumentError not raised ---------------------------------------------------------------------- Ran 96 tests in 0.875s FAILED (failures=1, skipped=65) ================================================================================ ==================== Test output for //tensorflow/python/kernel_tests/nn_ops:pooling_ops_test_cpu (shard 8 of 10): 2023-02-19 03:56:59.927479: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. Running tests under Python 3.9.16: /usr/bin/python3 [ RUN ] PoolingTest.testAvgPoolEmpty5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test_cpu.runfiles/org_tensorflow/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test.py:225: is_gpu_available (from tensorflow.python.framework.test_util) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.config.list_physical_devices('GPU')` instead. W0219 03:57:01.327098 281473745122176 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test_cpu.runfiles/org_tensorflow/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test.py:225: is_gpu_available (from tensorflow.python.framework.test_util) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.config.list_physical_devices('GPU')` instead. 2023-02-19 03:57:01.331355: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolEmpty5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.331662 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolEmpty5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolEmpty5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolEmptyInput3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [0, 8, 8, 8] 0 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:57:01.332318 281473745122176 pooling_ops_test.py:247] Running NHWC test. False [0, 8, 8, 8] 0 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:57:01.390266: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.455320: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:353] MLIR V1 optimization pass is not enabled 2023-02-19 03:57:01.465955: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.468473: E ./tensorflow/core/graph/mkl_graph_util.h:182] oneDNN BFloat16 support are only on platforms with AVX512. Falling back to default implementation if present. INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolEmptyInput3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.14s I0219 03:57:01.476006 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolEmptyInput3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.14s [ OK ] PoolingTest.testAvgPoolEmptyInput3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testAvgPoolGradOutputMemoryOutOfBounds 2023-02-19 03:57:01.478421: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.554625: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.559951: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.564648: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.567984: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolGradOutputMemoryOutOfBounds): 0.11s I0219 03:57:01.589204 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolGradOutputMemoryOutOfBounds): 0.11s [ FAILED ] PoolingTest.testAvgPoolGradOutputMemoryOutOfBounds [ RUN ] PoolingTest.testAvgPoolKernelSmallerThanStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:57:01.591102: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolKernelSmallerThanStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.591273 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolKernelSmallerThanStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolKernelSmallerThanStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:57:01.591868: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.591990 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolSamePadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingNonSquareWindow3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 2, 2, 1] 4 [1, 1, 2, 1] [1, 1, 1, 1] I0219 03:57:01.592536 281473745122176 pooling_ops_test.py:247] Running NHWC test. False [1, 2, 2, 1] 4 [1, 1, 2, 1] [1, 1, 1, 1] 2023-02-19 03:57:01.593145: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.600930: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindow3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.04s I0219 03:57:01.637175 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindow3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.04s [ OK ] PoolingTest.testAvgPoolSamePaddingNonSquareWindow3 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch11 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:57:01.638204: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch11 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.638355 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch11 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch11 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_21 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [2, 2, 2, 2] 16 [1, 2, 1, 1] [1, 1, 1, 1] I0219 03:57:01.638927 281473745122176 pooling_ops_test.py:247] Running NHWC test. False [2, 2, 2, 2] 16 [1, 2, 1, 1] [1, 1, 1, 1] 2023-02-19 03:57:01.639524: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.647239: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_21 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.04s I0219 03:57:01.677202 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_21 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.04s [ OK ] PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_21 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:57:01.678249: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.678401 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolSamePaddingNonSquareWindowMultiBatch_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingNonSquareWindow_27 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:57:01.678994: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindow_27 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.679121 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingNonSquareWindow_27 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolSamePaddingNonSquareWindow_27 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingPacket_45 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:57:01.679678: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingPacket_45 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.679798 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingPacket_45 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolSamePaddingPacket_45 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePaddingPacket_83 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 8, 8, 8] 512 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:57:01.680341 281473745122176 pooling_ops_test.py:247] Running NHWC test. False [1, 8, 8, 8] 512 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:57:01.681056: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.689939: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePaddingPacket_83 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s I0219 03:57:01.691623 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePaddingPacket_83 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testAvgPoolSamePaddingPacket_83 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testAvgPoolSamePadding_211 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:57:01.692556: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolSamePadding_211 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.692706 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolSamePadding_211 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolSamePadding_211 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolValidPadding1 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 3, 3, 3] 27 [1, 2, 2, 1] [1, 2, 2, 1] I0219 03:57:01.693277 281473745122176 pooling_ops_test.py:247] Running NHWC test. False [1, 3, 3, 3] 27 [1, 2, 2, 1] [1, 2, 2, 1] 2023-02-19 03:57:01.693872: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.703046: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolValidPadding1 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.02s I0219 03:57:01.717130 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolValidPadding1 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.02s [ OK ] PoolingTest.testAvgPoolValidPadding1 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testAvgPoolValidPadding9 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:57:01.718167: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolValidPadding9 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.718325 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolValidPadding9 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolValidPadding9 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolValidPaddingUnevenStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:57:01.718941: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolValidPaddingUnevenStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.719069 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolValidPaddingUnevenStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolValidPaddingUnevenStride7 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testAvgPoolValidPaddingUnevenStride_25 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:57:01.719634: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testAvgPoolValidPaddingUnevenStride_25 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.719754 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testAvgPoolValidPaddingUnevenStride_25 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testAvgPoolValidPaddingUnevenStride_25 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testDepthwiseMaxPool1x1DepthWindow3 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 1, 1, 10] 10 [1, 1, 1, 2] [1, 1, 1, 2] I0219 03:57:01.720300 281473745122176 pooling_ops_test.py:247] Running NHWC test. False [1, 1, 1, 10] 10 [1, 1, 1, 2] [1, 1, 1, 2] 2023-02-19 03:57:01.720896: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.729570: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testDepthwiseMaxPool1x1DepthWindow3 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.03s I0219 03:57:01.747185 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testDepthwiseMaxPool1x1DepthWindow3 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.03s [ OK ] PoolingTest.testDepthwiseMaxPool1x1DepthWindow3 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testDepthwiseMaxPool2x2DepthWindow11 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=True) INFO:tensorflow:Running NHWC test. True [1, 2, 2, 6] 24 [1, 1, 1, 3] [1, 1, 1, 3] I0219 03:57:01.748226 281473745122176 pooling_ops_test.py:247] Running NHWC test. True [1, 2, 2, 6] 24 [1, 1, 1, 3] [1, 1, 1, 3] 2023-02-19 03:57:01.748878: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.752528: I tensorflow/core/common_runtime/executor.cc:1214] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder' with dtype int32 and shape [4] [[{{node Placeholder}}]] 2023-02-19 03:57:01.762356: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testDepthwiseMaxPool2x2DepthWindow11 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=True)): 0.02s I0219 03:57:01.768411 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testDepthwiseMaxPool2x2DepthWindow11 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=True)): 0.02s [ OK ] PoolingTest.testDepthwiseMaxPool2x2DepthWindow11 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=True) [ RUN ] PoolingTest.testDepthwiseMaxPoolingWithArgmax 2023-02-19 03:57:01.771643: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.776200: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.782266: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.783910: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.785166: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testDepthwiseMaxPoolingWithArgmax): 0.02s I0219 03:57:01.786396 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testDepthwiseMaxPoolingWithArgmax): 0.02s [ OK ] PoolingTest.testDepthwiseMaxPoolingWithArgmax [ RUN ] PoolingTest.testKernelSmallerThanStrideSame1_14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True) 2023-02-19 03:57:01.787363: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s I0219 03:57:01.787503 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame1_14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame1_23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True) 2023-02-19 03:57:01.788160: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True)): 0.0s I0219 03:57:01.788285 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame1_23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame1_32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True) 2023-02-19 03:57:01.788856: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True)): 0.0s I0219 03:57:01.788976 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame1_32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame1_41 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 3, 3, 1] 9 [1, 1, 1, 1] [1, 2, 2, 1] I0219 03:57:01.789519 281473745122176 pooling_ops_test.py:247] Running NHWC test. False [1, 3, 3, 1] 9 [1, 1, 1, 1] [1, 2, 2, 1] 2023-02-19 03:57:01.790106: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.798071: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_41 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.01s I0219 03:57:01.802135 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_41 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testKernelSmallerThanStrideSame1_41 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame1_50 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:57:01.803149: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_50 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.803305 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame1_50 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame1_50 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame2_13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:57:01.803911: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.804034 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame2_13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame2_22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:57:01.804593: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.804713 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame2_22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame2_31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:57:01.805259: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.805377 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testKernelSmallerThanStrideSame2_31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame2_40 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 4, 4, 1] 16 [1, 1, 1, 1] [1, 2, 2, 1] I0219 03:57:01.805918 281473745122176 pooling_ops_test.py:247] Running NHWC test. False [1, 4, 4, 1] 16 [1, 1, 1, 1] [1, 2, 2, 1] 2023-02-19 03:57:01.806553: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.814481: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_40 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.01s I0219 03:57:01.816260 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_40 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testKernelSmallerThanStrideSame2_40 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testKernelSmallerThanStrideSame2_5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True) INFO:tensorflow:Running NHWC test. True [1, 4, 4, 1] 16 [1, 1, 1, 1] [1, 2, 2, 1] I0219 03:57:01.817245 281473745122176 pooling_ops_test.py:247] Running NHWC test. True [1, 4, 4, 1] 16 [1, 1, 1, 1] [1, 2, 2, 1] 2023-02-19 03:57:01.817875: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.821873: I tensorflow/core/common_runtime/executor.cc:1214] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder' with dtype int32 and shape [4] [[{{node Placeholder}}]] 2023-02-19 03:57:01.830180: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True)): 0.02s I0219 03:57:01.833266 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testKernelSmallerThanStrideSame2_5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True)): 0.02s [ OK ] PoolingTest.testKernelSmallerThanStrideSame2_5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolEmptyInput12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:57:01.834302: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolEmptyInput12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.834457 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolEmptyInput12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolEmptyInput12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolEmptyInput21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:57:01.835086: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolEmptyInput21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.835212 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolEmptyInput21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolEmptyInput21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolEmptyInput30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:57:01.835773: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolEmptyInput30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.835892 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolEmptyInput30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolEmptyInput30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolEmptyInput5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True) INFO:tensorflow:Running NHWC test. True [0, 8, 8, 8] 0 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:57:01.836467 281473745122176 pooling_ops_test.py:247] Running NHWC test. True [0, 8, 8, 8] 0 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:57:01.837078: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.840625: I tensorflow/core/common_runtime/executor.cc:1214] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder' with dtype int32 and shape [4] [[{{node Placeholder}}]] 2023-02-19 03:57:01.850343: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolEmptyInput5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True)): 0.02s I0219 03:57:01.851785 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolEmptyInput5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True)): 0.02s [ OK ] PoolingTest.testMaxPoolEmptyInput5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolExplicitPadding13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:57:01.852813: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.852968 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPadding22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:57:01.853592: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.853720 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPadding2_10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 3, 3, 1] 9 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:57:01.854278 281473745122176 pooling_ops_test.py:247] Running NHWC test. False [1, 3, 3, 1] 9 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:57:01.854881: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.864014: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding2_10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s I0219 03:57:01.865826 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding2_10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolExplicitPadding2_10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPadding2_2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True) INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding2_2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True)): 0.0s I0219 03:57:01.866889 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding2_2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding2_2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolExplicitPadding2_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True) 2023-02-19 03:57:01.867513: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding2_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True)): 0.0s I0219 03:57:01.867664 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding2_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding2_29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolExplicitPadding2_38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True) 2023-02-19 03:57:01.868240: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding2_38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s I0219 03:57:01.868368 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding2_38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding2_38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolExplicitPadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True) 2023-02-19 03:57:01.868924: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True)): 0.0s I0219 03:57:01.869046 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolExplicitPadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 3, 3, 1] 9 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:57:01.869589 281473745122176 pooling_ops_test.py:247] Running NHWC test. False [1, 3, 3, 1] 9 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:57:01.870206: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.879071: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.01s I0219 03:57:01.881053 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolExplicitPadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPaddingAdvanced15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:57:01.882070: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.882230 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPaddingAdvanced15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPaddingAdvanced24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:57:01.882857: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.882988 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPaddingAdvanced24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPaddingAdvanced33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:57:01.883558: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.883681 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPaddingAdvanced33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPaddingAdvanced8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True) INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True)): 0.0s I0219 03:57:01.884265 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPaddingAdvanced8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPaddingAdvanced8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolExplicitPadding_1D16 (pool_func=, data_format='NWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:57:01.884808: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding_1D16 (pool_func=, data_format='NWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.884928 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding_1D16 (pool_func=, data_format='NWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding_1D16 (pool_func=, data_format='NWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPadding_1D25 (pool_func=, data_format='NCW', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:57:01.885479: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding_1D25 (pool_func=, data_format='NCW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.885598 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding_1D25 (pool_func=, data_format='NCW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding_1D25 (pool_func=, data_format='NCW', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolExplicitPadding_1D34 (pool_func=, data_format='NCW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:57:01.886169: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolExplicitPadding_1D34 (pool_func=, data_format='NCW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.886298 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolExplicitPadding_1D34 (pool_func=, data_format='NCW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolExplicitPadding_1D34 (pool_func=, data_format='NCW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolFwd_maxpool4 2023-02-19 03:57:01.886821: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolFwd_maxpool4): 0.0s I0219 03:57:01.886917 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolFwd_maxpool4): 0.0s [ OK ] PoolingTest.testMaxPoolFwd_maxpool4 [ RUN ] PoolingTest.testMaxPoolGradWithArgmaxEagerShapeErrors 2023-02-19 03:57:01.888759: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.890433: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.892379: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.896491: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.900104: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.903342: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.905248: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.906782: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolGradWithArgmaxEagerShapeErrors): 0.02s I0219 03:57:01.906971 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolGradWithArgmaxEagerShapeErrors): 0.02s [ OK ] PoolingTest.testMaxPoolGradWithArgmaxEagerShapeErrors [ RUN ] PoolingTest.testMaxPoolInvalidFilterSize13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:57:01.907981: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.908510: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolInvalidFilterSize13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.911297 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolInvalidFilterSize13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ OK ] PoolingTest.testMaxPoolInvalidFilterSize13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolInvalidFilterSize22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:57:01.912136: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.912560: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolInvalidFilterSize22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.914951 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolInvalidFilterSize22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ OK ] PoolingTest.testMaxPoolInvalidFilterSize22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolInvalidFilterSize31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:57:01.915759: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.916320: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolInvalidFilterSize31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.918760 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolInvalidFilterSize31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ OK ] PoolingTest.testMaxPoolInvalidFilterSize31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolInvalidFilterSize6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) 2023-02-19 03:57:01.919574: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.920001: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolInvalidFilterSize6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.0s I0219 03:57:01.922825 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolInvalidFilterSize6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.0s [ OK ] PoolingTest.testMaxPoolInvalidFilterSize6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolKernelSmallerThanStrideValid4 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 7, 7, 1] 49 [1, 2, 2, 1] [1, 3, 3, 1] I0219 03:57:01.923622 281473745122176 pooling_ops_test.py:247] Running NHWC test. False [1, 7, 7, 1] 49 [1, 2, 2, 1] [1, 3, 3, 1] 2023-02-19 03:57:01.924188: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.937111: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolKernelSmallerThanStrideValid4 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.03s I0219 03:57:01.957607 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolKernelSmallerThanStrideValid4 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False)): 0.03s [ OK ] PoolingTest.testMaxPoolKernelSmallerThanStrideValid4 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPadding12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:57:01.958688: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.958853 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPadding12 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPadding21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:57:01.959445: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.959570 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPadding21 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPadding30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:57:01.960126: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.960247 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPadding30 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True) INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True)): 0.0s I0219 03:57:01.960855 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPadding5 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:57:01.961397: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.961518 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv13 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:57:01.962064: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.962183 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv22 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:57:01.962723: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.962841 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv31 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 6, 6, 1] 36 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:57:01.963378 281473745122176 pooling_ops_test.py:247] Running NHWC test. False [1, 6, 6, 1] 36 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:57:01.964021: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.972396: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.01s I0219 03:57:01.974139 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolNegativeInputExpPaddingAdv6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolNegativeInputExpPaddingAdv6 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePadding14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True) 2023-02-19 03:57:01.975117: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePadding14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s I0219 03:57:01.975266 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePadding14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePadding14 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolSamePadding23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True) 2023-02-19 03:57:01.975855: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePadding23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True)): 0.0s I0219 03:57:01.975979 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePadding23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePadding23 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolSamePadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True) 2023-02-19 03:57:01.976565: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True)): 0.0s I0219 03:57:01.976685 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePadding32 (pool_func=, data_format='NCHW', data_type=tf.float64, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolSamePadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 2, 3, 3] 18 [1, 2, 2, 1] [1, 2, 2, 1] I0219 03:57:01.977230 281473745122176 pooling_ops_test.py:247] Running NHWC test. False [1, 2, 3, 3] 18 [1, 2, 2, 1] [1, 2, 2, 1] 2023-02-19 03:57:01.977829: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.987433: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.01s I0219 03:57:01.990730 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolSamePadding7 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:57:01.991717: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.991881 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow15 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:57:01.992482: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.992608 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow24 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:57:01.993163: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:57:01.993282 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow33 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True) INFO:tensorflow:Running NHWC test. True [1, 2, 2, 1] 4 [1, 1, 2, 1] [1, 1, 1, 1] I0219 03:57:01.993824 281473745122176 pooling_ops_test.py:247] Running NHWC test. True [1, 2, 2, 1] 4 [1, 1, 2, 1] [1, 1, 1, 1] 2023-02-19 03:57:01.994422: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:01.998062: I tensorflow/core/common_runtime/executor.cc:1214] [/device:CPU:0] (DEBUG INFO) Executor start aborting (this does not indicate an error and you can ignore this message): INVALID_ARGUMENT: You must feed a value for placeholder tensor 'Placeholder' with dtype int32 and shape [4] [[{{node Placeholder}}]] 2023-02-19 03:57:02.006385: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True)): 0.01s I0219 03:57:02.007900 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingNonSquareWindow8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True)): 0.01s [ OK ] PoolingTest.testMaxPoolSamePaddingNonSquareWindow8 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket4_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:57:02.008866: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:57:02.009023 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingPacket4_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket4_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:57:02.009611: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:57:02.009735 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingPacket4_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket4_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:57:02.010290: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:57:02.010411 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingPacket4_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket4_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 4, 4, 4] 64 [1, 2, 2, 1] [1, 2, 2, 1] I0219 03:57:02.010951 281473745122176 pooling_ops_test.py:247] Running NHWC test. False [1, 4, 4, 4] 64 [1, 2, 2, 1] [1, 2, 2, 1] 2023-02-19 03:57:02.011521: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:02.020121: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s I0219 03:57:02.023482 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket4_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolSamePaddingPacket4_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket8_17 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=True) 2023-02-19 03:57:02.024471: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket8_17 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=True)): 0.0s I0219 03:57:02.024622 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket8_17 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingPacket8_17 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket8_26 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=True) 2023-02-19 03:57:02.025222: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket8_26 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s I0219 03:57:02.025346 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket8_26 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingPacket8_26 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolSamePaddingPacket8_35 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=True) 2023-02-19 03:57:02.025907: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolSamePaddingPacket8_35 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=True)): 0.0s I0219 03:57:02.026028 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolSamePaddingPacket8_35 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolSamePaddingPacket8_35 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolValidPadding0 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 3, 3, 3] 27 [1, 2, 2, 1] [1, 2, 2, 1] I0219 03:57:02.026640 281473745122176 pooling_ops_test.py:247] Running NHWC test. False [1, 3, 3, 3] 27 [1, 2, 2, 1] [1, 2, 2, 1] 2023-02-19 03:57:02.027234: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:02.036362: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPadding0 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False)): 0.02s I0219 03:57:02.046357 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPadding0 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False)): 0.02s [ OK ] PoolingTest.testMaxPoolValidPadding0 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPadding18 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:57:02.047440: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPadding18 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:57:02.047596 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPadding18 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPadding18 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPadding27 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:57:02.048201: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPadding27 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:57:02.048327 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPadding27 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPadding27 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPadding36 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:57:02.048887: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPadding36 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:57:02.049008 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPadding36 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPadding36 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride1 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 4, 4, 1] 16 [1, 2, 2, 1] [1, 1, 2, 1] I0219 03:57:02.049546 281473745122176 pooling_ops_test.py:247] Running NHWC test. False [1, 4, 4, 1] 16 [1, 2, 2, 1] [1, 1, 2, 1] 2023-02-19 03:57:02.050148: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:02.062796: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride1 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False)): 0.02s I0219 03:57:02.066249 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride1 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False)): 0.02s [ OK ] PoolingTest.testMaxPoolValidPaddingUnevenStride1 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride19 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False) 2023-02-19 03:57:02.067261: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride19 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s I0219 03:57:02.067413 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride19 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPaddingUnevenStride19 (pool_func=, data_format='NHWC', data_type=tf.float64, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride28 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:57:02.068005: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride28 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:57:02.068127 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride28 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPaddingUnevenStride28 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) 2023-02-19 03:57:02.068682: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s I0219 03:57:02.068801 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_16 (pool_func=, data_format='NHWC', data_type=tf.float16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) 2023-02-19 03:57:02.069345: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s I0219 03:57:02.069461 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_25 (pool_func=, data_format='NCHW', data_type=tf.float32, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) 2023-02-19 03:57:02.070000: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s I0219 03:57:02.070116 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_34 (pool_func=, data_format='NCHW', data_type=tf.bfloat16, use_gpu=True, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 4, 4, 1] 16 [1, 2, 2, 1] [1, 2, 1, 1] I0219 03:57:02.070646 281473745122176 pooling_ops_test.py:247] Running NHWC test. False [1, 4, 4, 1] 16 [1, 2, 2, 1] [1, 2, 1, 1] 2023-02-19 03:57:02.071258: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:02.079083: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s I0219 03:57:02.080839 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride2_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolValidPaddingUnevenStride2_9 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolValidPaddingUnevenStride38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True) 2023-02-19 03:57:02.081760: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s I0219 03:57:02.081905 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolValidPaddingUnevenStride38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolValidPaddingUnevenStride38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolZeroExplicitPadding10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) INFO:tensorflow:Running NHWC test. False [1, 3, 3, 1] 9 [1, 3, 3, 1] [1, 2, 2, 1] I0219 03:57:02.082475 281473745122176 pooling_ops_test.py:247] Running NHWC test. False [1, 3, 3, 1] 9 [1, 3, 3, 1] [1, 2, 2, 1] 2023-02-19 03:57:02.083044: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:02.090766: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s I0219 03:57:02.092359 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False)): 0.01s [ OK ] PoolingTest.testMaxPoolZeroExplicitPadding10 (pool_func=, data_format='NHWC', data_type=tf.bfloat16, use_gpu=False, v2=False) [ RUN ] PoolingTest.testMaxPoolZeroExplicitPadding2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True) INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True)): 0.0s I0219 03:57:02.093288 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolZeroExplicitPadding2 (pool_func=, data_format='NHWC', data_type=tf.float32, use_gpu=False, v2=True) [ RUN ] PoolingTest.testMaxPoolZeroExplicitPadding29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True) 2023-02-19 03:57:02.093872: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True)): 0.0s I0219 03:57:02.094016 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolZeroExplicitPadding29 (pool_func=, data_format='NCHW', data_type=tf.float16, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolZeroExplicitPadding38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True) 2023-02-19 03:57:02.094576: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s I0219 03:57:02.094698 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolZeroExplicitPadding38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True)): 0.0s [ SKIPPED ] PoolingTest.testMaxPoolZeroExplicitPadding38 (pool_func=, data_format='NCHW_VECT_C', data_type=tf.float32, use_gpu=True, v2=True) [ RUN ] PoolingTest.testMaxPoolingWithArgmax 2023-02-19 03:57:02.096992: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:02.100413: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:02.105008: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:02.108643: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:02.112000: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:02.114120: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 2023-02-19 03:57:02.115844: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1f184f00, num_threads=56 INFO:tensorflow:time(__main__.PoolingTest.testMaxPoolingWithArgmax): 0.02s I0219 03:57:02.117594 281473745122176 test_util.py:2467] time(__main__.PoolingTest.testMaxPoolingWithArgmax): 0.02s [ OK ] PoolingTest.testMaxPoolingWithArgmax ====================================================================== FAIL: testAvgPoolGradOutputMemoryOutOfBounds (__main__.PoolingTest) PoolingTest.testAvgPoolGradOutputMemoryOutOfBounds ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test_cpu.runfiles/org_tensorflow/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test.py", line 2348, in testAvgPoolGradOutputMemoryOutOfBounds self.evaluate( AssertionError: InvalidArgumentError not raised ---------------------------------------------------------------------- Ran 96 tests in 0.792s FAILED (failures=1, skipped=65) ================================================================================ ==================== Test output for //tensorflow/python/distribute/failure_handling:gce_failure_handler_test (shard 6 of 8): 2023-02-19 04:00:23.033667: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. Running tests under Python 3.9.16: /usr/bin/python3 [ RUN ] GceFailureHandlingTest.test_grace_period_continue_training_test_apiwrappingtrain_False_inputarg_checkpoint_mwmsmode_multiworker INFO:tensorflow:Using local port 22395 I0219 04:00:28.468715 281473468035968 test_util.py:3768] Using local port 22395 INFO:tensorflow:Using local port 21500 I0219 04:00:28.469369 281473468035968 test_util.py:3768] Using local port 21500 INFO:tensorflow:Using local port 19193 I0219 04:00:28.469766 281473468035968 test_util.py:3768] Using local port 19193 INFO:tensorflow:Using local port 24982 I0219 04:00:28.470151 281473468035968 test_util.py:3768] Using local port 24982 2023-02-19 04:00:29.386762: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. 2023-02-19 04:00:29.565676: I tensorflow/core/util/port.cc:116] Experimental oneDNN custom operations are on. If you experience issues, please turn them off by setting the environment variable `TF_ENABLE_ONEDNN_OPTS=0`. INFO:tensorflow:Cluster starting. I0219 04:00:31.586680 281473468035968 gce_failure_handler_test.py:460] Cluster starting. [worker-0]: I0219 04:00:31.643199 281473737520000 multi_process_runner.py:840] Subprocess with PID 2607595 (worker, 0) is now being started. [worker-0]: I0219 04:00:31.643698 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:22395", "localhost:21500", "localhost:19193", "localhost:24982"]}, "task": {"type": "worker", "index": 0}, "rpc_layer": "grpc"}' [worker-0]: 2023-02-19 04:00:31.652839: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:31.652908: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:31.736827: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:31.736951: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: I0219 04:00:31.782937 281473737520000 multi_process_runner.py:840] Subprocess with PID 2607603 (worker, 1) is now being started. [worker-1]: I0219 04:00:31.783447 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:22395", "localhost:21500", "localhost:19193", "localhost:24982"]}, "task": {"type": "worker", "index": 1}, "rpc_layer": "grpc"}' [worker-1]: 2023-02-19 04:00:31.795096: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:31.795154: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:31.801649: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:31.801753: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: I0219 04:00:31.868214 281473737520000 multi_process_runner.py:840] Subprocess with PID 2607621 (worker, 3) is now being started. [worker-1]: 2023-02-19 04:00:31.897261: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:21500 [worker-0]: 2023-02-19 04:00:31.957588: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:22395 [worker-0]: 2023-02-19 04:00:31.991377: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:525] /job:worker/replica:0/task:1 has connected to coordination service. Incarnation: 5145699857098990876 [worker-1]: 2023-02-19 04:00:31.992352: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:298] Coordination agent has successfully connected. [worker-3]: I0219 04:00:31.868725 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:22395", "localhost:21500", "localhost:19193", "localhost:24982"]}, "task": {"type": "worker", "index": 3}, "rpc_layer": "grpc"}' [worker-3]: 2023-02-19 04:00:31.899694: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:31.899750: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:31.953001: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:31.953102: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: I0219 04:00:32.010664 281473737520000 multi_process_runner.py:840] Subprocess with PID 2607611 (worker, 2) is now being started. [worker-2]: I0219 04:00:32.011161 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:22395", "localhost:21500", "localhost:19193", "localhost:24982"]}, "task": {"type": "worker", "index": 2}, "rpc_layer": "grpc"}' [worker-2]: 2023-02-19 04:00:32.021152: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:32.021214: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:32.033605: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:32.033701: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:32.056550: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:525] /job:worker/replica:0/task:0 has connected to coordination service. Incarnation: 3744134286632453821 [worker-0]: 2023-02-19 04:00:32.057469: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:298] Coordination agent has successfully connected. [worker-3]: 2023-02-19 04:00:32.128750: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:24982 [worker-0]: 2023-02-19 04:00:32.196378: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:525] /job:worker/replica:0/task:3 has connected to coordination service. Incarnation: 3676608053143193103 [worker-3]: 2023-02-19 04:00:32.196743: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:298] Coordination agent has successfully connected. [worker-2]: 2023-02-19 04:00:32.197157: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:19193 [worker-0]: 2023-02-19 04:00:32.219540: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:525] /job:worker/replica:0/task:2 has connected to coordination service. Incarnation: 12984870065593052242 [worker-2]: 2023-02-19 04:00:32.220065: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:298] Coordination agent has successfully connected. [worker-3]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1'] [worker-3]: I0219 04:00:32.223555 281473737520000 collective_all_reduce_strategy.py:532] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1'] [worker-0]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-0]: I0219 04:00:32.224217 281473737520000 collective_all_reduce_strategy.py:532] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-1]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-1]: I0219 04:00:32.237236 281473737520000 collective_all_reduce_strategy.py:532] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-2]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-2]: I0219 04:00:32.237121 281473737520000 collective_all_reduce_strategy.py:532] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-3]: 2023-02-19 04:00:32.286474: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:32.292608: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Check health not enabled. [worker-3]: I0219 04:00:32.300066 281473737520000 collective_all_reduce_strategy.py:575] Check health not enabled. [worker-3]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:22395', 'localhost:21500', 'localhost:19193', 'localhost:24982']}, task_type = 'worker', task_id = 3, num_workers = 4, local_devices = ('/job:worker/task:3/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-3]: I0219 04:00:32.300927 281473737520000 collective_all_reduce_strategy.py:577] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:22395', 'localhost:21500', 'localhost:19193', 'localhost:24982']}, task_type = 'worker', task_id = 3, num_workers = 4, local_devices = ('/job:worker/task:3/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-3]: 2023-02-19 04:00:32.306846: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:32.321990: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:32.329301: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:Check health not enabled. [worker-1]: 2023-02-19 04:00:32.345771: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: I0219 04:00:32.334792 281473737520000 collective_all_reduce_strategy.py:575] Check health not enabled. [worker-0]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:22395', 'localhost:21500', 'localhost:19193', 'localhost:24982']}, task_type = 'worker', task_id = 0, num_workers = 4, local_devices = ('/job:worker/task:0/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-0]: I0219 04:00:32.346855 281473737520000 collective_all_reduce_strategy.py:577] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:22395', 'localhost:21500', 'localhost:19193', 'localhost:24982']}, task_type = 'worker', task_id = 0, num_workers = 4, local_devices = ('/job:worker/task:0/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-1]: 2023-02-19 04:00:32.350691: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:32.352777: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: INFO:tensorflow:Check health not enabled. [worker-1]: I0219 04:00:32.355891 281473737520000 collective_all_reduce_strategy.py:575] Check health not enabled. [worker-1]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:22395', 'localhost:21500', 'localhost:19193', 'localhost:24982']}, task_type = 'worker', task_id = 1, num_workers = 4, local_devices = ('/job:worker/task:1/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-1]: I0219 04:00:32.357511 281473737520000 collective_all_reduce_strategy.py:577] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:22395', 'localhost:21500', 'localhost:19193', 'localhost:24982']}, task_type = 'worker', task_id = 1, num_workers = 4, local_devices = ('/job:worker/task:1/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-1]: 2023-02-19 04:00:32.363381: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:32.374323: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:32.378598: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: INFO:tensorflow:Check health not enabled. [worker-2]: I0219 04:00:32.401469 281473737520000 collective_all_reduce_strategy.py:575] Check health not enabled. [worker-2]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:22395', 'localhost:21500', 'localhost:19193', 'localhost:24982']}, task_type = 'worker', task_id = 2, num_workers = 4, local_devices = ('/job:worker/task:2/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-2]: I0219 04:00:32.413289 281473737520000 collective_all_reduce_strategy.py:577] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:22395', 'localhost:21500', 'localhost:19193', 'localhost:24982']}, task_type = 'worker', task_id = 2, num_workers = 4, local_devices = ('/job:worker/task:2/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-2]: 2023-02-19 04:00:32.420553: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:32.504426: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:32.504426: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:32.508694: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:32.508694: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:32.515832: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:32.515832: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:32.520164: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:32.520352: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:32.524433: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:32.539620: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:32.539620: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:32.539620: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:32.541601: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:32.541603: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:32.541605: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:32.547942: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:32.547942: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:32.548059: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:32.549711: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:32.549754: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:32.539706: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:32.543232: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:32.545111: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:32.548448: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:Start watcher for peer's signal. [worker-0]: I0219 04:00:32.549833 281473737520000 failure_handling.py:608] Start watcher for peer's signal. [worker-0]: INFO:tensorflow:Start polling for termination signal. [worker-0]: I0219 04:00:32.550586 281473737520000 failure_handling.py:657] Start polling for termination signal. [worker-1]: INFO:tensorflow:Start watcher for peer's signal. [worker-2]: INFO:tensorflow:Start watcher for peer's signal. [worker-1]: I0219 04:00:32.553845 281473737520000 failure_handling.py:608] Start watcher for peer's signal. [worker-3]: 2023-02-19 04:00:32.549992: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Start watcher for peer's signal. [worker-2]: I0219 04:00:32.553819 281473737520000 failure_handling.py:608] Start watcher for peer's signal. [worker-3]: I0219 04:00:32.553866 281473737520000 failure_handling.py:608] Start watcher for peer's signal. [worker-3]: INFO:tensorflow:Start polling for termination signal. [worker-3]: I0219 04:00:32.555211 281473737520000 failure_handling.py:657] Start polling for termination signal. [worker-3]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-3]: I0219 04:00:32.555681 281473737520000 failure_handling.py:516] PreemptionCheckpointHandler initialized or restored. [worker-3]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-3]: Instructions for updating: [worker-3]: Track steps using a tf.Variable saved in checkpoint instead. [worker-3]: W0219 04:00:32.556010 281473737520000 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-3]: Instructions for updating: [worker-3]: Track steps using a tf.Variable saved in checkpoint instead. [worker-3]: INFO:tensorflow:Start training at 0 [worker-3]: I0219 04:00:32.556198 281473737520000 gce_failure_handler_test.py:182] Start training at 0 [worker-1]: INFO:tensorflow:Start polling for termination signal. [worker-1]: I0219 04:00:32.566379 281473737520000 failure_handling.py:657] Start polling for termination signal. [worker-0]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-0]: I0219 04:00:32.566416 281473737520000 failure_handling.py:516] PreemptionCheckpointHandler initialized or restored. [worker-0]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-1]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-2]: INFO:tensorflow:Start polling for termination signal. [worker-0]: Instructions for updating: [worker-1]: I0219 04:00:32.586407 281473737520000 failure_handling.py:516] PreemptionCheckpointHandler initialized or restored. [worker-0]: Track steps using a tf.Variable saved in checkpoint instead. [worker-1]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-0]: W0219 04:00:32.566941 281473737520000 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-1]: Instructions for updating: [worker-0]: Instructions for updating: [worker-1]: Track steps using a tf.Variable saved in checkpoint instead. [worker-0]: Track steps using a tf.Variable saved in checkpoint instead. [worker-2]: I0219 04:00:32.591469 281473737520000 failure_handling.py:657] Start polling for termination signal. [worker-0]: INFO:tensorflow:Start training at 0 [worker-0]: I0219 04:00:32.567119 281473737520000 gce_failure_handler_test.py:182] Start training at 0 [worker-1]: W0219 04:00:32.586942 281473737520000 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-1]: Instructions for updating: [worker-1]: Track steps using a tf.Variable saved in checkpoint instead. [worker-2]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-2]: I0219 04:00:32.592041 281473737520000 failure_handling.py:516] PreemptionCheckpointHandler initialized or restored. [worker-2]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-2]: Instructions for updating: [worker-2]: Track steps using a tf.Variable saved in checkpoint instead. [worker-2]: W0219 04:00:32.592365 281473737520000 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-2]: Instructions for updating: [worker-2]: Track steps using a tf.Variable saved in checkpoint instead. [worker-2]: INFO:tensorflow:Start training at 0 [worker-2]: I0219 04:00:32.592573 281473737520000 gce_failure_handler_test.py:182] Start training at 0 [worker-1]: INFO:tensorflow:Start training at 0 [worker-1]: I0219 04:00:32.587126 281473737520000 gce_failure_handler_test.py:182] Start training at 0 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:32.719061 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:32.709169 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:32.732056 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:00:32.756534: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:32.767062: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:32.779120: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:32.786363 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: 2023-02-19 04:00:32.840236: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:32.921549 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:32.923702 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:32.926932 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:32.921850 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: 2023-02-19 04:00:32.961835: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:32.964808: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:32.966907: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:32.976356: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:32.994777 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:32.989745 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:33.005671 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:32.998757 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:00:33.035298: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.038757: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:33.042652: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.053461: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:33.078510 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:33.075981 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:33.097330 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:33.104792 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:00:33.117249: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:33.118346: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.147161: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.153978: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:33.166692 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:33.172747 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:33.179107 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:33.190935 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: 2023-02-19 04:00:33.213310: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.216345: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.231141: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:33.230867: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: WARNING:tensorflow:5 out of the last 5 calls to .wrapped_fn at 0xffffb041f1f0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-0]: WARNING:tensorflow:5 out of the last 5 calls to .wrapped_fn at 0xffffb041e1f0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-1]: WARNING:tensorflow:5 out of the last 5 calls to .wrapped_fn at 0xffffb03a01f0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-0]: W0219 04:00:33.240918 281473737520000 polymorphic_function.py:156] 5 out of the last 5 calls to .wrapped_fn at 0xffffb041e1f0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-3]: W0219 04:00:33.240791 281473737520000 polymorphic_function.py:156] 5 out of the last 5 calls to .wrapped_fn at 0xffffb041f1f0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-1]: W0219 04:00:33.241374 281473737520000 polymorphic_function.py:156] 5 out of the last 5 calls to .wrapped_fn at 0xffffb03a01f0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:33.249912 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:33.249946 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: WARNING:tensorflow:5 out of the last 5 calls to .wrapped_fn at 0xffffb03a01f0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-2]: W0219 04:00:33.246885 281473737520000 polymorphic_function.py:156] 5 out of the last 5 calls to .wrapped_fn at 0xffffb03a01f0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:33.255610 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:00:33.288668: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.288668: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:33.292746 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: 2023-02-19 04:00:33.295239: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:33.333276: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: WARNING:tensorflow:6 out of the last 6 calls to .wrapped_fn at 0xffffb041f3a0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-1]: WARNING:tensorflow:6 out of the last 6 calls to .wrapped_fn at 0xffffb03a03a0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-1]: W0219 04:00:33.341162 281473737520000 polymorphic_function.py:156] 6 out of the last 6 calls to .wrapped_fn at 0xffffb03a03a0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-1]: INFO:tensorflow:epoch 0 finished [worker-1]: I0219 04:00:33.341638 281473737520000 gce_failure_handler_test.py:180] epoch 0 finished [worker-0]: WARNING:tensorflow:6 out of the last 6 calls to .wrapped_fn at 0xffffb041e3a0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-0]: W0219 04:00:33.340917 281473737520000 polymorphic_function.py:156] 6 out of the last 6 calls to .wrapped_fn at 0xffffb041e3a0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-0]: INFO:tensorflow:epoch 0 finished [worker-2]: WARNING:tensorflow:6 out of the last 6 calls to .wrapped_fn at 0xffffb03a03a0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-0]: I0219 04:00:33.341406 281473737520000 gce_failure_handler_test.py:180] epoch 0 finished [worker-2]: W0219 04:00:33.341727 281473737520000 polymorphic_function.py:156] 6 out of the last 6 calls to .wrapped_fn at 0xffffb03a03a0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-2]: INFO:tensorflow:epoch 0 finished [worker-3]: W0219 04:00:33.340672 281473737520000 polymorphic_function.py:156] 6 out of the last 6 calls to .wrapped_fn at 0xffffb041f3a0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-2]: I0219 04:00:33.342195 281473737520000 gce_failure_handler_test.py:180] epoch 0 finished [worker-3]: INFO:tensorflow:epoch 0 finished [worker-3]: I0219 04:00:33.341161 281473737520000 gce_failure_handler_test.py:180] epoch 0 finished [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:33.350597 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:33.351998 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:33.350629 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:33.358915 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:00:33.393362: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.393515: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:33.399146: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.401587: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:33.418590 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:33.422742 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:33.425136 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:33.428478 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: 2023-02-19 04:00:33.463247: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.467728: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:33.468855: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.476624: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:33.496027 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:33.505448 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:33.496579 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:33.515495 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: 2023-02-19 04:00:33.539487: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.548209: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.549139: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.580863: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Termination notice available. [worker-1]: I0219 04:00:33.597371 281447931834848 gce_failure_handler_test.py:130] Termination notice available. [worker-2]: I0219 04:00:33.597574 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:33.599631 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Member 1 has received termination notice. [worker-1]: I0219 04:00:33.607455 281447931834848 failure_handling.py:684] Member 1 has received termination notice. [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:33.617858 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:33.614759 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: 2023-02-19 04:00:33.641306: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:33.642083: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.658065: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.670303: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:33.685250 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Termination caught in main thread on preempted worker [worker-1]: I0219 04:00:33.687446 281473737520000 failure_handling.py:1111] Termination caught in main thread on preempted worker [worker-2]: INFO:tensorflow:PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_2 set, preemption awareness acknowledged [worker-1]: INFO:tensorflow:RUN_TO_CHECKPOINT set to 11 [worker-2]: I0219 04:00:33.688982 281455573791200 failure_handling.py:1194] PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_2 set, preemption awareness acknowledged [worker-1]: I0219 04:00:33.688708 281473737520000 failure_handling.py:1120] RUN_TO_CHECKPOINT set to 11 [worker-1]: INFO:tensorflow:PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_1 set, preemption awareness acknowledged [worker-1]: I0219 04:00:33.689391 281448015327712 failure_handling.py:1194] PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_1 set, preemption awareness acknowledged [worker-3]: INFO:tensorflow:PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_3 set, preemption awareness acknowledged [worker-3]: I0219 04:00:33.690876 281451127697888 failure_handling.py:1194] PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_3 set, preemption awareness acknowledged [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:33.695737 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:33.704460 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Sigterm acknowledgement from replica 0 received [worker-1]: I0219 04:00:33.726842 281473737520000 failure_handling.py:1129] Sigterm acknowledgement from replica 0 received [worker-3]: 2023-02-19 04:00:33.728664: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_0 set, preemption awareness acknowledged [worker-0]: I0219 04:00:33.731839 281457570148832 failure_handling.py:1194] PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_0 set, preemption awareness acknowledged [worker-1]: INFO:tensorflow:Sigterm acknowledgement from replica 1 received [worker-1]: I0219 04:00:33.732907 281473737520000 failure_handling.py:1129] Sigterm acknowledgement from replica 1 received [worker-1]: INFO:tensorflow:Sigterm acknowledgement from replica 2 received [worker-1]: I0219 04:00:33.734318 281473737520000 failure_handling.py:1129] Sigterm acknowledgement from replica 2 received [worker-1]: INFO:tensorflow:Sigterm acknowledgement from replica 3 received [worker-1]: I0219 04:00:33.735331 281473737520000 failure_handling.py:1129] Sigterm acknowledgement from replica 3 received [worker-0]: 2023-02-19 04:00:33.743149: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.746673: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:33.748287 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: 2023-02-19 04:00:33.790206: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-0]: I0219 04:00:33.809375 281473737520000 failure_handling.py:1016] PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-0]: 2023-02-19 04:00:33.812050: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.815662: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.821399: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-3]: I0219 04:00:33.810428 281473737520000 failure_handling.py:1016] PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-3]: 2023-02-19 04:00:33.813140: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.816325: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.826948: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.819429: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.824241: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: INFO:tensorflow:PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-2]: I0219 04:00:33.836637 281473737520000 failure_handling.py:1016] PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-2]: 2023-02-19 04:00:33.839626: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.845040: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.836001: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.845198: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.847427: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.847922: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.848871: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.852668: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.854237: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.854464: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.854485: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.857713: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.857931: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.859214: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.860542: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.860864: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.863351: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.863424: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.864411: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.865194: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.868702: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.871160: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.873689: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.876014: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: INFO:tensorflow:PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-1]: I0219 04:00:33.864374 281473737520000 failure_handling.py:1016] PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-1]: 2023-02-19 04:00:33.867015: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:33.870252: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:33.873426: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.877870: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.879369: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.879644: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.882294: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.885515: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.887931: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.888952: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.889721: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:33.891278: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.893023: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.889619: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.892936: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.896266: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.897208: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.902989: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: INFO:tensorflow:Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmpvvpi3ysd/fh_ckpt/workertemp_2/ [worker-0]: 2023-02-19 04:00:33.905725: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: I0219 04:00:33.895777 281473737520000 failure_handling.py:1030] Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmpvvpi3ysd/fh_ckpt/workertemp_2/ [worker-2]: INFO:tensorflow:Continue training for the grace period. [worker-1]: 2023-02-19 04:00:33.899747: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: I0219 04:00:33.896109 281473737520000 failure_handling.py:1086] Continue training for the grace period. [worker-1]: 2023-02-19 04:00:33.904560: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:33.909826: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:33.912395: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmpvvpi3ysd/fh_ckpt/ [worker-0]: I0219 04:00:33.912628 281473737520000 failure_handling.py:1030] Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmpvvpi3ysd/fh_ckpt/ [worker-0]: INFO:tensorflow:Continue training for the grace period. [worker-0]: I0219 04:00:33.912891 281473737520000 failure_handling.py:1086] Continue training for the grace period. [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:33.917412 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: 2023-02-19 04:00:33.927753: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:33.931397: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.926989: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.929732: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:33.933903: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:33.936336: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:33.938400: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:33.940146: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmpvvpi3ysd/fh_ckpt/workertemp_3/ [worker-3]: I0219 04:00:33.935572 281473737520000 failure_handling.py:1030] Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmpvvpi3ysd/fh_ckpt/workertemp_3/ [worker-3]: INFO:tensorflow:Continue training for the grace period. [worker-3]: I0219 04:00:33.935915 281473737520000 failure_handling.py:1086] Continue training for the grace period. [worker-1]: 2023-02-19 04:00:33.942908: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:33.950771 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: 2023-02-19 04:00:33.946299: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:33.950146: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:33.952871: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:33.940577 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmpvvpi3ysd/fh_ckpt/workertemp_1/ [worker-1]: I0219 04:00:33.958310 281473737520000 failure_handling.py:1030] Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmpvvpi3ysd/fh_ckpt/workertemp_1/ [worker-1]: INFO:tensorflow:Continue training for the grace period. [worker-1]: I0219 04:00:33.958671 281473737520000 failure_handling.py:1086] Continue training for the grace period. [worker-2]: 2023-02-19 04:00:33.966071: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:33.986453: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:33.994022: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:33.990751 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: 2023-02-19 04:00:34.034896: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:epoch 1 finished [worker-3]: I0219 04:00:34.040597 281473737520000 gce_failure_handler_test.py:180] epoch 1 finished [worker-1]: INFO:tensorflow:epoch 1 finished [worker-1]: I0219 04:00:34.047369 281473737520000 gce_failure_handler_test.py:180] epoch 1 finished [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:34.049800 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:epoch 1 finished [worker-2]: INFO:tensorflow:epoch 1 finished [worker-2]: I0219 04:00:34.047471 281473737520000 gce_failure_handler_test.py:180] epoch 1 finished [worker-0]: I0219 04:00:34.046560 281473737520000 gce_failure_handler_test.py:180] epoch 1 finished [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:34.082432 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:34.074708 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:34.097265 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: 2023-02-19 04:00:34.123299: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:34.125669: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:34.127779: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:34.144833: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:34.157252 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:34.175727 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:34.187757 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:34.193307 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:00:34.197751: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:34.216985: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:34.229363: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:34.235431: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:34.255342 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:34.259217 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:34.266536 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:00:34.300895: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:34.293239 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: 2023-02-19 04:00:34.298528: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:34.327069: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:34.334666: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:34.347331 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:34.356663 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:34.359225 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:00:34.388194: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:34.390734 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:00:34.397292: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:34.399413: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:34.430997: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:34.444156 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:34.444165 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:34.444636 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:34.445914 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: 2023-02-19 04:00:34.487133: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:34.487906: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:34.488283: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:34.516904: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:34.561317 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:34.561695 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:34.575373 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:34.577332 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: 2023-02-19 04:00:34.609245: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:34.617935: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:34.619370: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:34.627383: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:epoch 2 finished [worker-3]: I0219 04:00:34.632186 281473737520000 gce_failure_handler_test.py:180] epoch 2 finished [worker-0]: INFO:tensorflow:epoch 2 finished [worker-2]: INFO:tensorflow:epoch 2 finished [worker-2]: I0219 04:00:34.632957 281473737520000 gce_failure_handler_test.py:180] epoch 2 finished [worker-1]: INFO:tensorflow:epoch 2 finished [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:34.641899 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:34.632683 281473737520000 gce_failure_handler_test.py:180] epoch 2 finished [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:34.641900 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:34.632756 281473737520000 gce_failure_handler_test.py:180] epoch 2 finished [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:34.657279 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:34.642292 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:00:34.682975: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:34.682975: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:34.711286: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:34.713575: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:34.745731 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:34.751597 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:34.760800 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:34.761050 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: 2023-02-19 04:00:34.788083: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:34.793074: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:34.828716: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:34.851424: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:34.863950 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:34.869132 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:34.868853 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:34.888082 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:00:34.910389: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:34.920536: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:34.925112: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:34.932273: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:34.959481 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:34.951516 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:34.971292 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:00:34.994195: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:34.999471 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:00:35.015872: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:35.024091: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:35.054452: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:35.068459 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:35.069603 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:35.085635 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:35.069336 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:00:35.110472: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:35.110351: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:35.111914: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:35.139372: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:35.183672 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:35.173369 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:35.190944 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:35.202884 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:00:35.218463: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:35.232754: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:35.249228: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:35.250145: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:epoch 3 finished [worker-3]: I0219 04:00:35.254526 281473737520000 gce_failure_handler_test.py:180] epoch 3 finished [worker-1]: INFO:tensorflow:epoch 3 finished [worker-2]: INFO:tensorflow:epoch 3 finished [worker-1]: I0219 04:00:35.254805 281473737520000 gce_failure_handler_test.py:180] epoch 3 finished [worker-2]: I0219 04:00:35.254935 281473737520000 gce_failure_handler_test.py:180] epoch 3 finished [worker-0]: INFO:tensorflow:epoch 3 finished [worker-0]: I0219 04:00:35.254733 281473737520000 gce_failure_handler_test.py:180] epoch 3 finished [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:35.266456 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: 2023-02-19 04:00:35.315508: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:35.388407 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:35.429011 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:00:35.449265: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:35.453834 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:00:35.470736: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:35.497229: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:35.527414 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:35.526668 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:35.551054 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: 2023-02-19 04:00:35.569338: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:35.569974: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:35.624893: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:35.764068 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: 2023-02-19 04:00:35.806139: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:35.871566 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:35.895298 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:35.895694 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:00:35.911869: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: I0219 04:00:35.911147 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: 2023-02-19 04:00:35.935625: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:35.935625: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:36.077043: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:36.106029 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:36.111898 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:00:36.145695: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:36.152023: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:36.140768 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:36.144756 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:00:36.186402: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:36.207051: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:36.220882 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:36.221957 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:36.235912 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:36.236145 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:00:36.261773: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:36.264311: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:36.276640: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:36.277569: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:36.294299 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:36.295027 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:36.295357 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:36.295587 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:00:36.334972: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:36.334984: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:36.334972: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:36.338062: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:epoch 4 finished [worker-0]: I0219 04:00:36.357131 281473737520000 gce_failure_handler_test.py:180] epoch 4 finished [worker-0]: INFO:tensorflow:Training finished. [worker-1]: INFO:tensorflow:epoch 4 finished [worker-1]: I0219 04:00:36.357456 281473737520000 gce_failure_handler_test.py:180] epoch 4 finished [worker-1]: INFO:tensorflow:Training finished. [worker-1]: I0219 04:00:36.357743 281473737520000 gce_failure_handler_test.py:232] Training finished. [worker-0]: I0219 04:00:36.357409 281473737520000 gce_failure_handler_test.py:232] Training finished. [worker-2]: INFO:tensorflow:epoch 4 finished [worker-2]: I0219 04:00:36.363500 281473737520000 gce_failure_handler_test.py:180] epoch 4 finished [worker-2]: INFO:tensorflow:Training finished. [worker-3]: INFO:tensorflow:epoch 4 finished [worker-3]: I0219 04:00:36.366497 281473737520000 gce_failure_handler_test.py:180] epoch 4 finished [worker-3]: INFO:tensorflow:Training finished. [worker-3]: I0219 04:00:36.366798 281473737520000 gce_failure_handler_test.py:232] Training finished. [worker-2]: I0219 04:00:36.363788 281473737520000 gce_failure_handler_test.py:232] Training finished. I0219 04:00:37.699153 281473468035968 multi_process_runner.py:646] worker-0 exit code: 0 I0219 04:00:37.699476 281473468035968 multi_process_runner.py:646] worker-1 exit code: 0 I0219 04:00:37.699612 281473468035968 multi_process_runner.py:646] worker-2 exit code: 0 I0219 04:00:37.699734 281473468035968 multi_process_runner.py:646] worker-3 exit code: 0 I0219 04:00:37.701736 281473468035968 multi_process_runner.py:662] Joining log reading threads. I0219 04:00:37.701969 281473468035968 multi_process_runner.py:665] Joined log reading threads. INFO:tensorflow:time(__main__.GceFailureHandlingTest.test_grace_period_continue_training_test_apiwrappingtrain_False_inputarg_checkpoint_mwmsmode_multiworker): 9.38s I0219 04:00:37.848591 281473468035968 test_util.py:2467] time(__main__.GceFailureHandlingTest.test_grace_period_continue_training_test_apiwrappingtrain_False_inputarg_checkpoint_mwmsmode_multiworker): 9.38s [ OK ] GceFailureHandlingTest.test_grace_period_continue_training_test_apiwrappingtrain_False_inputarg_checkpoint_mwmsmode_multiworker [ RUN ] GceFailureHandlingTest.test_multiple_workers_preempted_consecutively_test_apiwrappingtrain_False_graceperiod_0_inputarg_checkpoint_mwmsmode_multiworker INFO:tensorflow:Using local port 21941 I0219 04:00:37.859300 281473468035968 test_util.py:3768] Using local port 21941 INFO:tensorflow:Using local port 24103 I0219 04:00:37.859842 281473468035968 test_util.py:3768] Using local port 24103 INFO:tensorflow:Using local port 18027 I0219 04:00:37.860246 281473468035968 test_util.py:3768] Using local port 18027 INFO:tensorflow:Using local port 16620 I0219 04:00:37.860629 281473468035968 test_util.py:3768] Using local port 16620 INFO:tensorflow:Cluster starting. I0219 04:00:37.907954 281473468035968 gce_failure_handler_test.py:379] Cluster starting. [worker-1]: I0219 04:00:37.954991 281473737520000 multi_process_runner.py:840] Subprocess with PID 2630248 (worker, 1) is now being started. [worker-1]: I0219 04:00:37.955405 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:21941", "localhost:24103", "localhost:18027", "localhost:16620"]}, "task": {"type": "worker", "index": 1}, "rpc_layer": "grpc"}' [worker-0]: I0219 04:00:37.957732 281473737520000 multi_process_runner.py:840] Subprocess with PID 2630242 (worker, 0) is now being started. [worker-1]: 2023-02-19 04:00:37.966536: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:37.966621: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: I0219 04:00:37.958211 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:21941", "localhost:24103", "localhost:18027", "localhost:16620"]}, "task": {"type": "worker", "index": 0}, "rpc_layer": "grpc"}' [worker-1]: 2023-02-19 04:00:37.972629: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:37.972740: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:37.970447: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:37.970507: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: I0219 04:00:38.018320 281473737520000 multi_process_runner.py:840] Subprocess with PID 2630323 (worker, 2) is now being started. [worker-2]: I0219 04:00:38.018948 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:21941", "localhost:24103", "localhost:18027", "localhost:16620"]}, "task": {"type": "worker", "index": 2}, "rpc_layer": "grpc"}' [worker-2]: 2023-02-19 04:00:38.029075: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:38.029148: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: I0219 04:00:38.028851 281473737520000 multi_process_runner.py:840] Subprocess with PID 2630344 (worker, 3) is now being started. [worker-3]: I0219 04:00:38.029250 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:21941", "localhost:24103", "localhost:18027", "localhost:16620"]}, "task": {"type": "worker", "index": 3}, "rpc_layer": "grpc"}' [worker-2]: 2023-02-19 04:00:38.035427: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:38.035517: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:38.039470: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:38.039536: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:38.045694: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:38.045778: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:38.047542: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:38.047634: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:38.156724: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:24103 [worker-3]: 2023-02-19 04:00:38.160427: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:16620 [worker-0]: 2023-02-19 04:00:38.166585: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:21941 [worker-0]: 2023-02-19 04:00:38.167936: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:525] /job:worker/replica:0/task:1 has connected to coordination service. Incarnation: 892823816707622599 [worker-1]: 2023-02-19 04:00:38.171390: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:298] Coordination agent has successfully connected. [worker-0]: 2023-02-19 04:00:38.195632: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:525] /job:worker/replica:0/task:0 has connected to coordination service. Incarnation: 12765627871093029916 [worker-0]: 2023-02-19 04:00:38.198495: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:298] Coordination agent has successfully connected. [worker-2]: 2023-02-19 04:00:38.217981: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:18027 [worker-0]: 2023-02-19 04:00:38.221863: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:525] /job:worker/replica:0/task:2 has connected to coordination service. Incarnation: 1274202569156350383 [worker-2]: 2023-02-19 04:00:38.222404: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:298] Coordination agent has successfully connected. [worker-0]: 2023-02-19 04:00:38.239483: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:525] /job:worker/replica:0/task:3 has connected to coordination service. Incarnation: 13915750921905161880 [worker-3]: 2023-02-19 04:00:38.239730: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:298] Coordination agent has successfully connected. [worker-0]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-0]: I0219 04:00:38.241498 281473737520000 collective_all_reduce_strategy.py:532] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-3]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1'] [worker-3]: I0219 04:00:38.241755 281473737520000 collective_all_reduce_strategy.py:532] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1'] [worker-2]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-2]: I0219 04:00:38.257393 281473737520000 collective_all_reduce_strategy.py:532] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-1]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-1]: I0219 04:00:38.283337 281473737520000 collective_all_reduce_strategy.py:532] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-0]: 2023-02-19 04:00:38.299394: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:38.305856: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:38.304285: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:38.310601: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:Check health not enabled. [worker-0]: I0219 04:00:38.310358 281473737520000 collective_all_reduce_strategy.py:575] Check health not enabled. [worker-0]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:21941', 'localhost:24103', 'localhost:18027', 'localhost:16620']}, task_type = 'worker', task_id = 0, num_workers = 4, local_devices = ('/job:worker/task:0/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-0]: I0219 04:00:38.310658 281473737520000 collective_all_reduce_strategy.py:577] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:21941', 'localhost:24103', 'localhost:18027', 'localhost:16620']}, task_type = 'worker', task_id = 0, num_workers = 4, local_devices = ('/job:worker/task:0/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-0]: 2023-02-19 04:00:38.316141: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Check health not enabled. [worker-3]: I0219 04:00:38.316344 281473737520000 collective_all_reduce_strategy.py:575] Check health not enabled. [worker-3]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:21941', 'localhost:24103', 'localhost:18027', 'localhost:16620']}, task_type = 'worker', task_id = 3, num_workers = 4, local_devices = ('/job:worker/task:3/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-3]: I0219 04:00:38.316640 281473737520000 collective_all_reduce_strategy.py:577] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:21941', 'localhost:24103', 'localhost:18027', 'localhost:16620']}, task_type = 'worker', task_id = 3, num_workers = 4, local_devices = ('/job:worker/task:3/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-3]: 2023-02-19 04:00:38.321826: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:38.348615: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:38.353424: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: INFO:tensorflow:Check health not enabled. [worker-2]: I0219 04:00:38.358773 281473737520000 collective_all_reduce_strategy.py:575] Check health not enabled. [worker-2]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:21941', 'localhost:24103', 'localhost:18027', 'localhost:16620']}, task_type = 'worker', task_id = 2, num_workers = 4, local_devices = ('/job:worker/task:2/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-2]: I0219 04:00:38.359120 281473737520000 collective_all_reduce_strategy.py:577] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:21941', 'localhost:24103', 'localhost:18027', 'localhost:16620']}, task_type = 'worker', task_id = 2, num_workers = 4, local_devices = ('/job:worker/task:2/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-1]: 2023-02-19 04:00:38.364599: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:38.364301: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:38.370312: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: INFO:tensorflow:Check health not enabled. [worker-1]: I0219 04:00:38.388952 281473737520000 collective_all_reduce_strategy.py:575] Check health not enabled. [worker-1]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:21941', 'localhost:24103', 'localhost:18027', 'localhost:16620']}, task_type = 'worker', task_id = 1, num_workers = 4, local_devices = ('/job:worker/task:1/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-1]: I0219 04:00:38.389291 281473737520000 collective_all_reduce_strategy.py:577] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:21941', 'localhost:24103', 'localhost:18027', 'localhost:16620']}, task_type = 'worker', task_id = 1, num_workers = 4, local_devices = ('/job:worker/task:1/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-1]: 2023-02-19 04:00:38.394339: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:38.444754: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:38.444939: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:38.444965: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:38.448923: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:38.448923: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:38.449351: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:38.453383: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:38.453383: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:38.457914: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:38.478260: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:38.480400: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:38.487128: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:38.489279: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: INFO:tensorflow:Start watcher for peer's signal. [worker-2]: I0219 04:00:38.493127 281473737520000 failure_handling.py:608] Start watcher for peer's signal. [worker-2]: INFO:tensorflow:Start polling for termination signal. [worker-2]: I0219 04:00:38.494436 281473737520000 failure_handling.py:657] Start polling for termination signal. [worker-3]: 2023-02-19 04:00:38.499096: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:38.500816: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:38.499003: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:38.500819: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:38.507367: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-2]: I0219 04:00:38.508049 281473737520000 failure_handling.py:516] PreemptionCheckpointHandler initialized or restored. [worker-2]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-2]: Instructions for updating: [worker-2]: Track steps using a tf.Variable saved in checkpoint instead. [worker-2]: W0219 04:00:38.508505 281473737520000 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-2]: Instructions for updating: [worker-2]: Track steps using a tf.Variable saved in checkpoint instead. [worker-2]: INFO:tensorflow:Start training at 0 [worker-2]: I0219 04:00:38.508678 281473737520000 gce_failure_handler_test.py:182] Start training at 0 [worker-0]: 2023-02-19 04:00:38.511439: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:38.506613: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:38.506769: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:38.508474: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:38.508341: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: INFO:tensorflow:Start watcher for peer's signal. [worker-1]: I0219 04:00:38.512239 281473737520000 failure_handling.py:608] Start watcher for peer's signal. [worker-1]: INFO:tensorflow:Start polling for termination signal. [worker-3]: INFO:tensorflow:Start watcher for peer's signal. [worker-1]: I0219 04:00:38.514436 281473737520000 failure_handling.py:657] Start polling for termination signal. [worker-3]: I0219 04:00:38.512107 281473737520000 failure_handling.py:608] Start watcher for peer's signal. [worker-3]: INFO:tensorflow:Start polling for termination signal. [worker-3]: I0219 04:00:38.515489 281473737520000 failure_handling.py:657] Start polling for termination signal. [worker-1]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-1]: I0219 04:00:38.515276 281473737520000 failure_handling.py:516] PreemptionCheckpointHandler initialized or restored. [worker-1]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-1]: Instructions for updating: [worker-1]: Track steps using a tf.Variable saved in checkpoint instead. [worker-1]: W0219 04:00:38.515597 281473737520000 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-1]: Instructions for updating: [worker-1]: Track steps using a tf.Variable saved in checkpoint instead. [worker-1]: INFO:tensorflow:Start training at 0 [worker-1]: I0219 04:00:38.515760 281473737520000 gce_failure_handler_test.py:182] Start training at 0 [worker-0]: 2023-02-19 04:00:38.513373: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:38.516814: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:Start watcher for peer's signal. [worker-0]: I0219 04:00:38.518202 281473737520000 failure_handling.py:608] Start watcher for peer's signal. [worker-0]: INFO:tensorflow:Start polling for termination signal. [worker-0]: I0219 04:00:38.519146 281473737520000 failure_handling.py:657] Start polling for termination signal. [worker-0]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-0]: I0219 04:00:38.519640 281473737520000 failure_handling.py:516] PreemptionCheckpointHandler initialized or restored. [worker-0]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-0]: Instructions for updating: [worker-3]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-0]: Track steps using a tf.Variable saved in checkpoint instead. [worker-3]: I0219 04:00:38.520979 281473737520000 failure_handling.py:516] PreemptionCheckpointHandler initialized or restored. [worker-3]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-0]: W0219 04:00:38.520001 281473737520000 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-3]: Instructions for updating: [worker-3]: Track steps using a tf.Variable saved in checkpoint instead. [worker-0]: Instructions for updating: [worker-3]: W0219 04:00:38.521332 281473737520000 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-0]: Track steps using a tf.Variable saved in checkpoint instead. [worker-2]: INFO:tensorflow:Termination notice available. [worker-0]: INFO:tensorflow:Start training at 0 [worker-2]: I0219 04:00:38.523951 281447797617120 gce_failure_handler_test.py:134] Termination notice available. [worker-2]: INFO:tensorflow:Member 2 has received termination notice. [worker-3]: Instructions for updating: [worker-2]: I0219 04:00:38.525052 281447797617120 failure_handling.py:684] Member 2 has received termination notice. [worker-3]: Track steps using a tf.Variable saved in checkpoint instead. [worker-0]: I0219 04:00:38.520234 281473737520000 gce_failure_handler_test.py:182] Start training at 0 [worker-3]: INFO:tensorflow:Start training at 0 [worker-2]: INFO:tensorflow:Termination caught in main thread on preempted worker [worker-3]: I0219 04:00:38.521494 281473737520000 gce_failure_handler_test.py:182] Start training at 0 [worker-1]: INFO:tensorflow:Termination notice available. [worker-1]: I0219 04:00:38.528218 281453015200224 gce_failure_handler_test.py:134] Termination notice available. [worker-2]: I0219 04:00:38.527255 281473737520000 failure_handling.py:1111] Termination caught in main thread on preempted worker [worker-2]: INFO:tensorflow:RUN_TO_CHECKPOINT set to 1 [worker-0]: INFO:tensorflow:PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_0 set, preemption awareness acknowledged [worker-2]: I0219 04:00:38.528177 281473737520000 failure_handling.py:1120] RUN_TO_CHECKPOINT set to 1 [worker-0]: I0219 04:00:38.529520 281447822455264 failure_handling.py:1194] PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_0 set, preemption awareness acknowledged [worker-2]: INFO:tensorflow:PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_2 set, preemption awareness acknowledged [worker-2]: I0219 04:00:38.528914 281448216654304 failure_handling.py:1194] PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_2 set, preemption awareness acknowledged [worker-2]: INFO:tensorflow:Sigterm acknowledgement from replica 0 received [worker-2]: I0219 04:00:38.529377 281473737520000 failure_handling.py:1129] Sigterm acknowledgement from replica 0 received [worker-0]: INFO:tensorflow:Termination notice available. [worker-3]: INFO:tensorflow:PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_3 set, preemption awareness acknowledged [worker-3]: I0219 04:00:38.535567 281450095702496 failure_handling.py:1194] PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_3 set, preemption awareness acknowledged [worker-3]: INFO:tensorflow:Termination notice available. [worker-3]: I0219 04:00:38.547643 281449877991904 gce_failure_handler_test.py:134] Termination notice available. [worker-1]: INFO:tensorflow:PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_1 set, preemption awareness acknowledged [worker-2]: INFO:tensorflow:Sigterm acknowledgement from replica 1 received [worker-2]: I0219 04:00:38.566253 281473737520000 failure_handling.py:1129] Sigterm acknowledgement from replica 1 received [worker-1]: I0219 04:00:38.560015 281453023654368 failure_handling.py:1194] PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_1 set, preemption awareness acknowledged [worker-2]: INFO:tensorflow:Sigterm acknowledgement from replica 2 received [worker-3]: INFO:tensorflow:Member 3 has received termination notice. But some other worker has received it as well! Leaving it to them to decide when to checkpoint. [worker-1]: INFO:tensorflow:Member 1 has received termination notice. But some other worker has received it as well! Leaving it to them to decide when to checkpoint. [worker-3]: I0219 04:00:38.571955 281449877991904 failure_handling.py:695] Member 3 has received termination notice. But some other worker has received it as well! Leaving it to them to decide when to checkpoint. [worker-2]: I0219 04:00:38.571067 281473737520000 failure_handling.py:1129] Sigterm acknowledgement from replica 2 received [worker-1]: I0219 04:00:38.560275 281453015200224 failure_handling.py:695] Member 1 has received termination notice. But some other worker has received it as well! Leaving it to them to decide when to checkpoint. [worker-2]: INFO:tensorflow:Sigterm acknowledgement from replica 3 received [worker-2]: I0219 04:00:38.577539 281473737520000 failure_handling.py:1129] Sigterm acknowledgement from replica 3 received [worker-0]: I0219 04:00:38.532253 281447814001120 gce_failure_handler_test.py:134] Termination notice available. [worker-0]: INFO:tensorflow:Member 0 has received termination notice. But some other worker has received it as well! Leaving it to them to decide when to checkpoint. [worker-0]: I0219 04:00:38.593520 281447814001120 failure_handling.py:695] Member 0 has received termination notice. But some other worker has received it as well! Leaving it to them to decide when to checkpoint. [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:00:38.627459 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:00:38.664622 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: 2023-02-19 04:00:38.705900: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:00:38.714717 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:00:38.730120: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:38.761292: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:00:38.908642 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:00:38.956649: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-3]: I0219 04:00:38.999489 281473737520000 failure_handling.py:1016] PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-3]: 2023-02-19 04:00:39.002881: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:39.007779: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:39.014471: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-0]: I0219 04:00:39.017474 281473737520000 failure_handling.py:1016] PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-0]: 2023-02-19 04:00:39.020249: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:39.023518: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:39.026577: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:39.031313: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:39.035060: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:39.043781: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:39.055401: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: INFO:tensorflow:PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-1]: I0219 04:00:39.046592 281473737520000 failure_handling.py:1016] PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-1]: 2023-02-19 04:00:39.049352: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:39.052845: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:39.056084: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:39.060963: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:39.064239: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: INFO:tensorflow:PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-1]: 2023-02-19 04:00:39.081461: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:39.083384: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:39.083383: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:39.089300: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:39.085079: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:39.092676: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:39.089217: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:39.091840: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:39.094706: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: I0219 04:00:39.068215 281473737520000 failure_handling.py:1016] PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-1]: 2023-02-19 04:00:39.096539: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:39.097755: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:39.099997: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:39.103076: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:39.106738: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:39.071437: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:39.075864: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:39.082433: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:39.089182: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:39.111201: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:39.098763: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:39.101078: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:39.111100: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:39.119253: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:39.121849: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:39.119176: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:39.122187: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:39.123930: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:39.125037: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:39.125805: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:39.125741: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:39.127860: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:39.129687: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:39.134495: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:39.138481: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:39.136026: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:39.140175: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:39.127803: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:39.138226: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:39.145290: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:39.148467: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: 2023-02-19 04:00:39.148925: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:39.151010: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-2]: 2023-02-19 04:00:39.153336: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmp20jrg_hv/fh_ckpt/ [worker-0]: I0219 04:00:39.154124 281473737520000 failure_handling.py:1030] Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmp20jrg_hv/fh_ckpt/ [worker-2]: 2023-02-19 04:00:39.155494: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-0]: INFO:tensorflow:Shut down watcher for one's own termination signal [worker-3]: 2023-02-19 04:00:39.147919: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:39.149793: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: 2023-02-19 04:00:39.150886: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: 2023-02-19 04:00:39.152238: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmp20jrg_hv/fh_ckpt/workertemp_3/ [worker-0]: I0219 04:00:39.154436 281473737520000 failure_handling.py:708] Shut down watcher for one's own termination signal [worker-2]: 2023-02-19 04:00:39.160414: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: INFO:tensorflow:Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmp20jrg_hv/fh_ckpt/workertemp_1/ [worker-2]: 2023-02-19 04:00:39.164712: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: I0219 04:00:39.158942 281473737520000 failure_handling.py:1030] Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmp20jrg_hv/fh_ckpt/workertemp_3/ [worker-1]: I0219 04:00:39.156926 281473737520000 failure_handling.py:1030] Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmp20jrg_hv/fh_ckpt/workertemp_1/ [worker-3]: INFO:tensorflow:Shut down watcher for one's own termination signal [worker-1]: INFO:tensorflow:Shut down watcher for one's own termination signal [worker-3]: I0219 04:00:39.159380 281473737520000 failure_handling.py:708] Shut down watcher for one's own termination signal [worker-1]: I0219 04:00:39.157237 281473737520000 failure_handling.py:708] Shut down watcher for one's own termination signal [worker-2]: 2023-02-19 04:00:39.171762: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-1]: INFO:tensorflow:Shut down watcher for peer's termination signal. [worker-1]: I0219 04:00:39.171672 281473737520000 failure_handling.py:741] Shut down watcher for peer's termination signal. [worker-1]: INFO:tensorflow:PreemptionCheckpointHandler: checkpoint saved. Exiting. [worker-1]: I0219 04:00:39.172544 281473737520000 failure_handling.py:1080] PreemptionCheckpointHandler: checkpoint saved. Exiting. [worker-2]: 2023-02-19 04:00:39.174964: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a8b2910, num_threads=56 [worker-3]: INFO:tensorflow:Shut down watcher for peer's termination signal. [worker-3]: I0219 04:00:39.173829 281473737520000 failure_handling.py:741] Shut down watcher for peer's termination signal. [worker-3]: INFO:tensorflow:PreemptionCheckpointHandler: checkpoint saved. Exiting. [worker-0]: INFO:tensorflow:Shut down watcher for peer's termination signal. [worker-3]: I0219 04:00:39.174598 281473737520000 failure_handling.py:1080] PreemptionCheckpointHandler: checkpoint saved. Exiting. [worker-2]: INFO:tensorflow:Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmp20jrg_hv/fh_ckpt/workertemp_2/ [worker-2]: I0219 04:00:39.184047 281473737520000 failure_handling.py:1030] Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmp20jrg_hv/fh_ckpt/workertemp_2/ [worker-2]: INFO:tensorflow:Shut down watcher for one's own termination signal [worker-2]: I0219 04:00:39.184451 281473737520000 failure_handling.py:708] Shut down watcher for one's own termination signal [worker-0]: I0219 04:00:39.175310 281473737520000 failure_handling.py:741] Shut down watcher for peer's termination signal. [worker-0]: INFO:tensorflow:PreemptionCheckpointHandler: checkpoint saved. Exiting. [worker-0]: I0219 04:00:39.175557 281473737520000 failure_handling.py:1080] PreemptionCheckpointHandler: checkpoint saved. Exiting. [worker-2]: INFO:tensorflow:Shut down watcher for peer's termination signal. [worker-2]: I0219 04:00:39.198337 281473737520000 failure_handling.py:741] Shut down watcher for peer's termination signal. [worker-2]: INFO:tensorflow:PreemptionCheckpointHandler: checkpoint saved. Exiting. [worker-2]: I0219 04:00:39.199269 281473737520000 failure_handling.py:1080] PreemptionCheckpointHandler: checkpoint saved. Exiting. INFO:tensorflow:restarting workers I0219 04:00:41.027794 281473468035968 gce_failure_handler_test.py:385] restarting workers INFO:tensorflow:workers restarted I0219 04:00:41.103747 281473468035968 gce_failure_handler_test.py:389] workers restarted [worker-0]: I0219 04:00:41.243015 281473737520000 multi_process_runner.py:840] Subprocess with PID 2636536 (worker, 0) is now being started. [worker-2]: I0219 04:00:41.242841 281473737520000 multi_process_runner.py:840] Subprocess with PID 2636650 (worker, 2) is now being started. [worker-0]: I0219 04:00:41.243383 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:21941", "localhost:24103", "localhost:18027", "localhost:16620"]}, "task": {"type": "worker", "index": 0}, "rpc_layer": "grpc"}' [worker-2]: I0219 04:00:41.243213 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:21941", "localhost:24103", "localhost:18027", "localhost:16620"]}, "task": {"type": "worker", "index": 2}, "rpc_layer": "grpc"}' [worker-1]: I0219 04:00:41.248598 281473737520000 multi_process_runner.py:840] Subprocess with PID 2636625 (worker, 1) is now being started. [worker-0]: 2023-02-19 04:00:41.251285: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:00:41.251343: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:00:41.256096: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:00:41.256198: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: E0219 04:00:41.262182795 2636536 server_chttp2.cc:40] {"created":"@1676779241.262060912","description":"No address added out of total 1 resolved","file":"external/com_github_grpc_grpc/src/core/ext/transport/chttp2/server/chttp2_server.cc","file_line":395,"referenced_errors":[{"created":"@1676779241.262055907","description":"Failed to add any wildcard listeners","file":"external/com_github_grpc_grpc/src/core/lib/iomgr/tcp_server_posix.cc","file_line":341,"referenced_errors":[{"created":"@1676779241.262027459","description":"Unable to configure socket","fd":9,"file":"external/com_github_grpc_grpc/src/core/lib/iomgr/tcp_server_utils_posix_common.cc","file_line":215,"referenced_errors":[{"created":"@1676779241.262014527","description":"Address already in use","errno":98,"file":"external/com_github_grpc_grpc/src/core/lib/iomgr/tcp_server_utils_posix_common.cc","file_line":189,"os_error":"Address already in use","syscall":"bind"}]},{"created":"@1676779241.262054792","description":"Unable to configure socket","fd":9,"file":"external/com_github_grpc_grpc/src/core/lib/iomgr/tcp_server_utils_posix_common.cc","file_line":215,"referenced_errors":[{"created":"@1676779241.262047611","description":"Address already in use","errno":98,"file":"external/com_github_grpc_grpc/src/core/lib/iomgr/tcp_server_utils_posix_common.cc","file_line":189,"os_error":"Address already in use","syscall":"bind"}]}]}]} [worker-0]: 2023-02-19 04:00:41.262304: E tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:601] UNKNOWN: Could not start gRPC server [worker-2]: 2023-02-19 04:00:41.262270: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:00:41.262322: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:00:41.267027: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:00:41.267095: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: I0219 04:00:41.249089 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:21941", "localhost:24103", "localhost:18027", "localhost:16620"]}, "task": {"type": "worker", "index": 1}, "rpc_layer": "grpc"}' [worker-1]: 2023-02-19 04:00:41.309639: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:00:41.309710: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:00:41.314396: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:00:41.314481: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: I0219 04:00:41.357797 281473737520000 multi_process_runner.py:840] Subprocess with PID 2636654 (worker, 3) is now being started. [worker-3]: I0219 04:00:41.358297 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:21941", "localhost:24103", "localhost:18027", "localhost:16620"]}, "task": {"type": "worker", "index": 3}, "rpc_layer": "grpc"}' [worker-3]: 2023-02-19 04:00:41.381351: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:00:41.381418: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:00:41.386727: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:00:41.386834: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:00:41.499368: E tensorflow/core/common_runtime/eager/context_distributed_manager.cc:699] Could not start gRPC server [worker-2]: 2023-02-19 04:00:41.504176: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:18027 [worker-0]: Process _Process-10: [worker-0]: Traceback (most recent call last): [worker-0]: File "/usr/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap [worker-0]: self.run() [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 755, in _run_with_setenv [worker-0]: return self._actual_run() [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 54, in _run_with_absl [worker-0]: app.run(lambda _: self._run_impl()) [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/absl_py/absl/app.py", line 312, in run [worker-0]: _run_main(main, args) [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/absl_py/absl/app.py", line 258, in _run_main [worker-0]: sys.exit(main(argv)) [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 54, in [worker-0]: app.run(lambda _: self._run_impl()) [worker-0]: File "/usr/lib/python3.9/multiprocessing/process.py", line 108, in run [worker-0]: self._target(*self._args, **self._kwargs) [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 866, in __call__ [worker-0]: six.reraise(*info.exc_info) [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/six_archive/six.py", line 719, in reraise [worker-0]: raise value [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 1060, in _run_contained [worker-0]: return_value = fn(*args, **kwargs) [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py", line 122, in worker_fn [worker-0]: strategy = collective_all_reduce_strategy.CollectiveAllReduceStrategy() [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 188, in __init__ [worker-0]: CollectiveAllReduceExtended( [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 340, in __init__ [worker-0]: self._initialize_strategy(self._cluster_resolver, devices=devices) [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 359, in _initialize_strategy [worker-0]: self._initialize_multi_worker(cluster_resolver) [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 531, in _initialize_multi_worker [worker-0]: context.context().ensure_initialized() [worker-0]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/eager/context.py", line 595, in ensure_initialized [worker-0]: pywrap_tfe.TFE_EnableCollectiveOps(context_handle, server_def_str) [worker-0]: tensorflow.python.framework.errors_impl.UnknownError: Could not start gRPC server [worker-3]: 2023-02-19 04:00:41.657828: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:16620 [worker-1]: 2023-02-19 04:00:41.677569: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:24103 E0219 04:04:51.104308 281473468035968 multi_process_runner.py:626] Timeout when joining for child processes. Terminating... I0219 04:04:51.104676 281473468035968 multi_process_runner.py:715] worker-0 has already exited. Not terminating. I0219 04:04:51.104923 281473468035968 multi_process_runner.py:721] worker-1 terminated with signal . [worker-1]: Thread 0x0000ffff97b6f1e0 (most recent call first): I0219 04:04:51.105330 281473468035968 multi_process_runner.py:721] worker-2 terminated with signal . [worker-2]: Thread 0x0000ffff97b6f1e0 (most recent call first): I0219 04:04:51.105670 281473468035968 multi_process_runner.py:721] worker-3 terminated with signal . [worker-1]: File "/usr/lib/python3.9/multiprocessing/connection.py", line 379 in _recv [worker-3]: Thread 0x0000ffff97b6f1e0 (most recent call first): [worker-2]: File "/usr/lib/python3.9/multiprocessing/connection.py", line 379 in _recv [worker-1]: File "/usr/lib/python3.9/multiprocessing/connection.py", line 414 in _recv_bytes [worker-3]: File "/usr/lib/python3.9/multiprocessing/connection.py", line 379 in _recv [worker-2]: File "/usr/lib/python3.9/multiprocessing/connection.py", line 414 in _recv_bytes [worker-1]: File "/usr/lib/python3.9/multiprocessing/connection.py", line 216 in recv_bytes [worker-3]: File "/usr/lib/python3.9/multiprocessing/connection.py", line 414 in _recv_bytes [worker-2]: File "/usr/lib/python3.9/multiprocessing/connection.py", line 216 in recv_bytes [worker-1]: File "/usr/lib/python3.9/multiprocessing/connection.py", line 752 in answer_challenge [worker-3]: File "/usr/lib/python3.9/multiprocessing/connection.py", line 216 in recv_bytes [worker-2]: File "/usr/lib/python3.9/multiprocessing/connection.py", line 752 in answer_challenge [worker-1]: File "/usr/lib/python3.9/multiprocessing/connection.py", line 508 in Client [worker-3]: File "/usr/lib/python3.9/multiprocessing/connection.py", line 752 in answer_challenge [worker-2]: File "/usr/lib/python3.9/multiprocessing/connection.py", line 508 in Client [worker-1]: File "/usr/lib/python3.9/multiprocessing/managers.py", line 793 in _connect [worker-3]: File "/usr/lib/python3.9/multiprocessing/connection.py", line 508 in Client [worker-2]: File "/usr/lib/python3.9/multiprocessing/managers.py", line 793 in _connect [worker-1]: File "/usr/lib/python3.9/multiprocessing/managers.py", line 806 in _callmethod [worker-3]: File "/usr/lib/python3.9/multiprocessing/managers.py", line 793 in _connect [worker-2]: File "/usr/lib/python3.9/multiprocessing/managers.py", line 806 in _callmethod [worker-1]: File "", line 2 in get [worker-3]: File "/usr/lib/python3.9/multiprocessing/managers.py", line 806 in _callmethod [worker-2]: File "", line 2 in get [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 775 in _message_checking_func [worker-3]: File "", line 2 in get [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 775 in _message_checking_func [worker-1]: File "/usr/lib/python3.9/threading.py", line 917 in run [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 775 in _message_checking_func [worker-2]: File "/usr/lib/python3.9/threading.py", line 917 in run [worker-1]: File "/usr/lib/python3.9/threading.py", line 980 in _bootstrap_inner [worker-3]: File "/usr/lib/python3.9/threading.py", line 917 in run [worker-2]: File "/usr/lib/python3.9/threading.py", line 980 in _bootstrap_inner [worker-1]: File "/usr/lib/python3.9/threading.py", line 937 in _bootstrap [worker-3]: File "/usr/lib/python3.9/threading.py", line 980 in _bootstrap_inner [worker-2]: File "/usr/lib/python3.9/threading.py", line 937 in _bootstrap [worker-1]: [worker-3]: File "/usr/lib/python3.9/threading.py", line 937 in _bootstrap [worker-2]: [worker-1]: Current thread 0x0000ffffb6237380 (most recent call first): [worker-3]: [worker-2]: Current thread 0x0000ffffb6237380 (most recent call first): [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/eager/context.py", line 595 in ensure_initialized [worker-3]: Current thread 0x0000ffffb6237380 (most recent call first): [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/eager/context.py", line 595 in ensure_initialized [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 531 in _initialize_multi_worker [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/eager/context.py", line 595 in ensure_initialized [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 531 in _initialize_multi_worker [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 359 in _initialize_strategy [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 531 in _initialize_multi_worker [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 359 in _initialize_strategy [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 340 in __init__ [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 359 in _initialize_strategy [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 340 in __init__ [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 188 in __init__ [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 188 in __init__ [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py", line 122 in worker_fn [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 340 in __init__ [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py", line 122 in worker_fn [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 1060 in _run_contained [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 188 in __init__ [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 1060 in _run_contained [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 854 in __call__ [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py", line 122 in worker_fn [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 854 in __call__ [worker-2]: File "/usr/lib/python3.9/multiprocessing/process.py", line 108 in run [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 1060 in _run_contained [worker-1]: File "/usr/lib/python3.9/multiprocessing/process.py", line 108 in run [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 54 in [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 854 in __call__ [worker-3]: File "/usr/lib/python3.9/multiprocessing/process.py", line 108 in run [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/absl_py/absl/app.py", line 258 in _run_main [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 54 in [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 54 in [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/absl_py/absl/app.py", line 312 in run [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/absl_py/absl/app.py", line 258 in _run_main [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 54 in _run_with_absl [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/absl_py/absl/app.py", line 258 in _run_main [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/absl_py/absl/app.py", line 312 in run [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 755 in _run_with_setenv [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/absl_py/absl/app.py", line 312 in run [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 54 in _run_with_absl [worker-2]: File "/usr/lib/python3.9/multiprocessing/process.py", line 315 in _bootstrap [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 54 in _run_with_absl [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 755 in _run_with_setenv [worker-2]: File "/usr/lib/python3.9/multiprocessing/spawn.py", line 129 in _main [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 755 in _run_with_setenv [worker-1]: File "/usr/lib/python3.9/multiprocessing/process.py", line 315 in _bootstrap [worker-2]: File "/usr/lib/python3.9/multiprocessing/forkserver.py", line 313 in _serve_one [worker-3]: File "/usr/lib/python3.9/multiprocessing/process.py", line 315 in _bootstrap [worker-1]: File "/usr/lib/python3.9/multiprocessing/spawn.py", line 129 in _main [worker-2]: File "/usr/lib/python3.9/multiprocessing/forkserver.py", line 274 in main [worker-3]: File "/usr/lib/python3.9/multiprocessing/spawn.py", line 129 in _main [worker-1]: File "/usr/lib/python3.9/multiprocessing/forkserver.py", line 313 in _serve_one [worker-2]: File "", line 1 in [worker-3]: File "/usr/lib/python3.9/multiprocessing/forkserver.py", line 313 in _serve_one [worker-1]: File "/usr/lib/python3.9/multiprocessing/forkserver.py", line 274 in main [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 151 in _if_spawn_run_and_exit [worker-3]: File "/usr/lib/python3.9/multiprocessing/forkserver.py", line 274 in main [worker-1]: File "", line 1 in [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 164 in test_main [worker-3]: File "", line 1 in [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 151 in _if_spawn_run_and_exit [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 1455 in test_main [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 151 in _if_spawn_run_and_exit [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 164 in test_main [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/test_util.py", line 137 in main [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_lib.py", line 164 in test_main [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 1455 in test_main [worker-2]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py", line 518 in [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 1455 in test_main [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/test_util.py", line 137 in main [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/test_util.py", line 137 in main [worker-1]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py", line 518 in [worker-3]: File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py", line 518 in INFO:tensorflow:time(__main__.GceFailureHandlingTest.test_multiple_workers_preempted_consecutively_test_apiwrappingtrain_False_graceperiod_0_inputarg_checkpoint_mwmsmode_multiworker): 254.08s I0219 04:04:51.934604 281473468035968 test_util.py:2467] time(__main__.GceFailureHandlingTest.test_multiple_workers_preempted_consecutively_test_apiwrappingtrain_False_graceperiod_0_inputarg_checkpoint_mwmsmode_multiworker): 254.08s [ FAILED ] GceFailureHandlingTest.test_multiple_workers_preempted_consecutively_test_apiwrappingtrain_False_graceperiod_0_inputarg_checkpoint_mwmsmode_multiworker [ RUN ] GceFailureHandlingTest.test_multiple_workers_preempted_consecutively_test_apiwrappingtrain_True_graceperiod_0_inputarg_checkpoint_mwmsmode_multiworker INFO:tensorflow:Using local port 23472 I0219 04:04:51.939918 281473468035968 test_util.py:3768] Using local port 23472 INFO:tensorflow:Using local port 15883 I0219 04:04:51.940340 281473468035968 test_util.py:3768] Using local port 15883 INFO:tensorflow:Using local port 18705 I0219 04:04:51.940723 281473468035968 test_util.py:3768] Using local port 18705 INFO:tensorflow:Using local port 23855 I0219 04:04:51.941102 281473468035968 test_util.py:3768] Using local port 23855 INFO:tensorflow:Cluster starting. I0219 04:04:51.957075 281473468035968 gce_failure_handler_test.py:379] Cluster starting. [worker-0]: I0219 04:04:51.987952 281473737520000 multi_process_runner.py:840] Subprocess with PID 3071939 (worker, 0) is now being started. [worker-0]: I0219 04:04:51.988287 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:23472", "localhost:15883", "localhost:18705", "localhost:23855"]}, "task": {"type": "worker", "index": 0}, "rpc_layer": "grpc"}' [worker-1]: I0219 04:04:51.994294 281473737520000 multi_process_runner.py:840] Subprocess with PID 3071942 (worker, 1) is now being started. [worker-1]: I0219 04:04:51.994608 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:23472", "localhost:15883", "localhost:18705", "localhost:23855"]}, "task": {"type": "worker", "index": 1}, "rpc_layer": "grpc"}' [worker-0]: 2023-02-19 04:04:51.996614: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:51.996689: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: I0219 04:04:52.000735 281473737520000 multi_process_runner.py:840] Subprocess with PID 3071944 (worker, 2) is now being started. [worker-0]: 2023-02-19 04:04:52.001969: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: I0219 04:04:52.001058 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:23472", "localhost:15883", "localhost:18705", "localhost:23855"]}, "task": {"type": "worker", "index": 2}, "rpc_layer": "grpc"}' [worker-0]: 2023-02-19 04:04:52.002057: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.002703: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.002746: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: I0219 04:04:52.006659 281473737520000 multi_process_runner.py:840] Subprocess with PID 3071949 (worker, 3) is now being started. [worker-3]: I0219 04:04:52.006982 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:23472", "localhost:15883", "localhost:18705", "localhost:23855"]}, "task": {"type": "worker", "index": 3}, "rpc_layer": "grpc"}' [worker-1]: 2023-02-19 04:04:52.008361: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.008469: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.009251: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.009296: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.014538: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.014622: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.015110: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.015152: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.020034: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:23472 [worker-3]: 2023-02-19 04:04:52.020358: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.020432: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.024884: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:525] /job:worker/replica:0/task:0 has connected to coordination service. Incarnation: 18355919839373383488 [worker-0]: 2023-02-19 04:04:52.025166: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:298] Coordination agent has successfully connected. [worker-1]: 2023-02-19 04:04:52.027497: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:15883 [worker-2]: 2023-02-19 04:04:52.032704: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:18705 [worker-0]: 2023-02-19 04:04:52.033414: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:525] /job:worker/replica:0/task:1 has connected to coordination service. Incarnation: 901257655627265139 [worker-1]: 2023-02-19 04:04:52.033627: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:298] Coordination agent has successfully connected. [worker-0]: 2023-02-19 04:04:52.037753: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:525] /job:worker/replica:0/task:2 has connected to coordination service. Incarnation: 367335292677274761 [worker-3]: 2023-02-19 04:04:52.037843: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:23855 [worker-2]: 2023-02-19 04:04:52.037919: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:298] Coordination agent has successfully connected. [worker-0]: 2023-02-19 04:04:52.043963: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:525] /job:worker/replica:0/task:3 has connected to coordination service. Incarnation: 7384379640369065546 [worker-3]: 2023-02-19 04:04:52.044132: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:298] Coordination agent has successfully connected. [worker-3]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1'] [worker-2]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-0]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-1]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-3]: I0219 04:04:52.045644 281473737520000 collective_all_reduce_strategy.py:532] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1'] [worker-0]: I0219 04:04:52.045629 281473737520000 collective_all_reduce_strategy.py:532] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-2]: I0219 04:04:52.045629 281473737520000 collective_all_reduce_strategy.py:532] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-1]: I0219 04:04:52.045769 281473737520000 collective_all_reduce_strategy.py:532] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-1]: 2023-02-19 04:04:52.096419: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.096410: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.096410: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.096410: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.100165: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.100372: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.100372: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.100372: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: INFO:tensorflow:Check health not enabled. [worker-2]: INFO:tensorflow:Check health not enabled. [worker-0]: INFO:tensorflow:Check health not enabled. [worker-3]: INFO:tensorflow:Check health not enabled. [worker-1]: I0219 04:04:52.103800 281473737520000 collective_all_reduce_strategy.py:575] Check health not enabled. [worker-2]: I0219 04:04:52.103872 281473737520000 collective_all_reduce_strategy.py:575] Check health not enabled. [worker-3]: I0219 04:04:52.103872 281473737520000 collective_all_reduce_strategy.py:575] Check health not enabled. [worker-0]: I0219 04:04:52.103872 281473737520000 collective_all_reduce_strategy.py:575] Check health not enabled. [worker-1]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:23472', 'localhost:15883', 'localhost:18705', 'localhost:23855']}, task_type = 'worker', task_id = 1, num_workers = 4, local_devices = ('/job:worker/task:1/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-2]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:23472', 'localhost:15883', 'localhost:18705', 'localhost:23855']}, task_type = 'worker', task_id = 2, num_workers = 4, local_devices = ('/job:worker/task:2/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-3]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:23472', 'localhost:15883', 'localhost:18705', 'localhost:23855']}, task_type = 'worker', task_id = 3, num_workers = 4, local_devices = ('/job:worker/task:3/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-0]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:23472', 'localhost:15883', 'localhost:18705', 'localhost:23855']}, task_type = 'worker', task_id = 0, num_workers = 4, local_devices = ('/job:worker/task:0/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-1]: I0219 04:04:52.104171 281473737520000 collective_all_reduce_strategy.py:577] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:23472', 'localhost:15883', 'localhost:18705', 'localhost:23855']}, task_type = 'worker', task_id = 1, num_workers = 4, local_devices = ('/job:worker/task:1/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-2]: I0219 04:04:52.104154 281473737520000 collective_all_reduce_strategy.py:577] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:23472', 'localhost:15883', 'localhost:18705', 'localhost:23855']}, task_type = 'worker', task_id = 2, num_workers = 4, local_devices = ('/job:worker/task:2/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-3]: I0219 04:04:52.104154 281473737520000 collective_all_reduce_strategy.py:577] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:23472', 'localhost:15883', 'localhost:18705', 'localhost:23855']}, task_type = 'worker', task_id = 3, num_workers = 4, local_devices = ('/job:worker/task:3/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-0]: I0219 04:04:52.104154 281473737520000 collective_all_reduce_strategy.py:577] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:23472', 'localhost:15883', 'localhost:18705', 'localhost:23855']}, task_type = 'worker', task_id = 0, num_workers = 4, local_devices = ('/job:worker/task:0/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-3]: 2023-02-19 04:04:52.108682: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.108682: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.108682: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.109019: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.115253: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.115391: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.115518: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.115684: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.118113: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.118616: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.118927: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.118926: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.121383: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.125893: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.125980: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.125992: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.126037: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.127564: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.127567: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.127612: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.128051: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.129603: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.131590: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.131624: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.131822: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.132249: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.133176: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.133213: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.133429: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: INFO:tensorflow:Start watcher for peer's signal. [worker-0]: I0219 04:04:52.133466 281473737520000 failure_handling.py:608] Start watcher for peer's signal. [worker-0]: INFO:tensorflow:Start polling for termination signal. [worker-0]: I0219 04:04:52.134017 281473737520000 failure_handling.py:657] Start polling for termination signal. [worker-0]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-0]: I0219 04:04:52.134436 281473737520000 failure_handling.py:516] PreemptionCheckpointHandler initialized or restored. [worker-0]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-0]: Instructions for updating: [worker-3]: INFO:tensorflow:Start watcher for peer's signal. [worker-2]: INFO:tensorflow:Start watcher for peer's signal. [worker-2]: I0219 04:04:52.135520 281473737520000 failure_handling.py:608] Start watcher for peer's signal. [worker-1]: INFO:tensorflow:Start watcher for peer's signal. [worker-0]: Track steps using a tf.Variable saved in checkpoint instead. [worker-3]: I0219 04:04:52.135519 281473737520000 failure_handling.py:608] Start watcher for peer's signal. [worker-1]: I0219 04:04:52.135852 281473737520000 failure_handling.py:608] Start watcher for peer's signal. [worker-0]: W0219 04:04:52.134748 281473737520000 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-2]: INFO:tensorflow:Start polling for termination signal. [worker-3]: INFO:tensorflow:Start polling for termination signal. [worker-1]: INFO:tensorflow:Start polling for termination signal. [worker-0]: Instructions for updating: [worker-3]: I0219 04:04:52.136055 281473737520000 failure_handling.py:657] Start polling for termination signal. [worker-2]: I0219 04:04:52.136054 281473737520000 failure_handling.py:657] Start polling for termination signal. [worker-1]: I0219 04:04:52.136399 281473737520000 failure_handling.py:657] Start polling for termination signal. [worker-0]: Track steps using a tf.Variable saved in checkpoint instead. [worker-3]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-2]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-1]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-0]: INFO:tensorflow:Start training at 0 [worker-0]: I0219 04:04:52.134897 281473737520000 gce_failure_handler_test.py:182] Start training at 0 [worker-3]: I0219 04:04:52.136513 281473737520000 failure_handling.py:516] PreemptionCheckpointHandler initialized or restored. [worker-1]: I0219 04:04:52.136837 281473737520000 failure_handling.py:516] PreemptionCheckpointHandler initialized or restored. [worker-2]: I0219 04:04:52.136495 281473737520000 failure_handling.py:516] PreemptionCheckpointHandler initialized or restored. [worker-0]: INFO:tensorflow:Termination notice available. [worker-1]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-3]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-0]: I0219 04:04:52.137167 281447352693216 gce_failure_handler_test.py:134] Termination notice available. [worker-2]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-1]: Instructions for updating: [worker-0]: INFO:tensorflow:Member 0 has received termination notice. [worker-3]: Instructions for updating: [worker-2]: Instructions for updating: [worker-1]: Track steps using a tf.Variable saved in checkpoint instead. [worker-0]: I0219 04:04:52.137661 281447352693216 failure_handling.py:684] Member 0 has received termination notice. [worker-3]: Track steps using a tf.Variable saved in checkpoint instead. [worker-1]: W0219 04:04:52.137115 281473737520000 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-0]: INFO:tensorflow:Termination caught in main thread on preempted worker [worker-1]: Instructions for updating: [worker-3]: W0219 04:04:52.136750 281473737520000 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-2]: Track steps using a tf.Variable saved in checkpoint instead. [worker-0]: I0219 04:04:52.143296 281473737520000 failure_handling.py:1111] Termination caught in main thread on preempted worker [worker-3]: Instructions for updating: [worker-2]: W0219 04:04:52.136825 281473737520000 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-1]: Track steps using a tf.Variable saved in checkpoint instead. [worker-0]: INFO:tensorflow:RUN_TO_CHECKPOINT set to 1 [worker-1]: INFO:tensorflow:Start training at 0 [worker-2]: Instructions for updating: [worker-3]: Track steps using a tf.Variable saved in checkpoint instead. [worker-1]: I0219 04:04:52.137329 281473737520000 gce_failure_handler_test.py:182] Start training at 0 [worker-0]: I0219 04:04:52.143934 281473737520000 failure_handling.py:1120] RUN_TO_CHECKPOINT set to 1 [worker-2]: Track steps using a tf.Variable saved in checkpoint instead. [worker-3]: INFO:tensorflow:Start training at 0 [worker-0]: INFO:tensorflow:PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_0 set, preemption awareness acknowledged [worker-2]: INFO:tensorflow:Start training at 0 [worker-3]: I0219 04:04:52.136973 281473737520000 gce_failure_handler_test.py:182] Start training at 0 [worker-1]: INFO:tensorflow:PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_1 set, preemption awareness acknowledged [worker-2]: I0219 04:04:52.136980 281473737520000 gce_failure_handler_test.py:182] Start training at 0 [worker-0]: I0219 04:04:52.144302 281447361147360 failure_handling.py:1194] PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_0 set, preemption awareness acknowledged [worker-3]: INFO:tensorflow:Termination notice available. [worker-2]: INFO:tensorflow:Termination notice available. [worker-0]: INFO:tensorflow:Sigterm acknowledgement from replica 0 received [worker-1]: I0219 04:04:52.144167 281448283763168 failure_handling.py:1194] PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_1 set, preemption awareness acknowledged [worker-3]: I0219 04:04:52.143325 281447881109984 gce_failure_handler_test.py:134] Termination notice available. [worker-2]: I0219 04:04:52.143833 281447889564128 gce_failure_handler_test.py:134] Termination notice available. [worker-1]: INFO:tensorflow:Termination notice available. [worker-3]: INFO:tensorflow:Member 3 has received termination notice. But some other worker has received it as well! Leaving it to them to decide when to checkpoint. [worker-0]: I0219 04:04:52.144574 281473737520000 failure_handling.py:1129] Sigterm acknowledgement from replica 0 received [worker-2]: INFO:tensorflow:PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_2 set, preemption awareness acknowledged [worker-1]: I0219 04:04:52.145603 281447394963936 gce_failure_handler_test.py:134] Termination notice available. [worker-0]: INFO:tensorflow:Sigterm acknowledgement from replica 1 received [worker-3]: I0219 04:04:52.144146 281447881109984 failure_handling.py:695] Member 3 has received termination notice. But some other worker has received it as well! Leaving it to them to decide when to checkpoint. [worker-2]: I0219 04:04:52.144288 281447898018272 failure_handling.py:1194] PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_2 set, preemption awareness acknowledged [worker-1]: INFO:tensorflow:Member 1 has received termination notice. But some other worker has received it as well! Leaving it to them to decide when to checkpoint. [worker-0]: I0219 04:04:52.145047 281473737520000 failure_handling.py:1129] Sigterm acknowledgement from replica 1 received [worker-3]: INFO:tensorflow:PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_3 set, preemption awareness acknowledged [worker-2]: INFO:tensorflow:Member 2 has received termination notice. But some other worker has received it as well! Leaving it to them to decide when to checkpoint. [worker-1]: I0219 04:04:52.146389 281447394963936 failure_handling.py:695] Member 1 has received termination notice. But some other worker has received it as well! Leaving it to them to decide when to checkpoint. [worker-0]: INFO:tensorflow:Sigterm acknowledgement from replica 2 received [worker-3]: I0219 04:04:52.144237 281447889564128 failure_handling.py:1194] PreemptionCheckpointHandler: RECEIVED_SIGNAL_RUN_TO_CHECKPOINT_3 set, preemption awareness acknowledged [worker-2]: I0219 04:04:52.144707 281447889564128 failure_handling.py:695] Member 2 has received termination notice. But some other worker has received it as well! Leaving it to them to decide when to checkpoint. [worker-0]: I0219 04:04:52.145471 281473737520000 failure_handling.py:1129] Sigterm acknowledgement from replica 2 received [worker-0]: INFO:tensorflow:Sigterm acknowledgement from replica 3 received [worker-0]: I0219 04:04:52.145868 281473737520000 failure_handling.py:1129] Sigterm acknowledgement from replica 3 received [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:52.232644 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:52.232651 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:52.232636 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:52.235368 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: 2023-02-19 04:04:52.273664: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.273664: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.273664: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.274966: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-0]: INFO:tensorflow:PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-3]: I0219 04:04:52.283287 281473737520000 failure_handling.py:1016] PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-2]: INFO:tensorflow:PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-1]: INFO:tensorflow:PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-0]: I0219 04:04:52.283351 281473737520000 failure_handling.py:1016] PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-2]: I0219 04:04:52.283587 281473737520000 failure_handling.py:1016] PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-1]: I0219 04:04:52.283611 281473737520000 failure_handling.py:1016] PreemptionCheckpointHandler: Starting saving a checkpoint. [worker-3]: 2023-02-19 04:04:52.285659: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.285659: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.285766: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.285966: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.288727: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.288728: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.288729: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.289032: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.291042: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.291038: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.291054: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.291496: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.295959: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.295971: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.295980: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.296923: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.299262: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.299264: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.299266: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.300285: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.302826: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.302825: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.302826: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.303996: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.304380: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.304383: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.304383: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.305572: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.307270: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.307278: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.307291: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.308607: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.309589: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.309590: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.309665: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.310972: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.311665: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.311673: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.311735: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.313115: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.313658: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.313664: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.313724: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.315145: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.315343: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.315357: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.315409: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.316854: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.316861: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.316889: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.317899: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.318412: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.319134: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.319136: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.320753: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.320862: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.321770: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.321801: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.323090: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.323461: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.324045: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.324069: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:52.325118: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.325908: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:52.325998: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:52.326039: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:52.327933: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: INFO:tensorflow:Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmpxy_mbsze/fh_ckpt/ [worker-0]: I0219 04:04:52.328489 281473737520000 failure_handling.py:1030] Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmpxy_mbsze/fh_ckpt/ [worker-0]: INFO:tensorflow:Shut down watcher for one's own termination signal [worker-0]: I0219 04:04:52.328782 281473737520000 failure_handling.py:708] Shut down watcher for one's own termination signal [worker-3]: INFO:tensorflow:Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmpxy_mbsze/fh_ckpt/workertemp_3/ [worker-2]: INFO:tensorflow:Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmpxy_mbsze/fh_ckpt/workertemp_2/ [worker-3]: I0219 04:04:52.329182 281473737520000 failure_handling.py:1030] Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmpxy_mbsze/fh_ckpt/workertemp_3/ [worker-2]: I0219 04:04:52.329285 281473737520000 failure_handling.py:1030] Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmpxy_mbsze/fh_ckpt/workertemp_2/ [worker-3]: INFO:tensorflow:Shut down watcher for one's own termination signal [worker-2]: INFO:tensorflow:Shut down watcher for one's own termination signal [worker-0]: INFO:tensorflow:Shut down watcher for peer's termination signal. [worker-3]: I0219 04:04:52.329459 281473737520000 failure_handling.py:708] Shut down watcher for one's own termination signal [worker-2]: I0219 04:04:52.329626 281473737520000 failure_handling.py:708] Shut down watcher for one's own termination signal [worker-0]: I0219 04:04:52.329837 281473737520000 failure_handling.py:741] Shut down watcher for peer's termination signal. [worker-3]: INFO:tensorflow:Shut down watcher for peer's termination signal. [worker-2]: INFO:tensorflow:Shut down watcher for peer's termination signal. [worker-3]: I0219 04:04:52.330354 281473737520000 failure_handling.py:741] Shut down watcher for peer's termination signal. [worker-0]: INFO:tensorflow:PreemptionCheckpointHandler: checkpoint saved. Exiting. [worker-2]: I0219 04:04:52.330520 281473737520000 failure_handling.py:741] Shut down watcher for peer's termination signal. [worker-3]: INFO:tensorflow:PreemptionCheckpointHandler: checkpoint saved. Exiting. [worker-1]: INFO:tensorflow:Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmpxy_mbsze/fh_ckpt/workertemp_1/ [worker-0]: I0219 04:04:52.329984 281473737520000 failure_handling.py:1080] PreemptionCheckpointHandler: checkpoint saved. Exiting. [worker-2]: INFO:tensorflow:PreemptionCheckpointHandler: checkpoint saved. Exiting. [worker-3]: I0219 04:04:52.330888 281473737520000 failure_handling.py:1080] PreemptionCheckpointHandler: checkpoint saved. Exiting. [worker-2]: I0219 04:04:52.331041 281473737520000 failure_handling.py:1080] PreemptionCheckpointHandler: checkpoint saved. Exiting. [worker-1]: I0219 04:04:52.331313 281473737520000 failure_handling.py:1030] Checkpoint finished at path /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/1cdb7bf028c865694bc9537435dfbee5hfmq5kdr/tmpxy_mbsze/fh_ckpt/workertemp_1/ [worker-1]: INFO:tensorflow:Shut down watcher for one's own termination signal [worker-1]: I0219 04:04:52.331665 281473737520000 failure_handling.py:708] Shut down watcher for one's own termination signal [worker-1]: INFO:tensorflow:Shut down watcher for peer's termination signal. [worker-1]: I0219 04:04:52.332541 281473737520000 failure_handling.py:741] Shut down watcher for peer's termination signal. [worker-1]: INFO:tensorflow:PreemptionCheckpointHandler: checkpoint saved. Exiting. [worker-1]: I0219 04:04:52.333063 281473737520000 failure_handling.py:1080] PreemptionCheckpointHandler: checkpoint saved. Exiting. INFO:tensorflow:restarting workers I0219 04:04:53.985726 281473468035968 gce_failure_handler_test.py:385] restarting workers INFO:tensorflow:workers restarted I0219 04:04:54.012324 281473468035968 gce_failure_handler_test.py:389] workers restarted [worker-0]: I0219 04:04:54.017408 281473737520000 multi_process_runner.py:840] Subprocess with PID 3073311 (worker, 0) is now being started. [worker-0]: I0219 04:04:54.017745 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:23472", "localhost:15883", "localhost:18705", "localhost:23855"]}, "task": {"type": "worker", "index": 0}, "rpc_layer": "grpc"}' [worker-1]: I0219 04:04:54.024064 281473737520000 multi_process_runner.py:840] Subprocess with PID 3073314 (worker, 1) is now being started. [worker-1]: I0219 04:04:54.024384 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:23472", "localhost:15883", "localhost:18705", "localhost:23855"]}, "task": {"type": "worker", "index": 1}, "rpc_layer": "grpc"}' [worker-0]: 2023-02-19 04:04:54.026338: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.026407: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: I0219 04:04:54.030528 281473737520000 multi_process_runner.py:840] Subprocess with PID 3073316 (worker, 2) is now being started. [worker-2]: I0219 04:04:54.030859 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:23472", "localhost:15883", "localhost:18705", "localhost:23855"]}, "task": {"type": "worker", "index": 2}, "rpc_layer": "grpc"}' [worker-0]: 2023-02-19 04:04:54.031920: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.032001: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.032708: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.032753: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: I0219 04:04:54.036029 281473737520000 multi_process_runner.py:840] Subprocess with PID 3073321 (worker, 3) is now being started. [worker-3]: I0219 04:04:54.036369 281473737520000 multi_process_runner.py:842] TF_CONFIG: '{"cluster": {"worker": ["localhost:23472", "localhost:15883", "localhost:18705", "localhost:23855"]}, "task": {"type": "worker", "index": 3}, "rpc_layer": "grpc"}' [worker-1]: 2023-02-19 04:04:54.037931: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.038007: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.038976: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.039021: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.044089: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.044167: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.044526: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.044571: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.049598: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.049836: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:23472 [worker-3]: 2023-02-19 04:04:54.049674: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.054479: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:525] /job:worker/replica:0/task:0 has connected to coordination service. Incarnation: 13699279520478349558 [worker-0]: 2023-02-19 04:04:54.054679: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:298] Coordination agent has successfully connected. [worker-1]: 2023-02-19 04:04:54.055951: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:15883 [worker-0]: 2023-02-19 04:04:54.060744: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:525] /job:worker/replica:0/task:1 has connected to coordination service. Incarnation: 11007683394547433262 [worker-1]: 2023-02-19 04:04:54.060975: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:298] Coordination agent has successfully connected. [worker-2]: 2023-02-19 04:04:54.061798: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:18705 [worker-0]: 2023-02-19 04:04:54.067254: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:525] /job:worker/replica:0/task:2 has connected to coordination service. Incarnation: 10642277280435569062 [worker-2]: 2023-02-19 04:04:54.067453: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:298] Coordination agent has successfully connected. [worker-3]: 2023-02-19 04:04:54.067476: I tensorflow/core/distributed_runtime/rpc/grpc_server_lib.cc:450] Started server with target: grpc://localhost:23855 [worker-0]: 2023-02-19 04:04:54.072588: I tensorflow/tsl/distributed_runtime/coordination/coordination_service.cc:525] /job:worker/replica:0/task:3 has connected to coordination service. Incarnation: 16479855762986831889 [worker-3]: 2023-02-19 04:04:54.072762: I tensorflow/tsl/distributed_runtime/coordination/coordination_service_agent.cc:298] Coordination agent has successfully connected. [worker-2]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-1]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-3]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1'] [worker-0]: INFO:tensorflow:Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-2]: I0219 04:04:54.074509 281473737520000 collective_all_reduce_strategy.py:532] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-1]: I0219 04:04:54.074525 281473737520000 collective_all_reduce_strategy.py:532] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-3]: I0219 04:04:54.074586 281473737520000 collective_all_reduce_strategy.py:532] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1', '/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1'] [worker-0]: I0219 04:04:54.074509 281473737520000 collective_all_reduce_strategy.py:532] Enabled multi-worker collective ops with available devices: ['/job:worker/replica:0/task:0/device:CPU:0', '/job:worker/replica:0/task:0/device:CPU:1', '/job:worker/replica:0/task:1/device:CPU:0', '/job:worker/replica:0/task:1/device:CPU:1', '/job:worker/replica:0/task:2/device:CPU:0', '/job:worker/replica:0/task:2/device:CPU:1', '/job:worker/replica:0/task:3/device:CPU:0', '/job:worker/replica:0/task:3/device:CPU:1'] [worker-3]: 2023-02-19 04:04:54.125230: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.125230: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.125230: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.125230: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.129746: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.129747: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.129747: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.129747: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: INFO:tensorflow:Check health not enabled. [worker-1]: INFO:tensorflow:Check health not enabled. [worker-0]: INFO:tensorflow:Check health not enabled. [worker-3]: INFO:tensorflow:Check health not enabled. [worker-2]: I0219 04:04:54.133351 281473737520000 collective_all_reduce_strategy.py:575] Check health not enabled. [worker-1]: I0219 04:04:54.133350 281473737520000 collective_all_reduce_strategy.py:575] Check health not enabled. [worker-0]: I0219 04:04:54.133351 281473737520000 collective_all_reduce_strategy.py:575] Check health not enabled. [worker-3]: I0219 04:04:54.133350 281473737520000 collective_all_reduce_strategy.py:575] Check health not enabled. [worker-2]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:23472', 'localhost:15883', 'localhost:18705', 'localhost:23855']}, task_type = 'worker', task_id = 2, num_workers = 4, local_devices = ('/job:worker/task:2/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-1]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:23472', 'localhost:15883', 'localhost:18705', 'localhost:23855']}, task_type = 'worker', task_id = 1, num_workers = 4, local_devices = ('/job:worker/task:1/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-0]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:23472', 'localhost:15883', 'localhost:18705', 'localhost:23855']}, task_type = 'worker', task_id = 0, num_workers = 4, local_devices = ('/job:worker/task:0/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-3]: INFO:tensorflow:MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:23472', 'localhost:15883', 'localhost:18705', 'localhost:23855']}, task_type = 'worker', task_id = 3, num_workers = 4, local_devices = ('/job:worker/task:3/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-2]: I0219 04:04:54.133642 281473737520000 collective_all_reduce_strategy.py:577] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:23472', 'localhost:15883', 'localhost:18705', 'localhost:23855']}, task_type = 'worker', task_id = 2, num_workers = 4, local_devices = ('/job:worker/task:2/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-1]: I0219 04:04:54.133636 281473737520000 collective_all_reduce_strategy.py:577] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:23472', 'localhost:15883', 'localhost:18705', 'localhost:23855']}, task_type = 'worker', task_id = 1, num_workers = 4, local_devices = ('/job:worker/task:1/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-3]: I0219 04:04:54.133636 281473737520000 collective_all_reduce_strategy.py:577] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:23472', 'localhost:15883', 'localhost:18705', 'localhost:23855']}, task_type = 'worker', task_id = 3, num_workers = 4, local_devices = ('/job:worker/task:3/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-0]: I0219 04:04:54.133636 281473737520000 collective_all_reduce_strategy.py:577] MultiWorkerMirroredStrategy with cluster_spec = {'worker': ['localhost:23472', 'localhost:15883', 'localhost:18705', 'localhost:23855']}, task_type = 'worker', task_id = 0, num_workers = 4, local_devices = ('/job:worker/task:0/device:CPU:0',), communication = CommunicationImplementation.AUTO [worker-1]: 2023-02-19 04:04:54.138494: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.138494: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.138494: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.138495: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.146176: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.146192: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.146461: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.146620: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.149040: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.149652: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.149788: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.149902: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.152414: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.157216: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.157236: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.157338: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.157420: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.158848: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.158914: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.158989: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.159398: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.160955: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.165935: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.165935: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.165941: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.166305: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.169261: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.169261: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.169263: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.169590: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.171139: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.171167: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.171151: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.171445: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.174605: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.174607: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.174611: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.174748: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.177127: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.177248: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.177249: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.178318: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.179755: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.179779: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.182499: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.187343: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.187357: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.187355: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.188034: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: INFO:tensorflow:Start watcher for peer's signal. [worker-1]: INFO:tensorflow:Start watcher for peer's signal. [worker-0]: INFO:tensorflow:Start watcher for peer's signal. [worker-2]: I0219 04:04:54.188540 281473737520000 failure_handling.py:608] Start watcher for peer's signal. [worker-1]: I0219 04:04:54.188540 281473737520000 failure_handling.py:608] Start watcher for peer's signal. [worker-0]: I0219 04:04:54.188564 281473737520000 failure_handling.py:608] Start watcher for peer's signal. [worker-2]: INFO:tensorflow:Start polling for termination signal. [worker-1]: INFO:tensorflow:Start polling for termination signal. [worker-0]: INFO:tensorflow:Start polling for termination signal. [worker-3]: INFO:tensorflow:Start watcher for peer's signal. [worker-1]: I0219 04:04:54.189172 281473737520000 failure_handling.py:657] Start polling for termination signal. [worker-2]: I0219 04:04:54.189151 281473737520000 failure_handling.py:657] Start polling for termination signal. [worker-0]: I0219 04:04:54.189126 281473737520000 failure_handling.py:657] Start polling for termination signal. [worker-1]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-0]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-3]: I0219 04:04:54.189357 281473737520000 failure_handling.py:608] Start watcher for peer's signal. [worker-2]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-1]: I0219 04:04:54.189602 281473737520000 failure_handling.py:516] PreemptionCheckpointHandler initialized or restored. [worker-0]: I0219 04:04:54.189540 281473737520000 failure_handling.py:516] PreemptionCheckpointHandler initialized or restored. [worker-2]: I0219 04:04:54.189584 281473737520000 failure_handling.py:516] PreemptionCheckpointHandler initialized or restored. [worker-0]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-1]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-3]: INFO:tensorflow:Start polling for termination signal. [worker-2]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-1]: Instructions for updating: [worker-3]: I0219 04:04:54.190069 281473737520000 failure_handling.py:657] Start polling for termination signal. [worker-0]: Instructions for updating: [worker-2]: Instructions for updating: [worker-1]: Track steps using a tf.Variable saved in checkpoint instead. [worker-3]: INFO:tensorflow:PreemptionCheckpointHandler initialized or restored. [worker-1]: W0219 04:04:54.189870 281473737520000 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-0]: Track steps using a tf.Variable saved in checkpoint instead. [worker-2]: Track steps using a tf.Variable saved in checkpoint instead. [worker-0]: W0219 04:04:54.189803 281473737520000 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-1]: Instructions for updating: [worker-3]: I0219 04:04:54.190495 281473737520000 failure_handling.py:516] PreemptionCheckpointHandler initialized or restored. [worker-0]: Instructions for updating: [worker-2]: W0219 04:04:54.189871 281473737520000 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-3]: WARNING:tensorflow:From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-1]: Track steps using a tf.Variable saved in checkpoint instead. [worker-0]: Track steps using a tf.Variable saved in checkpoint instead. [worker-2]: Instructions for updating: [worker-1]: INFO:tensorflow:Start training at 1 [worker-3]: Instructions for updating: [worker-0]: INFO:tensorflow:Start training at 1 [worker-1]: I0219 04:04:54.190072 281473737520000 gce_failure_handler_test.py:182] Start training at 1 [worker-2]: Track steps using a tf.Variable saved in checkpoint instead. [worker-3]: Track steps using a tf.Variable saved in checkpoint instead. [worker-0]: I0219 04:04:54.190041 281473737520000 gce_failure_handler_test.py:182] Start training at 1 [worker-2]: INFO:tensorflow:Start training at 1 [worker-1]: INFO:tensorflow:['ckpt-1.data-00000-of-00001', 'ckpt-1.index', 'checkpoint', 'workertemp_1', 'workertemp_2', 'workertemp_3'] [worker-3]: W0219 04:04:54.190805 281473737520000 deprecation.py:364] From /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py:183: PreemptionCheckpointHandler.total_run_calls (from tensorflow.python.distribute.failure_handling.failure_handling) is deprecated and will be removed in a future version. [worker-3]: Instructions for updating: [worker-0]: INFO:tensorflow:['ckpt-1.data-00000-of-00001', 'ckpt-1.index', 'checkpoint', 'workertemp_1', 'workertemp_2', 'workertemp_3'] [worker-2]: I0219 04:04:54.190073 281473737520000 gce_failure_handler_test.py:182] Start training at 1 [worker-0]: I0219 04:04:54.197668 281473737520000 gce_failure_handler_test.py:191] ['ckpt-1.data-00000-of-00001', 'ckpt-1.index', 'checkpoint', 'workertemp_1', 'workertemp_2', 'workertemp_3'] [worker-3]: Track steps using a tf.Variable saved in checkpoint instead. [worker-1]: I0219 04:04:54.198928 281473737520000 gce_failure_handler_test.py:191] ['ckpt-1.data-00000-of-00001', 'ckpt-1.index', 'checkpoint', 'workertemp_1', 'workertemp_2', 'workertemp_3'] [worker-3]: INFO:tensorflow:Start training at 1 [worker-2]: INFO:tensorflow:['ckpt-1.data-00000-of-00001', 'ckpt-1.index', 'checkpoint', 'workertemp_1', 'workertemp_2', 'workertemp_3'] [worker-3]: I0219 04:04:54.191025 281473737520000 gce_failure_handler_test.py:182] Start training at 1 [worker-2]: I0219 04:04:54.200977 281473737520000 gce_failure_handler_test.py:191] ['ckpt-1.data-00000-of-00001', 'ckpt-1.index', 'checkpoint', 'workertemp_1', 'workertemp_2', 'workertemp_3'] [worker-3]: INFO:tensorflow:['ckpt-1.data-00000-of-00001', 'ckpt-1.index', 'checkpoint', 'workertemp_1', 'workertemp_2', 'workertemp_3'] [worker-3]: I0219 04:04:54.201793 281473737520000 gce_failure_handler_test.py:191] ['ckpt-1.data-00000-of-00001', 'ckpt-1.index', 'checkpoint', 'workertemp_1', 'workertemp_2', 'workertemp_3'] [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:54.285950 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:54.285960 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:54.287758 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:54.289615 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:54.327577: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.327577: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.327577: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.329581: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:54.347656 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:54.347654 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:54.347706 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:54.347665 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:54.384077: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.384077: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.384078: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.384077: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:54.393365 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:54.393457 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:54.393569 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:54.393656 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:04:54.427880: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.427879: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.428098: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.428110: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:54.437011 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:54.437150 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:54.437214 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:54.437293 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: 2023-02-19 04:04:54.471161: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.471162: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.471164: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.471251: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:54.480229 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:54.480296 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:54.480434 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:54.480555 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:54.514646: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.514682: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.514715: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.514822: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: WARNING:tensorflow:5 out of the last 5 calls to .wrapped_fn at 0xffffb03ae160> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-0]: WARNING:tensorflow:5 out of the last 5 calls to .wrapped_fn at 0xffffb03ae160> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-3]: W0219 04:04:54.517542 281473737520000 polymorphic_function.py:156] 5 out of the last 5 calls to .wrapped_fn at 0xffffb03ae160> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-1]: WARNING:tensorflow:5 out of the last 5 calls to .wrapped_fn at 0xffffb03af160> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-2]: WARNING:tensorflow:5 out of the last 5 calls to .wrapped_fn at 0xffffb03af160> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-0]: W0219 04:04:54.517659 281473737520000 polymorphic_function.py:156] 5 out of the last 5 calls to .wrapped_fn at 0xffffb03ae160> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-3]: INFO:tensorflow:epoch 0 finished [worker-1]: W0219 04:04:54.517824 281473737520000 polymorphic_function.py:156] 5 out of the last 5 calls to .wrapped_fn at 0xffffb03af160> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-2]: W0219 04:04:54.517877 281473737520000 polymorphic_function.py:156] 5 out of the last 5 calls to .wrapped_fn at 0xffffb03af160> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-0]: INFO:tensorflow:epoch 0 finished [worker-1]: INFO:tensorflow:epoch 0 finished [worker-3]: I0219 04:04:54.517805 281473737520000 gce_failure_handler_test.py:180] epoch 0 finished [worker-2]: INFO:tensorflow:epoch 0 finished [worker-0]: I0219 04:04:54.517905 281473737520000 gce_failure_handler_test.py:180] epoch 0 finished [worker-1]: I0219 04:04:54.518073 281473737520000 gce_failure_handler_test.py:180] epoch 0 finished [worker-2]: I0219 04:04:54.518121 281473737520000 gce_failure_handler_test.py:180] epoch 0 finished [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:54.524113 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:54.524123 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:54.524304 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:54.524357 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:04:54.558098: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:54.558107: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.558266: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.558298: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: WARNING:tensorflow:6 out of the last 6 calls to .wrapped_fn at 0xffffb03ae430> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-0]: WARNING:tensorflow:6 out of the last 6 calls to .wrapped_fn at 0xffffb03ae430> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-3]: W0219 04:04:54.561058 281473737520000 polymorphic_function.py:156] 6 out of the last 6 calls to .wrapped_fn at 0xffffb03ae430> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-1]: WARNING:tensorflow:6 out of the last 6 calls to .wrapped_fn at 0xffffb03af430> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-2]: WARNING:tensorflow:6 out of the last 6 calls to .wrapped_fn at 0xffffb03af430> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-0]: W0219 04:04:54.561182 281473737520000 polymorphic_function.py:156] 6 out of the last 6 calls to .wrapped_fn at 0xffffb03ae430> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-1]: W0219 04:04:54.561314 281473737520000 polymorphic_function.py:156] 6 out of the last 6 calls to .wrapped_fn at 0xffffb03af430> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-2]: W0219 04:04:54.561344 281473737520000 polymorphic_function.py:156] 6 out of the last 6 calls to .wrapped_fn at 0xffffb03af430> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has reduce_retracing=True option that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details. [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:54.567405 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:54.567442 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:54.567571 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:54.567653 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:54.601371: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.601395: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.601439: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.601432: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:54.610204 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:54.610300 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:54.610379 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:54.610495 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:54.644660: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.644671: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.644681: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.644842: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:54.653485 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:54.653656 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:54.653780 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:54.653784 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:54.687505: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.687517: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.687606: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.687645: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:54.696411 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:54.696587 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:54.696644 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:54.696684 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:54.730514: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.730613: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.730621: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.730616: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:54.739512 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:54.739591 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:54.739707 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:54.740958 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:54.773328: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.773435: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.773532: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.778002: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:epoch 1 finished [worker-0]: INFO:tensorflow:epoch 1 finished [worker-3]: I0219 04:04:54.780589 281473737520000 gce_failure_handler_test.py:180] epoch 1 finished [worker-1]: INFO:tensorflow:epoch 1 finished [worker-2]: INFO:tensorflow:epoch 1 finished [worker-0]: I0219 04:04:54.780704 281473737520000 gce_failure_handler_test.py:180] epoch 1 finished [worker-1]: I0219 04:04:54.780833 281473737520000 gce_failure_handler_test.py:180] epoch 1 finished [worker-2]: I0219 04:04:54.780896 281473737520000 gce_failure_handler_test.py:180] epoch 1 finished [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:54.788303 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:54.788491 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:54.788511 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:54.788809 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:54.822294: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.822368: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.822433: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.822947: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:54.831554 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:54.831606 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:54.831701 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:54.831760 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:54.865376: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.865495: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.865542: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.865571: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:54.874207 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:54.874352 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:54.874513 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:54.874523 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:54.908124: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.908137: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.908254: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.908403: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:54.917092 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:54.917220 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:54.917293 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:54.917147 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:54.951203: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.951369: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.951377: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.951378: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:54.960097 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:54.960034 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:54.960240 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:54.960260 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:54.993874: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:54.993998: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:54.994021: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:54.994070: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:55.002870 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:55.002805 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:55.003114 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:55.002996 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:55.036939: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:55.037058: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:55.037085: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:55.037122: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:epoch 2 finished [worker-0]: INFO:tensorflow:epoch 2 finished [worker-3]: I0219 04:04:55.039783 281473737520000 gce_failure_handler_test.py:180] epoch 2 finished [worker-1]: INFO:tensorflow:epoch 2 finished [worker-2]: INFO:tensorflow:epoch 2 finished [worker-0]: I0219 04:04:55.039908 281473737520000 gce_failure_handler_test.py:180] epoch 2 finished [worker-1]: I0219 04:04:55.040077 281473737520000 gce_failure_handler_test.py:180] epoch 2 finished [worker-2]: I0219 04:04:55.040125 281473737520000 gce_failure_handler_test.py:180] epoch 2 finished [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:55.046050 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:55.046011 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:55.046317 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:55.046208 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:55.079860: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:55.079949: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:55.079952: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:55.080077: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:55.088661 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:55.088780 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:55.088859 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:55.088966 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:55.122463: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:55.122472: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:55.122563: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:55.122589: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:55.131582 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:55.131630 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:55.131694 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:55.131783 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:55.165269: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:55.165473: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:55.165558: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:55.165569: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:55.174159 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:55.174274 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:55.174352 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:55.174483 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:04:55.208042: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:55.208087: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:55.208218: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:55.208241: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:55.216916 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:55.217021 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:55.217089 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:55.217182 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:55.250975: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:55.251042: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:55.251235: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:55.251227: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:55.259895 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:55.260021 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:55.260057 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:55.260155 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:04:55.293759: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:55.293763: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:55.293811: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:55.293791: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:epoch 3 finished [worker-0]: INFO:tensorflow:epoch 3 finished [worker-3]: I0219 04:04:55.296515 281473737520000 gce_failure_handler_test.py:180] epoch 3 finished [worker-2]: INFO:tensorflow:epoch 3 finished [worker-1]: INFO:tensorflow:epoch 3 finished [worker-0]: I0219 04:04:55.296658 281473737520000 gce_failure_handler_test.py:180] epoch 3 finished [worker-2]: I0219 04:04:55.296840 281473737520000 gce_failure_handler_test.py:180] epoch 3 finished [worker-1]: I0219 04:04:55.296786 281473737520000 gce_failure_handler_test.py:180] epoch 3 finished [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:55.303952 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:55.304304 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:55.304408 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:55.304482 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:04:55.337893: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:55.338265: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:55.338280: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:55.338430: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:55.425188 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:55.425188 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:55.425406 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:55.438312 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: 2023-02-19 04:04:55.464054: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:55.464054: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:55.464054: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:55.477495: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:55.487308 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:55.487327 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:55.487354 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:55.487348 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: 2023-02-19 04:04:55.521390: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:55.521437: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:55.521444: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:55.521931: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:55.530577 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:55.530695 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:55.530797 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:55.530712 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:55.564931: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:55.564989: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:55.565054: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:55.565136: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:55.573817 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:55.573729 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:55.573918 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:55.573946 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: 2023-02-19 04:04:55.607533: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:55.607587: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:55.607685: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:55.607705: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: I0219 04:04:55.616342 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: INFO:tensorflow:Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-0]: I0219 04:04:55.616499 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-1]: I0219 04:04:55.616596 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-2]: I0219 04:04:55.616634 281473737520000 cross_device_ops.py:1151] Collective all_reduce tensors: 1 all_reduces, num_devices = 1, group_size = 4, implementation = CommunicationImplementation.AUTO, num_packs = 1 [worker-3]: 2023-02-19 04:04:55.650297: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: 2023-02-19 04:04:55.650660: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:55.650753: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:55.650815: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: INFO:tensorflow:epoch 4 finished [worker-0]: INFO:tensorflow:epoch 4 finished [worker-1]: INFO:tensorflow:epoch 4 finished [worker-3]: I0219 04:04:55.653444 281473737520000 gce_failure_handler_test.py:180] epoch 4 finished [worker-0]: I0219 04:04:55.653557 281473737520000 gce_failure_handler_test.py:180] epoch 4 finished [worker-2]: INFO:tensorflow:epoch 4 finished [worker-1]: I0219 04:04:55.653699 281473737520000 gce_failure_handler_test.py:180] epoch 4 finished [worker-3]: INFO:tensorflow:Training finished. [worker-0]: INFO:tensorflow:Training finished. [worker-3]: I0219 04:04:55.653636 281473737520000 gce_failure_handler_test.py:232] Training finished. [worker-1]: INFO:tensorflow:Training finished. [worker-2]: I0219 04:04:55.653746 281473737520000 gce_failure_handler_test.py:180] epoch 4 finished [worker-0]: I0219 04:04:55.653748 281473737520000 gce_failure_handler_test.py:232] Training finished. [worker-3]: 2023-02-19 04:04:55.655428: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: I0219 04:04:55.653886 281473737520000 gce_failure_handler_test.py:232] Training finished. [worker-0]: 2023-02-19 04:04:55.655623: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: INFO:tensorflow:Training finished. [worker-1]: 2023-02-19 04:04:55.655669: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: I0219 04:04:55.653934 281473737520000 gce_failure_handler_test.py:232] Training finished. [worker-2]: 2023-02-19 04:04:55.655851: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-3]: 2023-02-19 04:04:55.657022: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-1]: 2023-02-19 04:04:55.657183: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-2]: 2023-02-19 04:04:55.657366: I tensorflow/core/common_runtime/local_device.cc:158] LocalDevice using CPU work thread pool: 0x1a800f70, num_threads=56 [worker-0]: INFO:tensorflow:Shut down watcher for peer's termination signal. [worker-0]: I0219 04:04:55.657646 281473737520000 failure_handling.py:741] Shut down watcher for peer's termination signal. [worker-0]: INFO:tensorflow:Shut down watcher for one's own termination signal [worker-0]: I0219 04:04:56.199137 281473737520000 failure_handling.py:708] Shut down watcher for one's own termination signal I0219 04:04:58.999390 281473468035968 multi_process_runner.py:646] worker-0 exit code: 0 I0219 04:04:58.999632 281473468035968 multi_process_runner.py:646] worker-1 exit code: 0 I0219 04:04:58.999759 281473468035968 multi_process_runner.py:646] worker-2 exit code: 0 I0219 04:04:58.999876 281473468035968 multi_process_runner.py:646] worker-3 exit code: 0 I0219 04:04:59.001279 281473468035968 multi_process_runner.py:662] Joining log reading threads. I0219 04:04:59.001473 281473468035968 multi_process_runner.py:665] Joined log reading threads. INFO:tensorflow:time(__main__.GceFailureHandlingTest.test_multiple_workers_preempted_consecutively_test_apiwrappingtrain_True_graceperiod_0_inputarg_checkpoint_mwmsmode_multiworker): 7.18s I0219 04:04:59.115635 281473468035968 test_util.py:2467] time(__main__.GceFailureHandlingTest.test_multiple_workers_preempted_consecutively_test_apiwrappingtrain_True_graceperiod_0_inputarg_checkpoint_mwmsmode_multiworker): 7.18s [ OK ] GceFailureHandlingTest.test_multiple_workers_preempted_consecutively_test_apiwrappingtrain_True_graceperiod_0_inputarg_checkpoint_mwmsmode_multiworker ====================================================================== ERROR: test_multiple_workers_preempted_consecutively_test_apiwrappingtrain_False_graceperiod_0_inputarg_checkpoint_mwmsmode_multiworker (__main__.GceFailureHandlingTest) GceFailureHandlingTest.test_multiple_workers_preempted_consecutively_test_apiwrappingtrain_False_graceperiod_0_inputarg_checkpoint_mwmsmode_multiworker test_multiple_workers_preempted_consecutively_test_apiwrappingtrain_False_graceperiod_0_inputarg_checkpoint_mwmsmode_multiworker(api_wrapping_train=False, grace_period=0, input_arg='checkpoint', mwms_mode='multi_worker') ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/absl_py/absl/testing/parameterized.py", line 314, in bound_param_test return test_method(self, **testcase_params) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/framework/test_combinations.py", line 360, in decorated execute_test_method() File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/framework/test_combinations.py", line 343, in execute_test_method test_method(**kwargs_to_pass) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/combinations.py", line 559, in decorator test_method(self, **kwargs) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py", line 391, in test_multiple_workers_preempted_consecutively mpr.join(timeout=250) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 637, in join self._reraise_if_subprocess_error(process_statuses) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 565, in _reraise_if_subprocess_error six.reraise(*process_status.exc_info) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/six_archive/six.py", line 719, in reraise raise value File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/multi_process_runner.py", line 1060, in _run_contained return_value = fn(*args, **kwargs) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.py", line 122, in worker_fn strategy = collective_all_reduce_strategy.CollectiveAllReduceStrategy() File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 188, in __init__ CollectiveAllReduceExtended( File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 340, in __init__ self._initialize_strategy(self._cluster_resolver, devices=devices) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 359, in _initialize_strategy self._initialize_multi_worker(cluster_resolver) File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/distribute/collective_all_reduce_strategy.py", line 531, in _initialize_multi_worker context.context().ensure_initialized() File "/home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/distribute/failure_handling/gce_failure_handler_test.runfiles/org_tensorflow/tensorflow/python/eager/context.py", line 595, in ensure_initialized pywrap_tfe.TFE_EnableCollectiveOps(context_handle, server_def_str) tensorflow.python.framework.errors_impl.UnknownError: Could not start gRPC server ---------------------------------------------------------------------- Ran 3 tests in 270.651s FAILED (errors=1) ================================================================================ //tensorflow/tsl/framework/convolution:spatial_convolutions_test FAILED TO BUILD //tensorflow/c:c_api_experimental_test PASSED in 32.1s //tensorflow/c:c_api_function_test PASSED in 30.8s //tensorflow/c:c_api_test_cpu PASSED in 45.8s //tensorflow/c:c_test PASSED in 32.6s //tensorflow/c:env_test_cpu PASSED in 36.6s //tensorflow/c:kernels_test_cpu PASSED in 46.5s //tensorflow/c:ops_test PASSED in 30.9s //tensorflow/c:while_loop_test PASSED in 32.8s //tensorflow/c/eager:c_api_cluster_test_cpu PASSED in 34.0s //tensorflow/c/eager:c_api_remote_function_test_cpu PASSED in 36.9s //tensorflow/c/eager:c_api_remote_test_cpu PASSED in 35.8s //tensorflow/c/eager:c_api_test_cpu PASSED in 37.9s //tensorflow/c/eager:custom_device_test PASSED in 30.8s //tensorflow/c/eager/parallel_device:parallel_device_lib_test PASSED in 29.1s //tensorflow/c/eager/parallel_device:parallel_device_remote_test PASSED in 35.6s //tensorflow/c/eager/parallel_device:parallel_device_test PASSED in 31.5s //tensorflow/c/experimental/filesystem/plugins/gcs:expiring_lru_cache_test PASSED in 0.6s //tensorflow/c/experimental/filesystem/plugins/gcs:ram_file_block_cache_test PASSED in 2.8s //tensorflow/c/experimental/grappler:grappler_test PASSED in 31.1s //tensorflow/c/experimental/ops/gen/common:case_format_test PASSED in 0.7s //tensorflow/c/experimental/ops/gen/cpp:cpp_generator_test PASSED in 3.5s //tensorflow/c/experimental/ops/gen/cpp/renderers:renderer_test PASSED in 1.2s //tensorflow/c/experimental/saved_model/core:constant_loading_test PASSED in 18.9s //tensorflow/c/experimental/saved_model/core:object_graph_traversal_test PASSED in 13.2s //tensorflow/c/experimental/saved_model/core:saved_variable_loading_test PASSED in 25.4s //tensorflow/c/experimental/saved_model/core:signature_flattening_test PASSED in 15.6s //tensorflow/c/experimental/saved_model/core:tf_concrete_function_loading_test PASSED in 16.7s //tensorflow/c/experimental/saved_model/core/ops:restore_ops_test PASSED in 14.1s //tensorflow/c/experimental/saved_model/core/ops:variable_ops_test PASSED in 17.2s //tensorflow/c/experimental/saved_model/internal:saved_model_api_test PASSED in 35.2s //tensorflow/c/experimental/stream_executor:stream_executor_test PASSED in 0.2s //tensorflow/c/kernels:bitcast_op_test PASSED in 1.0s //tensorflow/c/kernels:summary_op_benchmark_test PASSED in 0.7s //tensorflow/c/kernels:summary_op_test PASSED in 0.8s //tensorflow/c/kernels:tensor_shape_utils_test PASSED in 0.3s //tensorflow/cc:cc_op_gen_test PASSED in 0.9s //tensorflow/cc:client_client_session_test PASSED in 2.9s //tensorflow/cc:coordinator_test PASSED in 4.6s //tensorflow/cc:framework_cc_ops_test PASSED in 2.7s //tensorflow/cc:framework_gradient_checker_test PASSED in 4.2s //tensorflow/cc:framework_gradients_test PASSED in 5.5s //tensorflow/cc:framework_scope_test PASSED in 1.1s //tensorflow/cc:framework_while_gradients_test PASSED in 3.3s //tensorflow/cc:gradients_array_grad_test PASSED in 16.1s //tensorflow/cc:gradients_data_flow_grad_test PASSED in 3.3s //tensorflow/cc:gradients_functional_grad_test PASSED in 2.2s //tensorflow/cc:gradients_image_grad_test PASSED in 7.9s //tensorflow/cc:gradients_linalg_grad_test PASSED in 4.4s //tensorflow/cc:gradients_manip_grad_test PASSED in 2.7s //tensorflow/cc:gradients_math_grad_test PASSED in 10.1s //tensorflow/cc:gradients_nn_grad_test PASSED in 16.7s //tensorflow/cc:gradients_resource_variable_grad_test PASSED in 2.4s //tensorflow/cc:ops_const_op_test PASSED in 0.6s //tensorflow/cc:ops_while_loop_test PASSED in 3.3s //tensorflow/cc:queue_runner_test PASSED in 13.3s //tensorflow/cc/experimental/base/tests:tensor_test PASSED in 0.3s //tensorflow/cc/experimental/base/tests:tensorhandle_test PASSED in 32.3s //tensorflow/cc/experimental/libexport:load_test PASSED in 0.2s //tensorflow/cc/experimental/libexport:save_test PASSED in 0.1s //tensorflow/cc/experimental/libtf:libtf_module_test PASSED in 31.2s //tensorflow/cc/experimental/libtf:libtf_object_test PASSED in 0.1s //tensorflow/cc/experimental/libtf:libtf_perf_test PASSED in 0.1s //tensorflow/cc/experimental/libtf:libtf_runtime_test PASSED in 34.4s //tensorflow/cc/experimental/libtf:libtf_transform_test PASSED in 32.0s //tensorflow/cc/experimental/libtf:libtf_value_test PASSED in 0.6s //tensorflow/cc/experimental/libtf:libtf_visit_test PASSED in 0.3s //tensorflow/cc/experimental/libtf/impl:iostream_test PASSED in 0.1s //tensorflow/cc/experimental/libtf/impl:none_test PASSED in 0.3s //tensorflow/cc/experimental/libtf/impl:scalars_test PASSED in 0.1s //tensorflow/cc/experimental/libtf/impl:string_test PASSED in 1.1s //tensorflow/cc/experimental/libtf/impl:tensor_spec_test PASSED in 0.1s //tensorflow/cc/saved_model:bundle_v2_test PASSED in 0.3s //tensorflow/cc/saved_model:fingerprinting_test PASSED in 5.3s //tensorflow/cc/saved_model:metrics_test PASSED in 0.2s //tensorflow/cc/saved_model:reader_test PASSED in 0.2s //tensorflow/cc/saved_model:saved_model_bundle_lite_test PASSED in 7.2s //tensorflow/cc/saved_model:saved_model_bundle_test PASSED in 9.9s //tensorflow/cc/saved_model:util_test PASSED in 0.1s //tensorflow/cc/saved_model/experimental/tests:saved_model_api_test PASSED in 33.1s //tensorflow/cc/tools:freeze_saved_model_test PASSED in 2.1s //tensorflow/compiler/aot:codegen_test PASSED in 37.2s //tensorflow/compiler/jit:compilability_check_util_test PASSED in 19.0s //tensorflow/compiler/jit:deadness_analysis_test PASSED in 8.2s //tensorflow/compiler/jit:device_compilation_cache_test PASSED in 7.0s //tensorflow/compiler/jit:device_compilation_cluster_signature_test PASSED in 5.1s //tensorflow/compiler/jit:device_compilation_profiler_test PASSED in 23.4s //tensorflow/compiler/jit:device_compiler_client_test PASSED in 5.4s //tensorflow/compiler/jit:device_compiler_disable_test PASSED in 18.6s //tensorflow/compiler/jit:device_executable_persistor_test PASSED in 27.9s //tensorflow/compiler/jit:device_util_test PASSED in 5.4s //tensorflow/compiler/jit:encapsulate_util_test PASSED in 0.5s //tensorflow/compiler/jit:node_matchers_test PASSED in 0.7s //tensorflow/compiler/jit:resource_operation_safety_analysis_test PASSED in 8.7s //tensorflow/compiler/jit:shape_inference_test PASSED in 0.6s //tensorflow/compiler/jit:xla_activity_listener_test PASSED in 26.2s //tensorflow/compiler/jit:xla_cluster_util_test PASSED in 8.7s //tensorflow/compiler/jit:xla_compile_util_test PASSED in 5.6s //tensorflow/compiler/jit:xla_kernel_creator_test PASSED in 10.0s //tensorflow/compiler/jit/tests:auto_clustering_test PASSED in 31.5s //tensorflow/compiler/mlir:mlir_graph_optimization_pass_test PASSED in 13.4s //tensorflow/compiler/mlir/lite:lstm_utils_test PASSED in 0.8s //tensorflow/compiler/mlir/lite:perception_ops_utils_test PASSED in 0.8s //tensorflow/compiler/mlir/lite:size_utils_test PASSED in 0.2s //tensorflow/compiler/mlir/lite:tftext_utils_test PASSED in 0.8s //tensorflow/compiler/mlir/lite/experimental/tac:execution_metadata_exporter_test PASSED in 2.8s //tensorflow/compiler/mlir/lite/experimental/tac/tests:compute-cost.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/experimental/tac/tests:device-transform-gpu.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/experimental/tac/tests:device-transform-nnapi.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/experimental/tac/tests:fold-constants-to-subgraph.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/lite/experimental/tac/tests:get-alternative-subgraph.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/experimental/tac/tests:get-op-cost.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/experimental/tac/tests:pick-subgraphs.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/experimental/tac/tests:raise-target-subgraphs.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/experimental/tac/tests:target-annotation.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/experimental/tac/tests/e2e:device-transform-nnapi.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/experimental/tac/tests/e2e:simple-graph.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/metrics:error_collector_inst_test PASSED in 0.4s //tensorflow/compiler/mlir/lite/quantization:numerical_utils_test PASSED in 0.2s //tensorflow/compiler/mlir/lite/quantization/lite:quantize_model_test PASSED in 12.0s //tensorflow/compiler/mlir/lite/quantization/lite:quantize_weights_test PASSED in 11.4s //tensorflow/compiler/mlir/lite/quantization/tensorflow/tests:fallback_to_flex_ops_default.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/lite/quantization/tensorflow/tests:fallback_to_flex_ops_legacy.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/lite/quantization/tensorflow/tests:tf_to_quant.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/quantization/tensorflow/tests:tf_to_quant_4bit.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/lite/quantization/tests:import_quant_stats.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/sparsity:sparsify_model_test PASSED in 0.9s //tensorflow/compiler/mlir/lite/stablehlo/tests:fold_broadcast.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:fuse_mhlo_convolution.mlir.test PASSED in 1.8s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-inplaceupdate.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-skip-quantization-ops.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tf-fb-tf.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-add.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-broadcast_in_dim.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-clamp.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-compare.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-concat.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-constant.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-conv.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-dot.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-gather.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-max.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-mul.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-pad.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-reshape.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-rsqrt.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-scatter.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl-sub.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-stablehlo-tfl.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-add.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-broadcast.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-clamp.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-concat.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-constant.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-conv.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-max.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-mul.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-pad.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-reshape.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-rsqrt.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo-sub.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/stablehlo/tests:legalize-tfl-stablehlo.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/stablehlo/tests:odml-to-stablehlo-allow-tf.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/stablehlo/tests:odml-to-stablehlo-smuggle-resize.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/stablehlo/tests:optimize.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/stablehlo/tests:tf-tfl-translate-serialize-stablehlo.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/stablehlo/tests:tf-tfl-translate-tf-quantize.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/stablehlo/tests:unfuse_mhlo_batch_norm.mlir.test PASSED in 2.1s //tensorflow/compiler/mlir/lite/tests:analyze-variables.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests:canonicalize.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/lite/tests:decompose-hybrid-quantization.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests:default_quant_params.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests:dilated-conv.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests:fuse-tftext.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests:get-arithmetic-count.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests:guarantee_func_has_one_use.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/lite/tests:inlining.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests:insert_call_once_op.mlir.test PASSED in 2.8s //tensorflow/compiler/mlir/lite/tests:legalize-tf-assert.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests:legalize-tf-hashtables.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/lite/tests:legalize-tf-no-runtime-verification.mlir.test PASSED in 1.8s //tensorflow/compiler/mlir/lite/tests:legalize-tf-variables.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests:legalize-tf-while.mlir.test PASSED in 2.2s //tensorflow/compiler/mlir/lite/tests:legalize-tf.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests:legalize_jax_random.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests:lift_tflite_flex_ops.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/lite/tests:lower-static-tensor-list-default-to-single-batch.mlir.test PASSED in 1.8s //tensorflow/compiler/mlir/lite/tests:lower-static-tensor-list-enable-dynamic-update-slice.mlir.test PASSED in 1.8s //tensorflow/compiler/mlir/lite/tests:lower-static-tensor-list.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests:modify_io_nodes.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests:ops.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests:optimize-after-quantization.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests:optimize.mlir.test PASSED in 3.7s //tensorflow/compiler/mlir/lite/tests:optimize_functional_ops.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests:optimize_no_verify.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/lite/tests:optimize_op_order.mlir.test PASSED in 2.5s //tensorflow/compiler/mlir/lite/tests:partitioned-topological-sort.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests:pin-ops-with-side-effects.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/lite/tests:post-quantize-dynamic-range.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/lite/tests:post-quantize.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests:prepare-composite-functions-tf.mlir.test PASSED in 1.8s //tensorflow/compiler/mlir/lite/tests:prepare-quantize-dynamic-range.mlir.test PASSED in 2.2s //tensorflow/compiler/mlir/lite/tests:prepare-quantize-post-training-16bits.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/lite/tests:prepare-quantize-post-training.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/lite/tests:prepare-quantize-signed.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests:prepare-quantize.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/lite/tests:prepare-tf-fake-quant-4bit.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/lite/tests:prepare-tf-fake-quant.mlir.test PASSED in 3.5s //tensorflow/compiler/mlir/lite/tests:prepare-tf-with-allowing-bf16-and-f16-type-legalization.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests:prepare-tf.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/lite/tests:quantize-dynamic-range.mlir.test PASSED in 1.9s //tensorflow/compiler/mlir/lite/tests:quantize-numeric-verify.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests:quantize-variables.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests:quantize.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/lite/tests:raise-custom-ops.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests:reduce_while_operands.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests:shape-inference.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests:split-merged-operands.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests:tfl_while_op_licm.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests:tfl_while_outline.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/lite/tests:trim-functions-tf.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/lite/tests:unfold-large-splat-constant.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/debuginfo:v1_1.0_224_frozen.wrong_attr.line.part.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/debuginfo:v1_1.0_224_frozen.wrong_attr.stack.part.pbtxt.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests/end2end:add.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/end2end:back2back_fake_quant.pbtxt.test PASSED in 1.9s //tensorflow/compiler/mlir/lite/tests/end2end:control_flow_v1.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/end2end:conv_2d.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/end2end:conv_2d_nchw.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/end2end:custom_opdef.pbtxt.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests/end2end:fake_quant_per_channel.pbtxt.test PASSED in 2.7s //tensorflow/compiler/mlir/lite/tests/end2end:fake_quant_per_channel_4bit.pbtxt.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests/end2end:fake_quant_without_identity.pbtxt.test PASSED in 1.0s //tensorflow/compiler/mlir/lite/tests/end2end:fake_quant_without_identity_4bit.pbtxt.test PASSED in 1.5s //tensorflow/compiler/mlir/lite/tests/end2end:graph-input-node.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/end2end:graph_with_placeholder_with_default.pbtxt.test PASSED in 1.6s //tensorflow/compiler/mlir/lite/tests/end2end:if_op.pbtxt.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests/end2end:quant_stats.pbtxt.test PASSED in 1.7s //tensorflow/compiler/mlir/lite/tests/end2end:unroll_batch_matmul.pbtxt.test PASSED in 2.3s //tensorflow/compiler/mlir/lite/tests/end2end:unroll_batch_matmul_disabled.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:basic_lstm.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:bucketize.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:constants.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:control_edges.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:custom_op.mlir.test PASSED in 3.0s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:dynamic_shape.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:external_constant.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:if_op.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:import_json.json.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:importer_test_min_max.cc.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:importer_test_min_max.cc.test PASSED in 1.0s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:input_arrays.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:input_output_names_attr.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:legacy_reshape.json.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:lstm.json.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:lstm.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:many_attribute_op.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:math.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:matmul.mlir.test PASSED in 1.7s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:multi_output_op.json.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:optional.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:optional_input.json.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:output_arrays.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:pruning.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:pruning_function_input_as_output.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:quant_stats.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:quantization.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:reshape.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:signature.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:signature_with_multiple_entry_points.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:simple.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:tf_variant_type.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:unranked_function_output.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:unranked_tensor.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/flatbuffer2mlir:while_op.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/lite/tests/mlir2exec:tfl_while_op.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:basic_lstm.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:bucketize.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:custom_op_with_tflite_op.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:depthwise_conv2d.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:depthwise_conv2d_v2.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:disable_builtin.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:disable_custom.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:disable_flex.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:disable_flex_enable_builtin.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:dynamic_shape_constant.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:fake_quant.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:flex_exclusively.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:flex_op_with_complex128.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:flex_op_with_f64.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:flex_op_with_tflite_op.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:fully_connected.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:fully_connected_v2.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:hashtable_resource.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:if_op.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:logical.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:low_bit_packing.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:lstm.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:lstm_asym_attr.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:lstm_quantized.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:math.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:metadata.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:mul_v2.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:mul_v3.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:nn.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:numeric_verify.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:optional.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:quantization.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:reshape.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:signature_def.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:signature_def_output_override.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:signature_def_with_multiple_entry_points.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:signature_def_with_no_inputs.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:simple.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:simple_with_connected_control_nodes.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:simple_with_unconnected_control_nodes.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:svdf.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:svdf_v2.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:tf_entry_function.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:tfl_while_op.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:transpose_conv_optional.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:type_attr.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:unidirectional_sequence_lstm.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:unidirectional_sequence_rnn.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:unranked_tensor.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:unsorted_segment_prod.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:variant_type_on_func.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:variant_type_on_op.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/lite/tests/mlir2flatbuffer:while_op.mlir.test PASSED in 1.9s //tensorflow/compiler/mlir/quantization/tensorflow/calibrator:calibrator_singleton_test PASSED in 0.3s //tensorflow/compiler/mlir/quantization/tensorflow/calibrator:custom_aggregator_op_test PASSED in 15.9s //tensorflow/compiler/mlir/quantization/tensorflow/cc:const_op_size_test PASSED in 0.4s //tensorflow/compiler/mlir/quantization/tensorflow/cc:convert_asset_args_test PASSED in 4.5s //tensorflow/compiler/mlir/quantization/tensorflow/cc:save_variables_test PASSED in 0.5s //tensorflow/compiler/mlir/quantization/tensorflow/debugging:mlir_dump_test PASSED in 0.7s //tensorflow/compiler/mlir/quantization/tensorflow/python:concurrency_test PASSED in 34.9s //tensorflow/compiler/mlir/quantization/tensorflow/python:pywrap_quantize_model_test PASSED in 19.5s //tensorflow/compiler/mlir/quantization/tensorflow/python:representative_dataset_test PASSED in 7.4s //tensorflow/compiler/mlir/quantization/tensorflow/tests:cast_bf16_ops_to_f32.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/quantization/tensorflow/tests:convert_custom_aggregation_op_to_quant_stats.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/quantization/tensorflow/tests:convert_fake_quant_to_qdq.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/quantization/tensorflow/tests:convert_tf_quant_ops_to_mhlo.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/quantization/tensorflow/tests:convert_tpu_model_to_cpu.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/quantization/tensorflow/tests:duplicate_shape_determining_constants.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/quantization/tensorflow/tests:fake_quant_e2e_flow.mlir.test PASSED in 1.7s //tensorflow/compiler/mlir/quantization/tensorflow/tests:fake_quant_e2e_xla.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/quantization/tensorflow/tests:insert_custom_aggregation_ops.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/quantization/tensorflow/tests:insert_main_function.mlir.test PASSED in 1.7s //tensorflow/compiler/mlir/quantization/tensorflow/tests:insert_quantized_functions.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/quantization/tensorflow/tests:insert_quantized_functions_drq.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/quantization/tensorflow/tests:insert_quantized_functions_weight_only.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/quantization/tensorflow/tests:insert_restore_op.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/quantization/tensorflow/tests:insert_save_op.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/quantization/tensorflow/tests:issue_ids_of_custom_aggregation_ops.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/quantization/tensorflow/tests:lift_quantizable_spots_as_functions.mlir.test PASSED in 1.7s //tensorflow/compiler/mlir/quantization/tensorflow/tests:lift_quantizable_spots_as_functions_drq.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/quantization/tensorflow/tests:lift_quantizable_spots_as_functions_drq_min_elements.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/quantization/tensorflow/tests:lift_quantizable_spots_as_functions_xla.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/quantization/tensorflow/tests:mark_functions_noinline.mlir.test PASSED in 2.0s //tensorflow/compiler/mlir/quantization/tensorflow/tests:merge_initializer_function_ops_to_main.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/quantization/tensorflow/tests:merge_save_function_ops_to_main.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/quantization/tensorflow/tests:optimize.mlir.test PASSED in 2.1s //tensorflow/compiler/mlir/quantization/tensorflow/tests:prepare_lifting.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/quantization/tensorflow/tests:prepare_quantize.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/quantization/tensorflow/tests:prepare_quantize_drq.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/quantization/tensorflow/tests:prepare_quantize_drq_per_channel.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/quantization/tensorflow/tests:prepare_quantize_ptq.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/quantization/tensorflow/tests:prepare_quantize_ptq_per_channel.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/quantization/tensorflow/tests:preprocess_op.mlir.test PASSED in 2.0s //tensorflow/compiler/mlir/quantization/tensorflow/tests:quantize.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/quantization/tensorflow/tests:quantize_composite_functions.mlir.test PASSED in 3.0s //tensorflow/compiler/mlir/quantization/tensorflow/tests:quantize_composite_functions_drq.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/quantization/tensorflow/tests:quantize_composite_functions_weight_only.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/quantization/tensorflow/tests:quantize_composite_functions_xla.mlir.test PASSED in 1.9s //tensorflow/compiler/mlir/quantization/tensorflow/tests:quantize_drq.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/quantization/tensorflow/tests:quantize_xla.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/quantization/tensorflow/tests:remove_var_init_by_const.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/quantization/tensorflow/tests:replace_cast_hacks_with_tf_xla_ops.mlir.test PASSED in 2.3s //tensorflow/compiler/mlir/quantization/tensorflow/tests:replace_cast_hacks_with_tf_xla_ops_large_constants.mlir.test PASSED in 16.7s //tensorflow/compiler/mlir/quantization/tensorflow/tests:unfreeze_constants.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/quantization/tensorflow/utils:tf_to_xla_attribute_utils_test PASSED in 35.4s //tensorflow/compiler/mlir/tensorflow:bridge_logger_test PASSED in 3.9s //tensorflow/compiler/mlir/tensorflow:cluster_util_test PASSED in 0.4s //tensorflow/compiler/mlir/tensorflow:convert_tensor_test PASSED in 1.2s //tensorflow/compiler/mlir/tensorflow:convert_type_test PASSED in 0.2s //tensorflow/compiler/mlir/tensorflow:device_util_test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow:dump_graph_test PASSED in 0.4s //tensorflow/compiler/mlir/tensorflow:dump_mlir_util_test PASSED in 10.0s //tensorflow/compiler/mlir/tensorflow:error_util_test PASSED in 0.2s //tensorflow/compiler/mlir/tensorflow:tf_saved_model_test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow:tpu_rewrite_device_util_test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:annotate-parameter-replication.mlir.test PASSED in 2.8s //tensorflow/compiler/mlir/tensorflow/tests:batchmatmul_to_einsum.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:breakup-islands.mlir.test PASSED in 2.6s //tensorflow/compiler/mlir/tensorflow/tests:cannonicalize_ops_outside_compilation.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:canonicalize.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/tensorflow/tests:canonicalize_compile_and_replicate_attributes.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:check_control_dependencies.mlir.test PASSED in 1.8s //tensorflow/compiler/mlir/tensorflow/tests:cluster_formation.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:cluster_ops_by_policy.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:cluster_outlining.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:cluster_tf_ops_pass.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:constant-fold.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:constant_op_device_assignment.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:convert-tf-control-flow-to-scf.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:convert_control_to_data_outputs.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:convert_launch_func_to_tf_call.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:convert_session_initializer_to_function.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:convert_to_legacy_compile_and_replicate_attributes.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:decompose_reduce_dataset.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:decompose_resource_ops.mlir.test PASSED in 2.4s //tensorflow/compiler/mlir/tensorflow/tests:device_assignment.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:device_assignment_by_func_attr.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:device_attribute_to_launch.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:device_canonicalize.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:device_copy.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:drop_while_shape_invariant.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:einsum.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:empty-main.mlir.test PASSED in 1.7s //tensorflow/compiler/mlir/tensorflow/tests:end-to-end-tpu-reshard-variables.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:executor_canonicalize.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:executor_island_coarsening.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:executor_island_materialize_const.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:fold-broadcast.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:freeze_variables.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/tensorflow/tests:func-attr-invalid.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests:func-attr.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:functional-control-flow-to-cfg.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:functional-control-flow-to-regions.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests:functionalize-if-fail.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:functionalize-if.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:fused_kernel_matcher.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/tensorflow/tests:gpu_fusion.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:graph_pruning.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:graph_pruning_preserve_ops.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests:group_by_dialect.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:guarantee-all-funcs-one-use.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/tensorflow/tests:hoist_loop_invariant.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:hoist_replicate_invariant_resource_writes.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:host_launch_to_outside_compiled.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:init_text_file_to_import.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:init_text_file_to_import_invalid.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:init_text_file_to_import_saved_model.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:inlining.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:isolate-placer.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests:launch_outlining.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:launch_to_device_attribute.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:launch_to_device_attribute_legacy.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests:layout_optimization_layout_assignment_gpu_cc_60.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:layout_optimization_layout_assignment_gpu_cc_70.mlir.test PASSED in 2.6s //tensorflow/compiler/mlir/tensorflow/tests:layout_optimization_layout_assignment_to_nchw.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:layout_optimization_layout_assignment_to_nhwc.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:layout_optimization_move_transposes_begin.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:layout_optimization_move_transposes_end.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:layout_optimization_to_nchw.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/tensorflow/tests:layout_optimization_to_nhwc.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/tensorflow/tests:legalize_hlo.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:legalize_tfg.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:legalize_tfg_arg_control_dep.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:legalize_tfg_with_control_flow.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:localize_var_handles.mlir.test PASSED in 1.7s //tensorflow/compiler/mlir/tensorflow/tests:lower_globals_to_ml_program.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:lower_globals_to_ml_program_invalid.mlir.test PASSED in 2.0s //tensorflow/compiler/mlir/tensorflow/tests:lower_quantized.mlir.test PASSED in 1.9s //tensorflow/compiler/mlir/tensorflow/tests:lower_tf.mlir.test PASSED in 2.2s //tensorflow/compiler/mlir/tensorflow/tests:lower_variable_ops_to_ml_program.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:mark_input_output_aliases.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:mark_ops_for_outside_compilation.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:materialize_passthrough_op.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:merge_control_flow.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:mlprogram.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:name_anonymous_iterators.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:optimize-arg-operand-constraint.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:optimize.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:order_by_dialect.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:outside_compiled_to_host_launch.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:parallel_execute_to_islands.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests:parallel_execute_to_islands_legacy.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests:prepare_tpu_computation_for_tf_export.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:promote_resources_to_args.mlir.test PASSED in 1.7s //tensorflow/compiler/mlir/tensorflow/tests:promote_resources_to_args_functions.mlir.test PASSED in 3.9s //tensorflow/compiler/mlir/tensorflow/tests:promote_var_handles_to_args.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/tensorflow/tests:readonly_references_to_resources.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:region-control-flow-to-functional.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:remove_unused_arguments.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:remove_unused_while_results.mlir.test PASSED in 1.8s //tensorflow/compiler/mlir/tensorflow/tests:replica_id_to_device_ordinal.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:replicate_invariant_op_hoisting.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:replicate_tensor_list_init_ops.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:replicate_to_island.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:replicate_to_island_legacy.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:resource-alias-analysis-test.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:resource-device-inference.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:resource_inlining.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:resource_op_lifting.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:rewrite_tpu_embedding_ops.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:roundtrip-tf-executor.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:shape_inference.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:side-effect-analysis-test.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:sink_constant.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:split_into_island_per_op.mlir.test PASSED in 1.8s //tensorflow/compiler/mlir/tensorflow/tests:stack_ops_decomposition.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:strip_noinline.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:strip_saved_module_metadata.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests:strip_tf_attributes.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests:tensor_array_ops_decomposition.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/tensorflow/tests:tensor_list_ops_decomposition.mlir.test PASSED in 1.7s //tensorflow/compiler/mlir/tensorflow/tests:tf-executor-to-functional.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:tf-functional-to-executor.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tf-ops.mlir.test PASSED in 3.3s //tensorflow/compiler/mlir/tensorflow/tests:tf-reduce-identity.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:tf_data_fuse_map_and_batch.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tf_data_fuse_pmap_and_batch.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:tf_device_index_selector.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:tf_device_ops.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tf_device_ops_invalid.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/tensorflow/tests:tf_executor_ops.mlir.test PASSED in 1.7s //tensorflow/compiler/mlir/tensorflow/tests:tf_executor_ops_invalid.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tf_executor_ops_location_roundtrip.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:tf_executor_ops_printer.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:tf_executor_ops_side_effect.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/tensorflow/tests:tf_optimize.mlir.test PASSED in 1.9s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_deduplicate_bound_input_bindings.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_freeze_assets.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_freeze_global_tensors.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_freeze_global_tensors_mutable_tensors.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_initialize_variables_in_session_init.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_initialize_variables_in_session_init_fail.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_lift_variables.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_lift_variables_invalid_session.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_mark_initialized_variables.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_ops.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_ops_invalid.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_optimize_global_tensors.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_optimize_global_tensors_interprocedural.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests:tf_saved_model_remove_vars_in_session_initializer.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tensorflow/tests:tf_side_effect.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tf_trait_folds.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:tpu-cluster-cleanup-attributes.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:tpu-dynamic-layout-pass.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:tpu-merge-variables-with-execute.mlir.test PASSED in 2.0s //tensorflow/compiler/mlir/tensorflow/tests:tpu-multiple-while-body-func.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:tpu-resource-read-for-write.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:tpu-variable-runtime-reformatting.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tensorflow/tests:tpu_cluster_formation.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests:tpu_colocate_composite_resource_ops.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tpu_device_propagation.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tpu_extract_head_tail_outside_compilation.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:tpu_extract_outside_compilation.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tpu_host_computation_expansion.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:tpu_identity_pruning.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests:tpu_parallel_execute_sink_resource_write.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:tpu_partitioned_op_conversion.mlir.test PASSED in 1.5s //tensorflow/compiler/mlir/tensorflow/tests:tpu_reorder_replicate_and_partitioned_inputs.mlir.test PASSED in 1.6s //tensorflow/compiler/mlir/tensorflow/tests:tpu_resource_partitioning.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tpu_rewrite.mlir.test PASSED in 1.8s //tensorflow/compiler/mlir/tensorflow/tests:tpu_sharding_identification.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests:tpu_space_to_depth_pass.mlir.test PASSED in 1.8s //tensorflow/compiler/mlir/tensorflow/tests:tpu_tail_with_tobool_op.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:tpu_update_embedding_enqueue_op_inputs.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:unroll-batch-matmul.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests:update_control_dependencies.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:warn_when_using_deprecated_dumps.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests:while_licm.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/tensorflow/tests:xla_cluster_formation.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests:xla_inline_device_ops.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests:xla_rewrite.mlir.test PASSED in 1.3s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:add.mlir.test PASSED in 2.0s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:argument-sharding-invalid.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:argument-sharding.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:constant-folding-hook.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:constant-folding.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:graph-resource.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:graph-resource.pbtxt.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:graph.pbtxt.test PASSED in 1.4s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:mlir-module-serialized-str-attr.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:replicate-tensor-list-init-ops.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:result-sharding.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:serialized-mlir-module-str-attr-invalid.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:serialized-mlir-module-str-attr.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:shape-inference-after-legalization.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:shape-inference.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests/compile_mlir_util:stablehlo_add.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests/executor_tpuv1_island_coarsening:executor_tpuv1_island_coarsening.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tensorflow/tests/executor_tpuv1_island_coarsening:while_op.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/executor_tpuv1_island_inlining:executor_tpuv1_inline_tpu_island.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/tensorflow/tests/executor_tpuv1_island_inlining:while_op.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/executor_tpuv1_outline_island:case_op.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/executor_tpuv1_outline_island:executor_tpuv1_outline_tpu_island.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/executor_tpuv1_outline_island:while_op.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:add.pbtxt.test PASSED in 3.0s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:arg-as-fetch.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:arg-control-dep.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:arg-data-type-with-subtype.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:arg-data-type.pbtxt.test PASSED in 1.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:arg-multi-data-type-with-subtype.pbtxt.test PASSED in 1.3s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:arg-retval-attrs.pbtxt.test PASSED in 1.3s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:case_op.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:const-values.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:device-arg-retval-attr.pbtxt.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:empty-input-shapes.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:empty-value-attr.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:feed-as-fetch.pbtxt.test PASSED in 1.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:feed-control-dep.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:force_shared_name_for_resource_ops.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:function-func-attr.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:functional-if-ops.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:functional-while-ops.pbtxt.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-as-function-control-ret.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-as-function-retval-of-arg.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-as-function.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-custom-operation.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-default-attr.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-device-retval.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-empty-tensor-content.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-func-attr.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-function-call.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-function-control-ret-diff-island.pbtxt.test PASSED in 1.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-function-control-ret-same-island.pbtxt.test PASSED in 1.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-function-defs.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-function-input-shapes.pbtxt.test PASSED in 1.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-function-name-bug.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-function-resource-args.pbtxt.test PASSED in 1.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-gradient-def.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-input-func-arg-name-collision.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-library.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-malformed.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-scalar-input.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-uint8-return.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-undefined-output.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-version-info.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:graph-while-loop.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:invalid-output-index.pbtxt.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:legacy-fed-input-without-inputs.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:merge_node_with_function.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:mlir_passthrough_op.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:multi-output-feeds.pbtxt.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:multiple-use-next-iteration.pbtxt.test PASSED in 1.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:node-locations.pbtxt.test PASSED in 1.3s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:output-shapes-attr.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:output-shapes.pbtxt.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:parse_example.pbtxt.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:parse_example_v2.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:partial-device-name.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:prune_unused_nodes.pbtxt.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:quint8-const.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:shape-attrs.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:stateful-attribute.pbtxt.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:string-attr.pbtxt.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:switch_n.pbtxt.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:target.pbtxt.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:tensor-list.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:tf-data-pipeline.pbtxt.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir:unregistered_kernel.pbtxt.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/graphdef2mlir/batch_use_same_function:saved_model.pbtxt.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:aliasing_arg_attr.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:case.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:convert_tensor.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:derived_shape_attr.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:derived_size_attr.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:device-arg-retval-attr.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:export_main_to_flib.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:fetch_feed_names.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:func_attr.mlir.test PASSED in 2.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:func_list_attr.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:function-control-ret.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:function-order.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:function-resource-args-handle-info.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:function-resource-args.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:functional-if-ops.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:functional-while-ops.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:graph-as-function.mlir.test PASSED in 1.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:infer_derived_attribute.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:invalid_input.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:legalized_name.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:missing-main.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:noop.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:optional_symbol_ref.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:output-shapes-attr.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:parse_example.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:parse_example_v2.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:preserve-entry-func-names.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:ref-type-attr.mlir.test PASSED in 2.1s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:ref-while-loop.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:shape_list_attr.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:simple.mlir.test PASSED in 2.0s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:simple_tf_dialect_op.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:stringescape.mlir.test PASSED in 1.1s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:switchn.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:tf-gradient-attr.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:tf-legacy-call.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:tf_add.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:tf_identity_n.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:tf_tpu_embedding_ops.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:type_attr.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:type_list_attr.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:unique_name.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:unique_output_name.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tensorflow/tests/mlir2graphdef:while-loop.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tensorflow/tests/tf_to_hlo_pipeline:sccp-post-shape-inference.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tensorflow/tests/tpu_bridge_v1:end_to_end.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tfr:graph_decompose_test PASSED in 9.0s //tensorflow/compiler/mlir/tfr:node_expansion_test PASSED in 12.6s //tensorflow/compiler/mlir/tfr:op_reg_gen_test PASSED in 13.5s //tensorflow/compiler/mlir/tfr:tfr_decompose_ctx_test PASSED in 4.5s //tensorflow/compiler/mlir/tfr:tfr_gen_test PASSED in 15.2s //tensorflow/compiler/mlir/tfr/examples/customization:test_ops_test PASSED in 15.3s //tensorflow/compiler/mlir/tfr/examples/pad:pad_ops_test PASSED in 20.9s //tensorflow/compiler/mlir/tools/kernel_gen/tests:buffer_deallocation.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tools/kernel_gen/tests:buffer_reuse.mlir.test PASSED in 2.2s //tensorflow/compiler/mlir/tools/kernel_gen/tests:bufferize.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tools/kernel_gen/tests:copy_cleanup.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tools/kernel_gen/tests:embed_tf_framework.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tools/kernel_gen/tests:invalid.mlir.test PASSED in 0.4s //tensorflow/compiler/mlir/tools/kernel_gen/tests:isinf.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tools/kernel_gen/tests:ops.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tools/kernel_gen/tests:parallel_loops_to_sequential.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tools/kernel_gen/tests:rewrite_tf_framework_assert.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tools/kernel_gen/tests:tanh.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tools/kernel_gen/tests:tf-legalize-to-lmhlo.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/tools/kernel_gen/tests:tf_abi_knowledge.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/tools/kernel_gen/tests:tf_framework_legalize_to_llvm.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tools/kernel_gen/tests:tf_kernel_gpu_launch_to_llvm.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/tools/kernel_gen/tests:tf_to_jit_invocations.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tosa/tests:convert-tfl-uint8.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tosa/tests:fuse-bias-tf.mlir.test PASSED in 1.4s //tensorflow/compiler/mlir/tosa/tests:strip-quant-types.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/tosa/tests:tf-tfl-to-tosa-pipeline.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tosa/tests:tf-to-tosa-pipeline.mlir.test PASSED in 2.2s //tensorflow/compiler/mlir/tosa/tests:tfl-to-tosa-dequantize_softmax.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/tosa/tests:tfl-to-tosa-pipeline-filtered.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/tosa/tests:tfl-to-tosa-pipeline.mlir.test PASSED in 6.0s //tensorflow/compiler/mlir/xla:xla_legalize_targets_test PASSED in 0.7s //tensorflow/compiler/mlir/xla/tests:adjust-layout.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/xla/tests:convert-mhlo-quant-to-int.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/xla/tests:hlo_xla_runtime_pipeline.mlir.test PASSED in 0.7s //tensorflow/compiler/mlir/xla/tests:hlo_xla_sparsification.mlir.test PASSED in 0.6s //tensorflow/compiler/mlir/xla/tests:legalize-tf-BatchMatMulV2.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/xla/tests:legalize-tf-binary-elementwise.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/xla/tests:legalize-tf-collective.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/xla/tests:legalize-tf-communication.mlir.test PASSED in 1.0s //tensorflow/compiler/mlir/xla/tests:legalize-tf-full-conversion.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/xla/tests:legalize-tf-include-tf2xla-fallback.mlir.test PASSED in 1.8s //tensorflow/compiler/mlir/xla/tests:legalize-tf-no-tf2xla-fallback.mlir.test PASSED in 6.0s //tensorflow/compiler/mlir/xla/tests:legalize-tf-prefer-tf2xla.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/xla/tests:legalize-tf-types.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/xla/tests:legalize-tf-with-tf2xla.mlir.test PASSED in 1.2s //tensorflow/compiler/mlir/xla/tests:legalize-tf.mlir.test PASSED in 11.0s //tensorflow/compiler/mlir/xla/tests:tfxla_device_specific_transformations_cpu.mlir.test PASSED in 0.8s //tensorflow/compiler/mlir/xla/tests:tfxla_device_specific_transformations_gpu.mlir.test PASSED in 0.5s //tensorflow/compiler/mlir/xla/tests:verify-tfxla-legalization-no-chlo.mlir.test PASSED in 0.9s //tensorflow/compiler/mlir/xla/tests:verify-tfxla-legalization.mlir.test PASSED in 0.9s //tensorflow/compiler/tests:adadelta_test_cpu PASSED in 12.8s //tensorflow/compiler/tests:adagrad_da_test_cpu PASSED in 8.7s //tensorflow/compiler/tests:adagrad_test_cpu PASSED in 9.3s //tensorflow/compiler/tests:adam_test_cpu PASSED in 12.9s //tensorflow/compiler/tests:add_n_test_cpu PASSED in 7.1s //tensorflow/compiler/tests:argminmax_test_cpu PASSED in 10.8s //tensorflow/compiler/tests:argminmax_test_cpu_mlir_bridge_test PASSED in 15.7s //tensorflow/compiler/tests:bucketize_op_test_cpu PASSED in 7.0s //tensorflow/compiler/tests:bucketize_op_test_cpu_mlir_bridge_test PASSED in 7.2s //tensorflow/compiler/tests:case_test_cpu PASSED in 7.5s //tensorflow/compiler/tests:cast_ops_test_cpu PASSED in 9.9s //tensorflow/compiler/tests:cast_ops_test_cpu_mlir_bridge_test PASSED in 6.9s //tensorflow/compiler/tests:categorical_op_test_cpu PASSED in 10.4s //tensorflow/compiler/tests:categorical_op_test_cpu_mlir_bridge_test PASSED in 15.8s //tensorflow/compiler/tests:cholesky_op_test_cpu PASSED in 18.1s //tensorflow/compiler/tests:cholesky_op_test_cpu_mlir_bridge_test PASSED in 22.5s //tensorflow/compiler/tests:clustering_test_cpu PASSED in 7.1s //tensorflow/compiler/tests:clustering_test_cpu_mlir_bridge_test PASSED in 8.5s //tensorflow/compiler/tests:concat_ops_test_cpu PASSED in 10.4s //tensorflow/compiler/tests:concat_ops_test_cpu_mlir_bridge_test PASSED in 11.2s //tensorflow/compiler/tests:cond_test_cpu PASSED in 14.4s //tensorflow/compiler/tests:const_arg_test_cpu PASSED in 6.6s //tensorflow/compiler/tests:const_test_cpu PASSED in 7.1s //tensorflow/compiler/tests:data_format_ops_test_cpu PASSED in 10.0s //tensorflow/compiler/tests:data_format_ops_test_cpu_mlir_bridge_test PASSED in 16.3s //tensorflow/compiler/tests:dense_layer_test_cpu PASSED in 13.9s //tensorflow/compiler/tests:dynamic_slice_ops_test_cpu PASSED in 8.5s //tensorflow/compiler/tests:dynamic_slice_ops_test_cpu_mlir_bridge_test PASSED in 9.5s //tensorflow/compiler/tests:dynamic_stitch_test_cpu PASSED in 6.6s //tensorflow/compiler/tests:dynamic_stitch_test_cpu_mlir_bridge_test PASSED in 6.7s //tensorflow/compiler/tests:eager_test_cpu PASSED in 16.0s //tensorflow/compiler/tests:einsum_op_test_cpu PASSED in 7.2s //tensorflow/compiler/tests:einsum_op_test_cpu_mlir_bridge_test PASSED in 8.0s //tensorflow/compiler/tests:ensure_shape_op_test_cpu PASSED in 7.0s //tensorflow/compiler/tests:extract_image_patches_op_test_cpu PASSED in 7.3s //tensorflow/compiler/tests:extract_image_patches_op_test_cpu_mlir_bridge_test PASSED in 12.2s //tensorflow/compiler/tests:fake_quant_ops_test_cpu PASSED in 16.0s //tensorflow/compiler/tests:fake_quant_ops_test_cpu_mlir_bridge_test PASSED in 20.7s //tensorflow/compiler/tests:fifo_queue_test_cpu PASSED in 8.6s //tensorflow/compiler/tests:fifo_queue_test_cpu_mlir_bridge_test PASSED in 7.4s //tensorflow/compiler/tests:ftrl_ops_test_cpu PASSED in 17.8s //tensorflow/compiler/tests:ftrl_ops_test_cpu_mlir_bridge_test PASSED in 22.6s //tensorflow/compiler/tests:ftrl_test_cpu PASSED in 16.3s //tensorflow/compiler/tests:function_test_cpu PASSED in 6.4s //tensorflow/compiler/tests:function_test_cpu_mlir_bridge_test PASSED in 7.2s //tensorflow/compiler/tests:gather_nd_op_test_cpu PASSED in 8.1s //tensorflow/compiler/tests:gather_nd_op_test_cpu_mlir_bridge_test PASSED in 7.3s //tensorflow/compiler/tests:gather_test_cpu PASSED in 45.6s //tensorflow/compiler/tests:gather_test_cpu_mlir_bridge_test PASSED in 50.2s //tensorflow/compiler/tests:jit_test_cpu PASSED in 53.0s //tensorflow/compiler/tests:listdiff_op_test_cpu PASSED in 9.9s //tensorflow/compiler/tests:listdiff_op_test_cpu_mlir_bridge_test PASSED in 19.8s //tensorflow/compiler/tests:lrn_ops_test_cpu PASSED in 7.4s //tensorflow/compiler/tests:lrn_ops_test_cpu_mlir_bridge_test PASSED in 6.7s //tensorflow/compiler/tests:lstm_test_cpu PASSED in 30.0s //tensorflow/compiler/tests:manip_ops_test_cpu PASSED in 10.3s //tensorflow/compiler/tests:manip_ops_test_cpu_mlir_bridge_test PASSED in 13.3s //tensorflow/compiler/tests:matrix_band_part_test_cpu PASSED in 49.4s //tensorflow/compiler/tests:matrix_band_part_test_cpu_mlir_bridge_test PASSED in 32.9s //tensorflow/compiler/tests:matrix_inverse_op_test_cpu PASSED in 17.6s //tensorflow/compiler/tests:matrix_inverse_op_test_cpu_mlir_bridge_test PASSED in 20.1s //tensorflow/compiler/tests:matrix_solve_op_test_cpu PASSED in 7.3s //tensorflow/compiler/tests:matrix_solve_op_test_cpu_mlir_bridge_test PASSED in 7.5s //tensorflow/compiler/tests:matrix_triangular_solve_op_test_cpu PASSED in 25.8s //tensorflow/compiler/tests:matrix_triangular_solve_op_test_cpu_mlir_bridge_test PASSED in 32.1s //tensorflow/compiler/tests:momentum_test_cpu PASSED in 9.9s //tensorflow/compiler/tests:nary_ops_test_cpu PASSED in 9.6s //tensorflow/compiler/tests:nary_ops_test_cpu_mlir_bridge_test PASSED in 10.4s //tensorflow/compiler/tests:nullary_ops_test_cpu PASSED in 6.3s //tensorflow/compiler/tests:nullary_ops_test_cpu_mlir_bridge_test PASSED in 12.9s //tensorflow/compiler/tests:placeholder_test_cpu PASSED in 11.1s //tensorflow/compiler/tests:placeholder_test_cpu_mlir_bridge_test PASSED in 7.8s //tensorflow/compiler/tests:proximal_adagrad_test_cpu PASSED in 8.1s //tensorflow/compiler/tests:proximal_gradient_descent_test_cpu PASSED in 7.7s //tensorflow/compiler/tests:quantized_ops_test_cpu PASSED in 6.5s //tensorflow/compiler/tests:reduce_window_test_cpu PASSED in 7.5s //tensorflow/compiler/tests:reduce_window_test_cpu_mlir_bridge_test PASSED in 9.3s //tensorflow/compiler/tests:reshape_op_test_cpu PASSED in 6.3s //tensorflow/compiler/tests:reshape_op_test_cpu_mlir_bridge_test PASSED in 7.2s //tensorflow/compiler/tests:reverse_ops_test_cpu PASSED in 10.6s //tensorflow/compiler/tests:reverse_ops_test_cpu_mlir_bridge_test PASSED in 9.8s //tensorflow/compiler/tests:reverse_sequence_op_test_cpu PASSED in 8.2s //tensorflow/compiler/tests:reverse_sequence_op_test_cpu_mlir_bridge_test PASSED in 7.2s //tensorflow/compiler/tests:risc_ops_test_cpu_mlir_bridge_test PASSED in 7.2s //tensorflow/compiler/tests:rmsprop_test_cpu PASSED in 10.7s //tensorflow/compiler/tests:scatter_nd_op_test_cpu PASSED in 20.0s //tensorflow/compiler/tests:scatter_nd_op_test_cpu_mlir_bridge_test PASSED in 24.5s //tensorflow/compiler/tests:searchsorted_op_test_cpu PASSED in 9.9s //tensorflow/compiler/tests:searchsorted_op_test_cpu_mlir_bridge_test PASSED in 7.3s //tensorflow/compiler/tests:segment_reduction_ops_test_cpu PASSED in 19.3s //tensorflow/compiler/tests:segment_reduction_ops_test_cpu_mlir_bridge_test PASSED in 23.2s //tensorflow/compiler/tests:self_adjoint_eig_op_test_cpu PASSED in 15.1s //tensorflow/compiler/tests:self_adjoint_eig_op_test_cpu_mlir_bridge_test PASSED in 14.5s //tensorflow/compiler/tests:slice_ops_test_cpu PASSED in 13.9s //tensorflow/compiler/tests:slice_ops_test_cpu_mlir_bridge_test PASSED in 20.2s //tensorflow/compiler/tests:sparse_to_dense_op_test_cpu PASSED in 7.8s //tensorflow/compiler/tests:sparse_to_dense_op_test_cpu_mlir_bridge_test PASSED in 9.3s //tensorflow/compiler/tests:stack_ops_test_cpu PASSED in 6.8s //tensorflow/compiler/tests:tensor_list_ops_test_cpu PASSED in 11.5s //tensorflow/compiler/tests:tridiagonal_matmul_ops_test_cpu PASSED in 16.9s //tensorflow/compiler/tests:tridiagonal_matmul_ops_test_cpu_mlir_bridge_test PASSED in 17.3s //tensorflow/compiler/tests:tridiagonal_solve_ops_test_cpu PASSED in 11.1s //tensorflow/compiler/tests:tridiagonal_solve_ops_test_cpu_mlir_bridge_test PASSED in 19.4s //tensorflow/compiler/tests:unique_ops_test_cpu PASSED in 6.9s //tensorflow/compiler/tests:variable_ops_test_cpu PASSED in 39.7s //tensorflow/compiler/tests:variable_ops_test_cpu_mlir_bridge_test PASSED in 14.9s //tensorflow/compiler/tests:where_op_test_cpu PASSED in 7.6s //tensorflow/compiler/tests:while_test_cpu PASSED in 12.3s //tensorflow/compiler/tests:xla_call_module_test_cpu PASSED in 8.8s //tensorflow/compiler/tests:xla_custom_call_ops_test_cpu PASSED in 5.7s //tensorflow/compiler/tests:xla_device_gpu_test_cpu PASSED in 5.3s //tensorflow/compiler/tests:xla_device_test_cpu PASSED in 16.3s //tensorflow/compiler/tests:xla_device_test_cpu_mlir_bridge_test PASSED in 14.3s //tensorflow/compiler/tests:xla_ops_test_cpu PASSED in 42.9s //tensorflow/compiler/tests:xla_ops_test_cpu_mlir_bridge_test PASSED in 44.2s //tensorflow/compiler/tests:xla_test_test PASSED in 5.4s //tensorflow/compiler/tf2xla:const_analysis_test PASSED in 4.7s //tensorflow/compiler/tf2xla:cpu_function_runtime_test PASSED in 0.1s //tensorflow/compiler/tf2xla:functionalize_cond_test PASSED in 0.9s //tensorflow/compiler/tf2xla:functionalize_control_flow_test PASSED in 1.3s //tensorflow/compiler/tf2xla:fused_batchnorm_reserve_space_test_cpu PASSED in 26.9s //tensorflow/compiler/tf2xla:literal_util_test PASSED in 1.3s //tensorflow/compiler/tf2xla:resource_operation_table_test PASSED in 5.8s //tensorflow/compiler/tf2xla:resource_util_test_cpu PASSED in 2.1s //tensorflow/compiler/tf2xla:sharding_util_test PASSED in 0.7s //tensorflow/compiler/tf2xla:tf2xla_test PASSED in 19.8s //tensorflow/compiler/tf2xla:tf2xla_util_test PASSED in 0.6s //tensorflow/compiler/tf2xla:xla_compiler_test PASSED in 18.7s //tensorflow/compiler/tf2xla:xla_jit_compiled_cpu_function_test PASSED in 22.3s //tensorflow/compiler/tf2xla:xla_op_registry_test PASSED in 8.0s //tensorflow/compiler/tf2xla/kernels:rng_converter_utils_test PASSED in 1.7s //tensorflow/compiler/xla:array2d_test PASSED in 0.1s //tensorflow/compiler/xla:array3d_test PASSED in 0.2s //tensorflow/compiler/xla:array4d_test PASSED in 0.3s //tensorflow/compiler/xla:array_test PASSED in 0.7s //tensorflow/compiler/xla:bit_cast_test PASSED in 0.2s //tensorflow/compiler/xla:comparison_util_test PASSED in 0.2s //tensorflow/compiler/xla:debug_options_parsers_test PASSED in 0.5s //tensorflow/compiler/xla:index_util_test PASSED in 0.2s //tensorflow/compiler/xla:iterator_util_test PASSED in 0.3s //tensorflow/compiler/xla:layout_test PASSED in 0.3s //tensorflow/compiler/xla:layout_util_test PASSED in 0.1s //tensorflow/compiler/xla:literal_test PASSED in 0.5s //tensorflow/compiler/xla:parse_flags_from_env_test PASSED in 0.5s //tensorflow/compiler/xla:permutation_util_test PASSED in 0.1s //tensorflow/compiler/xla:primitive_util_test PASSED in 0.2s //tensorflow/compiler/xla:refcounting_hash_map_test PASSED in 0.3s //tensorflow/compiler/xla:reference_util_test PASSED in 0.5s //tensorflow/compiler/xla:shape_test PASSED in 0.1s //tensorflow/compiler/xla:shape_tree_test PASSED in 0.1s //tensorflow/compiler/xla:shape_util_test PASSED in 2.2s //tensorflow/compiler/xla:status_macros_test PASSED in 0.1s //tensorflow/compiler/xla:text_literal_reader_test PASSED in 0.4s //tensorflow/compiler/xla:text_literal_writer_test PASSED in 0.2s //tensorflow/compiler/xla:util_test PASSED in 0.3s //tensorflow/compiler/xla:window_util_test PASSED in 0.3s //tensorflow/compiler/xla/client:padding_test PASSED in 0.6s //tensorflow/compiler/xla/client:xla_builder_test PASSED in 0.3s //tensorflow/compiler/xla/client/lib:arithmetic_test_cpu PASSED in 8.6s //tensorflow/compiler/xla/client/lib:comparators_test_cpu PASSED in 9.5s //tensorflow/compiler/xla/client/lib:constants_test_cpu PASSED in 6.7s //tensorflow/compiler/xla/client/lib:logdet_test_cpu PASSED in 9.2s //tensorflow/compiler/xla/client/lib:math_test_cpu PASSED in 16.3s //tensorflow/compiler/xla/client/lib:matrix_test_cpu PASSED in 12.5s //tensorflow/compiler/xla/client/lib:pooling_test_cpu PASSED in 9.3s //tensorflow/compiler/xla/client/lib:qr_test_cpu PASSED in 11.1s //tensorflow/compiler/xla/client/lib:slicing_test_cpu PASSED in 8.3s //tensorflow/compiler/xla/client/lib:sorting_test_cpu PASSED in 7.9s //tensorflow/compiler/xla/examples/axpy:stablehlo_compile_test PASSED in 9.2s //tensorflow/compiler/xla/experimental/conv_emitter:conv_emitter_test PASSED in 1.6s //tensorflow/compiler/xla/hlo/evaluator:hlo_evaluator_test PASSED in 12.4s //tensorflow/compiler/xla/hlo/transforms:hlo_constant_splitter_test PASSED in 0.8s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:collective_ops.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:collective_ops_to_cpu_runtime.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:fft.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:legalize_i1_vector_transfers.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:lmhlo_custom_call.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:lmhlo_infeed.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:remove_copies_to_out_params.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:rng_bit_generator.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:xla_abi_legalization.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:xla_cpu_memref_element_cast_to_llvm.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir/backends/cpu/transforms/tests:xla_cpu_outfeed.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:add_hlo_trace.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:gpu_launch.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:gpu_memcpy.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:gpu_memset.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_case.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_custom_call.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_fft.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_gpu_cholesky.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_gpu_conv.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_gpu_cublas_lt_matmul.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_gpu_gemm.mlir.test PASSED in 1.4s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_infeed.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_outfeed.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_send_recv.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:lmhlo_while.mlir.test PASSED in 1.6s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:memref_get_global_to_arg.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/backends/gpu/transforms/tests:outline_cuda_graphs.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir/framework/tests:legalize-xla-framework.mlir.test PASSED in 1.3s //tensorflow/compiler/xla/mlir/framework/tests:outline-with-xla-framework.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/framework/tests:xla-framework.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/mlir/math/transforms/tests:math_legalization.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/math/transforms/tests:math_optimization.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir/memref/transforms/tests:aligned_allocations.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/runtime/ir/tests:ops.mlir.test PASSED in 1.9s //tensorflow/compiler/xla/mlir/runtime/ir/tests:ops_verify.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/runtime/ir/tests:testlib.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/runtime/transforms:calling_convention_test PASSED in 0.5s //tensorflow/compiler/xla/mlir/runtime/transforms:type_converter_test PASSED in 0.4s //tensorflow/compiler/xla/mlir/runtime/transforms/tests:compilation_pipeline.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir/runtime/transforms/tests:convert_asserts.mlir.test PASSED in 1.9s //tensorflow/compiler/xla/mlir/runtime/transforms/tests:convert_custom_calls.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/runtime/transforms/tests:export_functions.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/runtime/transforms/tests:ordinal_assignment.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/runtime/transforms/tests:rt_to_llvm.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/rewrites/tests:erase-op-without-results.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/rewrites/tests:inline-scf-while.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/rewrites/tests:reduce-gml-st-parallel-bounds.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/rewrites/tests:replace-op-with-constant.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/rewrites/tests:replace-op-with-value.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/rewrites/tests:replace-operand-with-constant.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/rewrites/tests:return-operands-of-terminator-operands.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/rewrites/tests:truncate-function.mlir.test PASSED in 1.7s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/tests:bisect.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/tests:no-bug.mlir.test PASSED in 1.9s //tensorflow/compiler/xla/mlir/tools/mlir_bisect/tests:snapshot.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir/tools/mlir_replay/public:execution_trace_utils_test PASSED in 0.2s //tensorflow/compiler/xla/mlir/utils:error_util_test PASSED in 0.4s //tensorflow/compiler/xla/mlir/xla_cpu/tests:bufferize.mlir.test PASSED in 1.3s //tensorflow/compiler/xla/mlir/xla_cpu/tests:invalid.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir/xla_cpu/tests:ops.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/chlo/chlo_legalize_to_hlo_broadcasts.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/chlo/chlo_legalize_to_hlo_no_broadcasts.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/chlo/chlo_legalize_to_mhlo.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/chlo/sparse_chlo_legalize_to_linalg.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/deallocation/buffer_reuse.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/deallocation/canonicalize.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/deallocation/convert_deallocation_ops_to_llvm.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/deallocation/deallocate.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/deallocation/deallocation_to_scf.mlir.test PASSED in 1.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/deallocation/split_alloc_tensors.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/add_debug_info.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/bufferization.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/canonicalize.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/collapse-shape.mlir.test PASSED in 1.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/compose_extract_insert_slice.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/dot.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/fibonacci.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/fusion_planning_for_cpu.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/inline_fusion_clusters.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/map_bcast_map.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/map_matmul.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/map_reduce_map.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/matmul.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/reduce_1d.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/reduce_2d.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/reverse.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/scatter.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/sort.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/cpu_tiling/transpose.mlir.test PASSED in 1.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/fusion.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/gml_st_to_scf.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/greedy_fusion.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/invalid.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/nested_tiling.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/nested_tiling_softmax.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/ops.mlir.test PASSED in 1.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/optimize_vector_transfer.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/rewrite_vector_contract.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/rewrite_vector_multi_reduction.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/simplify_dead_copy.mlir.test PASSED in 1.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/tile_by_one.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/tiling.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/tiling_and_fusion.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/tiling_softmax.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/vectorize_copy.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/gml_st/vectorize_for_cpu.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/lhlo/lhlo-legalize-select-and-scatter.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/lhlo/lhlo-legalize-to-affine.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/lhlo/lhlo-legalize-to-gpu.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/lhlo/lhlo-legalize-to-parallel-loops.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/lhlo/lhlo-legalize-to-tensor-op.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/lhlo/ops.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/lhlo_gpu/lhlo_gpu_ops.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/attrs.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/broadcast_propagation.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/bitcast.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/canonicalize.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/concatenate.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/convert.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/convolution.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/custom_call.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/folder_limit.mlir.test PASSED in 3.0s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/reduce.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/reshape.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/reverse.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/scatter.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/transpose.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/tuple.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/canonicalize/while.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/constraint_fusion.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/convert_to_signless.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/expand_hlo_tuples.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/expand_ops_simplifier.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/group_reduction_dimensions.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-collapse-elementwise-map.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-einsum-to-dot-general.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-gather-to-torch-index-select.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-shape-ops-to-standard.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-sort.mlir.test PASSED in 1.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-arithmetic.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-lhlo-only-dynamic.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-lhlo-unranked.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-lhlo.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-linalg.mlir.test PASSED in 3.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-memref-unranked.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-memref.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-stablehlo-experimental.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/hlo-legalize-to-stablehlo.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/inlining.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/invalid.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/legalize-control-flow.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/legalize-hlo-shape-computations.mlir.test PASSED in 1.1s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/legalize-mhlo-to-thlo.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/legalize-to-std.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/lower-complex.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/lower-general-dot.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/materialize-broadcasts.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/merge_assuming_ops.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_bytecode_customizations.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_canonicalize_dot.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_canonicalize_gather.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_canonicalize_reduction.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_canonicalize_scatter.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_flatten_tuple.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_infer_shape_type_methods.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_ops_prettyprint.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/mhlo_reduce_pretty_print.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/ops.mlir.test PASSED in 1.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/optimize-hlo.mlir.test PASSED in 1.3s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/prepare-for-export.mlir.test PASSED in 1.3s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/reify-result-types.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/restrict_max_rank.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/shape_reification.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/sink-constants-to-control-flow.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/sparse_gendot_lower.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/sparse_lower.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/sparse_ops.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/sparse_rewriting.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/sparse_transpose.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/stablehlo-legalize-to-hlo.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/symbolic-shape-optimization.mlir.test PASSED in 2.7s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/unfuse_batch_norm.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/verifier_bounds.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/verifier_conv_op.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/verifier_reduce_op.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/verifier_reduce_window_op.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/verifier_scatter_op.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/verifier_select_and_scatter_op.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/verifier_while_op.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/mhlo/while_prettyprint.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/thlo/bufferize.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/thlo/canonicalize.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/thlo/invalid.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/thlo/legalize_sort.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/mlir_hlo/tests:Dialect/thlo/ops.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:alloc_to_arg.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:assuming-structural-propagation.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:buffer_packing.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:buffer_reuse.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:bufferize.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir_hlo/tests:bufferize_one_shot.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:collapse_parallel_loops_to_1d_pass.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:copy_removal.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:detensorize_scf_ops.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:index_type_llvm_lowering.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:legalize-trigonometric-to-approximation.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:lower_index_cast.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:propagate_static_shapes.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:rank-specialization.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/mlir_hlo/tests:scalarization.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/mlir_hlo/tests:shape-component-analysis.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tests:shape_simplification.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:test_userange.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:tile_loops.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/mlir_hlo/tests:unbufferize.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tests:unroll-loops.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tools/mlir_interpreter/framework/tests:interpreter_value_test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tools/mlir_interpreter/framework/tests:tensor_or_memref_test PASSED in 0.1s //tensorflow/compiler/xla/mlir_hlo/tosa/tests:binary.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/mlir_hlo/tosa/tests:nullary.mlir.test PASSED in 1.5s //tensorflow/compiler/xla/mlir_hlo/tosa/tests:prepare-mhlo.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/mlir_hlo/tosa/tests:ternary.mlir.test PASSED in 1.3s //tensorflow/compiler/xla/mlir_hlo/tosa/tests:unary.mlir.test PASSED in 1.3s //tensorflow/compiler/xla/pjrt:host_callback_test PASSED in 0.2s //tensorflow/compiler/xla/pjrt:lru_cache_test PASSED in 0.2s //tensorflow/compiler/xla/pjrt:pjrt_api_test PASSED in 0.3s //tensorflow/compiler/xla/pjrt:pjrt_client_test_cpu PASSED in 8.6s //tensorflow/compiler/xla/pjrt:pjrt_compiler_test PASSED in 0.4s //tensorflow/compiler/xla/pjrt:pjrt_executable_test PASSED in 0.5s //tensorflow/compiler/xla/pjrt:pjrt_stream_executor_client_test PASSED in 7.8s //tensorflow/compiler/xla/pjrt:semaphore_test PASSED in 0.2s //tensorflow/compiler/xla/pjrt:tfrt_cpu_pjrt_client_test PASSED in 6.7s //tensorflow/compiler/xla/pjrt:tracked_device_buffer_test PASSED in 8.0s //tensorflow/compiler/xla/pjrt:tracked_tfrt_cpu_device_buffer_test PASSED in 0.4s //tensorflow/compiler/xla/pjrt:transpose_test PASSED in 50.8s //tensorflow/compiler/xla/pjrt/c:pjrt_c_api_cpu_test PASSED in 7.1s //tensorflow/compiler/xla/pjrt/distributed:client_server_test PASSED in 42.1s //tensorflow/compiler/xla/pjrt/distributed:service_test PASSED in 9.2s //tensorflow/compiler/xla/pjrt/gpu:se_gpu_pjrt_client_test PASSED in 2.0s //tensorflow/compiler/xla/python:outfeed_receiver_test_cpu PASSED in 8.1s //tensorflow/compiler/xla/python/ifrt:array_test PASSED in 0.4s //tensorflow/compiler/xla/python/ifrt:array_test_no_impl PASSED in 0.2s //tensorflow/compiler/xla/python/ifrt:client_test_no_impl PASSED in 0.5s //tensorflow/compiler/xla/python/ifrt:executable_test_no_impl PASSED in 1.0s //tensorflow/compiler/xla/python/ifrt:future_test PASSED in 0.9s //tensorflow/compiler/xla/python/ifrt:index_domain_test PASSED in 0.3s //tensorflow/compiler/xla/python/ifrt:index_test PASSED in 0.3s //tensorflow/compiler/xla/python/ifrt:shape_test PASSED in 0.6s //tensorflow/compiler/xla/python/ifrt:sharding_test PASSED in 0.2s //tensorflow/compiler/xla/python/ifrt:tuple_test_no_impl PASSED in 0.2s //tensorflow/compiler/xla/python/pjrt_ifrt:pjrt_array_impl_test_tfrt_cpu PASSED in 14.2s //tensorflow/compiler/xla/python/pjrt_ifrt:pjrt_client_impl_test_tfrt_cpu PASSED in 6.5s //tensorflow/compiler/xla/python/pjrt_ifrt:pjrt_executable_impl_test_tfrt_cpu PASSED in 6.1s //tensorflow/compiler/xla/python/pjrt_ifrt:pjrt_tuple_impl_test_tfrt_cpu PASSED in 6.9s //tensorflow/compiler/xla/rpc:grpc_client_test PASSED in 2.7s //tensorflow/compiler/xla/runtime:arguments_test PASSED in 0.2s //tensorflow/compiler/xla/runtime:async_runtime_test PASSED in 0.3s //tensorflow/compiler/xla/runtime:custom_call_test PASSED in 2.2s //tensorflow/compiler/xla/runtime:diagnostics_test PASSED in 0.1s //tensorflow/compiler/xla/runtime:executable_test PASSED in 1.7s //tensorflow/compiler/xla/runtime:ffi_test PASSED in 1.7s //tensorflow/compiler/xla/runtime:map_by_type_test PASSED in 0.5s //tensorflow/compiler/xla/runtime:module_test PASSED in 0.1s //tensorflow/compiler/xla/runtime:results_test PASSED in 0.6s //tensorflow/compiler/xla/runtime:state_test PASSED in 0.2s //tensorflow/compiler/xla/runtime:symbolic_shape_test PASSED in 0.3s //tensorflow/compiler/xla/runtime:type_id_test PASSED in 0.7s //tensorflow/compiler/xla/service:algebraic_simplifier_overflow_test_cpu PASSED in 9.4s //tensorflow/compiler/xla/service:algebraic_simplifier_test PASSED in 5.3s //tensorflow/compiler/xla/service:all_gather_broadcast_reorder_test PASSED in 1.6s //tensorflow/compiler/xla/service:all_gather_combiner_test PASSED in 0.8s //tensorflow/compiler/xla/service:all_gather_decomposer_test PASSED in 1.5s //tensorflow/compiler/xla/service:all_reduce_combiner_test PASSED in 2.2s //tensorflow/compiler/xla/service:all_reduce_contiguous_test PASSED in 0.8s //tensorflow/compiler/xla/service:all_reduce_folder_test PASSED in 1.7s //tensorflow/compiler/xla/service:all_reduce_promotion_test PASSED in 1.2s //tensorflow/compiler/xla/service:all_reduce_reassociate_test PASSED in 1.3s //tensorflow/compiler/xla/service:all_reduce_simplifier_test PASSED in 1.4s //tensorflow/compiler/xla/service:ar_crs_combiner_test PASSED in 4.9s //tensorflow/compiler/xla/service:async_collective_creator_test PASSED in 1.1s //tensorflow/compiler/xla/service:async_op_canonicalizer_test PASSED in 3.0s //tensorflow/compiler/xla/service:batch_dot_simplification_test PASSED in 0.8s //tensorflow/compiler/xla/service:batchnorm_expander_test_cpu PASSED in 7.4s //tensorflow/compiler/xla/service:bfloat16_conversion_folding_test PASSED in 1.8s //tensorflow/compiler/xla/service:bfloat16_normalization_test PASSED in 1.7s //tensorflow/compiler/xla/service:bfloat16_propagation_test PASSED in 1.5s //tensorflow/compiler/xla/service:bitcast_dtypes_expander_test PASSED in 1.4s //tensorflow/compiler/xla/service:broadcast_canonicalizer_test PASSED in 1.2s //tensorflow/compiler/xla/service:buffer_assignment_test PASSED in 21.4s //tensorflow/compiler/xla/service:call_graph_test PASSED in 1.2s //tensorflow/compiler/xla/service:call_inliner_test PASSED in 1.0s //tensorflow/compiler/xla/service:change_op_data_type_test PASSED in 0.9s //tensorflow/compiler/xla/service:collective_ops_utils_test PASSED in 0.3s //tensorflow/compiler/xla/service:collectives_schedule_linearizer_test PASSED in 2.0s //tensorflow/compiler/xla/service:compilation_environments_test PASSED in 0.3s //tensorflow/compiler/xla/service:conditional_canonicalizer_test PASSED in 1.1s //tensorflow/compiler/xla/service:conditional_code_motion_test PASSED in 2.0s //tensorflow/compiler/xla/service:conditional_simplifier_test PASSED in 1.5s //tensorflow/compiler/xla/service:conditional_to_select_test PASSED in 1.3s //tensorflow/compiler/xla/service:convert_mover_test PASSED in 1.2s //tensorflow/compiler/xla/service:convert_operand_folding_test PASSED in 2.3s //tensorflow/compiler/xla/service:convolution_4d_expander_test PASSED in 1.2s //tensorflow/compiler/xla/service:convolution_group_converter_test PASSED in 0.9s //tensorflow/compiler/xla/service:convolution_pred_expander_test PASSED in 1.1s //tensorflow/compiler/xla/service:copy_insertion_test PASSED in 2.4s //tensorflow/compiler/xla/service:custom_call_status_test PASSED in 0.1s //tensorflow/compiler/xla/service:defuser_test PASSED in 1.4s //tensorflow/compiler/xla/service:despecializer_test PASSED in 0.9s //tensorflow/compiler/xla/service:dfs_hlo_visitor_with_default_test PASSED in 1.0s //tensorflow/compiler/xla/service:dot_decomposer_test PASSED in 0.7s //tensorflow/compiler/xla/service:dot_merger_test PASSED in 1.4s //tensorflow/compiler/xla/service:dynamic_dimension_inference_test PASSED in 4.6s //tensorflow/compiler/xla/service:dynamic_dimension_simplifier_test PASSED in 3.4s //tensorflow/compiler/xla/service:dynamic_index_splitter_test PASSED in 1.2s //tensorflow/compiler/xla/service:dynamic_padder_test_cpu PASSED in 20.6s //tensorflow/compiler/xla/service:dynamic_parameter_binding_test PASSED in 0.8s //tensorflow/compiler/xla/service:dynamic_update_slice_test_cpu PASSED in 10.2s //tensorflow/compiler/xla/service:elemental_ir_emitter_test_cpu PASSED in 9.4s //tensorflow/compiler/xla/service:flatten_call_graph_test PASSED in 1.9s //tensorflow/compiler/xla/service:fusion_node_indexing_evaluation_test PASSED in 2.4s //tensorflow/compiler/xla/service:gather_expander_test PASSED in 1.1s //tensorflow/compiler/xla/service:gather_simplifier_test PASSED in 1.0s //tensorflow/compiler/xla/service:heap_simulator_test PASSED in 1.8s //tensorflow/compiler/xla/service:hlo_activation_analysis_test PASSED in 1.6s //tensorflow/compiler/xla/service:hlo_alias_analysis_test PASSED in 1.1s //tensorflow/compiler/xla/service:hlo_casting_utils_test PASSED in 8.5s //tensorflow/compiler/xla/service:hlo_computation_deduplicator_test PASSED in 2.8s //tensorflow/compiler/xla/service:hlo_computation_test PASSED in 2.3s //tensorflow/compiler/xla/service:hlo_constant_folding_test PASSED in 5.2s //tensorflow/compiler/xla/service:hlo_cost_analysis_test PASSED in 7.7s //tensorflow/compiler/xla/service:hlo_creation_utils_test PASSED in 5.7s //tensorflow/compiler/xla/service:hlo_cse_test PASSED in 9.8s //tensorflow/compiler/xla/service:hlo_dataflow_analysis_test PASSED in 2.2s //tensorflow/compiler/xla/service:hlo_dce_test PASSED in 0.9s //tensorflow/compiler/xla/service:hlo_domain_test PASSED in 1.3s //tensorflow/compiler/xla/service:hlo_element_type_converter_test PASSED in 1.0s //tensorflow/compiler/xla/service:hlo_execution_profile_test PASSED in 6.7s //tensorflow/compiler/xla/service:hlo_graph_dumper_test PASSED in 1.2s //tensorflow/compiler/xla/service:hlo_input_output_alias_config_test PASSED in 1.4s //tensorflow/compiler/xla/service:hlo_instruction_test PASSED in 1.1s //tensorflow/compiler/xla/service:hlo_live_range_test PASSED in 1.0s //tensorflow/compiler/xla/service:hlo_liveness_analysis_test PASSED in 0.9s //tensorflow/compiler/xla/service:hlo_matchers_test PASSED in 1.4s //tensorflow/compiler/xla/service:hlo_memory_scheduler_test PASSED in 1.4s //tensorflow/compiler/xla/service:hlo_module_dce_test PASSED in 1.2s //tensorflow/compiler/xla/service:hlo_module_metadata_test PASSED in 0.4s //tensorflow/compiler/xla/service:hlo_module_test PASSED in 1.1s //tensorflow/compiler/xla/service:hlo_opcode_test PASSED in 0.3s //tensorflow/compiler/xla/service:hlo_ordering_test PASSED in 1.3s //tensorflow/compiler/xla/service:hlo_parser_test PASSED in 0.5s //tensorflow/compiler/xla/service:hlo_pass_pipeline_test PASSED in 1.1s //tensorflow/compiler/xla/service:hlo_phi_graph_test PASSED in 0.2s //tensorflow/compiler/xla/service:hlo_proto_util_test PASSED in 1.0s //tensorflow/compiler/xla/service:hlo_reachability_test PASSED in 0.8s //tensorflow/compiler/xla/service:hlo_rematerialization_test PASSED in 4.1s //tensorflow/compiler/xla/service:hlo_rematerialization_test_utils_test PASSED in 1.1s //tensorflow/compiler/xla/service:hlo_replication_analysis_test PASSED in 1.4s //tensorflow/compiler/xla/service:hlo_schedule_test PASSED in 1.2s //tensorflow/compiler/xla/service:hlo_sharding_test PASSED in 1.4s //tensorflow/compiler/xla/service:hlo_sharding_util_test PASSED in 0.3s //tensorflow/compiler/xla/service:hlo_verifier_test PASSED in 1.9s //tensorflow/compiler/xla/service:indexed_array_analysis_test PASSED in 1.0s //tensorflow/compiler/xla/service:instruction_fusion_test PASSED in 1.0s //tensorflow/compiler/xla/service:latency_hiding_scheduler_test PASSED in 0.9s //tensorflow/compiler/xla/service:layout_assignment_test PASSED in 6.5s //tensorflow/compiler/xla/service:layout_normalization_test PASSED in 2.6s //tensorflow/compiler/xla/service:logistic_expander_test PASSED in 1.5s //tensorflow/compiler/xla/service:loop_schedule_linearizer_test PASSED in 1.0s //tensorflow/compiler/xla/service:map_inliner_test PASSED in 1.2s //tensorflow/compiler/xla/service:mapped_ptr_container_sorter_test PASSED in 0.6s //tensorflow/compiler/xla/service:memory_space_assignment_best_fit_repacker_test PASSED in 0.2s //tensorflow/compiler/xla/service:memory_space_assignment_test PASSED in 2.8s //tensorflow/compiler/xla/service:memory_space_propagation_test PASSED in 1.0s //tensorflow/compiler/xla/service:name_uniquer_test PASSED in 0.4s //tensorflow/compiler/xla/service:operand_upcaster_test PASSED in 1.8s //tensorflow/compiler/xla/service:optimize_input_output_buffer_alias_test PASSED in 1.1s //tensorflow/compiler/xla/service:pattern_matcher_gmock_test PASSED in 0.1s //tensorflow/compiler/xla/service:pattern_matcher_test PASSED in 1.6s //tensorflow/compiler/xla/service:real_imag_expander_test PASSED in 1.0s //tensorflow/compiler/xla/service:reduce_decomposer_test PASSED in 1.3s //tensorflow/compiler/xla/service:reduce_scatter_combiner_test PASSED in 1.0s //tensorflow/compiler/xla/service:reduce_scatter_decomposer_test PASSED in 1.7s //tensorflow/compiler/xla/service:reduce_scatter_reassociate_test PASSED in 1.2s //tensorflow/compiler/xla/service:reshape_decomposer_test PASSED in 1.0s //tensorflow/compiler/xla/service:reshape_mover_test PASSED in 1.4s //tensorflow/compiler/xla/service:result_caster_test PASSED in 0.7s //tensorflow/compiler/xla/service:root_instruction_sinker_test PASSED in 1.1s //tensorflow/compiler/xla/service:scatter_expander_test PASSED in 2.0s //tensorflow/compiler/xla/service:scatter_simplifier_test PASSED in 0.8s //tensorflow/compiler/xla/service:select_and_scatter_expander_test PASSED in 0.9s //tensorflow/compiler/xla/service:shape_inference_test PASSED in 0.2s //tensorflow/compiler/xla/service:shaped_buffer_test PASSED in 6.5s //tensorflow/compiler/xla/service:sharding_propagation_test PASSED in 2.9s //tensorflow/compiler/xla/service:sharding_remover_test PASSED in 0.8s //tensorflow/compiler/xla/service:simplify_fp_conversions_test PASSED in 1.9s //tensorflow/compiler/xla/service:slice_sinker_test PASSED in 1.3s //tensorflow/compiler/xla/service:sort_simplifier_test PASSED in 1.0s //tensorflow/compiler/xla/service:space_to_batch_converter_test PASSED in 0.8s //tensorflow/compiler/xla/service:stable_sort_expander_test PASSED in 0.8s //tensorflow/compiler/xla/service:stochastic_convert_decomposer_test PASSED in 1.2s //tensorflow/compiler/xla/service:stream_pool_test PASSED in 0.1s //tensorflow/compiler/xla/service:topk_rewriter_test PASSED in 0.8s //tensorflow/compiler/xla/service:transpose_folding_test PASSED in 1.9s //tensorflow/compiler/xla/service:tuple_points_to_analysis_test PASSED in 1.0s //tensorflow/compiler/xla/service:tuple_simplifier_test PASSED in 1.3s //tensorflow/compiler/xla/service:tuple_util_test PASSED in 2.3s //tensorflow/compiler/xla/service:while_loop_all_reduce_code_motion_test PASSED in 1.4s //tensorflow/compiler/xla/service:while_loop_analysis_test PASSED in 1.2s //tensorflow/compiler/xla/service:while_loop_concat_code_motion_test PASSED in 0.8s //tensorflow/compiler/xla/service:while_loop_constant_sinking_test PASSED in 0.8s //tensorflow/compiler/xla/service:while_loop_expensive_invariant_code_motion_test PASSED in 0.9s //tensorflow/compiler/xla/service:while_loop_invariant_code_motion_test PASSED in 0.8s //tensorflow/compiler/xla/service:while_loop_simplifier_test PASSED in 1.3s //tensorflow/compiler/xla/service:while_loop_trip_count_annotator_test PASSED in 0.8s //tensorflow/compiler/xla/service:while_util_test PASSED in 0.8s //tensorflow/compiler/xla/service:xla_aot_compile_stablehlo_cpu_test PASSED in 6.5s //tensorflow/compiler/xla/service:xla_debug_info_manager_test PASSED in 1.4s //tensorflow/compiler/xla/service:zero_sized_hlo_elimination_test PASSED in 0.8s //tensorflow/compiler/xla/service/cpu:conv_canonicalization_test PASSED in 1.2s //tensorflow/compiler/xla/service/cpu:cpu_eigen_tensor_alignment_test PASSED in 1.0s //tensorflow/compiler/xla/service/cpu:cpu_instruction_fusion_test PASSED in 1.1s //tensorflow/compiler/xla/service/cpu:cpu_layout_assignment_test PASSED in 1.8s //tensorflow/compiler/xla/service/cpu:ir_emission_utils_test PASSED in 1.0s //tensorflow/compiler/xla/service/cpu:parallel_task_assignment_test PASSED in 2.8s //tensorflow/compiler/xla/service/cpu:runtime_fft_test PASSED in 0.1s //tensorflow/compiler/xla/service/cpu:shape_partition_test PASSED in 0.9s //tensorflow/compiler/xla/service/cpu:xfeed_manager_test PASSED in 0.8s //tensorflow/compiler/xla/service/cpu/tests:cpu_bytesizeof_test PASSED in 1.0s //tensorflow/compiler/xla/service/cpu/tests:cpu_dyn_shape_test PASSED in 6.1s //tensorflow/compiler/xla/service/cpu/tests:cpu_eigen_dot_operation_test PASSED in 8.0s //tensorflow/compiler/xla/service/cpu/tests:cpu_external_constants_test PASSED in 24.3s //tensorflow/compiler/xla/service/cpu/tests:cpu_fusion_test PASSED in 6.6s //tensorflow/compiler/xla/service/cpu/tests:cpu_infeed_test PASSED in 5.9s //tensorflow/compiler/xla/service/cpu/tests:cpu_intrinsic_test PASSED in 8.0s //tensorflow/compiler/xla/service/cpu/tests:cpu_key_value_sort_test PASSED in 5.8s //tensorflow/compiler/xla/service/cpu/tests:cpu_literal_caching_test PASSED in 6.0s //tensorflow/compiler/xla/service/cpu/tests:cpu_noalias_test PASSED in 8.8s //tensorflow/compiler/xla/service/cpu/tests:cpu_outfeed_test PASSED in 8.8s //tensorflow/compiler/xla/service/cpu/tests:cpu_profiling_test PASSED in 7.6s //tensorflow/compiler/xla/service/cpu/tests:cpu_spmd_compile_test PASSED in 7.1s //tensorflow/compiler/xla/service/cpu/tests:cpu_topk_test PASSED in 6.9s //tensorflow/compiler/xla/service/cpu/tests:cpu_vectorization_test PASSED in 7.5s //tensorflow/compiler/xla/service/cpu/tests:cpu_while_test PASSED in 10.9s //tensorflow/compiler/xla/service/cpu/tests:tree_reduction_rewriter_test PASSED in 7.0s //tensorflow/compiler/xla/service/gpu:alias_passthrough_params_test PASSED in 0.9s //tensorflow/compiler/xla/service/gpu:all_reduce_blueconnect_test PASSED in 0.8s //tensorflow/compiler/xla/service/gpu:cublas_pad_for_gemms_test PASSED in 1.3s //tensorflow/compiler/xla/service/gpu:cudnn_pad_for_convolutions_test PASSED in 1.3s //tensorflow/compiler/xla/service/gpu:cudnn_simplify_padding_test PASSED in 2.4s //tensorflow/compiler/xla/service/gpu:cudnn_support_utils_test PASSED in 3.3s //tensorflow/compiler/xla/service/gpu:cudnn_vectorize_convolutions_test PASSED in 1.0s //tensorflow/compiler/xla/service/gpu:fusion_merger_test PASSED in 2.1s //tensorflow/compiler/xla/service/gpu:gemm_rewriter_triton_test PASSED in 1.1s //tensorflow/compiler/xla/service/gpu:gpu_conv_padding_legalization_test PASSED in 0.8s //tensorflow/compiler/xla/service/gpu:gpu_conv_rewriter_test PASSED in 1.0s //tensorflow/compiler/xla/service/gpu:gpu_fusible_test PASSED in 2.2s //tensorflow/compiler/xla/service/gpu:gpu_hlo_cost_analysis_test PASSED in 1.2s //tensorflow/compiler/xla/service/gpu:gpu_performance_model_test PASSED in 2.1s //tensorflow/compiler/xla/service/gpu:gpu_sanitize_constant_names_test PASSED in 4.1s //tensorflow/compiler/xla/service/gpu:hlo_algorithm_denylist_test PASSED in 0.6s //tensorflow/compiler/xla/service/gpu:hlo_fusion_stats_test PASSED in 1.0s //tensorflow/compiler/xla/service/gpu:instruction_fusion_test PASSED in 1.6s //tensorflow/compiler/xla/service/gpu:ir_emission_utils_test PASSED in 1.8s //tensorflow/compiler/xla/service/gpu:matmul_utils_test PASSED in 1.0s //tensorflow/compiler/xla/service/gpu:move_copy_to_users_test PASSED in 1.9s //tensorflow/compiler/xla/service/gpu:multi_output_fusion_test PASSED in 2.9s //tensorflow/compiler/xla/service/gpu:non_atomically_upgradeable_rw_lock_test PASSED in 0.1s //tensorflow/compiler/xla/service/gpu:reduction_splitter_test PASSED in 1.5s //tensorflow/compiler/xla/service/gpu:scatter_slice_simplifier_test PASSED in 1.1s //tensorflow/compiler/xla/service/gpu:target_util_test PASSED in 0.6s //tensorflow/compiler/xla/service/gpu:variadic_op_splitter_test PASSED in 2.0s //tensorflow/compiler/xla/service/gpu:while_transformer_test PASSED in 1.6s //tensorflow/compiler/xla/service/gpu/llvm_gpu_backend:utils_test PASSED in 0.5s //tensorflow/compiler/xla/service/gpu/tests:gpu_reduce_scatter_creator_test PASSED in 1.2s //tensorflow/compiler/xla/service/gpu/tests:reduction_degenerate_dim_remover_test PASSED in 1.9s //tensorflow/compiler/xla/service/gpu/tests:reduction_dimension_grouper_test PASSED in 1.2s //tensorflow/compiler/xla/service/gpu/tests:tree_reduction_rewriter_test PASSED in 2.0s //tensorflow/compiler/xla/service/graphcycles:graphcycles_test PASSED in 0.7s //tensorflow/compiler/xla/service/graphcycles:ordered_set_test PASSED in 0.2s //tensorflow/compiler/xla/service/llvm_ir:alias_analysis_test PASSED in 8.5s //tensorflow/compiler/xla/service/llvm_ir:ir_array_test PASSED in 0.6s //tensorflow/compiler/xla/service/spmd:canonicalize_all_gather_for_cse_test PASSED in 1.0s //tensorflow/compiler/xla/service/spmd:collective_permute_motion_test PASSED in 0.9s //tensorflow/compiler/xla/service/spmd:partition_assignment_test PASSED in 1.4s //tensorflow/compiler/xla/service/spmd:schedule_aware_collective_ops_cse_test PASSED in 1.2s //tensorflow/compiler/xla/service/spmd:spmd_partitioner_test PASSED in 3.9s //tensorflow/compiler/xla/service/spmd:stateful_rng_spmd_partitioner_test PASSED in 0.9s //tensorflow/compiler/xla/stream_executor:dnn_test PASSED in 0.4s //tensorflow/compiler/xla/stream_executor:stream_test PASSED in 0.1s //tensorflow/compiler/xla/stream_executor/host:host_stream_test PASSED in 0.1s //tensorflow/compiler/xla/tests:all_reduce_test_cpu PASSED in 12.9s //tensorflow/compiler/xla/tests:axpy_simple_test_cpu PASSED in 7.8s //tensorflow/compiler/xla/tests:bad_rng_shape_validation_test_cpu PASSED in 6.7s //tensorflow/compiler/xla/tests:binop_scaling_test_cpu PASSED in 11.1s //tensorflow/compiler/xla/tests:bitcast_convert_test_cpu PASSED in 8.5s //tensorflow/compiler/xla/tests:broadcast_simple_test_cpu PASSED in 16.1s //tensorflow/compiler/xla/tests:broadcast_test_cpu PASSED in 8.4s //tensorflow/compiler/xla/tests:buffer_donation_test_cpu PASSED in 8.3s //tensorflow/compiler/xla/tests:call_test_cpu PASSED in 9.3s //tensorflow/compiler/xla/tests:check_execution_arity_test_cpu PASSED in 6.4s //tensorflow/compiler/xla/tests:cholesky_test_cpu PASSED in 18.5s //tensorflow/compiler/xla/tests:client_test_cpu PASSED in 7.8s //tensorflow/compiler/xla/tests:collective_ops_test_cpu PASSED in 25.8s //tensorflow/compiler/xla/tests:compilation_cache_test_cpu PASSED in 6.6s //tensorflow/compiler/xla/tests:compute_constant_test_cpu PASSED in 7.0s //tensorflow/compiler/xla/tests:concat_test_cpu PASSED in 13.2s //tensorflow/compiler/xla/tests:constant_reduction_function_test_cpu PASSED in 7.4s //tensorflow/compiler/xla/tests:constants_test_cpu PASSED in 12.0s //tensorflow/compiler/xla/tests:convert_test_cpu PASSED in 9.9s //tensorflow/compiler/xla/tests:copy_test_cpu PASSED in 9.4s //tensorflow/compiler/xla/tests:cpu_gpu_fusion_test_cpu PASSED in 11.9s //tensorflow/compiler/xla/tests:custom_call_test_cpu PASSED in 9.8s //tensorflow/compiler/xla/tests:deallocation_test_cpu PASSED in 9.5s //tensorflow/compiler/xla/tests:deconstruct_tuple_test_cpu PASSED in 7.3s //tensorflow/compiler/xla/tests:deep_graph_test_cpu PASSED in 7.1s //tensorflow/compiler/xla/tests:execution_profile_test_cpu PASSED in 9.1s //tensorflow/compiler/xla/tests:fft_test_cpu PASSED in 8.1s //tensorflow/compiler/xla/tests:floor_ceil_test_cpu PASSED in 7.4s //tensorflow/compiler/xla/tests:fmax_fmin_test_cpu PASSED in 8.6s //tensorflow/compiler/xla/tests:gather_operation_test_cpu PASSED in 12.2s //tensorflow/compiler/xla/tests:get_dimension_size_test_cpu PASSED in 11.2s //tensorflow/compiler/xla/tests:half_test_cpu PASSED in 8.6s //tensorflow/compiler/xla/tests:hlo_metadata_test PASSED in 7.2s //tensorflow/compiler/xla/tests:literal_test_util_test PASSED in 6.5s //tensorflow/compiler/xla/tests:local_client_allocation_test_cpu PASSED in 9.8s //tensorflow/compiler/xla/tests:local_client_aot_test PASSED in 0.1s //tensorflow/compiler/xla/tests:log_test_cpu PASSED in 7.5s //tensorflow/compiler/xla/tests:map_test_cpu PASSED in 9.8s //tensorflow/compiler/xla/tests:matrix_ops_simple_test_cpu PASSED in 16.4s //tensorflow/compiler/xla/tests:multidimensional_slice_test_cpu PASSED in 7.5s //tensorflow/compiler/xla/tests:multiple_devices_on_host_test PASSED in 6.4s //tensorflow/compiler/xla/tests:multithreaded_compilation_test_cpu PASSED in 9.4s //tensorflow/compiler/xla/tests:outfeed_in_nested_computation_test_cpu PASSED in 8.4s //tensorflow/compiler/xla/tests:pad_test_cpu PASSED in 10.7s //tensorflow/compiler/xla/tests:pred_test_cpu PASSED in 9.2s //tensorflow/compiler/xla/tests:query_inferred_shape_test_cpu PASSED in 9.1s //tensorflow/compiler/xla/tests:reduce_hlo_test_cpu PASSED in 8.4s //tensorflow/compiler/xla/tests:reduce_precision_test_cpu PASSED in 8.9s //tensorflow/compiler/xla/tests:replay_test_cpu PASSED in 8.9s //tensorflow/compiler/xla/tests:reshape_motion_test_cpu PASSED in 7.7s //tensorflow/compiler/xla/tests:reverse_test_cpu PASSED in 9.8s //tensorflow/compiler/xla/tests:round_trip_packed_literal_test_cpu PASSED in 7.8s //tensorflow/compiler/xla/tests:round_trip_transfer_test_cpu PASSED in 10.1s //tensorflow/compiler/xla/tests:sample_text_test_cpu PASSED in 8.3s //tensorflow/compiler/xla/tests:scatter_test_cpu PASSED in 11.8s //tensorflow/compiler/xla/tests:select_test_cpu PASSED in 8.9s //tensorflow/compiler/xla/tests:test_utils_test_cpu PASSED in 9.6s //tensorflow/compiler/xla/tests:token_hlo_test_cpu PASSED in 8.0s //tensorflow/compiler/xla/tests:transfer_manager_test_cpu PASSED in 17.0s //tensorflow/compiler/xla/tests:transpose_test_cpu PASSED in 8.5s //tensorflow/compiler/xla/tests:tuple_test_cpu PASSED in 9.4s //tensorflow/compiler/xla/tests:unary_op_test_cpu PASSED in 8.7s //tensorflow/compiler/xla/tests:value_inference_test_cpu PASSED in 7.8s //tensorflow/compiler/xla/tests:vector_ops_reduce_test_cpu PASSED in 9.6s //tensorflow/compiler/xla/tests:vector_ops_simple_test_cpu PASSED in 8.4s //tensorflow/compiler/xla/tests:while_test_cpu PASSED in 9.4s //tensorflow/compiler/xla/tools:hlo_control_flow_flattening_test PASSED in 0.8s //tensorflow/compiler/xla/tools:hlo_extractor_test PASSED in 1.2s //tensorflow/compiler/xla/tools:hlo_module_loader_test PASSED in 0.9s //tensorflow/compiler/xla/tools:interactive_graphviz_bin_test PASSED in 0.2s //tensorflow/compiler/xla/tools:replay_computation_bin_test PASSED in 0.5s //tensorflow/compiler/xla/tools:run_hlo_module_bin_test PASSED in 1.6s //tensorflow/compiler/xla/tools/hlo_bisect:hlo_bisect_state_test PASSED in 1.0s //tensorflow/compiler/xla/translate/hlo_to_mhlo:hlo_utils_test PASSED in 0.5s //tensorflow/compiler/xla/translate/hlo_to_mhlo:mlir_hlo_builder_test PASSED in 0.7s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:bool_compare.hlotxt.test PASSED in 0.4s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:case_conditional.hlotxt.test PASSED in 3.2s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:dynamic_param.hlo.test PASSED in 0.7s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:entry_computation_layout.hlotxt.test PASSED in 0.5s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:frontend_attributes.hlotxt.test PASSED in 0.6s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:fully_connected_reference_model.hlotxt.test PASSED in 1.5s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:fusion.hlotxt.test PASSED in 0.5s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:if_conditional.hlotxt.test PASSED in 1.0s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:import.hlotxt.test PASSED in 1.0s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:import_async.hlotxt.test PASSED in 0.8s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:layouts_and_names.hlotxt.test PASSED in 0.5s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:location.hlotxt.test PASSED in 0.5s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:module_attributes.hlo.test PASSED in 0.5s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:simple.hlo.test PASSED in 0.5s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:spmd_module_sharding.hlo.test PASSED in 0.7s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:types.hlotxt.test PASSED in 0.5s //tensorflow/compiler/xla/translate/hlo_to_mhlo/tests:while.hlotxt.test PASSED in 1.2s //tensorflow/compiler/xla/translate/mhlo_to_hlo:type_to_shape_test PASSED in 0.9s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:add.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:case.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:export-with-layouts.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:export.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:export_and_check_layouts.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:export_large_constants.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:export_replicas.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:fusion.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:if.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:input_output_aliasing.mlir.test PASSED in 0.7s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:layouts_and_names.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:location_to_op_metadata.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:missing_main.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:module_attributes.mlir.test PASSED in 0.6s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:multiple_return_tuple.mlir.test PASSED in 1.0s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:opaque_elements_attr.mlir.test PASSED in 0.9s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:rng_get_and_update_state.mlir.test PASSED in 1.2s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:sharding.mlir.test PASSED in 0.8s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:simple.mlir.test PASSED in 0.4s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:unsupported_type.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/translate/mhlo_to_hlo/tests:while.mlir.test PASSED in 0.5s //tensorflow/compiler/xla/translate/mhlo_to_lhlo_with_xla/tests:hlo_text_to_lhlo_no_opt.hlotxt.test PASSED in 1.9s //tensorflow/compiler/xla/translate/mhlo_to_lhlo_with_xla/tests:no_opt_ops.hlotxt.test PASSED in 0.9s //tensorflow/compiler/xla/translate/mhlo_to_lhlo_with_xla/tests:non_identity_layouts.hlotxt.test PASSED in 1.2s //tensorflow/compiler/xla/translate/mhlo_to_lhlo_with_xla/tests:ops.mlir.test PASSED in 10.0s //tensorflow/compiler/xla/translate/mhlo_to_lhlo_with_xla/tests:passthrough.mlir.test PASSED in 0.6s //tensorflow/core:__tensorflow_core_lib_core_legacy_lib_core_all_tests PASSED in 10.6s //tensorflow/core:__tensorflow_core_lib_gtl_legacy_lib_gtl_tests PASSED in 0.2s //tensorflow/core:__tensorflow_core_lib_monitoring_cell_reader_test PASSED in 36.0s //tensorflow/core:__tensorflow_core_lib_monitoring_collection_registry_test PASSED in 0.4s //tensorflow/core:__tensorflow_core_lib_monitoring_counter_test PASSED in 0.2s //tensorflow/core:__tensorflow_core_lib_monitoring_gauge_test PASSED in 0.5s //tensorflow/core:__tensorflow_core_lib_monitoring_metric_def_test PASSED in 0.1s //tensorflow/core:__tensorflow_core_lib_monitoring_percentile_sampler_test PASSED in 0.2s //tensorflow/core:__tensorflow_core_lib_monitoring_sampler_test PASSED in 0.6s //tensorflow/core:__tensorflow_core_lib_monitoring_test_utils_test PASSED in 0.2s //tensorflow/core:__tensorflow_core_lib_strings_legacy_low_level_library_tests PASSED in 0.2s //tensorflow/core:__tensorflow_core_lib_wav_wav_io_test PASSED in 0.3s //tensorflow/core:__tensorflow_core_util_mkl_util_test_srcs PASSED in 0.1s //tensorflow/core:__tensorflow_tsl_lib_core_legacy_lib_core_all_tests PASSED in 0.5s //tensorflow/core:lib_strings_ordered_code_test PASSED in 1.4s //tensorflow/core:lib_strings_proto_serialization_test PASSED in 0.1s //tensorflow/core/api_def:api_test PASSED in 3.7s //tensorflow/core/api_def:update_api_def_test PASSED in 0.2s //tensorflow/core/common_runtime:all_to_all_test_cpu PASSED in 1.2s //tensorflow/core/common_runtime:arg_ret_placement_test PASSED in 0.7s //tensorflow/core/common_runtime:buf_rendezvous_test PASSED in 0.7s //tensorflow/core/common_runtime:collective_executor_mgr_test PASSED in 0.8s //tensorflow/core/common_runtime:collective_param_resolver_local_test PASSED in 6.0s //tensorflow/core/common_runtime:collective_rma_local_test PASSED in 1.0s //tensorflow/core/common_runtime:composite_device_test PASSED in 0.6s //tensorflow/core/common_runtime:cost_measurement_registry_test PASSED in 2.2s //tensorflow/core/common_runtime:cost_util_test PASSED in 0.2s //tensorflow/core/common_runtime:device_mgr_test PASSED in 1.0s //tensorflow/core/common_runtime:device_propagation_test PASSED in 1.0s //tensorflow/core/common_runtime:device_resolver_local_test PASSED in 1.9s //tensorflow/core/common_runtime:device_set_test PASSED in 1.0s //tensorflow/core/common_runtime:direct_session_test_cpu PASSED in 2.4s //tensorflow/core/common_runtime:direct_session_with_debug_test PASSED in 2.5s //tensorflow/core/common_runtime:direct_session_with_tracking_alloc_test PASSED in 1.6s //tensorflow/core/common_runtime:dynamic_device_mgr_test PASSED in 1.1s //tensorflow/core/common_runtime:executor_test PASSED in 1.8s //tensorflow/core/common_runtime:function_optimization_registration_test PASSED in 1.9s //tensorflow/core/common_runtime:function_optimization_registry_no_pass_test PASSED in 1.0s //tensorflow/core/common_runtime:function_optimization_registry_pass_failure_test PASSED in 1.6s //tensorflow/core/common_runtime:function_optimization_registry_test PASSED in 0.8s //tensorflow/core/common_runtime:function_threadpool_test PASSED in 1.3s //tensorflow/core/common_runtime:graph_constructor_test PASSED in 3.9s //tensorflow/core/common_runtime:graph_runner_test PASSED in 0.9s //tensorflow/core/common_runtime:hierarchical_tree_broadcaster_test_cpu PASSED in 4.1s //tensorflow/core/common_runtime:inline_function_utils_test PASSED in 1.3s //tensorflow/core/common_runtime:input_colocation_exemption_registry_test PASSED in 0.7s //tensorflow/core/common_runtime:int32_fulltype_test PASSED in 0.5s //tensorflow/core/common_runtime:isolate_placer_inspection_required_ops_pass_test PASSED in 0.9s //tensorflow/core/common_runtime:lower_case_op_test PASSED in 2.0s //tensorflow/core/common_runtime:lower_function_call_test PASSED in 2.8s //tensorflow/core/common_runtime:lower_functional_ops_test PASSED in 2.2s //tensorflow/core/common_runtime:lower_if_op_test PASSED in 2.5s //tensorflow/core/common_runtime:lower_while_op_test PASSED in 2.3s //tensorflow/core/common_runtime:mkl_cpu_allocator_test PASSED in 0.1s //tensorflow/core/common_runtime:mkl_layout_pass_test PASSED in 0.4s //tensorflow/core/common_runtime:mkl_tfconversion_pass_test PASSED in 0.1s //tensorflow/core/common_runtime:mkl_threadpool_device_test PASSED in 0.1s //tensorflow/core/common_runtime:no_op_cost_measurement_test PASSED in 1.5s //tensorflow/core/common_runtime:null_request_cost_accessor_test PASSED in 0.6s //tensorflow/core/common_runtime:optimization_registry_test PASSED in 1.0s //tensorflow/core/common_runtime:optimize_cross_host_control_deps_test PASSED in 13.6s //tensorflow/core/common_runtime:optimize_function_graph_utils_test PASSED in 1.7s //tensorflow/core/common_runtime:partitioning_utils_test PASSED in 0.8s //tensorflow/core/common_runtime:pending_counts_test PASSED in 1.2s //tensorflow/core/common_runtime:permuter_test_cpu PASSED in 4.1s //tensorflow/core/common_runtime:placer_inspection_required_ops_utils_test PASSED in 1.9s //tensorflow/core/common_runtime:placer_test PASSED in 0.7s //tensorflow/core/common_runtime:process_function_library_runtime_test_cpu PASSED in 0.7s //tensorflow/core/common_runtime:process_util_test PASSED in 0.2s //tensorflow/core/common_runtime:quantize_training_test PASSED in 2.7s //tensorflow/core/common_runtime:rendezvous_util_test PASSED in 0.1s //tensorflow/core/common_runtime:replicate_per_replica_nodes_test PASSED in 1.1s //tensorflow/core/common_runtime:request_cost_accessor_registry_test PASSED in 2.7s //tensorflow/core/common_runtime:request_cost_test PASSED in 0.1s //tensorflow/core/common_runtime:ring_gatherer_test_cpu PASSED in 3.6s //tensorflow/core/common_runtime:ring_reducer_test_cpu PASSED in 10.3s //tensorflow/core/common_runtime:scoped_allocator_mgr_test PASSED in 6.1s //tensorflow/core/common_runtime:session_test PASSED in 1.0s //tensorflow/core/common_runtime:shape_refiner_test PASSED in 0.8s //tensorflow/core/common_runtime:single_threaded_executor_test PASSED in 0.8s //tensorflow/core/common_runtime:threadpool_device_test PASSED in 2.0s //tensorflow/core/common_runtime:type_inference_test PASSED in 2.8s //tensorflow/core/common_runtime/eager:attr_builder_test PASSED in 37.8s //tensorflow/core/common_runtime/eager:context_test PASSED in 16.7s //tensorflow/core/common_runtime/eager:custom_device_test PASSED in 16.8s //tensorflow/core/common_runtime/eager:eager_executor_test PASSED in 15.6s //tensorflow/core/common_runtime/eager:eager_op_rewrite_registry_test PASSED in 1.4s //tensorflow/core/common_runtime/eager:eager_operation_test PASSED in 14.6s //tensorflow/core/common_runtime/eager:execute_node_test PASSED in 17.2s //tensorflow/core/common_runtime/eager:execute_test PASSED in 15.2s //tensorflow/core/common_runtime/eager:kernel_and_device_test PASSED in 1.0s //tensorflow/core/common_runtime/eager:mkl_eager_op_rewrite_test PASSED in 13.2s //tensorflow/core/common_runtime/eager:placement_test PASSED in 14.9s //tensorflow/core/common_runtime/eager:placement_utils_test PASSED in 12.8s //tensorflow/core/common_runtime/eager:tensor_handle_data_test PASSED in 14.4s //tensorflow/core/common_runtime/eager:tensor_handle_test PASSED in 16.1s //tensorflow/core/common_runtime/gpu:gpu_device_on_non_gpu_machine_test PASSED in 0.8s //tensorflow/core/common_runtime/next_pluggable_device/c:plugin_c_api_test PASSED in 5.5s //tensorflow/core/config:flags_py_test PASSED in 5.9s //tensorflow/core/config:flags_test PASSED in 0.2s //tensorflow/core/data:compression_utils_test PASSED in 1.9s //tensorflow/core/data:dataset_utils_test PASSED in 0.6s //tensorflow/core/data:hash_utils_test PASSED in 1.9s //tensorflow/core/data:metric_utils_test PASSED in 5.9s //tensorflow/core/data:name_utils_test PASSED in 0.3s //tensorflow/core/data:rewrite_utils_test PASSED in 0.6s //tensorflow/core/data:serialization_utils_test PASSED in 0.6s //tensorflow/core/data:snapshot_utils_test PASSED in 0.5s //tensorflow/core/data:split_utils_test PASSED in 0.5s //tensorflow/core/data:standalone_save_restore_test PASSED in 3.9s //tensorflow/core/data:standalone_test PASSED in 3.1s //tensorflow/core/data:tfdataz_metrics_test PASSED in 1.9s //tensorflow/core/data:unbounded_thread_pool_test PASSED in 0.5s //tensorflow/core/data/service:auto_shard_rewriter_test PASSED in 1.4s //tensorflow/core/data/service:common_test PASSED in 0.1s //tensorflow/core/data/service:credentials_factory_test PASSED in 1.1s //tensorflow/core/data/service:cross_trainer_cache_test PASSED in 1.6s //tensorflow/core/data/service:data_service_test PASSED in 13.6s //tensorflow/core/data/service:data_transfer_test PASSED in 0.8s //tensorflow/core/data/service:dataset_store_test PASSED in 1.0s //tensorflow/core/data/service:dispatcher_client_test PASSED in 5.8s //tensorflow/core/data/service:dispatcher_state_test PASSED in 0.8s //tensorflow/core/data/service:grpc_dispatcher_impl_test PASSED in 4.1s //tensorflow/core/data/service:grpc_util_test PASSED in 1.1s //tensorflow/core/data/service:grpc_worker_impl_test PASSED in 2.8s //tensorflow/core/data/service:journal_test PASSED in 1.0s //tensorflow/core/data/service:logging_utils_test PASSED in 0.1s //tensorflow/core/data/service:task_runner_test PASSED in 4.6s //tensorflow/core/data/service:test_util_test PASSED in 2.8s //tensorflow/core/data/service:url_test PASSED in 1.0s //tensorflow/core/data/service:utils_test PASSED in 0.6s //tensorflow/core/data/service:validate_utils_test PASSED in 0.2s //tensorflow/core/data/service:worker_client_test PASSED in 3.5s //tensorflow/core/data/service:worker_impl_test PASSED in 5.2s //tensorflow/core/data/service/client:data_service_client_test PASSED in 4.6s //tensorflow/core/data/service/client:utils_test PASSED in 3.5s //tensorflow/core/data/service/client:validate_utils_test PASSED in 2.4s //tensorflow/core/data/service/snapshot:distributed_snapshot_test PASSED in 19.8s //tensorflow/core/data/service/snapshot:file_utils_test PASSED in 0.7s //tensorflow/core/data/service/snapshot:path_utils_test PASSED in 0.5s //tensorflow/core/data/service/snapshot:snapshot_reader_test PASSED in 2.4s //tensorflow/core/data/service/snapshot:snapshot_split_provider_test PASSED in 1.2s //tensorflow/core/data/service/snapshot:snapshot_stream_writer_checkpoint_test PASSED in 5.2s //tensorflow/core/data/service/snapshot:snapshot_stream_writer_test PASSED in 5.5s //tensorflow/core/data/service/snapshot:utils_test PASSED in 0.2s //tensorflow/core/debug:debug_graph_utils_test PASSED in 0.6s //tensorflow/core/distributed_runtime:call_options_test PASSED in 0.1s //tensorflow/core/distributed_runtime:cluster_function_library_runtime_test PASSED in 5.0s //tensorflow/core/distributed_runtime:collective_param_resolver_distributed_test PASSED in 1.1s //tensorflow/core/distributed_runtime:collective_rma_distributed_test PASSED in 0.9s //tensorflow/core/distributed_runtime:device_resolver_distributed_test PASSED in 0.6s //tensorflow/core/distributed_runtime:message_wrappers_test PASSED in 0.1s //tensorflow/core/distributed_runtime:partial_run_mgr_test PASSED in 0.4s //tensorflow/core/distributed_runtime:recent_request_ids_test PASSED in 0.1s //tensorflow/core/distributed_runtime:request_id_test PASSED in 0.1s //tensorflow/core/distributed_runtime:rpc_collective_executor_mgr_test PASSED in 0.4s //tensorflow/core/distributed_runtime:server_lib_test PASSED in 0.1s //tensorflow/core/distributed_runtime:session_mgr_test PASSED in 1.0s //tensorflow/core/distributed_runtime:tensor_coding_test PASSED in 0.3s //tensorflow/core/distributed_runtime/coordination:coordination_service_barrier_proxy_test PASSED in 2.5s //tensorflow/core/distributed_runtime/eager:eager_service_impl_test PASSED in 22.5s //tensorflow/core/distributed_runtime/eager:remote_mgr_test PASSED in 13.9s //tensorflow/core/distributed_runtime/integration_test:c_api_coordination_test_cpu PASSED in 45.4s //tensorflow/core/distributed_runtime/integration_test:c_api_multi_client_test_cpu PASSED in 34.3s //tensorflow/core/distributed_runtime/integration_test:c_api_recoverable_jobs_test_cpu PASSED in 49.9s //tensorflow/core/distributed_runtime/rpc:grpc_tensor_coding_test PASSED in 3.7s //tensorflow/core/distributed_runtime/rpc:grpc_worker_cache_test PASSED in 0.8s //tensorflow/core/distributed_runtime/rpc/eager:grpc_eager_client_test PASSED in 1.0s //tensorflow/core/example:example_parser_configuration_test PASSED in 2.3s //tensorflow/core/example:feature_util_test PASSED in 0.1s //tensorflow/core/framework:allocator_test PASSED in 4.3s //tensorflow/core/framework:attr_value_util_test PASSED in 1.5s //tensorflow/core/framework:batch_util_test PASSED in 0.9s //tensorflow/core/framework:bfloat16_test PASSED in 1.1s //tensorflow/core/framework:common_shape_fns_test PASSED in 1.3s //tensorflow/core/framework:dataset_test PASSED in 1.3s //tensorflow/core/framework:device_base_test PASSED in 1.0s //tensorflow/core/framework:disable_jit_test PASSED in 1.0s //tensorflow/core/framework:framework_op_gen_lib_test PASSED in 0.7s //tensorflow/core/framework:framework_op_segment_test PASSED in 0.8s //tensorflow/core/framework:framework_resource_var_test PASSED in 0.4s //tensorflow/core/framework:framework_run_handler_test PASSED in 3.0s //tensorflow/core/framework:framework_run_handler_util_test PASSED in 2.6s //tensorflow/core/framework:full_type_inference_util_test PASSED in 1.1s //tensorflow/core/framework:full_type_util_test PASSED in 1.7s //tensorflow/core/framework:function_test PASSED in 2.6s //tensorflow/core/framework:graph_def_util_test PASSED in 1.1s //tensorflow/core/framework:graph_to_functiondef_test PASSED in 5.1s //tensorflow/core/framework:kernel_def_builder_test PASSED in 0.9s //tensorflow/core/framework:kernel_def_util_test PASSED in 0.9s //tensorflow/core/framework:memory_types_test PASSED in 1.0s //tensorflow/core/framework:model_test PASSED in 1.3s //tensorflow/core/framework:node_def_builder_test PASSED in 1.5s //tensorflow/core/framework:node_def_util_test PASSED in 1.0s //tensorflow/core/framework:node_properties_test PASSED in 0.8s //tensorflow/core/framework:op_compatibility_test PASSED in 1.2s //tensorflow/core/framework:op_def_builder_test PASSED in 1.1s //tensorflow/core/framework:op_def_util_test PASSED in 0.9s //tensorflow/core/framework:op_kernel_test PASSED in 1.2s //tensorflow/core/framework:op_registration_test PASSED in 0.9s //tensorflow/core/framework:partial_tensor_shape_test PASSED in 1.4s //tensorflow/core/framework:rendezvous_test PASSED in 3.9s //tensorflow/core/framework:resource_handle_test PASSED in 0.1s //tensorflow/core/framework:resource_mgr_test PASSED in 1.9s //tensorflow/core/framework:resource_op_kernel_test PASSED in 1.1s //tensorflow/core/framework:shape_inference_test PASSED in 1.2s //tensorflow/core/framework:shape_inference_testutil_test PASSED in 1.4s //tensorflow/core/framework:tensor_shape_test PASSED in 6.8s //tensorflow/core/framework:tensor_slice_test PASSED in 0.8s //tensorflow/core/framework:tensor_test PASSED in 31.2s //tensorflow/core/framework:tensor_testutil_test PASSED in 0.9s //tensorflow/core/framework:tensor_util_test PASSED in 1.5s //tensorflow/core/framework:tracking_allocator_test PASSED in 1.9s //tensorflow/core/framework:types_test PASSED in 1.1s //tensorflow/core/framework:variant_op_registry_test PASSED in 18.4s //tensorflow/core/framework:variant_test PASSED in 0.7s //tensorflow/core/framework/registration:registration_test PASSED in 0.5s //tensorflow/core/function/capture:by_ref_capture_test PASSED in 8.4s //tensorflow/core/function/capture:capture_container_test PASSED in 6.6s //tensorflow/core/function/integration_test:side_inputs_manual_api_test PASSED in 13.0s //tensorflow/core/function/integration_test:side_inputs_test PASSED in 13.6s //tensorflow/core/function/polymorphism:function_cache_test PASSED in 6.1s //tensorflow/core/function/polymorphism:function_type_test PASSED in 5.9s //tensorflow/core/function/polymorphism:type_dispatch_test PASSED in 7.1s //tensorflow/core/function/runtime_client:runtime_client_cc_test PASSED in 33.2s //tensorflow/core/function/trace_type:default_types_test PASSED in 6.8s //tensorflow/core/function/trace_type:serialization_test PASSED in 6.2s //tensorflow/core/function/trace_type:trace_type_test PASSED in 11.3s //tensorflow/core/graph:algorithm_test PASSED in 1.3s //tensorflow/core/graph:collective_order_test PASSED in 0.9s //tensorflow/core/graph:control_flow_test PASSED in 0.8s //tensorflow/core/graph:costmodel_test PASSED in 0.9s //tensorflow/core/graph:edgeset_test PASSED in 0.7s //tensorflow/core/graph:graph_def_builder_test PASSED in 0.9s //tensorflow/core/graph:graph_partition_test PASSED in 1.0s //tensorflow/core/graph:graph_test PASSED in 0.9s //tensorflow/core/graph:node_builder_test PASSED in 1.1s //tensorflow/core/graph:optimizer_cse_test PASSED in 0.8s //tensorflow/core/graph:subgraph_test PASSED in 0.9s //tensorflow/core/graph:tensor_id_test PASSED in 1.1s //tensorflow/core/graph:validate_test PASSED in 1.1s //tensorflow/core/graph/regularization:simple_delete_test PASSED in 0.3s //tensorflow/core/graph/regularization:util_test PASSED in 0.3s //tensorflow/core/grappler:graph_topology_view_test PASSED in 0.1s //tensorflow/core/grappler:graph_view_test PASSED in 2.4s //tensorflow/core/grappler:grappler_item_builder_test PASSED in 2.2s //tensorflow/core/grappler:grappler_item_test PASSED in 2.3s //tensorflow/core/grappler:mutable_graph_view_test PASSED in 1.7s //tensorflow/core/grappler:utils_test PASSED in 3.4s //tensorflow/core/grappler/clusters:single_machine_test PASSED in 29.5s //tensorflow/core/grappler/clusters:virtual_cluster_test PASSED in 2.2s //tensorflow/core/grappler/costs:analytical_cost_estimator_test PASSED in 2.2s //tensorflow/core/grappler/costs:cost_estimator_test PASSED in 0.4s //tensorflow/core/grappler/costs:graph_memory_test PASSED in 2.0s //tensorflow/core/grappler/costs:graph_properties_test PASSED in 5.5s //tensorflow/core/grappler/costs:robust_stats_test PASSED in 0.1s //tensorflow/core/grappler/costs:utils_test PASSED in 1.6s //tensorflow/core/grappler/costs:virtual_placer_test PASSED in 0.4s //tensorflow/core/grappler/costs:virtual_scheduler_test PASSED in 2.0s //tensorflow/core/grappler/graph_analyzer:gen_node_test PASSED in 3.1s //tensorflow/core/grappler/graph_analyzer:graph_analyzer_test PASSED in 2.2s //tensorflow/core/grappler/graph_analyzer:hash_tools_test PASSED in 2.5s //tensorflow/core/grappler/graph_analyzer:sig_node_test PASSED in 3.9s //tensorflow/core/grappler/graph_analyzer:subgraph_test PASSED in 2.2s //tensorflow/core/grappler/inputs:utils_test PASSED in 1.1s //tensorflow/core/grappler/optimizers:arithmetic_optimizer_test_cpu PASSED in 10.8s //tensorflow/core/grappler/optimizers:auto_parallel_test_cpu PASSED in 2.4s //tensorflow/core/grappler/optimizers:common_subgraph_elimination_test_cpu PASSED in 2.9s //tensorflow/core/grappler/optimizers:custom_graph_optimizer_registry_test_cpu PASSED in 5.3s //tensorflow/core/grappler/optimizers:debug_stripper_test_cpu PASSED in 2.3s //tensorflow/core/grappler/optimizers:dependency_optimizer_test_cpu PASSED in 2.0s //tensorflow/core/grappler/optimizers:evaluation_utils_test PASSED in 0.8s //tensorflow/core/grappler/optimizers:function_api_info_test PASSED in 0.3s //tensorflow/core/grappler/optimizers:function_optimizer_test_cpu PASSED in 3.5s //tensorflow/core/grappler/optimizers:generic_layout_optimizer_test_cpu PASSED in 2.1s //tensorflow/core/grappler/optimizers:generic_layout_optimizer_transposer_factory_test PASSED in 0.2s //tensorflow/core/grappler/optimizers:generic_layout_optimizer_transposer_test_cpu PASSED in 5.6s //tensorflow/core/grappler/optimizers:graph_optimizer_stage_test_cpu PASSED in 2.4s //tensorflow/core/grappler/optimizers:implementation_selector_test PASSED in 3.1s //tensorflow/core/grappler/optimizers:loop_optimizer_test_cpu PASSED in 3.0s //tensorflow/core/grappler/optimizers:memory_optimizer_test_cpu PASSED in 3.4s //tensorflow/core/grappler/optimizers:meta_optimizer_test_cpu PASSED in 7.7s //tensorflow/core/grappler/optimizers:mkl_remapper_test PASSED in 3.9s //tensorflow/core/grappler/optimizers:model_pruner_test_cpu PASSED in 2.7s //tensorflow/core/grappler/optimizers:pin_to_host_optimizer_test_cpu PASSED in 2.3s //tensorflow/core/grappler/optimizers:scoped_allocator_optimizer_test PASSED in 4.3s //tensorflow/core/grappler/optimizers:shape_optimizer_test_cpu PASSED in 4.0s //tensorflow/core/grappler/optimizers:static_schedule_test_cpu PASSED in 1.7s //tensorflow/core/grappler/optimizers:tfg_optimizer_hook_test PASSED in 1.2s //tensorflow/core/grappler/optimizers/data:auto_shard_test PASSED in 0.6s //tensorflow/core/grappler/optimizers/data:autotune_buffer_sizes_test PASSED in 1.1s //tensorflow/core/grappler/optimizers/data:batch_parallelization_test PASSED in 0.6s //tensorflow/core/grappler/optimizers/data:disable_intra_op_parallelism_test PASSED in 0.7s //tensorflow/core/grappler/optimizers/data:disable_prefetch_legacy_autotune_test PASSED in 0.8s //tensorflow/core/grappler/optimizers/data:enable_gradient_descent_test PASSED in 0.8s //tensorflow/core/grappler/optimizers/data:filter_fusion_test PASSED in 1.8s //tensorflow/core/grappler/optimizers/data:filter_parallelization_test PASSED in 1.1s //tensorflow/core/grappler/optimizers/data:function_utils_test PASSED in 0.8s //tensorflow/core/grappler/optimizers/data:fusion_utils_test PASSED in 0.5s //tensorflow/core/grappler/optimizers/data:graph_utils_test PASSED in 0.7s //tensorflow/core/grappler/optimizers/data:inject_prefetch_test PASSED in 0.5s //tensorflow/core/grappler/optimizers/data:make_deterministic_test PASSED in 0.5s //tensorflow/core/grappler/optimizers/data:make_sloppy_test PASSED in 0.7s //tensorflow/core/grappler/optimizers/data:map_and_batch_fusion_test PASSED in 0.4s //tensorflow/core/grappler/optimizers/data:map_and_filter_fusion_test PASSED in 0.6s //tensorflow/core/grappler/optimizers/data:map_fusion_test PASSED in 0.6s //tensorflow/core/grappler/optimizers/data:map_parallelization_test PASSED in 0.7s //tensorflow/core/grappler/optimizers/data:noop_elimination_test PASSED in 0.5s //tensorflow/core/grappler/optimizers/data:parallel_batch_test PASSED in 0.5s //tensorflow/core/grappler/optimizers/data:replicate_on_split_test PASSED in 0.8s //tensorflow/core/grappler/optimizers/data:shuffle_and_repeat_fusion_test PASSED in 0.4s //tensorflow/core/grappler/optimizers/data:slack_test PASSED in 1.4s //tensorflow/core/grappler/optimizers/data:split_utils_test PASSED in 1.7s //tensorflow/core/grappler/optimizers/data:use_private_thread_pool_test PASSED in 0.8s //tensorflow/core/grappler/optimizers/inference:batch_op_rewriter_test PASSED in 1.0s //tensorflow/core/grappler/utils:canonicalizer_test PASSED in 1.8s //tensorflow/core/grappler/utils:colocation_test PASSED in 0.6s //tensorflow/core/grappler/utils:frame_test PASSED in 0.4s //tensorflow/core/grappler/utils:functions_test PASSED in 1.5s //tensorflow/core/grappler/utils:graph_view_internal_test PASSED in 0.5s //tensorflow/core/grappler/utils:graph_view_test PASSED in 2.4s //tensorflow/core/grappler/utils:grappler_test_test PASSED in 7.1s //tensorflow/core/grappler/utils:pattern_utils_test PASSED in 1.0s //tensorflow/core/grappler/utils:scc_test PASSED in 2.0s //tensorflow/core/grappler/utils:symbolic_shapes_test PASSED in 0.5s //tensorflow/core/grappler/utils:topological_sort_test PASSED in 1.5s //tensorflow/core/grappler/utils:tpu_test PASSED in 0.1s //tensorflow/core/grappler/utils:transitive_fanin_test PASSED in 0.5s //tensorflow/core/grappler/utils:traversal_test PASSED in 0.5s //tensorflow/core/grappler/verifiers:structure_verifier_test PASSED in 3.0s //tensorflow/core/ir:interfaces_test PASSED in 0.4s //tensorflow/core/ir:ops_test PASSED in 0.4s //tensorflow/core/ir:shape_inference_utils_test PASSED in 0.3s //tensorflow/core/ir:tf_op_registry_test PASSED in 0.4s //tensorflow/core/ir:tf_op_wrapper_test PASSED in 0.3s //tensorflow/core/ir:utility_test PASSED in 0.2s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:arg_as_control_ret.pbtxt.test PASSED in 0.9s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:backedge_segment.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:empty.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:error_during_backedge.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:import_case_with_attr_inference.pbtxt.test PASSED in 1.1s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:import_if_with_attr_inference.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:import_iterator_get_next_attr_inference.pbtxt.test PASSED in 0.7s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:import_underscore_output_shapes.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:import_while_with_attr_inference.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:infeed_dequeue.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:infer_arg_handle_type.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:infer_with_output_shapes.pbtxt.test PASSED in 1.3s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_arg_name.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_backedge_input_size.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_duplicated_node_name.pbtxt.test PASSED in 0.4s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_edge_index.pbtxt.test PASSED in 1.0s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_edge_name.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_empty_attr_key.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_empty_func_attr_key.pbtxt.test PASSED in 0.6s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_empty_func_attr_name.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_empty_op_type.pbtxt.test PASSED in 0.7s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_func_with_empty_name.pbtxt.test PASSED in 0.7s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_function_import.pbtxt.test PASSED in 1.7s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_generic_func_with_empty_control_result.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_generic_func_with_empty_input.pbtxt.test PASSED in 0.9s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_generic_func_with_empty_name.pbtxt.test PASSED in 0.8s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_generic_func_with_empty_result.pbtxt.test PASSED in 1.2s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_generic_function_attr_name.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_generic_function_named_edge_index.pbtxt.test PASSED in 0.4s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_handle_data.pbtxt.test PASSED in 0.6s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_missing_control_input.pbtxt.test PASSED in 0.6s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_missing_control_result.pbtxt.test PASSED in 0.9s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_missing_control_result_value.pbtxt.test PASSED in 1.1s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_missing_data_result.pbtxt.test PASSED in 0.6s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_missing_data_result_value.pbtxt.test PASSED in 0.6s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_missing_input.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_missing_two_inputs.pbtxt.test PASSED in 0.4s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_named_edge_index.pbtxt.test PASSED in 0.8s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_op_name.pbtxt.test PASSED in 0.4s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:invalid_type_list.pbtxt.test PASSED in 0.4s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:legacy_call.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:negative_shape.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:negative_zero_constant.pbtxt.test PASSED in 0.6s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:three_nodes_with_attrs.pbtxt.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/graphdef_to_mlir:version.pbtxt.test PASSED in 0.6s //tensorflow/core/ir/importexport/tests/mlir_to_graphdef:empty.mlir.test PASSED in 1.0s //tensorflow/core/ir/importexport/tests/mlir_to_graphdef:fulltype.mlir.test PASSED in 1.1s //tensorflow/core/ir/importexport/tests/mlir_to_graphdef:func_with_no_args_or_results.mlir.test PASSED in 0.7s //tensorflow/core/ir/importexport/tests/mlir_to_graphdef:negative_zero_constant.mlir.test PASSED in 0.5s //tensorflow/core/ir/importexport/tests/mlir_to_graphdef:nested_legacy_call.mlir.test PASSED in 0.9s //tensorflow/core/ir/importexport/tests/mlir_to_graphdef:three_nodes_with_attrs.mlir.test PASSED in 0.7s //tensorflow/core/ir/importexport/tests/mlir_to_graphdef:version.mlir.test PASSED in 0.6s //tensorflow/core/ir/importexport/tests/saved_model:saved_model_roundtrip_test PASSED in 0.3s //tensorflow/core/ir/tests:attributes.mlir.test PASSED in 0.6s //tensorflow/core/ir/tests:canonicalize.mlir.test PASSED in 0.9s //tensorflow/core/ir/tests:compatible_types.mlir.test PASSED in 0.4s //tensorflow/core/ir/tests:concrete-ops.mlir.test PASSED in 0.5s //tensorflow/core/ir/tests:generic_concrete_ops.mlir.test PASSED in 0.4s //tensorflow/core/ir/tests:invalid-concrete-ops.mlir.test PASSED in 0.6s //tensorflow/core/ir/tests:invalid-preserved-attrs.mlir.test PASSED in 0.5s //tensorflow/core/ir/tests:invalid.mlir.test PASSED in 0.6s //tensorflow/core/ir/tests:invalid_types.mlir.test PASSED in 0.5s //tensorflow/core/ir/tests:ops.mlir.test PASSED in 0.5s //tensorflow/core/ir/tests:region-invalid-ops.mlir.test PASSED in 0.6s //tensorflow/core/ir/tests:region-ops-graph.mlir.test PASSED in 1.7s //tensorflow/core/ir/tests:region-ops.mlir.test PASSED in 0.5s //tensorflow/core/ir/tests:types.mlir.test PASSED in 0.4s //tensorflow/core/ir/types:dialect_test PASSED in 0.8s //tensorflow/core/kernels:as_string_op_test PASSED in 0.7s //tensorflow/core/kernels:basic_ops_benchmark_test PASSED in 0.7s //tensorflow/core/kernels:batch_kernels_env_test PASSED in 0.7s //tensorflow/core/kernels:batch_kernels_test PASSED in 0.5s //tensorflow/core/kernels:bias_op_test PASSED in 0.6s //tensorflow/core/kernels:bincount_op_test_cpu PASSED in 0.8s //tensorflow/core/kernels:broadcast_to_op_test_cpu PASSED in 0.6s //tensorflow/core/kernels:cast_op_test_cpu PASSED in 3.2s //tensorflow/core/kernels:checkpoint_callback_manager_test PASSED in 1.2s //tensorflow/core/kernels:clustering_ops_test PASSED in 0.5s //tensorflow/core/kernels:composite_tensor_variant_test PASSED in 1.0s //tensorflow/core/kernels:concat_op_test PASSED in 0.6s //tensorflow/core/kernels:constant_op_test_cpu PASSED in 0.8s //tensorflow/core/kernels:control_flow_ops_test PASSED in 7.8s //tensorflow/core/kernels:conv_grad_filter_ops_benchmark_test_cpu PASSED in 0.7s //tensorflow/core/kernels:conv_grad_input_ops_benchmark_test_cpu PASSED in 0.6s //tensorflow/core/kernels:conv_ops_benchmark_test_cpu PASSED in 0.7s //tensorflow/core/kernels:conv_ops_test_cpu PASSED in 9.2s //tensorflow/core/kernels:count_ops_test PASSED in 0.8s //tensorflow/core/kernels:cross_op_test PASSED in 0.8s //tensorflow/core/kernels:cwise_ops_test_cpu PASSED in 1.0s //tensorflow/core/kernels:debug_ops_test PASSED in 1.6s //tensorflow/core/kernels:decode_wav_op_test PASSED in 2.0s //tensorflow/core/kernels:deep_conv2d_test PASSED in 0.4s //tensorflow/core/kernels:dequantize_op_test PASSED in 0.7s //tensorflow/core/kernels:diag_op_test_cpu PASSED in 0.5s //tensorflow/core/kernels:dynamic_partition_op_test_cpu PASSED in 0.6s //tensorflow/core/kernels:dynamic_stitch_op_test_cpu PASSED in 0.6s //tensorflow/core/kernels:eigen_activations_test PASSED in 0.2s //tensorflow/core/kernels:eigen_attention_test PASSED in 0.3s //tensorflow/core/kernels:eigen_backward_cuboid_convolutions_test PASSED in 0.4s //tensorflow/core/kernels:eigen_backward_spatial_convolutions_test PASSED in 0.4s //tensorflow/core/kernels:eigen_benchmark_cpu_test PASSED in 0.5s //tensorflow/core/kernels:eigen_mkldnn_contraction_kernel_test PASSED in 0.2s //tensorflow/core/kernels:eigen_pooling_test PASSED in 0.4s //tensorflow/core/kernels:encode_wav_op_test PASSED in 2.0s //tensorflow/core/kernels:fingerprint_op_test PASSED in 0.6s //tensorflow/core/kernels:fused_batch_norm_ex_op_test_cpu PASSED in 0.8s //tensorflow/core/kernels:fused_batch_norm_op_test_cpu PASSED in 0.9s //tensorflow/core/kernels:gather_nd_op_test_cpu PASSED in 1.2s //tensorflow/core/kernels:gather_op_test_cpu PASSED in 1.3s //tensorflow/core/kernels:guarantee_const_op_test PASSED in 0.7s //tensorflow/core/kernels:identity_n_op_test PASSED in 0.8s //tensorflow/core/kernels:identity_op_test PASSED in 1.4s //tensorflow/core/kernels:immutable_constant_op_test PASSED in 2.0s //tensorflow/core/kernels:in_topk_op_test PASSED in 0.6s //tensorflow/core/kernels:isotonic_regression_op_test PASSED in 0.8s //tensorflow/core/kernels:logging_ops_test PASSED in 2.0s //tensorflow/core/kernels:lookup_ops_test PASSED in 0.6s //tensorflow/core/kernels:loss_test PASSED in 0.1s //tensorflow/core/kernels:lrn_op_test_cpu PASSED in 0.6s //tensorflow/core/kernels:matmul_op_test_cpu PASSED in 6.8s //tensorflow/core/kernels:merge_v2_checkpoints_op_test PASSED in 0.8s //tensorflow/core/kernels:mfcc_dct_test PASSED in 0.2s //tensorflow/core/kernels:mfcc_mel_filterbank_test PASSED in 0.1s //tensorflow/core/kernels:mfcc_op_test_cpu PASSED in 3.5s //tensorflow/core/kernels:mfcc_test PASSED in 0.1s //tensorflow/core/kernels:multinomial_op_test_cpu PASSED in 0.6s //tensorflow/core/kernels:nn_ops_test_cpu PASSED in 0.8s //tensorflow/core/kernels:one_hot_op_test PASSED in 0.5s //tensorflow/core/kernels:ops_testutil_test PASSED in 0.6s //tensorflow/core/kernels:ops_util_test PASSED in 0.4s //tensorflow/core/kernels:parameterized_truncated_normal_op_test_cpu PASSED in 0.7s //tensorflow/core/kernels:parse_tensor_test PASSED in 1.5s //tensorflow/core/kernels:quantization_utils_test PASSED in 0.5s //tensorflow/core/kernels:quantize_and_dequantize_op_test_cpu PASSED in 1.0s //tensorflow/core/kernels:quantize_down_and_shrink_range_op_test PASSED in 0.6s //tensorflow/core/kernels:quantize_op_test PASSED in 0.9s //tensorflow/core/kernels:quantized_activation_ops_test PASSED in 0.6s //tensorflow/core/kernels:quantized_add_op_test PASSED in 1.3s //tensorflow/core/kernels:quantized_batch_norm_op_test PASSED in 0.7s //tensorflow/core/kernels:quantized_bias_add_op_test PASSED in 1.1s //tensorflow/core/kernels:quantized_concat_op_test PASSED in 0.9s //tensorflow/core/kernels:quantized_conv_ops_test PASSED in 0.8s //tensorflow/core/kernels:quantized_instance_norm_test PASSED in 1.0s //tensorflow/core/kernels:quantized_matmul_op_test PASSED in 0.6s //tensorflow/core/kernels:quantized_mul_op_test PASSED in 1.2s //tensorflow/core/kernels:quantized_pooling_ops_test PASSED in 0.7s //tensorflow/core/kernels:quantized_reshape_op_test PASSED in 0.6s //tensorflow/core/kernels:quantized_resize_bilinear_op_test PASSED in 2.4s //tensorflow/core/kernels:ragged_gather_op_test PASSED in 0.7s //tensorflow/core/kernels:ragged_range_op_test PASSED in 0.6s //tensorflow/core/kernels:ragged_tensor_from_variant_op_test PASSED in 0.7s //tensorflow/core/kernels:ragged_tensor_to_sparse_kernel_test PASSED in 0.9s //tensorflow/core/kernels:ragged_tensor_to_tensor_op_test PASSED in 1.5s //tensorflow/core/kernels:ragged_tensor_to_variant_op_test PASSED in 1.1s //tensorflow/core/kernels:random_binomial_op_test_cpu PASSED in 0.5s //tensorflow/core/kernels:random_index_shuffle_test PASSED in 0.3s //tensorflow/core/kernels:random_op_test_cpu PASSED in 0.5s //tensorflow/core/kernels:random_poisson_op_test_cpu PASSED in 0.7s //tensorflow/core/kernels:range_sampler_test PASSED in 0.2s //tensorflow/core/kernels:reduction_ops_test_cpu PASSED in 1.0s //tensorflow/core/kernels:regex_replace_op_test PASSED in 0.6s //tensorflow/core/kernels:requantization_range_op_test PASSED in 1.0s //tensorflow/core/kernels:requantize_op_test PASSED in 0.7s //tensorflow/core/kernels:resource_ops_test PASSED in 0.8s //tensorflow/core/kernels:restore_op_test PASSED in 1.0s //tensorflow/core/kernels:restore_v2_op_test PASSED in 0.9s //tensorflow/core/kernels:reverse_op_test PASSED in 1.5s //tensorflow/core/kernels:roll_op_test PASSED in 0.9s //tensorflow/core/kernels:save_op_test PASSED in 1.0s //tensorflow/core/kernels:save_v2_op_test PASSED in 1.0s //tensorflow/core/kernels:scan_ops_test_cpu PASSED in 0.7s //tensorflow/core/kernels:scatter_nd_op_test_cpu PASSED in 1.0s //tensorflow/core/kernels:scatter_op_test PASSED in 1.0s //tensorflow/core/kernels:scoped_allocator_ops_test_cpu PASSED in 6.7s //tensorflow/core/kernels:sdca_ops_test PASSED in 2.1s //tensorflow/core/kernels:segment_reduction_ops_test PASSED in 0.9s //tensorflow/core/kernels:sendrecv_ops_test PASSED in 0.9s //tensorflow/core/kernels:sequence_ops_test PASSED in 0.7s //tensorflow/core/kernels:shape_ops_test PASSED in 0.5s //tensorflow/core/kernels:slice_op_test PASSED in 0.4s //tensorflow/core/kernels:spacetobatch_benchmark_test_cpu PASSED in 0.6s //tensorflow/core/kernels:sparse_add_op_test PASSED in 0.5s //tensorflow/core/kernels:sparse_dense_binary_op_shared_test PASSED in 0.7s //tensorflow/core/kernels:sparse_matmul_op_test_cpu PASSED in 1.4s //tensorflow/core/kernels:sparse_reduce_sum_op_test PASSED in 0.5s //tensorflow/core/kernels:sparse_tensor_dense_matmul_op_test_cpu PASSED in 0.8s //tensorflow/core/kernels:sparse_to_dense_op_test_cpu PASSED in 0.9s //tensorflow/core/kernels:sparse_utils_test PASSED in 0.4s //tensorflow/core/kernels:sparse_xent_op_test_cpu PASSED in 0.7s //tensorflow/core/kernels:spectrogram_op_test_cpu PASSED in 2.2s //tensorflow/core/kernels:spectrogram_test PASSED in 0.2s //tensorflow/core/kernels:split_op_test_cpu PASSED in 2.2s //tensorflow/core/kernels:split_v_op_test_cpu PASSED in 0.7s //tensorflow/core/kernels:strided_slice_op_test PASSED in 0.6s //tensorflow/core/kernels:string_format_op_test PASSED in 0.6s //tensorflow/core/kernels:string_ngrams_op_test PASSED in 0.7s //tensorflow/core/kernels:string_split_op_test PASSED in 0.6s //tensorflow/core/kernels:substr_op_test PASSED in 0.7s //tensorflow/core/kernels:summary_audio_op_test PASSED in 1.0s //tensorflow/core/kernels:summary_image_op_test PASSED in 0.8s //tensorflow/core/kernels:summary_op_test PASSED in 0.7s //tensorflow/core/kernels:summary_tensor_op_test PASSED in 0.6s //tensorflow/core/kernels:tensor_cord_test PASSED in 0.3s //tensorflow/core/kernels:tensor_flag_utils_test PASSED in 0.2s //tensorflow/core/kernels:tensor_map_test PASSED in 0.2s //tensorflow/core/kernels:training_ops_test PASSED in 0.5s //tensorflow/core/kernels:transpose_util_test PASSED in 0.5s //tensorflow/core/kernels:unary_ops_composition_test_cpu PASSED in 3.4s //tensorflow/core/kernels:unique_op_test PASSED in 0.8s //tensorflow/core/kernels:variable_ops_test PASSED in 2.1s //tensorflow/core/kernels:while_op_test PASSED in 0.9s //tensorflow/core/kernels:xent_op_test_cpu PASSED in 0.6s //tensorflow/core/kernels/batching_util:basic_batch_scheduler_test PASSED in 0.4s //tensorflow/core/kernels/batching_util:batch_input_task_test PASSED in 0.6s //tensorflow/core/kernels/batching_util:batch_resource_base_test PASSED in 0.2s //tensorflow/core/kernels/batching_util:batch_scheduler_test PASSED in 0.5s //tensorflow/core/kernels/batching_util:bounded_executor_test PASSED in 20.3s //tensorflow/core/kernels/batching_util:input_split_metadata_test PASSED in 0.1s //tensorflow/core/kernels/batching_util:periodic_function_test PASSED in 3.7s //tensorflow/core/kernels/batching_util:serial_device_batch_scheduler_test PASSED in 2.5s //tensorflow/core/kernels/batching_util:shared_batch_scheduler_test PASSED in 3.9s //tensorflow/core/kernels/batching_util:threadsafe_status_test PASSED in 0.1s //tensorflow/core/kernels/data:batch_dataset_op_test PASSED in 2.5s //tensorflow/core/kernels/data:cache_dataset_ops_test PASSED in 1.4s //tensorflow/core/kernels/data:concatenate_dataset_op_test PASSED in 0.8s //tensorflow/core/kernels/data:filter_dataset_op_test PASSED in 1.5s //tensorflow/core/kernels/data:finalize_dataset_op_test PASSED in 1.4s //tensorflow/core/kernels/data:fixed_length_record_dataset_op_test PASSED in 0.8s //tensorflow/core/kernels/data:flat_map_dataset_op_test PASSED in 1.2s //tensorflow/core/kernels/data:get_options_op_test PASSED in 1.0s //tensorflow/core/kernels/data:interleave_dataset_op_test PASSED in 1.2s //tensorflow/core/kernels/data:iterator_ops_test PASSED in 1.2s //tensorflow/core/kernels/data:map_dataset_op_test PASSED in 1.2s //tensorflow/core/kernels/data:map_defun_op_test PASSED in 1.1s //tensorflow/core/kernels/data:optimize_dataset_op_test PASSED in 0.9s //tensorflow/core/kernels/data:options_dataset_op_test PASSED in 1.1s //tensorflow/core/kernels/data:padded_batch_dataset_op_test PASSED in 0.8s //tensorflow/core/kernels/data:parallel_batch_dataset_op_test PASSED in 1.9s //tensorflow/core/kernels/data:parallel_filter_dataset_op_test PASSED in 1.1s //tensorflow/core/kernels/data:parallel_interleave_dataset_op_test PASSED in 1.0s //tensorflow/core/kernels/data:parallel_map_dataset_op_test PASSED in 1.3s //tensorflow/core/kernels/data:prefetch_autotuner_test PASSED in 0.2s //tensorflow/core/kernels/data:prefetch_dataset_op_test PASSED in 1.4s //tensorflow/core/kernels/data:range_dataset_op_test PASSED in 1.5s //tensorflow/core/kernels/data:reduce_dataset_op_test PASSED in 1.2s //tensorflow/core/kernels/data:repeat_dataset_op_test PASSED in 1.6s //tensorflow/core/kernels/data:rewrite_dataset_op_test PASSED in 0.8s //tensorflow/core/kernels/data:shard_dataset_op_test PASSED in 1.1s //tensorflow/core/kernels/data:shuffle_dataset_op_test PASSED in 1.0s //tensorflow/core/kernels/data:skip_dataset_op_test PASSED in 0.7s //tensorflow/core/kernels/data:sparse_tensor_slice_dataset_op_test PASSED in 1.2s //tensorflow/core/kernels/data:take_dataset_op_test PASSED in 0.9s //tensorflow/core/kernels/data:tensor_dataset_op_test PASSED in 0.8s //tensorflow/core/kernels/data:tensor_slice_dataset_op_test PASSED in 1.3s //tensorflow/core/kernels/data:text_line_dataset_op_test PASSED in 0.7s //tensorflow/core/kernels/data:tf_record_dataset_op_test PASSED in 1.3s //tensorflow/core/kernels/data:window_dataset_op_test PASSED in 1.6s //tensorflow/core/kernels/data:zip_dataset_op_test PASSED in 1.2s //tensorflow/core/kernels/data/experimental:assert_next_dataset_op_test PASSED in 0.7s //tensorflow/core/kernels/data/experimental:assert_prev_dataset_op_test PASSED in 0.9s //tensorflow/core/kernels/data/experimental:auto_shard_dataset_op_test PASSED in 1.8s //tensorflow/core/kernels/data/experimental:directed_interleave_dataset_op_test PASSED in 0.6s //tensorflow/core/kernels/data/experimental:list_dataset_op_test PASSED in 1.8s //tensorflow/core/kernels/data/experimental:lmdb_dataset_op_test PASSED in 0.8s //tensorflow/core/kernels/data/experimental:map_and_batch_dataset_op_test PASSED in 1.3s //tensorflow/core/kernels/data/experimental:parallel_interleave_dataset_op_test PASSED in 1.3s //tensorflow/core/kernels/data/experimental:random_dataset_op_test PASSED in 0.7s //tensorflow/core/kernels/data/experimental:sampling_dataset_op_test PASSED in 1.6s //tensorflow/core/kernels/data/experimental:save_dataset_op_test PASSED in 1.3s //tensorflow/core/kernels/data/experimental:unique_dataset_op_test PASSED in 0.6s //tensorflow/core/kernels/image:adjust_contrast_op_benchmark_test_cpu PASSED in 0.5s //tensorflow/core/kernels/image:adjust_contrast_op_test PASSED in 0.9s //tensorflow/core/kernels/image:colorspace_op_test PASSED in 0.8s //tensorflow/core/kernels/image:crop_and_resize_op_benchmark_test_cpu PASSED in 0.7s //tensorflow/core/kernels/image:crop_and_resize_op_test PASSED in 1.9s //tensorflow/core/kernels/image:encode_jpeg_op_test PASSED in 1.0s //tensorflow/core/kernels/image:mirror_pad_op_benchmark_test_cpu PASSED in 0.6s //tensorflow/core/kernels/image:mirror_pad_op_test PASSED in 0.8s //tensorflow/core/kernels/image:non_max_suppression_op_benchmark_test PASSED in 1.1s //tensorflow/core/kernels/image:non_max_suppression_op_test PASSED in 1.0s //tensorflow/core/kernels/image:resize_area_op_test PASSED in 1.3s //tensorflow/core/kernels/image:resize_benchmark_test_cpu PASSED in 0.5s //tensorflow/core/kernels/image:resize_bicubic_op_test PASSED in 3.9s //tensorflow/core/kernels/image:resize_ops_test_cpu PASSED in 3.5s //tensorflow/core/kernels/image:sampling_kernels_test PASSED in 0.5s //tensorflow/core/kernels/image:scale_and_translate_op_test PASSED in 1.9s //tensorflow/core/kernels/linalg:banded_triangular_solve_op_test_cpu PASSED in 1.0s //tensorflow/core/kernels/linalg:matrix_triangular_solve_op_test_cpu PASSED in 0.7s //tensorflow/core/kernels/mkl:mkl_conv_ops_test PASSED in 0.2s //tensorflow/core/kernels/mkl:mkl_dequantize_op_test PASSED in 0.4s //tensorflow/core/kernels/mkl:mkl_fused_batch_norm_op_test PASSED in 0.6s //tensorflow/core/kernels/mkl:mkl_fused_ops_test PASSED in 2.0s //tensorflow/core/kernels/mkl:mkl_matmul_op_benchmark PASSED in 0.2s //tensorflow/core/kernels/mkl:mkl_qmatmul_op_test PASSED in 0.4s //tensorflow/core/kernels/mkl:mkl_quantize_op_test PASSED in 0.1s //tensorflow/core/kernels/mkl:mkl_quantized_concat_op_test PASSED in 0.2s //tensorflow/core/kernels/mkl:mkl_quantized_conv_ops_perchannel_test PASSED in 0.2s //tensorflow/core/kernels/mkl:mkl_quantized_conv_ops_test PASSED in 0.3s //tensorflow/core/kernels/mkl:mkl_quantized_pooling_ops_test PASSED in 0.3s //tensorflow/core/kernels/mkl:mkl_relu_op_test PASSED in 0.1s //tensorflow/core/kernels/mkl:mkl_requantize_ops_test PASSED in 0.2s //tensorflow/core/kernels/mkl:mkl_swish_op_test PASSED in 0.2s //tensorflow/core/kernels/mkl:onednn_nn_ops_benchmark PASSED in 0.2s //tensorflow/core/kernels/sparse:kernels_test PASSED in 0.6s //tensorflow/core/kernels/uniform_quant_ops:math_utils_test PASSED in 0.2s //tensorflow/core/kernels/uniform_quant_ops:tensor_utils_test PASSED in 0.2s //tensorflow/core/kernels/uniform_quant_ops:uniform_dequantize_op_test PASSED in 1.4s //tensorflow/core/kernels/uniform_quant_ops:uniform_quantize_op_test PASSED in 0.6s //tensorflow/core/kernels/uniform_quant_ops:uniform_quantized_add_op_test PASSED in 0.5s //tensorflow/core/kernels/uniform_quant_ops:uniform_quantized_clip_by_value_op_test PASSED in 0.6s //tensorflow/core/kernels/uniform_quant_ops:uniform_quantized_convolution_ops_test PASSED in 0.8s //tensorflow/core/kernels/uniform_quant_ops:uniform_quantized_dot_ops_test PASSED in 1.0s //tensorflow/core/kernels/uniform_quant_ops:uniform_requantize_op_test PASSED in 0.7s //tensorflow/core/lib/db:sqlite_test PASSED in 0.2s //tensorflow/core/lib/gif:lib_gif_io_test PASSED in 1.4s //tensorflow/core/lib/jpeg:lib_jpeg_jpeg_mem_unittest PASSED in 0.6s //tensorflow/core/ops:cudnn_rnn_ops_test_cc PASSED in 0.6s //tensorflow/core/ops:ops_array_grad_test PASSED in 1.8s //tensorflow/core/ops:ops_math_grad_test PASSED in 4.9s //tensorflow/core/ops:ops_tests PASSED in 1.0s //tensorflow/core/ops/compat:backwards_compatibility_test PASSED in 0.6s //tensorflow/core/platform:__tensorflow_tsl_platform_profile_utils_cpu_utils_test PASSED in 0.4s //tensorflow/core/platform:enable_tf2_utils_test PASSED in 0.1s //tensorflow/core/platform:env_test PASSED in 3.1s //tensorflow/core/platform:fake_python_env_test PASSED in 0.2s //tensorflow/core/platform:file_system_test PASSED in 1.7s //tensorflow/core/platform:platform_strings_test PASSED in 0.3s //tensorflow/core/platform:resource_loader_test PASSED in 0.2s //tensorflow/core/platform:vmodule_benchmark_test PASSED in 0.2s //tensorflow/core/platform:vmodule_test PASSED in 0.3s //tensorflow/core/profiler/backends/cpu:host_tracer_test PASSED in 0.2s //tensorflow/core/profiler/convert:hlo_proto_to_graph_view_test PASSED in 0.3s //tensorflow/core/profiler/convert:hlo_proto_to_memory_visualization_utils_test PASSED in 4.5s //tensorflow/core/profiler/convert:op_stats_to_pod_stats_test PASSED in 0.1s //tensorflow/core/profiler/convert:op_stats_to_pod_viewer_test PASSED in 0.4s //tensorflow/core/profiler/convert:op_stats_to_tf_stats_test PASSED in 0.2s //tensorflow/core/profiler/convert:xplane_to_kernel_stats_db_test PASSED in 0.1s //tensorflow/core/profiler/convert:xplane_to_memory_profile_test PASSED in 0.1s //tensorflow/core/profiler/convert:xplane_to_op_metrics_db_test PASSED in 0.2s //tensorflow/core/profiler/convert:xplane_to_op_stats_test PASSED in 0.3s //tensorflow/core/profiler/convert:xplane_to_step_events_test PASSED in 0.2s //tensorflow/core/profiler/convert:xplane_to_tf_functions_test PASSED in 0.7s //tensorflow/core/profiler/convert:xplane_to_tool_names_test PASSED in 0.1s //tensorflow/core/profiler/internal:tfprof_show_test PASSED in 0.8s //tensorflow/core/profiler/internal:tfprof_stats_test PASSED in 1.3s //tensorflow/core/profiler/internal:tfprof_tensor_test PASSED in 0.6s //tensorflow/core/profiler/internal:tfprof_timeline_test PASSED in 0.6s //tensorflow/core/profiler/internal/advisor:tfprof_advisor_test PASSED in 0.5s //tensorflow/core/profiler/lib:profiler_disabled_test PASSED in 0.2s //tensorflow/core/profiler/utils:derived_timeline_test PASSED in 0.2s //tensorflow/core/profiler/utils:kernel_stats_utils_test PASSED in 0.1s //tensorflow/core/profiler/utils:op_metrics_db_utils_test PASSED in 0.6s //tensorflow/core/profiler/utils:step_intersection_test PASSED in 0.1s //tensorflow/core/summary:schema_test PASSED in 0.2s //tensorflow/core/summary:summary_db_writer_test PASSED in 0.3s //tensorflow/core/summary:summary_file_writer_test PASSED in 0.1s //tensorflow/core/tfrt/common:pjrt_state_test PASSED in 4.8s //tensorflow/core/tfrt/common:pjrt_util_test PASSED in 6.7s //tensorflow/core/tfrt/fallback:cost_recorder_test PASSED in 0.3s //tensorflow/core/tfrt/fallback:fallback_state_test PASSED in 0.5s //tensorflow/core/transforms:eval_utils_test PASSED in 1.9s //tensorflow/core/transforms:graph_transform_wrapper_test PASSED in 0.3s //tensorflow/core/util:bcast_test PASSED in 0.7s //tensorflow/core/util:command_line_flags_test PASSED in 1.0s //tensorflow/core/util:debug_events_writer_test PASSED in 0.2s //tensorflow/core/util:dump_graph_test PASSED in 1.1s //tensorflow/core/util:equal_graph_def_test PASSED in 0.7s //tensorflow/core/util:events_writer_test PASSED in 3.1s //tensorflow/core/util:example_proto_fast_parsing_test PASSED in 1.1s //tensorflow/core/util:example_proto_helper_test PASSED in 0.8s //tensorflow/core/util:exec_on_stall_test PASSED in 2.3s //tensorflow/core/util:fake_clock_env_test PASSED in 1.8s //tensorflow/core/util:incremental_barrier_test PASSED in 0.2s //tensorflow/core/util:matmul_bcast_test PASSED in 0.8s //tensorflow/core/util:memmapped_file_system_test PASSED in 1.1s //tensorflow/core/util:overflow_test PASSED in 0.7s //tensorflow/core/util:presized_cuckoo_map_test PASSED in 2.4s //tensorflow/core/util:ragged_to_dense_util_test PASSED in 0.9s //tensorflow/core/util:reffed_status_callback_test PASSED in 0.9s //tensorflow/core/util:reporter_test PASSED in 1.1s //tensorflow/core/util:saved_tensor_slice_util_test PASSED in 0.9s //tensorflow/core/util:semver_test PASSED in 0.9s //tensorflow/core/util:stat_summarizer_test PASSED in 0.8s //tensorflow/core/util:strided_slice_op_test PASSED in 1.1s //tensorflow/core/util:tensor_format_test PASSED in 0.7s //tensorflow/core/util:tensor_slice_reader_test PASSED in 0.8s //tensorflow/core/util:tensor_slice_set_test PASSED in 0.8s //tensorflow/core/util:tensor_slice_util_test PASSED in 0.8s //tensorflow/core/util:tensor_slice_writer_test PASSED in 1.5s //tensorflow/core/util:work_sharder_test PASSED in 0.8s //tensorflow/core/util/ctc:ctc_beam_search_test PASSED in 0.1s //tensorflow/core/util/proto:descriptor_pool_registry_test PASSED in 0.4s //tensorflow/core/util/proto:proto_utils_test PASSED in 1.5s //tensorflow/core/util/quantization:uniform_quant_ops_params_test PASSED in 0.5s //tensorflow/core/util/sparse:sparse_tensor_test PASSED in 0.3s //tensorflow/core/util/tensor_bundle:tensor_bundle_test PASSED in 32.8s //tensorflow/dtensor/mlir:dtensor_location_test PASSED in 0.1s //tensorflow/dtensor/mlir:group_assignment_test PASSED in 0.3s //tensorflow/dtensor/mlir/tests:annotate_global_shape.mlir.test PASSED in 0.7s //tensorflow/dtensor/mlir/tests:cluster_function_conversion.mlir.test PASSED in 0.8s //tensorflow/dtensor/mlir/tests:constant_folding.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:designate_resource_handle_mesh.mlir.test PASSED in 0.4s //tensorflow/dtensor/mlir/tests:device_mesh_cluster_coarsening.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:dtensor_all_gather.mlir.test PASSED in 0.6s //tensorflow/dtensor/mlir/tests:dtensor_all_scatter.mlir.test PASSED in 0.6s //tensorflow/dtensor/mlir/tests:dtensor_allreduce_combine_optimization.mlir.test PASSED in 0.8s //tensorflow/dtensor/mlir/tests:dtensor_allreduce_lowering.mlir.test PASSED in 1.3s //tensorflow/dtensor/mlir/tests:dtensor_allreduce_scatter_optimization.mlir.test PASSED in 0.7s //tensorflow/dtensor/mlir/tests:dtensor_allreduce_sum_optimization.mlir.test PASSED in 0.7s //tensorflow/dtensor/mlir/tests:dtensor_mixed_precision_reduce.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:dtensor_reduce_scatter_lowering.mlir.test PASSED in 0.8s //tensorflow/dtensor/mlir/tests:dtensor_remove_dtensorlayout.mlir.test PASSED in 0.7s //tensorflow/dtensor/mlir/tests:dtensor_replace_auxiliary_layout_op.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:dtensor_set_hlo_sharding.mlir.test PASSED in 0.9s //tensorflow/dtensor/mlir/tests:dtensor_set_hlo_sharding_default.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:dtensor_xla_spmd_integration.mlir.test PASSED in 0.7s //tensorflow/dtensor/mlir/tests:elide_identity_before_copy_to_mesh.mlir.test PASSED in 0.7s //tensorflow/dtensor/mlir/tests:function_renaming.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:handle_cross_cluster_dependencies.mlir.test PASSED in 0.9s //tensorflow/dtensor/mlir/tests:handle_sparsetensors.mlir.test PASSED in 0.6s //tensorflow/dtensor/mlir/tests:layout_propagation_v2.mlir.test PASSED in 0.9s //tensorflow/dtensor/mlir/tests:lower_send_recv.mlir.test PASSED in 0.6s //tensorflow/dtensor/mlir/tests:merge_clusters.mlir.test PASSED in 0.9s //tensorflow/dtensor/mlir/tests:mesh_propagation.mlir.test PASSED in 0.7s //tensorflow/dtensor/mlir/tests:op_to_device_cluster.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:propagate_default_layout.mlir.test PASSED in 0.8s //tensorflow/dtensor/mlir/tests:propagate_device_id_to_function.mlir.test PASSED in 0.6s //tensorflow/dtensor/mlir/tests:restore_and_assign.mlir.test PASSED in 0.8s //tensorflow/dtensor/mlir/tests:restore_shape_inference.mlir.test PASSED in 0.8s //tensorflow/dtensor/mlir/tests:set_default_sharding.mlir.test PASSED in 0.4s //tensorflow/dtensor/mlir/tests:sparse_expansion.mlir.test PASSED in 0.7s //tensorflow/dtensor/mlir/tests:spmd_batchparallel.mlir.test PASSED in 0.6s //tensorflow/dtensor/mlir/tests:spmd_concat.mlir.test PASSED in 1.0s //tensorflow/dtensor/mlir/tests:spmd_conv.mlir.test PASSED in 0.7s //tensorflow/dtensor/mlir/tests:spmd_einsum.mlir.test PASSED in 0.8s //tensorflow/dtensor/mlir/tests:spmd_expansion.mlir.test PASSED in 0.6s //tensorflow/dtensor/mlir/tests:spmd_io_ops.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:spmd_iterator.mlir.test PASSED in 0.9s //tensorflow/dtensor/mlir/tests:spmd_matmul.mlir.test PASSED in 0.6s //tensorflow/dtensor/mlir/tests:spmd_random.mlir.test PASSED in 0.6s //tensorflow/dtensor/mlir/tests:spmd_save_restore.mlir.test PASSED in 0.7s //tensorflow/dtensor/mlir/tests:spmd_segment_sum.mlir.test PASSED in 0.8s //tensorflow/dtensor/mlir/tests:spmd_slice.mlir.test PASSED in 0.8s //tensorflow/dtensor/mlir/tests:spmd_softmax_loss.mlir.test PASSED in 0.5s //tensorflow/dtensor/mlir/tests:spmd_squeeze.mlir.test PASSED in 0.6s //tensorflow/dtensor/mlir/tests:spmd_var_handle.mlir.test PASSED in 0.8s //tensorflow/dtensor/mlir/tests:tf_dtensor_ops.mlir.test PASSED in 0.7s //tensorflow/dtensor/mlir/tests:tpu_add_resource_device_attribute.mlir.test PASSED in 1.5s //tensorflow/dtensor/mlir/tests:tpu_integration.mlir.test PASSED in 1.0s //tensorflow/dtensor/mlir/tests:undo_merge_const_across_mesh.mlir.test PASSED in 0.4s //tensorflow/dtensor/mlir/tests:update_tpu_metadata.mlir.test PASSED in 0.8s //tensorflow/dtensor/python/tests:collective_combine_all_reduce_test_cpu PASSED in 15.5s //tensorflow/dtensor/python/tests:collective_test_cpu PASSED in 16.3s //tensorflow/dtensor/python/tests:config_test_cpu PASSED in 7.4s //tensorflow/dtensor/python/tests:multi_client_test_cpu PASSED in 12.9s //tensorflow/dtensor/python/tests:numpy_util_test_cpu PASSED in 7.8s //tensorflow/dtensor/tests:layout_to_xla_sharding_test PASSED in 0.2s //tensorflow/dtensor/tests:tensor_layout_test PASSED in 0.2s //tensorflow/examples/adding_an_op:fact_test PASSED in 15.3s //tensorflow/examples/adding_an_op:zero_out_1_test PASSED in 13.5s //tensorflow/examples/adding_an_op:zero_out_2_test PASSED in 15.1s //tensorflow/examples/adding_an_op:zero_out_3_test PASSED in 11.4s //tensorflow/examples/custom_ops_doc/multiplex_1:multiplex_1_test PASSED in 13.6s //tensorflow/examples/custom_ops_doc/multiplex_2:multiplex_2_test_cpu PASSED in 14.9s //tensorflow/examples/custom_ops_doc/multiplex_3:multiplex_3_test PASSED in 17.2s //tensorflow/examples/custom_ops_doc/multiplex_4:multiplex_4_test PASSED in 14.5s //tensorflow/examples/custom_ops_doc/simple_hash_table:simple_hash_table_test PASSED in 16.4s //tensorflow/examples/custom_ops_doc/sleep:sleep_test PASSED in 14.2s //tensorflow/examples/speech_commands:accuracy_utils_test PASSED in 1.7s //tensorflow/examples/speech_commands:models_test PASSED in 15.4s //tensorflow/examples/speech_commands:recognize_commands_test PASSED in 3.0s //tensorflow/examples/wav_to_spectrogram:wav_to_spectrogram_test PASSED in 2.9s //tensorflow/js:ts_op_gen_test PASSED in 1.1s //tensorflow/python:array_grad_test_cpu PASSED in 8.3s //tensorflow/python:batch_norm_benchmark_cpu PASSED in 5.3s //tensorflow/python:bincount_ops_test PASSED in 7.2s //tensorflow/python:bitwise_ops_test_cpu PASSED in 6.7s //tensorflow/python:clip_ops_test PASSED in 7.7s //tensorflow/python:clustering_ops_test PASSED in 19.2s //tensorflow/python:collective_ops_benchmark_cpu PASSED in 5.7s //tensorflow/python:collective_ops_gpu_test_2gpu PASSED in 6.4s //tensorflow/python:collective_ops_gpu_test_cpu PASSED in 6.2s //tensorflow/python:collective_ops_test PASSED in 18.5s //tensorflow/python:collective_ops_xla_test PASSED in 6.5s //tensorflow/python:compiled_collective_ops_gpu_test_2gpu PASSED in 8.5s //tensorflow/python:compiled_collective_ops_gpu_test_cpu PASSED in 7.8s //tensorflow/python:concat_benchmark_cpu PASSED in 6.7s //tensorflow/python:control_flow_ops_benchmark_cpu PASSED in 7.8s //tensorflow/python:control_flow_v2_enable_test PASSED in 6.8s //tensorflow/python:control_flow_v2_toggles_test PASSED in 5.9s //tensorflow/python:dequantize_op_test PASSED in 6.0s //tensorflow/python:embedding_ops_test_cpu PASSED in 7.8s //tensorflow/python:factory_ops_test_cpu PASSED in 8.4s //tensorflow/python:functional_ops_test PASSED in 6.1s //tensorflow/python:gradient_checker_v2_test_cpu PASSED in 26.1s //tensorflow/python:gradients_test_cpu PASSED in 18.3s //tensorflow/python:init_ops_test_cpu PASSED in 6.8s //tensorflow/python:init_ops_v2_test_cpu PASSED in 8.3s //tensorflow/python:math_grad_test_cpu PASSED in 18.2s //tensorflow/python:math_ops_linspace_test_cpu PASSED in 6.4s //tensorflow/python:math_ops_test_cpu PASSED in 20.6s //tensorflow/python:matmul_benchmark_cpu PASSED in 7.3s //tensorflow/python:nn_grad_test_cpu PASSED in 13.2s //tensorflow/python:nn_loss_scaling_utilities_test PASSED in 10.2s //tensorflow/python:nn_test_cpu PASSED in 58.6s //tensorflow/python:nn_xent_test_cpu PASSED in 7.1s //tensorflow/python:op_selector_test PASSED in 8.1s //tensorflow/python:ops/array_ops_test PASSED in 10.6s //tensorflow/python:quantized_conv_ops_test PASSED in 5.6s //tensorflow/python:quantized_ops_test PASSED in 6.5s //tensorflow/python:raw_ops_test_cpu PASSED in 6.7s //tensorflow/python:rnn_grad_test_cpu PASSED in 7.0s //tensorflow/python:script_ops_test PASSED in 8.0s //tensorflow/python:sort_ops_test PASSED in 7.4s //tensorflow/python:sparse_ops_test PASSED in 12.1s //tensorflow/python:split_benchmark_cpu PASSED in 6.0s //tensorflow/python:tensor_array_ops_test PASSED in 6.4s //tensorflow/python:transpose_benchmark_cpu PASSED in 5.3s //tensorflow/python:variable_spec_test PASSED in 7.8s //tensorflow/python/autograph/converters:asserts_test PASSED in 6.9s //tensorflow/python/autograph/converters:break_statements_test PASSED in 7.6s //tensorflow/python/autograph/converters:call_trees_test PASSED in 6.8s //tensorflow/python/autograph/converters:conditional_expressions_test PASSED in 5.9s //tensorflow/python/autograph/converters:continue_statements_test PASSED in 7.5s //tensorflow/python/autograph/converters:control_flow_test PASSED in 14.1s //tensorflow/python/autograph/converters:directives_test PASSED in 6.0s //tensorflow/python/autograph/converters:functions_test PASSED in 6.5s //tensorflow/python/autograph/converters:list_comprehensions_test PASSED in 6.3s //tensorflow/python/autograph/converters:lists_test PASSED in 8.1s //tensorflow/python/autograph/converters:logical_expressions_test PASSED in 7.2s //tensorflow/python/autograph/converters:return_statements_test PASSED in 8.3s //tensorflow/python/autograph/converters:slices_test PASSED in 6.0s //tensorflow/python/autograph/converters:variables_test PASSED in 7.4s //tensorflow/python/autograph/core:converter_test PASSED in 7.0s //tensorflow/python/autograph/core:function_wrappers_test PASSED in 6.7s //tensorflow/python/autograph/impl:api_test PASSED in 12.7s //tensorflow/python/autograph/impl:conversion_test PASSED in 6.3s //tensorflow/python/autograph/lang:special_functions_test PASSED in 6.4s //tensorflow/python/autograph/operators:conditional_expressions_test PASSED in 6.6s //tensorflow/python/autograph/operators:control_flow_test PASSED in 14.9s //tensorflow/python/autograph/operators:data_structures_test PASSED in 6.3s //tensorflow/python/autograph/operators:exceptions_test PASSED in 5.9s //tensorflow/python/autograph/operators:logical_test PASSED in 7.3s //tensorflow/python/autograph/operators:py_builtins_test PASSED in 18.0s //tensorflow/python/autograph/operators:slices_test PASSED in 6.0s //tensorflow/python/autograph/operators:variables_test PASSED in 5.5s //tensorflow/python/autograph/pyct:anno_test PASSED in 6.0s //tensorflow/python/autograph/pyct:ast_util_test PASSED in 6.4s //tensorflow/python/autograph/pyct:cache_test PASSED in 7.1s //tensorflow/python/autograph/pyct:cfg_test PASSED in 5.8s //tensorflow/python/autograph/pyct:error_utils_test PASSED in 7.6s //tensorflow/python/autograph/pyct:inspect_utils_test PASSED in 7.4s //tensorflow/python/autograph/pyct:loader_test PASSED in 6.0s //tensorflow/python/autograph/pyct:naming_test PASSED in 5.4s //tensorflow/python/autograph/pyct:origin_info_test PASSED in 6.1s //tensorflow/python/autograph/pyct:parser_test PASSED in 7.4s //tensorflow/python/autograph/pyct:pretty_printer_test PASSED in 6.4s //tensorflow/python/autograph/pyct:qual_names_test PASSED in 6.5s //tensorflow/python/autograph/pyct:templates_test PASSED in 6.1s //tensorflow/python/autograph/pyct:transformer_test PASSED in 5.5s //tensorflow/python/autograph/pyct:transpiler_test PASSED in 6.4s //tensorflow/python/autograph/pyct/static_analysis:activity_test PASSED in 7.3s //tensorflow/python/autograph/pyct/static_analysis:liveness_test PASSED in 6.3s //tensorflow/python/autograph/pyct/static_analysis:reaching_definitions_test PASSED in 5.9s //tensorflow/python/autograph/pyct/static_analysis:type_inference_test PASSED in 6.9s //tensorflow/python/autograph/tests:assertion_test PASSED in 17.4s //tensorflow/python/autograph/tests:basic_ifexp_test PASSED in 18.2s //tensorflow/python/autograph/tests:call_to_builtin_function_test PASSED in 15.5s //tensorflow/python/autograph/tests:call_to_lambda_function_test PASSED in 15.5s //tensorflow/python/autograph/tests:call_to_named_tuple_test PASSED in 14.3s //tensorflow/python/autograph/tests:call_to_numpy_function_test PASSED in 16.2s //tensorflow/python/autograph/tests:call_to_print_function_test PASSED in 15.7s //tensorflow/python/autograph/tests:call_to_tf_api_test PASSED in 14.7s //tensorflow/python/autograph/tests:call_to_user_function_test PASSED in 15.0s //tensorflow/python/autograph/tests:composite_names_in_control_flow_test PASSED in 22.3s //tensorflow/python/autograph/tests:cond_basic_test PASSED in 26.5s //tensorflow/python/autograph/tests:datasets_test PASSED in 22.8s //tensorflow/python/autograph/tests:early_return_test PASSED in 17.0s //tensorflow/python/autograph/tests:ext_slice_test PASSED in 13.7s //tensorflow/python/autograph/tests:generator_test PASSED in 18.4s //tensorflow/python/autograph/tests:logical_expression_test PASSED in 15.5s //tensorflow/python/autograph/tests:loop_basic_test PASSED in 74.9s //tensorflow/python/autograph/tests:loop_control_flow_illegal_cases_test PASSED in 18.2s //tensorflow/python/autograph/tests:loop_created_variables_test PASSED in 25.9s //tensorflow/python/autograph/tests:loop_scoping_test PASSED in 20.0s //tensorflow/python/autograph/tests:loop_with_function_call_test PASSED in 25.9s //tensorflow/python/autograph/tests:loop_with_variable_type_illegal_cases_test PASSED in 18.1s //tensorflow/python/autograph/tests:loop_with_variable_type_test PASSED in 35.0s //tensorflow/python/autograph/tests:nested_control_flow_test PASSED in 52.0s //tensorflow/python/autograph/tests:type_annotations_test PASSED in 15.0s //tensorflow/python/autograph/utils:context_managers_test PASSED in 6.6s //tensorflow/python/autograph/utils:misc_test PASSED in 6.8s //tensorflow/python/autograph/utils:py_func_test PASSED in 6.9s //tensorflow/python/autograph/utils:tensor_list_test PASSED in 6.9s //tensorflow/python/autograph/utils:tensors_test PASSED in 5.9s //tensorflow/python/checkpoint:benchmarks_test PASSED in 8.3s //tensorflow/python/checkpoint:checkpoint_management_test_cpu PASSED in 11.6s //tensorflow/python/checkpoint:checkpoint_metrics_test PASSED in 13.7s //tensorflow/python/checkpoint:checkpoint_test PASSED in 23.6s //tensorflow/python/checkpoint:checkpoint_view_test PASSED in 7.5s //tensorflow/python/checkpoint:checkpoint_with_v1_optimizers_test PASSED in 10.4s //tensorflow/python/checkpoint:functional_saver_test_cpu PASSED in 11.3s //tensorflow/python/checkpoint:restore_test PASSED in 8.0s //tensorflow/python/checkpoint:save_util_v1_test PASSED in 6.6s //tensorflow/python/checkpoint:saveable_compat_test PASSED in 9.9s //tensorflow/python/checkpoint:tensor_callable_test PASSED in 7.4s //tensorflow/python/checkpoint:trackable_view_test PASSED in 7.0s //tensorflow/python/client:device_lib_test_cpu PASSED in 5.4s //tensorflow/python/client:events_writer_test PASSED in 6.1s //tensorflow/python/client:session_benchmark_cpu PASSED in 11.1s //tensorflow/python/client:session_partial_run_test PASSED in 14.5s //tensorflow/python/client:timeline_test_cpu PASSED in 7.7s //tensorflow/python/client:virtual_gpu_test_cpu PASSED in 6.8s //tensorflow/python/compat:compat_test PASSED in 5.4s //tensorflow/python/compat:disable_v2_behavior_test PASSED in 6.7s //tensorflow/python/compiler/mlir:mlir_test PASSED in 12.3s //tensorflow/python/compiler/tensorrt:trt_convert_test_cpu PASSED in 13.8s //tensorflow/python/compiler/tensorrt/test:batch_matmul_test_cpu PASSED in 7.5s //tensorflow/python/compiler/tensorrt/test:biasadd_matmul_test_cpu PASSED in 7.8s //tensorflow/python/compiler/tensorrt/test:binary_tensor_weight_broadcast_test_cpu PASSED in 7.0s //tensorflow/python/compiler/tensorrt/test:bool_test_cpu PASSED in 7.5s //tensorflow/python/compiler/tensorrt/test:cast_test_cpu PASSED in 7.7s //tensorflow/python/compiler/tensorrt/test:concatenation_test_cpu PASSED in 7.9s //tensorflow/python/compiler/tensorrt/test:const_broadcast_test_cpu PASSED in 7.1s //tensorflow/python/compiler/tensorrt/test:data_dependent_shape_test_cpu PASSED in 7.6s //tensorflow/python/compiler/tensorrt/test:dynamic_input_shapes_test_cpu PASSED in 7.7s //tensorflow/python/compiler/tensorrt/test:identity_output_test_cpu PASSED in 7.1s //tensorflow/python/compiler/tensorrt/test:int32_test_cpu PASSED in 7.5s //tensorflow/python/compiler/tensorrt/test:lru_cache_test_cpu PASSED in 7.4s //tensorflow/python/compiler/tensorrt/test:memory_alignment_test_cpu PASSED in 7.4s //tensorflow/python/compiler/tensorrt/test:multi_connection_neighbor_engine_test_cpu PASSED in 6.7s //tensorflow/python/compiler/tensorrt/test:neighboring_engine_test_cpu PASSED in 13.3s //tensorflow/python/compiler/tensorrt/test:quantization_test_cpu PASSED in 7.8s //tensorflow/python/compiler/tensorrt/test:rank_two_test_cpu PASSED in 7.4s //tensorflow/python/compiler/tensorrt/test:reshape_transpose_test_cpu PASSED in 7.0s //tensorflow/python/compiler/tensorrt/test:topk_test_cpu PASSED in 12.4s //tensorflow/python/compiler/tensorrt/test:trt_engine_op_shape_test_cpu PASSED in 9.2s //tensorflow/python/compiler/tensorrt/test:trt_mode_test_cpu PASSED in 7.3s //tensorflow/python/compiler/tensorrt/test:unary_test_cpu PASSED in 7.8s //tensorflow/python/compiler/tensorrt/test:vgg_block_nchw_test_cpu PASSED in 7.6s //tensorflow/python/compiler/tensorrt/test:vgg_block_test_cpu PASSED in 6.8s //tensorflow/python/compiler/xla:jit_compile_test_cpu PASSED in 6.0s //tensorflow/python/compiler/xla:jit_test_cpu PASSED in 11.1s //tensorflow/python/compiler/xla/experimental:xla_sharding_test PASSED in 15.5s //tensorflow/python/data/benchmarks:batch_benchmark PASSED in 7.6s //tensorflow/python/data/benchmarks:filter_benchmark PASSED in 6.6s //tensorflow/python/data/benchmarks:from_tensor_slices_benchmark PASSED in 6.9s //tensorflow/python/data/benchmarks:interleave_benchmark PASSED in 8.2s //tensorflow/python/data/benchmarks:list_files_benchmark PASSED in 6.2s //tensorflow/python/data/benchmarks:map_benchmark PASSED in 7.5s //tensorflow/python/data/benchmarks:meta_benchmark PASSED in 7.3s //tensorflow/python/data/benchmarks:prefetch_benchmark PASSED in 8.5s //tensorflow/python/data/benchmarks:range_benchmark PASSED in 6.8s //tensorflow/python/data/experimental/benchmarks:autotune_benchmark PASSED in 7.1s //tensorflow/python/data/experimental/benchmarks:csv_dataset_benchmark PASSED in 6.9s //tensorflow/python/data/experimental/benchmarks:map_and_batch_benchmark PASSED in 7.5s //tensorflow/python/data/experimental/benchmarks:map_defun_benchmark PASSED in 7.1s //tensorflow/python/data/experimental/benchmarks:matching_files_benchmark PASSED in 6.1s //tensorflow/python/data/experimental/benchmarks:optimize_benchmark PASSED in 6.6s //tensorflow/python/data/experimental/benchmarks:parameter_value_benchmark PASSED in 6.8s //tensorflow/python/data/experimental/benchmarks:rejection_resample_benchmark PASSED in 6.3s //tensorflow/python/data/experimental/benchmarks:snapshot_dataset_benchmark PASSED in 6.8s //tensorflow/python/data/experimental/benchmarks:unbatch_benchmark PASSED in 7.1s //tensorflow/python/data/experimental/kernel_tests:assert_cardinality_test PASSED in 30.3s //tensorflow/python/data/experimental/kernel_tests:assert_next_test PASSED in 7.1s //tensorflow/python/data/experimental/kernel_tests:assert_prev_test PASSED in 11.4s //tensorflow/python/data/experimental/kernel_tests:compression_ops_test PASSED in 15.2s //tensorflow/python/data/experimental/kernel_tests:copy_to_device_test_cpu PASSED in 13.7s //tensorflow/python/data/experimental/kernel_tests:dense_to_sparse_batch_test PASSED in 26.0s //tensorflow/python/data/experimental/kernel_tests:distributed_save_test PASSED in 14.1s //tensorflow/python/data/experimental/kernel_tests:from_list_test PASSED in 28.0s //tensorflow/python/data/experimental/kernel_tests:io_test PASSED in 27.1s //tensorflow/python/data/experimental/kernel_tests:lookup_ops_test PASSED in 12.2s //tensorflow/python/data/experimental/kernel_tests:make_csv_dataset_test PASSED in 38.9s //tensorflow/python/data/experimental/kernel_tests:make_saveable_from_iterator_test PASSED in 6.9s //tensorflow/python/data/experimental/kernel_tests:make_tf_record_dataset_test PASSED in 54.0s //tensorflow/python/data/experimental/kernel_tests:map_defun_op_test PASSED in 6.1s //tensorflow/python/data/experimental/kernel_tests:matching_files_dataset_test PASSED in 15.4s //tensorflow/python/data/experimental/kernel_tests:model_dataset_test PASSED in 9.3s //tensorflow/python/data/experimental/kernel_tests:non_serializable_test PASSED in 8.0s //tensorflow/python/data/experimental/kernel_tests:prefetch_to_device_test_cpu PASSED in 10.2s //tensorflow/python/data/experimental/kernel_tests:prefetch_with_slack_test PASSED in 14.9s //tensorflow/python/data/experimental/kernel_tests:shuffle_and_repeat_test PASSED in 33.6s //tensorflow/python/data/experimental/kernel_tests:sleep_test PASSED in 6.8s //tensorflow/python/data/experimental/kernel_tests:tf_record_writer_test PASSED in 10.7s //tensorflow/python/data/experimental/kernel_tests:variant_test PASSED in 8.1s //tensorflow/python/data/experimental/kernel_tests:wrap_unwrap_test_cpu PASSED in 7.5s //tensorflow/python/data/experimental/kernel_tests/optimization:filter_fusion_test PASSED in 49.2s //tensorflow/python/data/experimental/kernel_tests/optimization:filter_parallelization_test PASSED in 57.4s //tensorflow/python/data/experimental/kernel_tests/optimization:grappler_test_cpu PASSED in 8.7s //tensorflow/python/data/experimental/kernel_tests/optimization:make_deterministic_test PASSED in 29.9s //tensorflow/python/data/experimental/kernel_tests/optimization:map_and_batch_fusion_test PASSED in 7.9s //tensorflow/python/data/experimental/kernel_tests/optimization:map_and_filter_fusion_test PASSED in 20.3s //tensorflow/python/data/experimental/kernel_tests/optimization:map_fusion_test PASSED in 23.9s //tensorflow/python/data/experimental/kernel_tests/optimization:map_parallelization_test PASSED in 10.7s //tensorflow/python/data/experimental/kernel_tests/optimization:noop_elimination_test PASSED in 22.7s //tensorflow/python/data/experimental/kernel_tests/service:multi_device_test PASSED in 21.0s //tensorflow/python/data/experimental/service:server_lib_test PASSED in 8.1s //tensorflow/python/data/kernel_tests:as_numpy_iterator_test PASSED in 8.9s //tensorflow/python/data/kernel_tests:bucket_by_sequence_length_test PASSED in 18.9s //tensorflow/python/data/kernel_tests:cache_test PASSED in 53.3s //tensorflow/python/data/kernel_tests:cardinality_test PASSED in 13.3s //tensorflow/python/data/kernel_tests:checkpoint_test PASSED in 14.3s //tensorflow/python/data/kernel_tests:concatenate_test PASSED in 35.9s //tensorflow/python/data/kernel_tests:counter_test PASSED in 33.0s //tensorflow/python/data/kernel_tests:dataset_spec_test PASSED in 7.6s //tensorflow/python/data/kernel_tests:dataset_test PASSED in 20.6s //tensorflow/python/data/kernel_tests:enumerate_test PASSED in 19.3s //tensorflow/python/data/kernel_tests:from_sparse_tensor_slices_test PASSED in 8.5s //tensorflow/python/data/kernel_tests:from_tensor_slices_test PASSED in 30.5s //tensorflow/python/data/kernel_tests:from_tensors_test PASSED in 20.3s //tensorflow/python/data/kernel_tests:get_single_element_test PASSED in 10.3s //tensorflow/python/data/kernel_tests:ignore_errors_test PASSED in 20.2s //tensorflow/python/data/kernel_tests:io_test PASSED in 27.3s //tensorflow/python/data/kernel_tests:len_test PASSED in 6.5s //tensorflow/python/data/kernel_tests:list_files_test PASSED in 11.5s //tensorflow/python/data/kernel_tests:optional_test_cpu PASSED in 9.9s //tensorflow/python/data/kernel_tests:options_test PASSED in 10.1s //tensorflow/python/data/kernel_tests:placement_test_cpu PASSED in 7.7s //tensorflow/python/data/kernel_tests:prefetch_test PASSED in 48.8s //tensorflow/python/data/kernel_tests:random_test PASSED in 46.1s //tensorflow/python/data/kernel_tests:range_test PASSED in 39.9s //tensorflow/python/data/kernel_tests:rebatch_test PASSED in 7.0s //tensorflow/python/data/kernel_tests:reduce_test_cpu PASSED in 25.4s //tensorflow/python/data/kernel_tests:scan_test_cpu PASSED in 41.2s //tensorflow/python/data/kernel_tests:sparse_batch_test PASSED in 20.5s //tensorflow/python/data/kernel_tests:unbatch_test PASSED in 35.2s //tensorflow/python/data/util:convert_test PASSED in 11.1s //tensorflow/python/data/util:nest_test PASSED in 7.1s //tensorflow/python/data/util:options_test PASSED in 6.8s //tensorflow/python/data/util:random_seed_test PASSED in 8.2s //tensorflow/python/data/util:sparse_test PASSED in 7.1s //tensorflow/python/data/util:structure_test PASSED in 9.0s //tensorflow/python/data/util:traverse_test PASSED in 7.6s //tensorflow/python/debug/cli:analyzer_cli_test_cpu PASSED in 9.5s //tensorflow/python/debug/cli:cli_config_test PASSED in 7.2s //tensorflow/python/debug/cli:cli_shared_test PASSED in 5.6s //tensorflow/python/debug/cli:command_parser_test PASSED in 6.0s //tensorflow/python/debug/cli:curses_ui_test PASSED in 6.2s //tensorflow/python/debug/cli:debugger_cli_common_test PASSED in 6.9s //tensorflow/python/debug/cli:evaluator_test PASSED in 5.9s //tensorflow/python/debug/cli:profile_analyzer_cli_test PASSED in 6.8s //tensorflow/python/debug/cli:readline_ui_test PASSED in 6.6s //tensorflow/python/debug/cli:tensor_format_test PASSED in 5.9s //tensorflow/python/debug/lib:check_numerics_callback_test_cpu PASSED in 11.8s //tensorflow/python/debug/lib:common_test PASSED in 6.2s //tensorflow/python/debug/lib:debug_data_test PASSED in 7.6s //tensorflow/python/debug/lib:debug_events_monitors_test PASSED in 8.6s //tensorflow/python/debug/lib:debug_events_writer_test PASSED in 8.0s //tensorflow/python/debug/lib:debug_gradients_test_cpu PASSED in 6.6s //tensorflow/python/debug/lib:debug_graph_reconstruction_test_cpu PASSED in 8.2s //tensorflow/python/debug/lib:debug_graphs_test PASSED in 6.5s //tensorflow/python/debug/lib:debug_grappler_test_cpu PASSED in 7.1s //tensorflow/python/debug/lib:debug_utils_test PASSED in 6.7s //tensorflow/python/debug/lib:debug_v2_ops_test_cpu PASSED in 15.3s //tensorflow/python/debug/lib:profiling_test PASSED in 5.6s //tensorflow/python/debug/lib:session_debug_file_test_cpu PASSED in 12.0s //tensorflow/python/debug/lib:session_debug_multi_gpu_test_cpu PASSED in 6.2s //tensorflow/python/debug/lib:source_utils_test PASSED in 9.1s //tensorflow/python/debug/wrappers:disk_usage_test PASSED in 7.9s //tensorflow/python/debug/wrappers:dumping_wrapper_test PASSED in 8.2s //tensorflow/python/debug/wrappers:framework_test PASSED in 6.7s //tensorflow/python/debug/wrappers:local_cli_wrapper_test PASSED in 8.8s //tensorflow/python/distribute:checkpoint_utils_test_2gpu PASSED in 11.5s //tensorflow/python/distribute:checkpoint_utils_test_cpu PASSED in 10.7s //tensorflow/python/distribute:checkpointing_test_2gpu PASSED in 9.8s //tensorflow/python/distribute:checkpointing_test_cpu PASSED in 9.0s //tensorflow/python/distribute:collective_all_reduce_strategy_test_2gpu PASSED in 55.9s //tensorflow/python/distribute:collective_all_reduce_strategy_test_cpu PASSED in 57.0s //tensorflow/python/distribute:collective_all_reduce_strategy_test_xla_2gpu PASSED in 35.0s //tensorflow/python/distribute:collective_util_test PASSED in 6.7s //tensorflow/python/distribute:combinations_test_2gpu PASSED in 19.1s //tensorflow/python/distribute:combinations_test_cpu PASSED in 23.5s //tensorflow/python/distribute:cross_device_utils_test_cpu PASSED in 8.5s //tensorflow/python/distribute:custom_training_loop_gradient_test_2gpu PASSED in 11.2s //tensorflow/python/distribute:custom_training_loop_gradient_test_cpu PASSED in 9.5s //tensorflow/python/distribute:device_util_test_cpu PASSED in 8.7s //tensorflow/python/distribute:distribute_coordinator_test PASSED in 14.8s //tensorflow/python/distribute:distribute_lib_test PASSED in 11.0s //tensorflow/python/distribute:distribute_utils_test_2gpu PASSED in 8.3s //tensorflow/python/distribute:distribute_utils_test_cpu PASSED in 9.2s //tensorflow/python/distribute:input_ops_test_cpu PASSED in 16.2s //tensorflow/python/distribute:metrics_v1_test_2gpu PASSED in 27.9s //tensorflow/python/distribute:metrics_v1_test_cpu PASSED in 28.7s //tensorflow/python/distribute:mirrored_values_test_2gpu PASSED in 7.9s //tensorflow/python/distribute:mirrored_values_test_cpu PASSED in 8.8s //tensorflow/python/distribute:mirrored_variable_test_2gpu PASSED in 18.9s //tensorflow/python/distribute:mirrored_variable_test_cpu PASSED in 21.2s //tensorflow/python/distribute:multi_process_runner_no_init_test PASSED in 7.3s //tensorflow/python/distribute:multi_worker_continuous_run_test_cpu PASSED in 22.8s //tensorflow/python/distribute:multi_worker_util_test PASSED in 5.7s //tensorflow/python/distribute:numpy_dataset_test PASSED in 8.0s //tensorflow/python/distribute:one_device_strategy_test_cpu PASSED in 20.2s //tensorflow/python/distribute:packed_distributed_variable_test PASSED in 8.6s //tensorflow/python/distribute:parameter_server_strategy_v2_test_2gpu PASSED in 20.9s //tensorflow/python/distribute:parameter_server_strategy_v2_test_cpu PASSED in 22.6s //tensorflow/python/distribute:per_replica_test_2gpu PASSED in 9.1s //tensorflow/python/distribute:per_replica_test_cpu PASSED in 8.7s //tensorflow/python/distribute:ps_values_test_2gpu PASSED in 8.8s //tensorflow/python/distribute:ps_values_test_cpu PASSED in 7.0s //tensorflow/python/distribute:remote_mirrored_strategy_eager_test_cpu PASSED in 8.6s //tensorflow/python/distribute:sharded_variable_test PASSED in 20.6s //tensorflow/python/distribute:shared_variable_creator_test PASSED in 6.1s //tensorflow/python/distribute:strategy_combinations_test_cpu PASSED in 54.2s //tensorflow/python/distribute:template_mirrored_strategy_test_cpu PASSED in 7.4s //tensorflow/python/distribute:test_util_test_2gpu PASSED in 15.9s //tensorflow/python/distribute:test_util_test_cpu PASSED in 14.3s //tensorflow/python/distribute:tf_function_test_2gpu PASSED in 8.0s //tensorflow/python/distribute:tf_function_test_cpu PASSED in 8.7s //tensorflow/python/distribute:values_v2_test_cpu PASSED in 10.6s //tensorflow/python/distribute:warm_starting_util_test_2gpu PASSED in 9.3s //tensorflow/python/distribute:warm_starting_util_test_cpu PASSED in 9.2s //tensorflow/python/distribute/cluster_resolver:base_cluster_resolver_py_test PASSED in 7.1s //tensorflow/python/distribute/cluster_resolver:gce_cluster_resolver_py_test PASSED in 7.1s //tensorflow/python/distribute/cluster_resolver:kubernetes_cluster_resolver_py_test PASSED in 6.0s //tensorflow/python/distribute/cluster_resolver:sagemaker_cluster_resolver_py_test PASSED in 6.8s //tensorflow/python/distribute/cluster_resolver:slurm_cluster_resolver_py_test PASSED in 7.7s //tensorflow/python/distribute/cluster_resolver:tfconfig_cluster_resolver_py_test PASSED in 6.1s //tensorflow/python/distribute/cluster_resolver/tpu:tpu_cluster_resolver_py_test PASSED in 11.3s //tensorflow/python/distribute/coordinator:metric_utils_test PASSED in 9.4s //tensorflow/python/distribute/coordinator:watchdog_test PASSED in 60.3s //tensorflow/python/distribute/experimental:dtensor_util_test_cpu PASSED in 10.6s //tensorflow/python/distribute/experimental:mirrored_strategy_test_cpu PASSED in 26.1s //tensorflow/python/distribute/integration_test:saved_model_test_cpu PASSED in 36.2s //tensorflow/python/distribute/parallel_device:parallel_device_test_cpu PASSED in 21.9s //tensorflow/python/distribute/v1:all_reduce_test PASSED in 40.9s //tensorflow/python/distribute/v1:cross_device_ops_test_2gpu PASSED in 73.1s //tensorflow/python/distribute/v1:cross_device_ops_test_cpu PASSED in 56.4s //tensorflow/python/dlpack:dlpack_test_cpu PASSED in 7.0s //tensorflow/python/eager:backprop_test_cpu PASSED in 120.4s //tensorflow/python/eager:benchmarks_test_cpu PASSED in 6.5s //tensorflow/python/eager:cancellation_test_cpu PASSED in 7.3s //tensorflow/python/eager:context_test_cpu PASSED in 8.4s //tensorflow/python/eager:core_test_cpu PASSED in 17.9s //tensorflow/python/eager:gradient_input_output_exclusions_test PASSED in 37.1s //tensorflow/python/eager:graph_only_ops_test_cpu PASSED in 7.6s //tensorflow/python/eager:lift_to_graph_test PASSED in 8.4s //tensorflow/python/eager:monitoring_test_cpu PASSED in 5.8s //tensorflow/python/eager:ops_test_cpu PASSED in 11.7s //tensorflow/python/eager:profiler_client_test PASSED in 6.0s //tensorflow/python/eager:profiler_test_cpu PASSED in 5.6s //tensorflow/python/eager:pywrap_tfe_test PASSED in 25.3s //tensorflow/python/eager:remote_benchmarks_test_cpu PASSED in 5.6s //tensorflow/python/eager:run_eager_op_as_function_test_cpu PASSED in 7.2s //tensorflow/python/eager:run_eager_op_as_function_xla_test_cpu PASSED in 6.6s //tensorflow/python/eager:tape_test PASSED in 8.4s //tensorflow/python/eager:tensor_test_cpu PASSED in 10.8s //tensorflow/python/eager:wrap_function_device_test_cpu PASSED in 8.5s //tensorflow/python/eager:wrap_function_test PASSED in 9.4s //tensorflow/python/eager/benchmarks:kpi_benchmark_test_cpu PASSED in 15.3s //tensorflow/python/eager/memory_tests:remote_memory_test_cpu PASSED in 6.0s //tensorflow/python/eager/polymorphic_function:argument_naming_test_cpu PASSED in 10.7s //tensorflow/python/eager/polymorphic_function:collection_test_cpu PASSED in 6.6s //tensorflow/python/eager/polymorphic_function:compiler_ir_test_cpu PASSED in 7.9s //tensorflow/python/eager/polymorphic_function:compiler_ir_test_cpu_mlir_bridge_test PASSED in 9.1s //tensorflow/python/eager/polymorphic_function:function_spec_test PASSED in 6.0s //tensorflow/python/eager/polymorphic_function:polymorphic_function_xla_jit_test_cpu PASSED in 28.4s //tensorflow/python/eager/polymorphic_function:polymorphic_function_xla_jit_test_cpu_mlir_bridge_test PASSED in 23.5s //tensorflow/python/eager/polymorphic_function:polymorphic_function_xla_test_cpu PASSED in 7.8s //tensorflow/python/eager/polymorphic_function:quarantine_test PASSED in 27.1s //tensorflow/python/feature_column:sequence_feature_column_integration_test PASSED in 9.1s //tensorflow/python/feature_column:serialization_test PASSED in 9.1s //tensorflow/python/framework:auto_control_deps_test PASSED in 24.1s //tensorflow/python/framework:c_api_util_test PASSED in 7.0s //tensorflow/python/framework:common_shapes_test PASSED in 12.2s //tensorflow/python/framework:composite_tensor_test PASSED in 7.3s //tensorflow/python/framework:config_test_2gpu PASSED in 9.1s //tensorflow/python/framework:config_test_cpu PASSED in 11.5s //tensorflow/python/framework:constant_op_test PASSED in 6.5s //tensorflow/python/framework:device_spec_test PASSED in 6.2s //tensorflow/python/framework:device_test PASSED in 6.2s //tensorflow/python/framework:dtypes_test PASSED in 14.6s //tensorflow/python/framework:error_interpolation_test PASSED in 7.8s //tensorflow/python/framework:errors_test PASSED in 6.9s //tensorflow/python/framework:extension_type_field_test PASSED in 6.4s //tensorflow/python/framework:extension_type_test PASSED in 18.3s //tensorflow/python/framework:file_system_test PASSED in 6.2s //tensorflow/python/framework:function_def_to_graph_test PASSED in 8.8s //tensorflow/python/framework:graph_building_benchmark_cpu PASSED in 6.5s //tensorflow/python/framework:graph_util_test PASSED in 8.1s //tensorflow/python/framework:immutable_dict_test PASSED in 5.4s //tensorflow/python/framework:importer_test PASSED in 8.4s //tensorflow/python/framework:indexed_slices_test PASSED in 7.3s //tensorflow/python/framework:kernels_test PASSED in 6.5s //tensorflow/python/framework:meta_graph_test PASSED in 9.4s //tensorflow/python/framework:node_file_writer_test_cpu PASSED in 6.8s //tensorflow/python/framework:offset_counter_helper_test PASSED in 0.3s //tensorflow/python/framework:op_allowlist_namespace_test PASSED in 2.2s //tensorflow/python/framework:op_callbacks_test_cpu PASSED in 12.2s //tensorflow/python/framework:op_def_library_test PASSED in 7.1s //tensorflow/python/framework:op_def_util_test PASSED in 6.7s //tensorflow/python/framework:ops_enable_eager_test PASSED in 1.7s //tensorflow/python/framework:ops_test PASSED in 19.9s //tensorflow/python/framework:proto_test PASSED in 5.6s //tensorflow/python/framework:py_context_manager_test PASSED in 5.9s //tensorflow/python/framework:python_api_dispatcher_test PASSED in 7.5s //tensorflow/python/framework:python_api_info_test PASSED in 5.8s //tensorflow/python/framework:python_api_parameter_converter_test PASSED in 9.6s //tensorflow/python/framework:python_op_gen_annotator_test PASSED in 0.5s //tensorflow/python/framework:python_op_gen_test PASSED in 0.1s //tensorflow/python/framework:python_tensor_converter_test PASSED in 6.0s //tensorflow/python/framework:random_seed_test PASSED in 6.4s //tensorflow/python/framework:registry_test PASSED in 6.0s //tensorflow/python/framework:smart_cond_test PASSED in 7.7s //tensorflow/python/framework:sparse_tensor_test PASSED in 7.6s //tensorflow/python/framework:subscribe_test PASSED in 6.9s //tensorflow/python/framework:tensor_shape_test PASSED in 5.5s //tensorflow/python/framework:tensor_test PASSED in 6.9s //tensorflow/python/framework:tensor_util_test PASSED in 7.6s //tensorflow/python/framework:test_combinations_test PASSED in 5.8s //tensorflow/python/framework:test_util_test_cpu PASSED in 14.8s //tensorflow/python/framework:tf2_test PASSED in 6.8s //tensorflow/python/framework:traceable_stack_test PASSED in 6.6s //tensorflow/python/framework:type_spec_test PASSED in 5.8s //tensorflow/python/framework:versions_test PASSED in 6.3s //tensorflow/python/framework/experimental:graph_building_test_cpu PASSED in 5.9s //tensorflow/python/framework/experimental:unified_api_test_cpu PASSED in 11.4s //tensorflow/python/grappler:arithmetic_optimizer_test_cpu PASSED in 6.6s //tensorflow/python/grappler:auto_mixed_precision_test_cpu PASSED in 9.6s //tensorflow/python/grappler:constant_folding_test_cpu PASSED in 6.8s //tensorflow/python/grappler:cost_analyzer_test PASSED in 14.9s //tensorflow/python/grappler:datasets_test PASSED in 8.2s //tensorflow/python/grappler:item_test PASSED in 5.6s //tensorflow/python/grappler:memory_optimizer_test PASSED in 15.0s //tensorflow/python/grappler:model_analyzer_test PASSED in 6.1s //tensorflow/python/grappler:remapper_test_cpu PASSED in 7.4s //tensorflow/python/grappler:tf_optimizer_test PASSED in 5.3s //tensorflow/python/kernel_tests:benchmark_test_cpu PASSED in 7.8s //tensorflow/python/kernel_tests:check_ops_test_cpu PASSED in 17.6s //tensorflow/python/kernel_tests:collective_ops_multi_worker_test PASSED in 29.6s //tensorflow/python/kernel_tests:composite_tensor_ops_test PASSED in 6.9s //tensorflow/python/kernel_tests:critical_section_test_cpu PASSED in 15.6s //tensorflow/python/kernel_tests:garbage_collection_test PASSED in 8.0s //tensorflow/python/kernel_tests:gradient_correctness_test_cpu PASSED in 6.8s //tensorflow/python/kernel_tests:histogram_ops_test_cpu PASSED in 6.0s //tensorflow/python/kernel_tests:logging_ops_test_cpu PASSED in 10.8s //tensorflow/python/kernel_tests:numerics_test_cpu PASSED in 6.3s //tensorflow/python/kernel_tests:template_test PASSED in 9.1s //tensorflow/python/kernel_tests:trace_op_test_cpu PASSED in 6.9s //tensorflow/python/kernel_tests/array_ops:batch_gather_op_test_cpu PASSED in 7.7s //tensorflow/python/kernel_tests/array_ops:batch_scatter_ops_test PASSED in 7.6s //tensorflow/python/kernel_tests/array_ops:batchtospace_op_test_cpu PASSED in 11.7s //tensorflow/python/kernel_tests/array_ops:bcast_ops_test PASSED in 5.4s //tensorflow/python/kernel_tests/array_ops:bitcast_op_test_cpu PASSED in 6.4s //tensorflow/python/kernel_tests/array_ops:broadcast_to_ops_test_cpu PASSED in 26.6s //tensorflow/python/kernel_tests/array_ops:cast_op_test_cpu PASSED in 9.8s //tensorflow/python/kernel_tests/array_ops:constant_op_eager_test_cpu PASSED in 7.7s //tensorflow/python/kernel_tests/array_ops:constant_op_test_cpu PASSED in 9.3s //tensorflow/python/kernel_tests/array_ops:denormal_test_cpu PASSED in 5.6s //tensorflow/python/kernel_tests/array_ops:depthtospace_op_test_cpu PASSED in 9.3s //tensorflow/python/kernel_tests/array_ops:edit_distance_op_test PASSED in 7.0s //tensorflow/python/kernel_tests/array_ops:fingerprint_op_test PASSED in 6.1s //tensorflow/python/kernel_tests/array_ops:gather_nd_op_test_cpu PASSED in 7.8s //tensorflow/python/kernel_tests/array_ops:identity_n_op_py_test PASSED in 7.2s //tensorflow/python/kernel_tests/array_ops:identity_op_py_test PASSED in 6.6s //tensorflow/python/kernel_tests/array_ops:large_concat_op_test_cpu PASSED in 7.0s //tensorflow/python/kernel_tests/array_ops:manip_ops_test_cpu PASSED in 14.6s //tensorflow/python/kernel_tests/array_ops:one_hot_op_test_cpu PASSED in 7.1s //tensorflow/python/kernel_tests/array_ops:pad_op_test_cpu PASSED in 13.1s //tensorflow/python/kernel_tests/array_ops:reshape_op_test_cpu PASSED in 7.2s //tensorflow/python/kernel_tests/array_ops:reverse_sequence_op_test_cpu PASSED in 7.6s //tensorflow/python/kernel_tests/array_ops:scalar_test_cpu PASSED in 7.5s //tensorflow/python/kernel_tests/array_ops:shape_ops_test_cpu PASSED in 15.2s //tensorflow/python/kernel_tests/array_ops:slice_op_test_cpu PASSED in 9.3s //tensorflow/python/kernel_tests/array_ops:spacetobatch_op_test_cpu PASSED in 18.4s //tensorflow/python/kernel_tests/array_ops:spacetodepth_op_test_cpu PASSED in 6.8s //tensorflow/python/kernel_tests/array_ops:stack_op_test_cpu PASSED in 13.4s //tensorflow/python/kernel_tests/array_ops:unique_op_test_cpu PASSED in 6.8s //tensorflow/python/kernel_tests/array_ops:unstack_op_test_cpu PASSED in 6.9s //tensorflow/python/kernel_tests/array_ops:where_op_test_cpu PASSED in 13.7s //tensorflow/python/kernel_tests/control_flow:cond_v2_test_cpu PASSED in 51.3s //tensorflow/python/kernel_tests/control_flow:control_flow_util_test PASSED in 8.6s //tensorflow/python/kernel_tests/control_flow:control_flow_util_v2_test PASSED in 7.3s //tensorflow/python/kernel_tests/control_flow:py_func_test_cpu PASSED in 17.1s //tensorflow/python/kernel_tests/control_flow:scan_ops_test_cpu PASSED in 61.5s //tensorflow/python/kernel_tests/control_flow:while_v2_test_cpu PASSED in 60.7s //tensorflow/python/kernel_tests/custom_ops:ackermann_test PASSED in 5.9s //tensorflow/python/kernel_tests/custom_ops:duplicate_op_test PASSED in 7.9s //tensorflow/python/kernel_tests/custom_ops:invalid_op_test PASSED in 6.6s //tensorflow/python/kernel_tests/data_structures:conditional_accumulator_test PASSED in 8.7s //tensorflow/python/kernel_tests/data_structures:dynamic_partition_op_test_2gpu PASSED in 12.2s //tensorflow/python/kernel_tests/data_structures:dynamic_partition_op_test_cpu PASSED in 13.2s //tensorflow/python/kernel_tests/data_structures:dynamic_stitch_op_test_cpu PASSED in 7.0s //tensorflow/python/kernel_tests/data_structures:fifo_queue_test PASSED in 10.1s //tensorflow/python/kernel_tests/data_structures:list_ops_test_cpu PASSED in 22.0s //tensorflow/python/kernel_tests/data_structures:listdiff_op_test PASSED in 7.7s //tensorflow/python/kernel_tests/data_structures:lookup_ops_test PASSED in 26.3s //tensorflow/python/kernel_tests/data_structures:map_ops_test PASSED in 12.8s //tensorflow/python/kernel_tests/data_structures:padding_fifo_queue_test_cpu PASSED in 6.4s //tensorflow/python/kernel_tests/data_structures:priority_queue_test PASSED in 6.0s //tensorflow/python/kernel_tests/data_structures:stack_ops_test_cpu PASSED in 5.7s //tensorflow/python/kernel_tests/data_structures:stage_op_test_cpu PASSED in 7.4s //tensorflow/python/kernel_tests/distributions:bernoulli_test_cpu PASSED in 12.2s //tensorflow/python/kernel_tests/distributions:bijector_test_cpu PASSED in 7.5s //tensorflow/python/kernel_tests/distributions:categorical_test_cpu PASSED in 9.5s //tensorflow/python/kernel_tests/distributions:dirichlet_multinomial_test_cpu PASSED in 12.9s //tensorflow/python/kernel_tests/distributions:dirichlet_test_cpu PASSED in 12.1s //tensorflow/python/kernel_tests/distributions:exponential_test_cpu PASSED in 8.1s //tensorflow/python/kernel_tests/distributions:gamma_test_cpu PASSED in 43.7s //tensorflow/python/kernel_tests/distributions:identity_bijector_test_cpu PASSED in 5.9s //tensorflow/python/kernel_tests/distributions:kullback_leibler_test_cpu PASSED in 7.1s //tensorflow/python/kernel_tests/distributions:laplace_test_cpu PASSED in 27.5s //tensorflow/python/kernel_tests/distributions:multinomial_test_cpu PASSED in 6.4s //tensorflow/python/kernel_tests/distributions:normal_test_cpu PASSED in 22.1s //tensorflow/python/kernel_tests/distributions:special_math_test_cpu PASSED in 18.5s //tensorflow/python/kernel_tests/distributions:uniform_test_cpu PASSED in 9.7s //tensorflow/python/kernel_tests/image_ops:attention_ops_test PASSED in 6.5s //tensorflow/python/kernel_tests/image_ops:decode_bmp_op_test PASSED in 8.0s //tensorflow/python/kernel_tests/image_ops:decode_compressed_op_test PASSED in 6.0s //tensorflow/python/kernel_tests/image_ops:decode_image_op_test PASSED in 6.7s //tensorflow/python/kernel_tests/image_ops:decode_jpeg_op_test PASSED in 6.7s //tensorflow/python/kernel_tests/image_ops:decode_png_op_test PASSED in 6.3s //tensorflow/python/kernel_tests/image_ops:decode_raw_op_test PASSED in 6.8s //tensorflow/python/kernel_tests/image_ops:draw_bounding_box_op_test_cpu PASSED in 5.9s //tensorflow/python/kernel_tests/image_ops:extract_image_patches_op_test_cpu PASSED in 6.5s //tensorflow/python/kernel_tests/image_ops:extract_volume_patches_op_test_cpu PASSED in 5.8s //tensorflow/python/kernel_tests/io_ops:checkpoint_ops_test PASSED in 9.6s //tensorflow/python/kernel_tests/io_ops:decode_csv_op_test PASSED in 6.2s //tensorflow/python/kernel_tests/io_ops:io_ops_test PASSED in 8.7s //tensorflow/python/kernel_tests/io_ops:parse_single_example_op_test PASSED in 9.0s //tensorflow/python/kernel_tests/io_ops:parsing_ops_test PASSED in 28.2s //tensorflow/python/kernel_tests/io_ops:reader_ops_test PASSED in 12.4s //tensorflow/python/kernel_tests/io_ops:record_input_test PASSED in 32.8s //tensorflow/python/kernel_tests/io_ops:save_restore_ops_test PASSED in 6.6s //tensorflow/python/kernel_tests/linalg:determinant_op_test_cpu PASSED in 6.3s //tensorflow/python/kernel_tests/linalg:linear_operator_addition_test_cpu PASSED in 6.2s //tensorflow/python/kernel_tests/linalg:linear_operator_algebra_test_cpu PASSED in 6.9s //tensorflow/python/kernel_tests/linalg:linear_operator_test_cpu PASSED in 7.8s //tensorflow/python/kernel_tests/linalg:lu_op_test_cpu PASSED in 7.9s //tensorflow/python/kernel_tests/linalg:matrix_inverse_op_test_cpu PASSED in 7.3s //tensorflow/python/kernel_tests/linalg:matrix_logarithm_op_test PASSED in 62.2s //tensorflow/python/kernel_tests/linalg:matrix_solve_ls_op_test_cpu PASSED in 20.2s //tensorflow/python/kernel_tests/linalg:matrix_solve_op_test_cpu PASSED in 21.8s //tensorflow/python/kernel_tests/linalg:matrix_square_root_op_test_cpu PASSED in 6.7s //tensorflow/python/kernel_tests/linalg:slicing_test_cpu PASSED in 13.3s //tensorflow/python/kernel_tests/linalg/sparse:conjugate_gradient_test_cpu PASSED in 10.1s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_test_cpu PASSED in 5.5s //tensorflow/python/kernel_tests/math_ops:aggregate_ops_test_cpu PASSED in 10.6s //tensorflow/python/kernel_tests/math_ops:argmax_op_test_cpu PASSED in 7.8s //tensorflow/python/kernel_tests/math_ops:banded_triangular_solve_op_test_cpu PASSED in 8.6s //tensorflow/python/kernel_tests/math_ops:basic_gpu_test_cpu PASSED in 6.5s //tensorflow/python/kernel_tests/math_ops:bincount_op_test_cpu PASSED in 10.8s //tensorflow/python/kernel_tests/math_ops:bucketize_op_test_cpu PASSED in 5.9s //tensorflow/python/kernel_tests/math_ops:clip_ops_test PASSED in 7.1s //tensorflow/python/kernel_tests/math_ops:confusion_matrix_test PASSED in 13.3s //tensorflow/python/kernel_tests/math_ops:cross_grad_test_cpu PASSED in 6.6s //tensorflow/python/kernel_tests/math_ops:cumulative_logsumexp_test_cpu PASSED in 10.9s //tensorflow/python/kernel_tests/math_ops:in_topk_op_test_cpu PASSED in 8.5s //tensorflow/python/kernel_tests/math_ops:reduce_benchmark_test_cpu PASSED in 12.4s //tensorflow/python/kernel_tests/math_ops:segment_reduction_ops_d9m_test_cpu PASSED in 6.8s //tensorflow/python/kernel_tests/math_ops:sets_test PASSED in 22.4s //tensorflow/python/kernel_tests/math_ops:topk_op_test_cpu PASSED in 8.4s //tensorflow/python/kernel_tests/math_ops:zero_division_test_cpu PASSED in 7.5s //tensorflow/python/kernel_tests/nn_ops:betainc_op_test_cpu PASSED in 9.4s //tensorflow/python/kernel_tests/nn_ops:bias_op_test_cpu PASSED in 168.5s //tensorflow/python/kernel_tests/nn_ops:conv1d_test_cpu PASSED in 6.4s //tensorflow/python/kernel_tests/nn_ops:conv1d_transpose_test_cpu PASSED in 12.0s //tensorflow/python/kernel_tests/nn_ops:conv2d_transpose_test_cpu PASSED in 6.4s //tensorflow/python/kernel_tests/nn_ops:conv3d_backprop_filter_v2_grad_test_cpu PASSED in 29.9s //tensorflow/python/kernel_tests/nn_ops:conv3d_transpose_test_cpu PASSED in 7.1s //tensorflow/python/kernel_tests/nn_ops:ctc_decoder_ops_test PASSED in 7.1s //tensorflow/python/kernel_tests/nn_ops:ctc_loss_op_test_cpu PASSED in 60.2s //tensorflow/python/kernel_tests/nn_ops:cudnn_d9m_test_cpu PASSED in 6.3s //tensorflow/python/kernel_tests/nn_ops:cudnn_deterministic_ops_test_cpu PASSED in 6.1s //tensorflow/python/kernel_tests/nn_ops:losses_test PASSED in 38.1s //tensorflow/python/kernel_tests/nn_ops:lrn_op_test_cpu PASSED in 9.8s //tensorflow/python/kernel_tests/nn_ops:morphological_ops_test_cpu PASSED in 10.2s //tensorflow/python/kernel_tests/nn_ops:nth_element_op_test_cpu PASSED in 7.8s //tensorflow/python/kernel_tests/nn_ops:pool_test_cpu PASSED in 42.4s //tensorflow/python/kernel_tests/nn_ops:pooling_ops_3d_test_cpu PASSED in 29.6s //tensorflow/python/kernel_tests/nn_ops:relu_op_test_cpu PASSED in 10.1s //tensorflow/python/kernel_tests/nn_ops:softmax_op_test_cpu PASSED in 7.1s //tensorflow/python/kernel_tests/nn_ops:softplus_op_test_cpu PASSED in 6.9s //tensorflow/python/kernel_tests/nn_ops:softsign_op_test_cpu PASSED in 7.6s //tensorflow/python/kernel_tests/nn_ops:xent_op_d9m_test_cpu PASSED in 158.4s //tensorflow/python/kernel_tests/nn_ops:xent_op_test_cpu PASSED in 9.1s //tensorflow/python/kernel_tests/proto:descriptor_source_test PASSED in 6.1s //tensorflow/python/kernel_tests/proto:encode_proto_op_test PASSED in 11.8s //tensorflow/python/kernel_tests/quantization_ops:quantization_ops_test PASSED in 6.6s //tensorflow/python/kernel_tests/random:candidate_sampler_ops_test PASSED in 6.7s //tensorflow/python/kernel_tests/random:multinomial_op_test_cpu PASSED in 7.0s //tensorflow/python/kernel_tests/random:parameterized_truncated_normal_op_test_cpu PASSED in 13.4s //tensorflow/python/kernel_tests/random:random_crop_test_cpu PASSED in 7.7s //tensorflow/python/kernel_tests/random:random_grad_test_cpu PASSED in 7.8s //tensorflow/python/kernel_tests/random:random_ops_test_cpu PASSED in 20.8s //tensorflow/python/kernel_tests/random:random_poisson_test_cpu PASSED in 12.6s //tensorflow/python/kernel_tests/random:random_shuffle_queue_test PASSED in 6.7s //tensorflow/python/kernel_tests/random:stateful_random_ops_test_cpu PASSED in 16.7s //tensorflow/python/kernel_tests/signal:mel_ops_test_cpu PASSED in 14.2s //tensorflow/python/kernel_tests/signal:mfcc_ops_test_cpu PASSED in 7.5s //tensorflow/python/kernel_tests/signal:reconstruction_ops_test_cpu PASSED in 11.7s //tensorflow/python/kernel_tests/signal:shape_ops_test_cpu PASSED in 21.8s //tensorflow/python/kernel_tests/sparse_ops:sparse_add_op_test PASSED in 9.7s //tensorflow/python/kernel_tests/sparse_ops:sparse_concat_op_test PASSED in 10.1s //tensorflow/python/kernel_tests/sparse_ops:sparse_conditional_accumulator_test PASSED in 8.6s //tensorflow/python/kernel_tests/sparse_ops:sparse_cross_op_test PASSED in 11.3s //tensorflow/python/kernel_tests/sparse_ops:sparse_matmul_op_test_cpu PASSED in 38.0s //tensorflow/python/kernel_tests/sparse_ops:sparse_reorder_op_test PASSED in 8.1s //tensorflow/python/kernel_tests/sparse_ops:sparse_reshape_op_test PASSED in 15.0s //tensorflow/python/kernel_tests/sparse_ops:sparse_serialization_ops_test PASSED in 7.6s //tensorflow/python/kernel_tests/sparse_ops:sparse_slice_op_test PASSED in 10.9s //tensorflow/python/kernel_tests/sparse_ops:sparse_split_op_test_cpu PASSED in 6.9s //tensorflow/python/kernel_tests/sparse_ops:sparse_tensor_dense_matmul_grad_test_cpu PASSED in 22.8s //tensorflow/python/kernel_tests/sparse_ops:sparse_tensor_dense_matmul_op_d9m_test_cpu PASSED in 33.7s //tensorflow/python/kernel_tests/sparse_ops:sparse_tensor_dense_matmul_op_test_cpu PASSED in 32.1s //tensorflow/python/kernel_tests/sparse_ops:sparse_tensors_map_ops_test PASSED in 7.7s //tensorflow/python/kernel_tests/sparse_ops:sparse_to_dense_op_py_test_cpu PASSED in 12.1s //tensorflow/python/kernel_tests/sparse_ops:sparse_xent_op_d9m_test_cpu PASSED in 82.6s //tensorflow/python/kernel_tests/sparse_ops:sparse_xent_op_test_cpu PASSED in 9.3s //tensorflow/python/kernel_tests/sparse_ops:sparsemask_op_test PASSED in 7.1s //tensorflow/python/kernel_tests/strings_ops:as_string_op_test PASSED in 7.8s //tensorflow/python/kernel_tests/strings_ops:base64_ops_test PASSED in 12.4s //tensorflow/python/kernel_tests/strings_ops:reduce_join_op_test_cpu PASSED in 6.5s //tensorflow/python/kernel_tests/strings_ops:regex_full_match_op_test PASSED in 6.6s //tensorflow/python/kernel_tests/strings_ops:regex_replace_op_test PASSED in 6.7s //tensorflow/python/kernel_tests/strings_ops:string_bytes_split_op_test PASSED in 7.4s //tensorflow/python/kernel_tests/strings_ops:string_format_op_test PASSED in 7.3s //tensorflow/python/kernel_tests/strings_ops:string_join_op_test PASSED in 6.5s //tensorflow/python/kernel_tests/strings_ops:string_length_op_test PASSED in 6.7s //tensorflow/python/kernel_tests/strings_ops:string_lower_op_test PASSED in 6.0s //tensorflow/python/kernel_tests/strings_ops:string_split_op_test PASSED in 8.5s //tensorflow/python/kernel_tests/strings_ops:string_strip_op_test PASSED in 6.1s //tensorflow/python/kernel_tests/strings_ops:string_to_hash_bucket_op_test_cpu PASSED in 6.8s //tensorflow/python/kernel_tests/strings_ops:string_to_number_op_test_cpu PASSED in 6.3s //tensorflow/python/kernel_tests/strings_ops:string_upper_op_test PASSED in 6.5s //tensorflow/python/kernel_tests/strings_ops:substr_op_test PASSED in 8.9s //tensorflow/python/kernel_tests/strings_ops:unicode_decode_op_test PASSED in 19.7s //tensorflow/python/kernel_tests/strings_ops:unicode_encode_op_test PASSED in 6.7s //tensorflow/python/kernel_tests/strings_ops:unicode_script_op_test PASSED in 5.7s //tensorflow/python/kernel_tests/strings_ops:unicode_transcode_op_test PASSED in 6.6s //tensorflow/python/kernel_tests/strings_ops:unsorted_segment_join_op_test_cpu PASSED in 6.5s //tensorflow/python/kernel_tests/summary_ops:summary_ops_test_cpu PASSED in 17.0s //tensorflow/python/kernel_tests/summary_ops:summary_v1_audio_op_test_cpu PASSED in 7.1s //tensorflow/python/kernel_tests/summary_ops:summary_v1_image_op_test_cpu PASSED in 7.7s //tensorflow/python/kernel_tests/summary_ops:summary_v1_ops_test PASSED in 9.3s //tensorflow/python/kernel_tests/summary_ops:summary_v1_tensor_op_test PASSED in 7.5s //tensorflow/python/kernel_tests/v1_compat_tests:array_ops_test_cpu PASSED in 7.1s //tensorflow/python/kernel_tests/v1_compat_tests:dense_update_ops_test_cpu PASSED in 5.6s //tensorflow/python/kernel_tests/v1_compat_tests:identity_op_py_test PASSED in 5.8s //tensorflow/python/kernel_tests/v1_compat_tests:scatter_nd_ops_test_cpu PASSED in 6.0s //tensorflow/python/kernel_tests/v1_compat_tests:session_ops_test_cpu PASSED in 8.9s //tensorflow/python/kernel_tests/v1_compat_tests:stack_op_test_cpu PASSED in 7.7s //tensorflow/python/kernel_tests/variables:dense_update_ops_no_tsan_test_cpu PASSED in 8.5s //tensorflow/python/kernel_tests/variables:dense_update_ops_test_cpu PASSED in 7.3s //tensorflow/python/kernel_tests/variables:partitioned_variables_test PASSED in 9.6s //tensorflow/python/kernel_tests/variables:resource_variable_ops_test_cpu PASSED in 50.6s //tensorflow/python/kernel_tests/variables:variable_ops_test_cpu PASSED in 7.8s //tensorflow/python/kernel_tests/variables:variable_scope_test PASSED in 34.5s //tensorflow/python/kernel_tests/variables:variables_test PASSED in 9.2s //tensorflow/python/lib/core:custom_float_test PASSED in 6.9s //tensorflow/python/lib/io:file_io_test PASSED in 9.4s //tensorflow/python/lib/io:tf_record_test PASSED in 9.3s //tensorflow/python/module:module_test PASSED in 8.7s //tensorflow/python/ops/losses:util_test PASSED in 6.7s //tensorflow/python/ops/memory_tests:custom_gradient_memory_test_cpu PASSED in 10.0s //tensorflow/python/ops/numpy_ops:np_array_ops_test_cpu PASSED in 70.9s //tensorflow/python/ops/numpy_ops:np_arrays_test_cpu PASSED in 9.8s //tensorflow/python/ops/numpy_ops:np_dtypes_test_cpu PASSED in 6.1s //tensorflow/python/ops/numpy_ops:np_interop_test_cpu PASSED in 44.4s //tensorflow/python/ops/numpy_ops:np_logic_test_cpu PASSED in 9.6s //tensorflow/python/ops/numpy_ops:np_math_ops_test_cpu PASSED in 21.6s //tensorflow/python/ops/numpy_ops:np_random_test_cpu PASSED in 71.1s //tensorflow/python/ops/numpy_ops:np_utils_test_cpu PASSED in 6.0s //tensorflow/python/ops/numpy_ops/integration_test:np_config_test_cpu PASSED in 13.6s //tensorflow/python/ops/numpy_ops/integration_test:public_symbol_test PASSED in 14.9s //tensorflow/python/ops/parallel_for:array_test_cpu PASSED in 43.9s //tensorflow/python/ops/parallel_for:gradients_test_cpu PASSED in 11.5s //tensorflow/python/ops/parallel_for:xla_control_flow_ops_test_cpu PASSED in 62.7s //tensorflow/python/ops/ragged:convert_to_tensor_or_ragged_tensor_op_test PASSED in 6.6s //tensorflow/python/ops/ragged:ragged_batch_gather_op_test PASSED in 40.8s //tensorflow/python/ops/ragged:ragged_bitcast_op_test PASSED in 7.5s //tensorflow/python/ops/ragged:ragged_boolean_mask_op_test PASSED in 16.2s //tensorflow/python/ops/ragged:ragged_concat_op_test PASSED in 10.0s //tensorflow/python/ops/ragged:ragged_const_op_test PASSED in 9.0s //tensorflow/python/ops/ragged:ragged_constant_value_op_test PASSED in 6.4s //tensorflow/python/ops/ragged:ragged_cross_op_test PASSED in 20.1s //tensorflow/python/ops/ragged:ragged_dispatch_test PASSED in 129.7s //tensorflow/python/ops/ragged:ragged_dynamic_partition_op_test_cpu PASSED in 14.9s //tensorflow/python/ops/ragged:ragged_eager_test PASSED in 8.4s //tensorflow/python/ops/ragged:ragged_expand_dims_op_test PASSED in 11.4s //tensorflow/python/ops/ragged:ragged_factory_ops_test_cpu PASSED in 13.5s //tensorflow/python/ops/ragged:ragged_from_sparse_op_test PASSED in 8.0s //tensorflow/python/ops/ragged:ragged_from_tensor_op_test PASSED in 19.8s //tensorflow/python/ops/ragged:ragged_gather_nd_op_test PASSED in 13.8s //tensorflow/python/ops/ragged:ragged_map_flat_values_op_test PASSED in 9.4s //tensorflow/python/ops/ragged:ragged_map_fn_op_test PASSED in 15.8s //tensorflow/python/ops/ragged:ragged_math_ops_test PASSED in 16.2s //tensorflow/python/ops/ragged:ragged_matmul_op_test PASSED in 34.7s //tensorflow/python/ops/ragged:ragged_merge_dims_op_test PASSED in 28.3s //tensorflow/python/ops/ragged:ragged_one_hot_op_test PASSED in 9.4s //tensorflow/python/ops/ragged:ragged_operators_test PASSED in 21.2s //tensorflow/python/ops/ragged:ragged_placeholder_op_test PASSED in 5.7s //tensorflow/python/ops/ragged:ragged_print_op_test PASSED in 12.4s //tensorflow/python/ops/ragged:ragged_range_op_test PASSED in 6.8s //tensorflow/python/ops/ragged:ragged_rank_op_test PASSED in 5.9s //tensorflow/python/ops/ragged:ragged_reduce_op_test PASSED in 37.9s //tensorflow/python/ops/ragged:ragged_resize_image_op_test PASSED in 22.1s //tensorflow/python/ops/ragged:ragged_reverse_op_test PASSED in 6.2s //tensorflow/python/ops/ragged:ragged_row_lengths_op_test PASSED in 11.5s //tensorflow/python/ops/ragged:ragged_row_splits_to_segment_ids_op_test PASSED in 6.5s //tensorflow/python/ops/ragged:ragged_segment_ids_to_row_splits_op_test PASSED in 7.9s //tensorflow/python/ops/ragged:ragged_segment_op_test PASSED in 17.7s //tensorflow/python/ops/ragged:ragged_size_op_test PASSED in 5.7s //tensorflow/python/ops/ragged:ragged_split_op_test PASSED in 42.0s //tensorflow/python/ops/ragged:ragged_squeeze_op_test PASSED in 23.2s //tensorflow/python/ops/ragged:ragged_stack_op_test PASSED in 17.2s //tensorflow/python/ops/ragged:ragged_tensor_bounding_shape_op_test PASSED in 8.8s //tensorflow/python/ops/ragged:ragged_tensor_shape_test PASSED in 67.6s //tensorflow/python/ops/ragged:ragged_tile_op_test PASSED in 50.5s //tensorflow/python/ops/ragged:ragged_to_sparse_op_test PASSED in 8.7s //tensorflow/python/ops/ragged:ragged_to_tensor_op_test PASSED in 66.9s //tensorflow/python/ops/ragged:ragged_util_test PASSED in 24.5s //tensorflow/python/ops/ragged:ragged_where_op_test PASSED in 36.4s //tensorflow/python/ops/ragged:row_partition_test PASSED in 28.8s //tensorflow/python/ops/ragged:string_ngrams_op_test PASSED in 7.7s //tensorflow/python/ops/ragged:strings_reduce_join_op_test PASSED in 8.4s //tensorflow/python/ops/structured:structured_array_ops_test PASSED in 45.2s //tensorflow/python/ops/structured:structured_tensor_slice_test PASSED in 59.2s //tensorflow/python/ops/structured:structured_tensor_spec_test PASSED in 10.1s //tensorflow/python/ops/structured:structured_tensor_test PASSED in 42.4s //tensorflow/python/ops/v1_compat_tests:gradient_checker_test_cpu PASSED in 11.7s //tensorflow/python/platform:benchmark_test PASSED in 7.6s //tensorflow/python/platform:build_info_test PASSED in 6.4s //tensorflow/python/platform:resource_loader_test PASSED in 1.7s //tensorflow/python/profiler:pprof_profiler_test PASSED in 7.0s //tensorflow/python/profiler:profile_context_test_cpu PASSED in 37.5s //tensorflow/python/profiler:profiler_client_test_cpu PASSED in 6.0s //tensorflow/python/profiler:profiler_test_cpu PASSED in 21.4s //tensorflow/python/profiler:profiler_v2_test_cpu PASSED in 6.7s //tensorflow/python/profiler:profiler_wrapper_test PASSED in 10.1s //tensorflow/python/profiler:tfprof_logger_test PASSED in 5.7s //tensorflow/python/profiler/integration_test:profiler_api_test_cpu PASSED in 27.1s //tensorflow/python/profiler/internal:flops_registry_test PASSED in 5.8s //tensorflow/python/profiler/internal:print_model_analysis_test PASSED in 5.3s //tensorflow/python/profiler/internal:run_metadata_test_cpu PASSED in 15.1s //tensorflow/python/saved_model:fingerprinting_test PASSED in 8.3s //tensorflow/python/saved_model:keras_injection_test PASSED in 12.7s //tensorflow/python/saved_model:load_v1_in_v2_test PASSED in 15.6s //tensorflow/python/saved_model:loader_test PASSED in 12.1s //tensorflow/python/saved_model:method_name_updater_test PASSED in 6.5s //tensorflow/python/saved_model:metrics_test PASSED in 14.3s //tensorflow/python/saved_model:nested_structure_coder_test PASSED in 7.1s //tensorflow/python/saved_model:pywrap_saved_model_fingerprinting_test PASSED in 6.0s //tensorflow/python/saved_model:pywrap_saved_model_metrics_test PASSED in 5.9s //tensorflow/python/saved_model:revived_types_test PASSED in 7.4s //tensorflow/python/saved_model:save_context_test PASSED in 5.7s //tensorflow/python/saved_model:save_test PASSED in 23.0s //tensorflow/python/saved_model:saved_model_test PASSED in 17.6s //tensorflow/python/saved_model:signature_def_utils_test PASSED in 6.0s //tensorflow/python/saved_model:simple_save_test PASSED in 11.6s //tensorflow/python/saved_model:tracing_utils_test PASSED in 8.2s //tensorflow/python/saved_model:utils_test PASSED in 5.9s //tensorflow/python/saved_model/model_utils:export_output_test PASSED in 6.9s //tensorflow/python/saved_model/model_utils:export_test PASSED in 10.3s //tensorflow/python/saved_model/model_utils:mode_keys_test PASSED in 6.5s //tensorflow/python/saved_model/registration:registration_saving_test PASSED in 15.4s //tensorflow/python/saved_model/registration:registration_test PASSED in 5.6s //tensorflow/python/saved_model/registration:tf_registration_test PASSED in 15.0s //tensorflow/python/summary:plugin_asset_test PASSED in 5.4s //tensorflow/python/summary:summary_iterator_test PASSED in 5.6s //tensorflow/python/summary:summary_test PASSED in 9.5s //tensorflow/python/summary:summary_v2_test PASSED in 7.6s //tensorflow/python/summary/writer:writer_test PASSED in 16.8s //tensorflow/python/tools:aot_compiled_test PASSED in 28.8s //tensorflow/python/tools:freeze_graph_test PASSED in 15.9s //tensorflow/python/tools:optimize_for_inference_test PASSED in 5.9s //tensorflow/python/tools:print_selective_registration_header_test PASSED in 14.6s //tensorflow/python/tools:saved_model_cli_test PASSED in 21.2s //tensorflow/python/tools:saved_model_utils_test PASSED in 6.4s //tensorflow/python/tools:strip_unused_test PASSED in 6.1s //tensorflow/python/tools/api/generator:create_python_api_test PASSED in 13.3s //tensorflow/python/tools/api/generator:output_init_files_test PASSED in 17.6s //tensorflow/python/tools/api/generator:tensorflow_doc_srcs_test PASSED in 16.3s //tensorflow/python/tpu:bfloat16_test PASSED in 13.6s //tensorflow/python/tpu:feature_column_test PASSED in 10.8s //tensorflow/python/tpu:topology_test PASSED in 8.5s //tensorflow/python/tpu:tpu_embedding_for_serving_test PASSED in 10.9s //tensorflow/python/tpu:tpu_embedding_v2_utils_test PASSED in 8.5s //tensorflow/python/tpu:tpu_infeed_test PASSED in 13.9s //tensorflow/python/tpu:tpu_sharding_test PASSED in 6.2s //tensorflow/python/tpu:tpu_test_wrapper_test PASSED in 6.6s //tensorflow/python/tpu/client:client_py_test PASSED in 7.9s //tensorflow/python/trackable:autotrackable_test PASSED in 8.6s //tensorflow/python/trackable:base_delegate_test PASSED in 8.5s //tensorflow/python/trackable:base_test PASSED in 7.6s //tensorflow/python/trackable:data_structures_test PASSED in 10.2s //tensorflow/python/trackable:python_state_test PASSED in 7.3s //tensorflow/python/trackable:resource_test PASSED in 5.7s //tensorflow/python/trackable:trackable_utils_test PASSED in 5.9s //tensorflow/python/training:adadelta_test_cpu PASSED in 15.2s //tensorflow/python/training:adagrad_da_test_cpu PASSED in 8.5s //tensorflow/python/training:adagrad_test_cpu PASSED in 13.1s //tensorflow/python/training:adam_test_cpu PASSED in 14.6s //tensorflow/python/training:basic_loops_test_cpu PASSED in 7.5s //tensorflow/python/training:basic_session_run_hooks_test PASSED in 20.0s //tensorflow/python/training:checkpoint_ops_test PASSED in 6.7s //tensorflow/python/training:coordinator_test_cpu PASSED in 13.9s //tensorflow/python/training:device_setter_test_cpu PASSED in 8.2s //tensorflow/python/training:ftrl_test_cpu PASSED in 13.3s //tensorflow/python/training:gradient_descent_test_cpu PASSED in 10.2s //tensorflow/python/training:input_test PASSED in 26.1s //tensorflow/python/training:momentum_test_cpu PASSED in 11.9s //tensorflow/python/training:monitored_session_test PASSED in 28.4s //tensorflow/python/training:moving_averages_test_cpu PASSED in 17.7s //tensorflow/python/training:optimizer_test_cpu PASSED in 9.9s //tensorflow/python/training:proximal_adagrad_test_cpu PASSED in 8.7s //tensorflow/python/training:proximal_gradient_descent_test_cpu PASSED in 8.4s //tensorflow/python/training:quantize_training_test_cpu PASSED in 6.4s //tensorflow/python/training:queue_runner_test_cpu PASSED in 7.0s //tensorflow/python/training:rmsprop_test_cpu PASSED in 22.7s //tensorflow/python/training:saver_large_partitioned_variable_test PASSED in 15.0s //tensorflow/python/training:saver_test_2gpu PASSED in 37.1s //tensorflow/python/training:saver_test_cpu PASSED in 31.8s //tensorflow/python/training:server_lib_multiple_containers_test PASSED in 7.1s //tensorflow/python/training:server_lib_same_variables_clear_container_test PASSED in 7.9s //tensorflow/python/training:server_lib_same_variables_clear_test PASSED in 8.1s //tensorflow/python/training:server_lib_same_variables_no_clear_test PASSED in 7.4s //tensorflow/python/training:server_lib_sparse_job_test PASSED in 6.4s //tensorflow/python/training:session_manager_test_cpu PASSED in 75.9s //tensorflow/python/training:slot_creator_test_cpu PASSED in 7.5s //tensorflow/python/training:supervisor_test PASSED in 13.4s //tensorflow/python/training:training_ops_mlir_test_cpu PASSED in 5.9s //tensorflow/python/training:training_ops_test_cpu PASSED in 6.7s //tensorflow/python/training:training_util_test PASSED in 7.4s //tensorflow/python/training:warm_starting_util_test PASSED in 22.2s //tensorflow/python/training/experimental:loss_scale_optimizer_test PASSED in 14.0s //tensorflow/python/training/experimental:loss_scale_test PASSED in 29.1s //tensorflow/python/training/experimental:mixed_precision_test_cpu PASSED in 8.8s //tensorflow/python/training/saving:saveable_object_util_test PASSED in 6.9s //tensorflow/python/util:compat_test PASSED in 7.7s //tensorflow/python/util:decorator_utils_test PASSED in 6.3s //tensorflow/python/util:deprecation_test PASSED in 6.2s //tensorflow/python/util:dispatch_test PASSED in 9.1s //tensorflow/python/util:example_parser_configuration_test PASSED in 5.5s //tensorflow/python/util:fast_module_type_test PASSED in 5.8s //tensorflow/python/util:function_parameter_canonicalizer_test PASSED in 6.5s //tensorflow/python/util:function_utils_test PASSED in 6.2s //tensorflow/python/util:keyword_args_test PASSED in 5.9s //tensorflow/python/util:lock_util_test PASSED in 7.3s //tensorflow/python/util:module_wrapper_test PASSED in 6.3s //tensorflow/python/util:nest_test PASSED in 11.5s //tensorflow/python/util:object_identity_test PASSED in 5.7s //tensorflow/python/util:serialization_test PASSED in 6.7s //tensorflow/python/util:tf_contextlib_test PASSED in 6.7s //tensorflow/python/util:tf_decorator_test PASSED in 6.0s //tensorflow/python/util:tf_export_test PASSED in 7.2s //tensorflow/python/util:tf_inspect_test PASSED in 7.0s //tensorflow/python/util:tf_should_use_test PASSED in 6.7s //tensorflow/python/util:tf_stack_test PASSED in 7.0s //tensorflow/python/util:traceback_utils_test PASSED in 7.0s //tensorflow/python/util:type_annotations_test PASSED in 6.8s //tensorflow/python/util:variable_utils_test PASSED in 9.3s //tensorflow/tools/api/tests:module_test PASSED in 14.1s //tensorflow/tools/benchmark:benchmark_model_test PASSED in 6.1s //tensorflow/tools/common:public_api_test PASSED in 1.9s //tensorflow/tools/common:traverse_test PASSED in 3.2s //tensorflow/tools/compatibility:all_renames_v2_test PASSED in 5.6s //tensorflow/tools/compatibility:ast_edits_test PASSED in 6.3s //tensorflow/tools/compatibility:test_file_v1_0 PASSED in 19.7s //tensorflow/tools/compatibility:test_file_v2_0 PASSED in 14.6s //tensorflow/tools/compatibility:tf_upgrade_test PASSED in 5.4s //tensorflow/tools/compatibility:tf_upgrade_v2_safety_test PASSED in 5.9s //tensorflow/tools/docs:tf_doctest_test PASSED in 2.1s //tensorflow/tools/graph_transforms:file_utils_test PASSED in 0.8s //tensorflow/tools/graph_transforms:transform_graph_test PASSED in 3.6s //tensorflow/tools/graph_transforms:transform_utils_test PASSED in 3.4s //tensorflow/tools/graph_transforms:transforms_test PASSED in 4.0s //tensorflow/tools/proto_text:gen_proto_text_functions_lib_test PASSED in 0.2s //tensorflow/tools/tensorflow_builder/compat_checker:compat_checker_test PASSED in 0.3s //tensorflow/tsl/c:tsl_status_helper_test PASSED in 0.3s //tensorflow/tsl/c:tsl_status_test PASSED in 0.1s //tensorflow/tsl/concurrency:async_value_ref_test PASSED in 0.1s //tensorflow/tsl/concurrency:async_value_test PASSED in 0.2s //tensorflow/tsl/concurrency:concurrent_vector_test PASSED in 0.6s //tensorflow/tsl/cuda:cudnn_version_test PASSED in 0.1s //tensorflow/tsl/distributed_runtime/coordination:coordination_service_agent_test PASSED in 12.7s //tensorflow/tsl/distributed_runtime/coordination:coordination_service_error_util_test PASSED in 1.1s //tensorflow/tsl/distributed_runtime/coordination:coordination_service_recoverable_job_test PASSED in 0.5s //tensorflow/tsl/distributed_runtime/preemption:preemption_notifier_test PASSED in 6.0s //tensorflow/tsl/distributed_runtime/preemption:preemption_sync_manager_test PASSED in 5.7s //tensorflow/tsl/distributed_runtime/rpc:grpc_channel_test PASSED in 0.3s //tensorflow/tsl/distributed_runtime/rpc:grpc_util_test PASSED in 0.2s //tensorflow/tsl/framework:cancellation_test PASSED in 1.6s //tensorflow/tsl/lib/gtl:tsl_lib_gtl_tests PASSED in 0.4s //tensorflow/tsl/lib/hash:crc32c_test PASSED in 0.4s //tensorflow/tsl/lib/histogram:histogram_test PASSED in 0.1s //tensorflow/tsl/lib/io:buffered_inputstream_test PASSED in 0.2s //tensorflow/tsl/lib/io:cache_test PASSED in 0.3s //tensorflow/tsl/lib/io:inputbuffer_test PASSED in 1.7s //tensorflow/tsl/lib/io:inputstream_interface_test PASSED in 0.1s //tensorflow/tsl/lib/io:random_inputstream_test PASSED in 0.3s //tensorflow/tsl/lib/io:record_reader_writer_test PASSED in 1.1s //tensorflow/tsl/lib/io:recordio_test PASSED in 0.3s //tensorflow/tsl/lib/io:table_test PASSED in 3.8s //tensorflow/tsl/lib/io:zlib_buffers_test PASSED in 2.3s //tensorflow/tsl/lib/io/snappy:snappy_test PASSED in 1.0s //tensorflow/tsl/lib/math:math_util_test PASSED in 0.3s //tensorflow/tsl/lib/random:distribution_sampler_test PASSED in 0.1s //tensorflow/tsl/lib/random:philox_random_test PASSED in 0.1s //tensorflow/tsl/lib/random:random_distributions_test PASSED in 17.9s //tensorflow/tsl/lib/random:simple_philox_test PASSED in 0.2s //tensorflow/tsl/lib/random:weighted_picker_test PASSED in 11.8s //tensorflow/tsl/platform:ctstring_test PASSED in 0.1s //tensorflow/tsl/platform:denormal_test PASSED in 0.3s //tensorflow/tsl/platform:errors_test PASSED in 0.3s //tensorflow/tsl/platform:fingerprint_test PASSED in 0.1s //tensorflow/tsl/platform:float8_test PASSED in 0.5s //tensorflow/tsl/platform:hash_test PASSED in 0.1s //tensorflow/tsl/platform:integral_types_test PASSED in 0.3s //tensorflow/tsl/platform:intrusive_ptr_test PASSED in 0.2s //tensorflow/tsl/platform:logging_test PASSED in 23.6s //tensorflow/tsl/platform:mutex_test PASSED in 0.1s //tensorflow/tsl/platform:net_test PASSED in 0.2s //tensorflow/tsl/platform:numbers_test PASSED in 0.1s //tensorflow/tsl/platform:path_test PASSED in 0.1s //tensorflow/tsl/platform:port_test PASSED in 8.3s //tensorflow/tsl/platform:random_test PASSED in 3.2s //tensorflow/tsl/platform:refcount_test PASSED in 1.0s //tensorflow/tsl/platform:retrying_file_system_test PASSED in 0.1s //tensorflow/tsl/platform:retrying_utils_test PASSED in 0.1s //tensorflow/tsl/platform:scanner_test PASSED in 0.2s //tensorflow/tsl/platform:setround_test PASSED in 0.3s //tensorflow/tsl/platform:stacktrace_handler_test PASSED in 2.1s //tensorflow/tsl/platform:stacktrace_test PASSED in 0.6s //tensorflow/tsl/platform:status_matchers_test PASSED in 0.1s //tensorflow/tsl/platform:status_test PASSED in 0.2s //tensorflow/tsl/platform:statusor_test PASSED in 17.1s //tensorflow/tsl/platform:str_util_test PASSED in 0.1s //tensorflow/tsl/platform:strcat_test PASSED in 0.2s //tensorflow/tsl/platform:stringpiece_test PASSED in 0.3s //tensorflow/tsl/platform:stringprintf_test PASSED in 0.3s //tensorflow/tsl/platform:subprocess_test PASSED in 0.5s //tensorflow/tsl/platform:tstring_test PASSED in 0.1s //tensorflow/tsl/platform:unbounded_work_queue_test PASSED in 0.6s //tensorflow/tsl/platform/cloud:compute_engine_metadata_client_test PASSED in 0.2s //tensorflow/tsl/platform/cloud:compute_engine_zone_provider_test PASSED in 0.1s //tensorflow/tsl/platform/cloud:curl_http_request_test PASSED in 7.2s //tensorflow/tsl/platform/cloud:expiring_lru_cache_test PASSED in 0.2s //tensorflow/tsl/platform/cloud:gcs_dns_cache_test PASSED in 0.2s //tensorflow/tsl/platform/cloud:gcs_file_system_test PASSED in 6.6s //tensorflow/tsl/platform/cloud:gcs_throttle_test PASSED in 0.3s //tensorflow/tsl/platform/cloud:google_auth_provider_test PASSED in 0.2s //tensorflow/tsl/platform/cloud:oauth_client_test PASSED in 0.3s //tensorflow/tsl/platform/cloud:ram_file_block_cache_test PASSED in 2.4s //tensorflow/tsl/platform/cloud:time_util_test PASSED in 0.1s //tensorflow/tsl/profiler/backends/cpu:traceme_recorder_test PASSED in 0.4s //tensorflow/tsl/profiler/convert:trace_events_to_json_test PASSED in 0.1s //tensorflow/tsl/profiler/convert:xla_op_utils_test PASSED in 0.1s //tensorflow/tsl/profiler/convert:xplane_to_trace_events_test PASSED in 0.1s //tensorflow/tsl/profiler/lib:profiler_factory_test PASSED in 0.2s //tensorflow/tsl/profiler/lib:profiler_lock_test PASSED in 0.1s //tensorflow/tsl/profiler/lib:scoped_annotation_test PASSED in 0.5s //tensorflow/tsl/profiler/lib:traceme_encode_test PASSED in 0.1s //tensorflow/tsl/profiler/rpc/client:profiler_client_test PASSED in 3.4s //tensorflow/tsl/profiler/rpc/client:remote_profiler_session_manager_test PASSED in 3.3s //tensorflow/tsl/profiler/utils:buffer_pool_test PASSED in 0.1s //tensorflow/tsl/profiler/utils:group_events_test PASSED in 0.3s //tensorflow/tsl/profiler/utils:parse_annotation_test PASSED in 0.2s //tensorflow/tsl/profiler/utils:tf_op_utils_test PASSED in 0.1s //tensorflow/tsl/profiler/utils:timespan_test PASSED in 0.2s //tensorflow/tsl/profiler/utils:tpu_xplane_utils_test PASSED in 0.2s //tensorflow/tsl/profiler/utils:xplane_builder_test PASSED in 0.1s //tensorflow/tsl/profiler/utils:xplane_utils_test PASSED in 0.2s //tensorflow/tsl/util:device_name_utils_test PASSED in 0.2s //tensorflow/tsl/util:stats_calculator_test PASSED in 0.1s //tensorflow/compiler/tests:complex_div_test_cpu PASSED in 8.8s Stats over 2 runs: max = 8.8s, min = 8.1s, avg = 8.5s, dev = 0.4s //tensorflow/compiler/tests:complex_div_test_cpu_mlir_bridge_test PASSED in 7.5s Stats over 2 runs: max = 7.5s, min = 6.2s, avg = 6.8s, dev = 0.7s //tensorflow/compiler/xla/tests:conditional_test_cpu PASSED in 11.2s Stats over 2 runs: max = 11.2s, min = 9.1s, avg = 10.1s, dev = 1.1s //tensorflow/python:control_flow_ops_test_cpu PASSED in 38.5s Stats over 2 runs: max = 38.5s, min = 36.1s, avg = 37.3s, dev = 1.2s //tensorflow/python/data/experimental/kernel_tests/optimization:optimization_test PASSED in 17.8s Stats over 2 runs: max = 17.8s, min = 11.7s, avg = 14.8s, dev = 3.0s //tensorflow/python/data/experimental/kernel_tests/service:metadata_test PASSED in 15.5s Stats over 2 runs: max = 15.5s, min = 13.0s, avg = 14.3s, dev = 1.2s //tensorflow/python/data/kernel_tests:padded_batch_test PASSED in 27.2s Stats over 2 runs: max = 27.2s, min = 26.4s, avg = 26.8s, dev = 0.4s //tensorflow/python/data/kernel_tests:repeat_test PASSED in 39.7s Stats over 2 runs: max = 39.7s, min = 39.3s, avg = 39.5s, dev = 0.2s //tensorflow/python/data/kernel_tests:window_test PASSED in 37.6s Stats over 2 runs: max = 37.6s, min = 28.1s, avg = 32.8s, dev = 4.8s //tensorflow/python/distribute:strategy_common_test_2gpu PASSED in 27.0s Stats over 2 runs: max = 27.0s, min = 21.4s, avg = 24.2s, dev = 2.8s //tensorflow/python/distribute:strategy_common_test_cpu PASSED in 25.2s Stats over 2 runs: max = 25.2s, min = 20.5s, avg = 22.9s, dev = 2.4s //tensorflow/python/distribute:strategy_common_test_xla_2gpu PASSED in 16.4s Stats over 2 runs: max = 16.4s, min = 16.2s, avg = 16.3s, dev = 0.1s //tensorflow/python/kernel_tests/array_ops:scatter_nd_ops_test_cpu PASSED in 12.1s Stats over 2 runs: max = 12.1s, min = 11.5s, avg = 11.8s, dev = 0.3s //tensorflow/python/kernel_tests/array_ops:scatter_ops_test_cpu PASSED in 21.6s Stats over 2 runs: max = 21.6s, min = 19.4s, avg = 20.5s, dev = 1.1s //tensorflow/python/kernel_tests/control_flow:functional_ops_test_cpu PASSED in 13.0s Stats over 2 runs: max = 13.0s, min = 12.9s, avg = 13.0s, dev = 0.1s //tensorflow/python/kernel_tests/control_flow:map_fn_test_cpu PASSED in 14.6s Stats over 2 runs: max = 14.6s, min = 13.6s, avg = 14.1s, dev = 0.5s //tensorflow/python/kernel_tests/nn_ops:bias_op_d9m_test_cpu PASSED in 130.9s Stats over 2 runs: max = 130.9s, min = 61.4s, avg = 96.2s, dev = 34.7s //tensorflow/python/kernel_tests/nn_ops:conv2d_backprop_filter_grad_test_cpu PASSED in 162.0s Stats over 2 runs: max = 162.0s, min = 10.5s, avg = 86.3s, dev = 75.7s //tensorflow/compiler/tests:spacetobatch_op_test_cpu PASSED in 7.8s Stats over 3 runs: max = 7.8s, min = 7.1s, avg = 7.4s, dev = 0.3s //tensorflow/compiler/tests:spacetobatch_op_test_cpu_mlir_bridge_test PASSED in 9.6s Stats over 3 runs: max = 9.6s, min = 9.3s, avg = 9.4s, dev = 0.1s //tensorflow/compiler/xla/tests:triangular_solve_test_cpu PASSED in 61.9s Stats over 3 runs: max = 61.9s, min = 57.3s, avg = 59.8s, dev = 1.9s //tensorflow/core/data/service:thread_safe_buffer_test PASSED in 0.7s Stats over 3 runs: max = 0.7s, min = 0.5s, avg = 0.6s, dev = 0.1s //tensorflow/python/data/experimental/kernel_tests/service:multi_process_cluster_test PASSED in 14.9s Stats over 3 runs: max = 14.9s, min = 10.5s, avg = 13.1s, dev = 1.9s //tensorflow/python/data/kernel_tests:unique_test PASSED in 14.3s Stats over 3 runs: max = 14.3s, min = 11.4s, avg = 12.5s, dev = 1.3s //tensorflow/python/kernel_tests/array_ops:gather_op_test_cpu PASSED in 44.7s Stats over 3 runs: max = 44.7s, min = 23.8s, avg = 31.5s, dev = 9.4s //tensorflow/python/kernel_tests/array_ops:weights_broadcast_test PASSED in 9.2s Stats over 3 runs: max = 9.2s, min = 8.8s, avg = 9.0s, dev = 0.2s //tensorflow/python/kernel_tests/distributions:util_test_cpu PASSED in 12.5s Stats over 3 runs: max = 12.5s, min = 10.7s, avg = 11.4s, dev = 0.8s //tensorflow/python/kernel_tests/random:multinomial_op_big_test_cpu PASSED in 14.3s Stats over 3 runs: max = 14.3s, min = 11.0s, avg = 12.2s, dev = 1.5s //tensorflow/python/kernel_tests/proto:decode_proto_op_test FAILED in 3 out of 3 in 7.5s Stats over 3 runs: max = 7.5s, min = 3.9s, avg = 5.2s, dev = 1.6s /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/kernel_tests/proto/decode_proto_op_test/test.log /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/kernel_tests/proto/decode_proto_op_test/test_attempts/attempt_1.log /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/kernel_tests/proto/decode_proto_op_test/test_attempts/attempt_2.log //tensorflow/python/util/protobuf:protobuf_compare_test FAILED in 3 out of 3 in 3.8s Stats over 3 runs: max = 3.8s, min = 2.6s, avg = 3.2s, dev = 0.5s /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/util/protobuf/protobuf_compare_test/test.log /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/util/protobuf/protobuf_compare_test/test_attempts/attempt_1.log /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/util/protobuf/protobuf_compare_test/test_attempts/attempt_2.log //tensorflow/tools/api/tests:api_compatibility_test FAILED in 3 out of 3 in 25.0s Stats over 3 runs: max = 25.0s, min = 18.3s, avg = 20.8s, dev = 3.0s /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/tools/api/tests/api_compatibility_test/test.log /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/tools/api/tests/api_compatibility_test/test_attempts/attempt_1.log /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/tools/api/tests/api_compatibility_test/test_attempts/attempt_2.log //tensorflow/compiler/tests:ternary_ops_test_cpu PASSED in 14.7s Stats over 4 runs: max = 14.7s, min = 9.6s, avg = 12.0s, dev = 2.1s //tensorflow/compiler/tests:ternary_ops_test_cpu_mlir_bridge_test PASSED in 14.5s Stats over 4 runs: max = 14.5s, min = 9.4s, avg = 11.3s, dev = 2.0s //tensorflow/compiler/tests:unary_ops_test_cpu PASSED in 39.1s Stats over 4 runs: max = 39.1s, min = 8.2s, avg = 26.3s, dev = 12.7s //tensorflow/compiler/tests:unary_ops_test_cpu_mlir_bridge_test PASSED in 40.4s Stats over 4 runs: max = 40.4s, min = 9.7s, avg = 27.6s, dev = 13.1s //tensorflow/compiler/xla/tests:dynamic_ops_test_cpu PASSED in 10.3s Stats over 4 runs: max = 10.3s, min = 8.0s, avg = 9.1s, dev = 0.9s //tensorflow/core/kernels:example_parsing_ops_test PASSED in 0.7s Stats over 4 runs: max = 0.7s, min = 0.5s, avg = 0.6s, dev = 0.1s //tensorflow/python:nn_batchnorm_test_cpu PASSED in 21.3s Stats over 4 runs: max = 21.3s, min = 8.3s, avg = 16.1s, dev = 5.1s //tensorflow/python:nn_fused_batchnorm_d9m_test_cpu PASSED in 14.3s Stats over 4 runs: max = 14.3s, min = 13.1s, avg = 13.7s, dev = 0.5s //tensorflow/python/data/experimental/kernel_tests:auto_shard_dataset_test PASSED in 33.3s Stats over 4 runs: max = 33.3s, min = 14.0s, avg = 23.6s, dev = 7.0s //tensorflow/python/data/experimental/kernel_tests:map_and_batch_test PASSED in 45.4s Stats over 4 runs: max = 45.4s, min = 27.3s, avg = 33.5s, dev = 7.2s //tensorflow/python/data/experimental/kernel_tests:parse_example_dataset_test PASSED in 36.2s Stats over 4 runs: max = 36.2s, min = 19.2s, avg = 27.2s, dev = 7.9s //tensorflow/python/data/experimental/kernel_tests:rebatch_dataset_test PASSED in 14.1s Stats over 4 runs: max = 14.1s, min = 6.7s, avg = 9.7s, dev = 2.9s //tensorflow/python/data/experimental/kernel_tests:sql_dataset_test PASSED in 34.4s Stats over 4 runs: max = 34.4s, min = 21.5s, avg = 28.6s, dev = 5.3s //tensorflow/python/data/experimental/kernel_tests/service:cross_trainer_cache_ft_test PASSED in 7.7s Stats over 4 runs: max = 7.7s, min = 6.4s, avg = 7.1s, dev = 0.5s //tensorflow/python/data/kernel_tests:batch_test PASSED in 34.1s Stats over 4 runs: max = 34.1s, min = 20.3s, avg = 26.0s, dev = 5.0s //tensorflow/python/data/kernel_tests:fixed_length_record_dataset_test PASSED in 17.1s Stats over 4 runs: max = 17.1s, min = 9.4s, avg = 12.9s, dev = 3.2s //tensorflow/python/data/kernel_tests:from_generator_test PASSED in 27.8s Stats over 4 runs: max = 27.8s, min = 16.2s, avg = 21.5s, dev = 4.3s //tensorflow/python/data/kernel_tests:group_by_window_test PASSED in 20.6s Stats over 4 runs: max = 20.6s, min = 6.5s, avg = 12.4s, dev = 6.0s //tensorflow/python/data/kernel_tests:ragged_batch_test PASSED in 17.4s Stats over 4 runs: max = 17.4s, min = 16.3s, avg = 16.9s, dev = 0.5s //tensorflow/python/data/kernel_tests:shuffle_test PASSED in 33.2s Stats over 4 runs: max = 33.2s, min = 23.2s, avg = 27.6s, dev = 4.3s //tensorflow/python/data/kernel_tests:skip_test PASSED in 24.6s Stats over 4 runs: max = 24.6s, min = 17.8s, avg = 21.7s, dev = 2.9s //tensorflow/python/data/kernel_tests:take_test PASSED in 43.8s Stats over 4 runs: max = 43.8s, min = 40.1s, avg = 42.8s, dev = 1.6s //tensorflow/python/data/kernel_tests:take_while_test PASSED in 45.6s Stats over 4 runs: max = 45.6s, min = 42.9s, avg = 44.6s, dev = 1.0s //tensorflow/python/data/kernel_tests:text_line_dataset_test PASSED in 20.1s Stats over 4 runs: max = 20.1s, min = 14.4s, avg = 17.2s, dev = 2.6s //tensorflow/python/data/kernel_tests:zip_test PASSED in 14.5s Stats over 4 runs: max = 14.5s, min = 12.9s, avg = 13.4s, dev = 0.7s //tensorflow/python/debug/lib:dumping_callback_test_cpu PASSED in 15.0s Stats over 4 runs: max = 15.0s, min = 12.1s, avg = 13.7s, dev = 1.0s //tensorflow/python/distribute:cross_device_ops_test_2gpu PASSED in 31.9s Stats over 4 runs: max = 31.9s, min = 21.3s, avg = 26.4s, dev = 3.9s //tensorflow/python/distribute:cross_device_ops_test_cpu PASSED in 28.9s Stats over 4 runs: max = 28.9s, min = 19.9s, avg = 23.6s, dev = 3.7s //tensorflow/python/distribute:strategy_gather_test_2gpu PASSED in 26.5s Stats over 4 runs: max = 26.5s, min = 14.3s, avg = 20.1s, dev = 5.5s //tensorflow/python/distribute:strategy_gather_test_cpu PASSED in 26.6s Stats over 4 runs: max = 26.6s, min = 15.4s, avg = 20.7s, dev = 5.2s //tensorflow/python/distribute:strategy_gather_test_xla_2gpu PASSED in 16.5s Stats over 4 runs: max = 16.5s, min = 7.6s, avg = 12.2s, dev = 3.8s //tensorflow/python/framework:convert_to_constants_test PASSED in 24.3s Stats over 4 runs: max = 24.3s, min = 16.0s, avg = 19.8s, dev = 3.0s //tensorflow/python/kernel_tests:collective_ops_test_2gpu PASSED in 35.6s Stats over 4 runs: max = 35.6s, min = 33.9s, avg = 34.6s, dev = 0.6s //tensorflow/python/kernel_tests:collective_ops_test_cpu PASSED in 36.2s Stats over 4 runs: max = 36.2s, min = 32.9s, avg = 34.8s, dev = 1.3s //tensorflow/python/kernel_tests/array_ops:concat_op_test_cpu PASSED in 27.2s Stats over 4 runs: max = 27.2s, min = 14.0s, avg = 20.1s, dev = 5.1s //tensorflow/python/kernel_tests/array_ops:init_ops_test_cpu PASSED in 66.5s Stats over 4 runs: max = 66.5s, min = 20.5s, avg = 43.2s, dev = 19.9s //tensorflow/python/kernel_tests/array_ops:split_op_test_cpu PASSED in 26.5s Stats over 4 runs: max = 26.5s, min = 6.5s, avg = 13.6s, dev = 8.1s //tensorflow/python/kernel_tests/linalg:einsum_op_test_cpu PASSED in 123.0s Stats over 4 runs: max = 123.0s, min = 15.9s, avg = 57.1s, dev = 43.2s //tensorflow/python/kernel_tests/linalg:linear_operator_lower_triangular_test_cpu PASSED in 26.6s Stats over 4 runs: max = 26.6s, min = 25.0s, avg = 26.1s, dev = 0.7s //tensorflow/python/kernel_tests/random:random_gamma_test_cpu PASSED in 89.2s Stats over 4 runs: max = 89.2s, min = 7.2s, avg = 41.5s, dev = 35.4s //tensorflow/python/kernel_tests/signal:window_ops_test_cpu PASSED in 17.7s Stats over 4 runs: max = 17.7s, min = 15.5s, avg = 16.6s, dev = 1.0s //tensorflow/python/ops/ragged:ragged_gather_op_test PASSED in 73.9s Stats over 4 runs: max = 73.9s, min = 18.4s, avg = 42.3s, dev = 20.1s //tensorflow/python/ops/ragged:ragged_getitem_test PASSED in 51.2s Stats over 4 runs: max = 51.2s, min = 48.1s, avg = 49.5s, dev = 1.1s //tensorflow/tools/docs:tf_doctest PASSED in 42.1s Stats over 4 runs: max = 42.1s, min = 32.5s, avg = 36.7s, dev = 3.5s //tensorflow/compiler/tests:async_comp_test_cpu PASSED in 5.3s Stats over 5 runs: max = 5.3s, min = 5.1s, avg = 5.3s, dev = 0.1s //tensorflow/compiler/tests:conv3d_test_cpu PASSED in 13.5s Stats over 5 runs: max = 13.5s, min = 5.8s, avg = 9.0s, dev = 3.5s //tensorflow/compiler/tests:conv3d_test_cpu_mlir_bridge_test PASSED in 15.8s Stats over 5 runs: max = 15.8s, min = 6.2s, avg = 10.0s, dev = 4.1s //tensorflow/compiler/tests:depthwise_conv_op_test_cpu PASSED in 14.6s Stats over 5 runs: max = 14.6s, min = 7.7s, avg = 10.5s, dev = 2.6s //tensorflow/compiler/tests:depthwise_conv_op_test_cpu_mlir_bridge_test PASSED in 15.9s Stats over 5 runs: max = 15.9s, min = 8.9s, avg = 11.7s, dev = 2.8s //tensorflow/compiler/tests:fused_batchnorm_test_cpu PASSED in 8.1s Stats over 5 runs: max = 8.1s, min = 6.6s, avg = 7.2s, dev = 0.6s //tensorflow/compiler/tests:fused_batchnorm_test_cpu_mlir_bridge_test PASSED in 7.6s Stats over 5 runs: max = 7.6s, min = 6.6s, avg = 7.2s, dev = 0.3s //tensorflow/compiler/tests:image_ops_jit_compile_test_cpu PASSED in 7.2s Stats over 5 runs: max = 7.2s, min = 5.5s, avg = 6.2s, dev = 0.6s //tensorflow/compiler/tests:reduce_ops_test_cpu PASSED in 9.5s Stats over 5 runs: max = 9.5s, min = 8.1s, avg = 8.7s, dev = 0.5s //tensorflow/compiler/tests:reduce_ops_test_cpu_mlir_bridge_test PASSED in 11.3s Stats over 5 runs: max = 11.3s, min = 9.3s, avg = 10.1s, dev = 0.7s //tensorflow/compiler/tests:repeat_op_test_cpu PASSED in 6.9s Stats over 5 runs: max = 6.9s, min = 5.4s, avg = 5.8s, dev = 0.5s //tensorflow/compiler/tests:repeat_op_test_cpu_mlir_bridge_test PASSED in 6.4s Stats over 5 runs: max = 6.4s, min = 4.2s, avg = 5.3s, dev = 0.7s //tensorflow/compiler/tests:special_math_test_cpu PASSED in 135.7s Stats over 5 runs: max = 135.7s, min = 18.9s, avg = 62.7s, dev = 40.1s //tensorflow/compiler/tests:special_math_test_cpu_mlir_bridge_test PASSED in 107.5s Stats over 5 runs: max = 107.5s, min = 13.8s, avg = 48.7s, dev = 32.1s //tensorflow/compiler/xla/client/lib:self_adjoint_eig_test_cpu PASSED in 28.5s Stats over 5 runs: max = 28.5s, min = 12.8s, avg = 21.0s, dev = 6.4s //tensorflow/core/grappler/optimizers:constant_folding_test PASSED in 3.8s Stats over 5 runs: max = 3.8s, min = 2.6s, avg = 3.0s, dev = 0.4s //tensorflow/python/distribute:mirrored_strategy_test_2gpu PASSED in 9.4s Stats over 5 runs: max = 9.4s, min = 7.9s, avg = 8.8s, dev = 0.7s //tensorflow/python/distribute:mirrored_strategy_test_cpu PASSED in 9.8s Stats over 5 runs: max = 9.8s, min = 7.0s, avg = 8.6s, dev = 1.0s //tensorflow/python/distribute:moving_averages_test_2gpu PASSED in 20.2s Stats over 5 runs: max = 20.2s, min = 14.3s, avg = 16.7s, dev = 2.0s //tensorflow/python/distribute:moving_averages_test_cpu PASSED in 20.5s Stats over 5 runs: max = 20.5s, min = 14.8s, avg = 17.6s, dev = 2.0s //tensorflow/python/distribute:vars_test_2gpu PASSED in 15.0s Stats over 5 runs: max = 15.0s, min = 12.3s, avg = 13.8s, dev = 1.0s //tensorflow/python/distribute:vars_test_cpu PASSED in 18.6s Stats over 5 runs: max = 18.6s, min = 14.6s, avg = 15.7s, dev = 1.5s //tensorflow/python/eager:device_placement_test_cpu PASSED in 8.2s Stats over 5 runs: max = 8.2s, min = 7.2s, avg = 7.7s, dev = 0.4s //tensorflow/python/eager:forwardprop_test_cpu PASSED in 119.3s Stats over 5 runs: max = 119.3s, min = 13.8s, avg = 48.0s, dev = 36.8s //tensorflow/python/eager/polymorphic_function:gradients_test_cpu PASSED in 13.9s Stats over 5 runs: max = 13.9s, min = 9.2s, avg = 11.7s, dev = 1.9s //tensorflow/python/kernel_tests/linalg:cholesky_op_test_cpu PASSED in 86.3s Stats over 5 runs: max = 86.3s, min = 40.3s, avg = 56.6s, dev = 16.4s //tensorflow/python/kernel_tests/linalg:linear_operator_adjoint_test_cpu PASSED in 26.9s Stats over 5 runs: max = 26.9s, min = 24.8s, avg = 25.6s, dev = 0.8s //tensorflow/python/kernel_tests/linalg:linear_operator_composition_test_cpu PASSED in 46.6s Stats over 5 runs: max = 46.6s, min = 42.1s, avg = 43.9s, dev = 1.5s //tensorflow/python/kernel_tests/linalg:linear_operator_diag_test_cpu PASSED in 22.4s Stats over 5 runs: max = 22.4s, min = 21.0s, avg = 21.7s, dev = 0.6s //tensorflow/python/kernel_tests/linalg:linear_operator_full_matrix_test_cpu PASSED in 26.5s Stats over 5 runs: max = 26.5s, min = 24.0s, avg = 25.4s, dev = 0.9s //tensorflow/python/kernel_tests/linalg:linear_operator_householder_test_cpu PASSED in 28.0s Stats over 5 runs: max = 28.0s, min = 24.9s, avg = 26.1s, dev = 1.2s //tensorflow/python/kernel_tests/linalg:linear_operator_identity_test_cpu PASSED in 33.9s Stats over 5 runs: max = 33.9s, min = 31.7s, avg = 32.6s, dev = 0.8s //tensorflow/python/kernel_tests/linalg:linear_operator_inversion_test_cpu PASSED in 23.1s Stats over 5 runs: max = 23.1s, min = 21.8s, avg = 22.4s, dev = 0.6s //tensorflow/python/kernel_tests/linalg:linear_operator_permutation_test_cpu PASSED in 19.8s Stats over 5 runs: max = 19.8s, min = 18.1s, avg = 18.9s, dev = 0.6s //tensorflow/python/kernel_tests/linalg:linear_operator_toeplitz_test_cpu PASSED in 17.7s Stats over 5 runs: max = 17.7s, min = 14.0s, avg = 15.6s, dev = 1.3s //tensorflow/python/kernel_tests/linalg:linear_operator_tridiag_test_cpu PASSED in 91.7s Stats over 5 runs: max = 91.7s, min = 82.1s, avg = 85.1s, dev = 3.5s //tensorflow/python/kernel_tests/linalg:linear_operator_util_test_cpu PASSED in 7.5s Stats over 5 runs: max = 7.5s, min = 6.1s, avg = 6.9s, dev = 0.5s //tensorflow/python/kernel_tests/linalg:linear_operator_zeros_test_cpu PASSED in 14.0s Stats over 5 runs: max = 14.0s, min = 11.8s, avg = 13.2s, dev = 0.8s //tensorflow/python/kernel_tests/nn_ops:fractional_avg_pool_op_test PASSED in 16.9s Stats over 5 runs: max = 16.9s, min = 7.4s, avg = 10.1s, dev = 3.5s //tensorflow/python/kernel_tests/nn_ops:fractional_max_pool_op_test PASSED in 20.6s Stats over 5 runs: max = 20.6s, min = 7.5s, avg = 11.1s, dev = 4.9s //tensorflow/python/kernel_tests/sparse_ops:sparse_ops_test_cpu PASSED in 34.5s Stats over 5 runs: max = 34.5s, min = 7.0s, avg = 13.0s, dev = 10.8s //tensorflow/python/ops/parallel_for:math_test_cpu PASSED in 78.6s Stats over 5 runs: max = 78.6s, min = 24.1s, avg = 45.2s, dev = 19.6s //tensorflow/compiler/tests:scan_ops_test_cpu PASSED in 22.2s Stats over 6 runs: max = 22.2s, min = 17.4s, avg = 19.7s, dev = 1.4s //tensorflow/compiler/tests:scan_ops_test_cpu_mlir_bridge_test PASSED in 17.9s Stats over 6 runs: max = 17.9s, min = 11.3s, avg = 14.5s, dev = 1.9s //tensorflow/compiler/xla/tests:prng_test_cpu PASSED in 10.5s Stats over 6 runs: max = 10.5s, min = 9.1s, avg = 9.8s, dev = 0.5s //tensorflow/python:accumulate_n_benchmark_cpu PASSED in 5.7s Stats over 6 runs: max = 5.7s, min = 4.7s, avg = 5.3s, dev = 0.3s //tensorflow/python/data/experimental/kernel_tests:make_batched_features_dataset_test PASSED in 31.6s Stats over 6 runs: max = 31.6s, min = 6.2s, avg = 17.5s, dev = 11.3s //tensorflow/python/kernel_tests/array_ops:diag_op_test_cpu PASSED in 56.9s Stats over 6 runs: max = 56.9s, min = 7.0s, avg = 18.5s, dev = 17.3s //tensorflow/python/kernel_tests/math_ops:reduction_ops_test_cpu PASSED in 40.1s Stats over 6 runs: max = 40.1s, min = 21.2s, avg = 33.5s, dev = 6.1s //tensorflow/python/distribute/experimental/rpc:rpc_ops_test PASSED in 11.3s Stats over 7 runs: max = 11.3s, min = 6.6s, avg = 8.4s, dev = 1.5s //tensorflow/compiler/tests:matrix_diag_ops_test_cpu PASSED in 74.9s Stats over 8 runs: max = 74.9s, min = 3.2s, avg = 29.0s, dev = 24.2s //tensorflow/compiler/tests:matrix_diag_ops_test_cpu_mlir_bridge_test PASSED in 76.8s Stats over 8 runs: max = 76.8s, min = 5.0s, avg = 26.8s, dev = 24.0s //tensorflow/python/data/experimental/kernel_tests:csv_dataset_test PASSED in 43.3s Stats over 8 runs: max = 43.3s, min = 8.7s, avg = 23.9s, dev = 13.9s //tensorflow/python/data/experimental/kernel_tests:parallel_interleave_test PASSED in 50.4s Stats over 8 runs: max = 50.4s, min = 13.5s, avg = 32.2s, dev = 14.1s //tensorflow/python/data/experimental/kernel_tests/service:coordinated_read_ft_test PASSED in 46.1s Stats over 8 runs: max = 46.1s, min = 15.8s, avg = 30.2s, dev = 12.9s //tensorflow/python/data/experimental/kernel_tests/service:coordinated_read_test PASSED in 55.0s Stats over 8 runs: max = 55.0s, min = 10.8s, avg = 22.9s, dev = 14.9s //tensorflow/python/data/experimental/kernel_tests/service:cross_trainer_cache_test PASSED in 24.4s Stats over 8 runs: max = 24.4s, min = 6.0s, avg = 12.3s, dev = 6.4s //tensorflow/python/data/experimental/kernel_tests/service:fault_tolerance_test PASSED in 30.2s Stats over 8 runs: max = 30.2s, min = 12.8s, avg = 18.9s, dev = 5.5s //tensorflow/python/data/experimental/kernel_tests/service:snapshot_ft_test PASSED in 40.6s Stats over 8 runs: max = 40.6s, min = 4.8s, avg = 11.7s, dev = 11.6s //tensorflow/python/data/kernel_tests:filter_test PASSED in 15.3s Stats over 8 runs: max = 15.3s, min = 12.0s, avg = 13.5s, dev = 0.9s //tensorflow/python/data/kernel_tests:flat_map_test PASSED in 19.1s Stats over 8 runs: max = 19.1s, min = 12.9s, avg = 15.9s, dev = 1.9s //tensorflow/python/data/kernel_tests:shard_test PASSED in 19.7s Stats over 8 runs: max = 19.7s, min = 13.5s, avg = 17.3s, dev = 2.0s //tensorflow/python/data/kernel_tests:tf_record_dataset_test PASSED in 33.7s Stats over 8 runs: max = 33.7s, min = 17.0s, avg = 24.4s, dev = 5.0s //tensorflow/python/distribute/failure_handling:failure_handler_test PASSED in 39.8s Stats over 8 runs: max = 39.8s, min = 11.7s, avg = 31.4s, dev = 9.9s //tensorflow/python/kernel_tests/linalg:linalg_ops_test_cpu PASSED in 52.6s Stats over 8 runs: max = 52.6s, min = 31.7s, avg = 43.9s, dev = 7.3s //tensorflow/python/kernel_tests/linalg:linear_operator_block_diag_test_cpu PASSED in 61.5s Stats over 8 runs: max = 61.5s, min = 46.3s, avg = 54.4s, dev = 5.5s //tensorflow/python/kernel_tests/linalg:linear_operator_block_lower_triangular_test_cpu PASSED in 53.5s Stats over 8 runs: max = 53.5s, min = 36.9s, avg = 44.4s, dev = 6.0s //tensorflow/python/kernel_tests/nn_ops:depthwise_conv_op_d9m_test_cpu PASSED in 77.3s Stats over 8 runs: max = 77.3s, min = 5.0s, avg = 16.8s, dev = 23.5s //tensorflow/python/kernel_tests/nn_ops:depthwise_conv_op_test_cpu PASSED in 6.8s Stats over 8 runs: max = 6.8s, min = 5.8s, avg = 6.2s, dev = 0.4s //tensorflow/python/kernel_tests/signal:fft_ops_test_cpu PASSED in 16.9s Stats over 8 runs: max = 16.9s, min = 5.8s, avg = 10.9s, dev = 4.3s //tensorflow/python/ops/ragged:dynamic_ragged_shape_test PASSED in 58.2s Stats over 8 runs: max = 58.2s, min = 33.9s, avg = 42.1s, dev = 8.0s //tensorflow/python/ops/ragged:ragged_tensor_test PASSED in 21.5s Stats over 8 runs: max = 21.5s, min = 11.7s, avg = 15.2s, dev = 2.9s //tensorflow/python/distribute/failure_handling:gce_failure_handler_test FLAKY, failed in 1 out of 9 in 277.4s Stats over 9 runs: max = 277.4s, min = 8.7s, avg = 57.0s, dev = 80.4s /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/distribute/failure_handling/gce_failure_handler_test/shard_6_of_8/test_attempts/attempt_1.log //tensorflow/compiler/tests:bincount_op_test_cpu PASSED in 11.4s Stats over 10 runs: max = 11.4s, min = 4.2s, avg = 5.6s, dev = 2.0s //tensorflow/compiler/tests:conv2d_test_cpu PASSED in 9.4s Stats over 10 runs: max = 9.4s, min = 8.2s, avg = 8.8s, dev = 0.3s //tensorflow/compiler/tests:conv2d_test_cpu_mlir_bridge_test PASSED in 7.5s Stats over 10 runs: max = 7.5s, min = 6.9s, avg = 7.1s, dev = 0.2s //tensorflow/compiler/tests:image_ops_test_cpu PASSED in 18.1s Stats over 10 runs: max = 18.1s, min = 11.8s, avg = 14.7s, dev = 2.1s //tensorflow/compiler/tests:random_ops_test_cpu PASSED in 24.4s Stats over 10 runs: max = 24.4s, min = 16.4s, avg = 20.1s, dev = 2.4s //tensorflow/compiler/tests:random_ops_test_cpu_mlir_bridge_test PASSED in 18.7s Stats over 10 runs: max = 18.7s, min = 12.8s, avg = 15.7s, dev = 1.8s //tensorflow/compiler/tests:stateless_random_ops_test_cpu PASSED in 74.5s Stats over 10 runs: max = 74.5s, min = 30.2s, avg = 52.6s, dev = 14.7s //tensorflow/compiler/tests:stateless_random_ops_test_cpu_mlir_bridge_test PASSED in 74.5s Stats over 10 runs: max = 74.5s, min = 32.5s, avg = 56.1s, dev = 14.0s //tensorflow/compiler/xla/client/lib:svd_test_cpu PASSED in 65.7s Stats over 10 runs: max = 65.7s, min = 12.5s, avg = 28.9s, dev = 20.0s //tensorflow/compiler/xla/client/lib:tridiagonal_test_cpu PASSED in 7.4s Stats over 10 runs: max = 7.4s, min = 6.9s, avg = 7.2s, dev = 0.2s //tensorflow/compiler/xla/service/cpu:cpu_runtime_test PASSED in 3.5s Stats over 10 runs: max = 3.5s, min = 1.0s, avg = 2.8s, dev = 0.9s //tensorflow/python:special_math_ops_test_cpu PASSED in 51.2s Stats over 10 runs: max = 51.2s, min = 6.4s, avg = 14.4s, dev = 12.7s //tensorflow/python/data/kernel_tests:rejection_resample_test PASSED in 19.3s Stats over 10 runs: max = 19.3s, min = 6.4s, avg = 11.9s, dev = 4.2s //tensorflow/python/distribute:input_lib_test_2gpu PASSED in 35.3s Stats over 10 runs: max = 35.3s, min = 22.8s, avg = 27.2s, dev = 3.3s //tensorflow/python/distribute:input_lib_test_cpu PASSED in 37.0s Stats over 10 runs: max = 37.0s, min = 22.5s, avg = 31.0s, dev = 4.2s //tensorflow/python/distribute:input_lib_type_spec_test_2gpu PASSED in 17.9s Stats over 10 runs: max = 17.9s, min = 6.6s, avg = 12.6s, dev = 4.0s //tensorflow/python/distribute:input_lib_type_spec_test_cpu PASSED in 16.3s Stats over 10 runs: max = 16.3s, min = 3.9s, avg = 10.4s, dev = 4.1s //tensorflow/python/framework:config_vgpu_test_2gpu PASSED in 6.1s Stats over 10 runs: max = 6.1s, min = 2.9s, avg = 4.9s, dev = 1.2s //tensorflow/python/framework:config_vgpu_test_cpu PASSED in 5.8s Stats over 10 runs: max = 5.8s, min = 5.0s, avg = 5.3s, dev = 0.3s //tensorflow/python/framework:function_test_cpu PASSED in 78.1s Stats over 10 runs: max = 78.1s, min = 4.6s, avg = 14.5s, dev = 21.5s //tensorflow/python/grappler:cluster_test_cpu PASSED in 6.1s Stats over 10 runs: max = 6.1s, min = 2.6s, avg = 4.7s, dev = 1.0s //tensorflow/python/kernel_tests/array_ops:array_ops_test_cpu PASSED in 13.0s Stats over 10 runs: max = 13.0s, min = 7.7s, avg = 10.1s, dev = 1.5s //tensorflow/python/kernel_tests/array_ops:inplace_ops_test_cpu PASSED in 6.1s Stats over 10 runs: max = 6.1s, min = 4.1s, avg = 5.2s, dev = 0.6s //tensorflow/python/kernel_tests/data_structures:tensor_array_ops_test_cpu PASSED in 10.3s Stats over 10 runs: max = 10.3s, min = 6.7s, avg = 8.3s, dev = 1.3s //tensorflow/python/kernel_tests/linalg:linear_operator_kronecker_test_cpu PASSED in 34.1s Stats over 10 runs: max = 34.1s, min = 29.6s, avg = 31.8s, dev = 1.5s //tensorflow/python/kernel_tests/linalg:linear_operator_low_rank_update_test_cpu PASSED in 79.4s Stats over 10 runs: max = 79.4s, min = 73.8s, avg = 76.7s, dev = 1.6s //tensorflow/python/kernel_tests/linalg:tridiagonal_matmul_op_test_cpu PASSED in 124.0s Stats over 10 runs: max = 124.0s, min = 4.6s, avg = 17.5s, dev = 35.5s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_ops_test_cpu PASSED in 33.8s Stats over 10 runs: max = 33.8s, min = 8.5s, avg = 19.3s, dev = 7.4s //tensorflow/python/kernel_tests/math_ops:segment_reduction_ops_test_cpu PASSED in 30.7s Stats over 10 runs: max = 30.7s, min = 7.5s, avg = 16.1s, dev = 8.6s //tensorflow/python/kernel_tests/nn_ops:rnn_test_cpu PASSED in 11.0s Stats over 10 runs: max = 11.0s, min = 8.6s, avg = 9.9s, dev = 0.7s //tensorflow/python/kernel_tests/random:random_index_shuffle_test PASSED in 7.6s Stats over 10 runs: max = 7.6s, min = 6.1s, avg = 6.7s, dev = 0.5s //tensorflow/python/kernel_tests/random:stateless_random_ops_test_cpu PASSED in 101.1s Stats over 10 runs: max = 101.1s, min = 20.1s, avg = 59.5s, dev = 38.4s //tensorflow/python/ops/ragged:ragged_tensor_supported_values_test PASSED in 19.0s Stats over 10 runs: max = 19.0s, min = 15.1s, avg = 17.5s, dev = 1.0s //tensorflow/python/saved_model:load_test_cpu PASSED in 45.3s Stats over 10 runs: max = 45.3s, min = 25.5s, avg = 29.6s, dev = 5.6s //tensorflow/compiler/tests:fft_test_cpu PASSED in 20.0s Stats over 12 runs: max = 20.0s, min = 5.7s, avg = 12.4s, dev = 5.2s //tensorflow/compiler/xla/service:triangular_solve_expander_test PASSED in 5.8s Stats over 12 runs: max = 5.8s, min = 2.9s, avg = 4.2s, dev = 0.8s //tensorflow/python/data/experimental/kernel_tests:group_by_reducer_test PASSED in 26.9s Stats over 12 runs: max = 26.9s, min = 12.3s, avg = 17.1s, dev = 4.6s //tensorflow/python/data/kernel_tests:choose_from_datasets_test PASSED in 12.7s Stats over 12 runs: max = 12.7s, min = 6.0s, avg = 8.7s, dev = 2.0s //tensorflow/python/data/kernel_tests:memory_cleanup_test_cpu PASSED in 9.8s Stats over 12 runs: max = 9.8s, min = 2.7s, avg = 6.0s, dev = 2.2s //tensorflow/python/distribute:multi_process_runner_test_2gpu PASSED in 223.6s Stats over 12 runs: max = 223.6s, min = 11.7s, avg = 49.1s, dev = 58.8s //tensorflow/python/distribute:multi_process_runner_test_cpu PASSED in 219.7s Stats over 12 runs: max = 219.7s, min = 9.8s, avg = 48.8s, dev = 57.8s //tensorflow/python/kernel_tests/nn_ops:pooling_ops_test_cpu FAILED in 3 out of 12 in 28.1s Stats over 12 runs: max = 28.1s, min = 3.6s, avg = 9.6s, dev = 7.7s /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test_cpu/shard_8_of_10/test.log /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test_cpu/shard_8_of_10/test_attempts/attempt_1.log /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/kernel_tests/nn_ops/pooling_ops_test_cpu/shard_8_of_10/test_attempts/attempt_2.log //tensorflow/python/eager/polymorphic_function:polymorphic_function_test_cpu PASSED in 20.6s Stats over 15 runs: max = 20.6s, min = 12.4s, avg = 15.4s, dev = 2.7s //tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test_cpu PASSED in 107.0s Stats over 15 runs: max = 107.0s, min = 68.4s, avg = 88.2s, dev = 8.1s //tensorflow/python/kernel_tests/nn_ops:rnn_cell_test_cpu PASSED in 58.5s Stats over 15 runs: max = 58.5s, min = 6.5s, avg = 14.4s, dev = 12.9s //tensorflow/python:image_ops_test_cpu PASSED in 18.8s Stats over 16 runs: max = 18.8s, min = 9.6s, avg = 13.8s, dev = 3.0s //tensorflow/python/data/experimental/kernel_tests/service:dynamic_sharding_test PASSED in 24.6s Stats over 16 runs: max = 24.6s, min = 15.6s, avg = 19.0s, dev = 2.6s //tensorflow/python/data/experimental/kernel_tests/service:worker_tags_test PASSED in 26.4s Stats over 16 runs: max = 26.4s, min = 3.9s, avg = 15.5s, dev = 7.3s //tensorflow/python/data/kernel_tests:snapshot_test PASSED in 26.0s Stats over 16 runs: max = 26.0s, min = 10.4s, avg = 17.5s, dev = 4.4s //tensorflow/python/kernel_tests/control_flow:control_flow_ops_py_test_cpu PASSED in 33.3s Stats over 16 runs: max = 33.3s, min = 4.1s, avg = 9.6s, dev = 6.5s //tensorflow/python/kernel_tests/linalg:matrix_exponential_op_test PASSED in 10.1s Stats over 16 runs: max = 10.1s, min = 4.4s, avg = 6.6s, dev = 1.5s //tensorflow/python/kernel_tests/signal:dct_ops_test_cpu PASSED in 10.3s Stats over 16 runs: max = 10.3s, min = 6.8s, avg = 8.3s, dev = 0.8s //tensorflow/python/ops/parallel_for:control_flow_ops_test_cpu PASSED in 73.1s Stats over 16 runs: max = 73.1s, min = 13.8s, avg = 25.4s, dev = 13.6s //tensorflow/python/data/kernel_tests:map_test PASSED in 56.1s Stats over 19 runs: max = 56.1s, min = 12.4s, avg = 19.5s, dev = 9.1s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 7.1s Stats over 20 runs: max = 7.1s, min = 4.4s, avg = 5.6s, dev = 0.8s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 6.9s Stats over 20 runs: max = 6.9s, min = 2.9s, avg = 4.4s, dev = 1.1s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 12.3s Stats over 20 runs: max = 12.3s, min = 3.1s, avg = 4.9s, dev = 2.1s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 12.0s Stats over 20 runs: max = 12.0s, min = 2.7s, avg = 4.4s, dev = 2.2s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 7.6s Stats over 20 runs: max = 7.6s, min = 6.4s, avg = 6.9s, dev = 0.3s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 13.8s Stats over 20 runs: max = 13.8s, min = 9.4s, avg = 11.5s, dev = 1.3s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 12.5s Stats over 20 runs: max = 12.5s, min = 9.2s, avg = 10.4s, dev = 0.8s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 41.4s Stats over 20 runs: max = 41.4s, min = 7.0s, avg = 15.1s, dev = 10.8s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 19.4s Stats over 20 runs: max = 19.4s, min = 14.7s, avg = 17.1s, dev = 1.3s //tensorflow/python/kernel_tests:metrics_test PASSED in 45.2s Stats over 20 runs: max = 45.2s, min = 7.3s, avg = 20.9s, dev = 10.1s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 6.6s Stats over 20 runs: max = 6.6s, min = 2.7s, avg = 4.4s, dev = 1.0s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 13.6s Stats over 20 runs: max = 13.6s, min = 2.8s, avg = 5.8s, dev = 2.9s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 54.5s Stats over 20 runs: max = 54.5s, min = 3.4s, avg = 16.1s, dev = 17.4s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 107.2s Stats over 20 runs: max = 107.2s, min = 27.9s, avg = 60.8s, dev = 26.0s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 7.0s Stats over 20 runs: max = 7.0s, min = 3.5s, avg = 4.4s, dev = 0.9s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 12.1s Stats over 20 runs: max = 12.1s, min = 4.8s, avg = 8.5s, dev = 2.2s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 233.3s Stats over 20 runs: max = 233.3s, min = 30.6s, avg = 104.5s, dev = 53.5s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 20.3s Stats over 20 runs: max = 20.3s, min = 3.6s, avg = 9.6s, dev = 5.7s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 20.9s Stats over 20 runs: max = 20.9s, min = 5.2s, avg = 12.5s, dev = 5.2s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 17.4s Stats over 20 runs: max = 17.4s, min = 12.2s, avg = 14.8s, dev = 1.7s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 70.9s Stats over 20 runs: max = 70.9s, min = 5.0s, avg = 29.4s, dev = 23.1s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 23.4s Stats over 20 runs: max = 23.4s, min = 3.3s, avg = 6.8s, dev = 4.4s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 21.4s Stats over 24 runs: max = 21.4s, min = 7.8s, avg = 15.0s, dev = 3.7s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 16.7s Stats over 24 runs: max = 16.7s, min = 5.6s, avg = 10.8s, dev = 3.0s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 29.9s Stats over 24 runs: max = 29.9s, min = 4.9s, avg = 14.2s, dev = 6.9s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 9.9s Stats over 25 runs: max = 9.9s, min = 7.3s, avg = 8.4s, dev = 0.6s //tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 35.0s Stats over 25 runs: max = 35.0s, min = 7.7s, avg = 12.4s, dev = 7.1s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 8.7s Stats over 30 runs: max = 8.7s, min = 6.9s, avg = 8.0s, dev = 0.6s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 19.0s Stats over 30 runs: max = 19.0s, min = 13.7s, avg = 16.3s, dev = 1.8s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 8.9s Stats over 30 runs: max = 8.9s, min = 7.3s, avg = 7.9s, dev = 0.5s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 8.8s Stats over 30 runs: max = 8.8s, min = 6.0s, avg = 7.4s, dev = 0.8s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 29.1s Stats over 30 runs: max = 29.1s, min = 2.9s, avg = 9.4s, dev = 6.5s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 10.8s Stats over 31 runs: max = 10.8s, min = 6.9s, avg = 8.2s, dev = 0.9s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 15.0s Stats over 32 runs: max = 15.0s, min = 6.8s, avg = 9.4s, dev = 2.5s //tensorflow/python/data/experimental/kernel_tests/service:auto_shard_test PASSED in 18.6s Stats over 32 runs: max = 18.6s, min = 4.5s, avg = 11.7s, dev = 3.6s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 30.2s Stats over 32 runs: max = 30.2s, min = 12.1s, avg = 19.6s, dev = 4.5s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 14.8s Stats over 40 runs: max = 14.8s, min = 8.2s, avg = 11.5s, dev = 1.4s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 13.8s Stats over 40 runs: max = 13.8s, min = 8.0s, avg = 10.4s, dev = 1.2s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 9.8s Stats over 40 runs: max = 9.8s, min = 7.9s, avg = 8.8s, dev = 0.4s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 11.4s Stats over 40 runs: max = 11.4s, min = 7.4s, avg = 8.5s, dev = 0.8s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 97.1s Stats over 50 runs: max = 97.1s, min = 17.8s, avg = 42.4s, dev = 28.3s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 39.3s Stats over 50 runs: max = 39.3s, min = 2.6s, avg = 10.2s, dev = 8.1s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 38.0s Stats over 50 runs: max = 38.0s, min = 2.7s, avg = 9.9s, dev = 7.5s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 11.3s Stats over 50 runs: max = 11.3s, min = 7.4s, avg = 9.3s, dev = 0.8s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 14.8s Stats over 50 runs: max = 14.8s, min = 8.5s, avg = 11.0s, dev = 1.3s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 20.8s Stats over 50 runs: max = 20.8s, min = 10.3s, avg = 13.6s, dev = 2.7s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 17.8s Stats over 50 runs: max = 17.8s, min = 4.6s, avg = 10.6s, dev = 3.6s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 6.4s Stats over 50 runs: max = 6.4s, min = 2.7s, avg = 4.2s, dev = 1.0s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 6.2s Stats over 50 runs: max = 6.2s, min = 2.7s, avg = 4.1s, dev = 0.8s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 29.2s Stats over 50 runs: max = 29.2s, min = 6.2s, avg = 15.1s, dev = 5.7s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 13.8s Stats over 50 runs: max = 13.8s, min = 2.6s, avg = 4.8s, dev = 1.8s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 12.9s Stats over 50 runs: max = 12.9s, min = 2.8s, avg = 4.7s, dev = 2.3s Executed 3588 out of 3589 tests: 3584 tests pass, 1 fails to build and 4 fail locally. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are.