ManagedConnectionsTest.BEH_API_Bootstrap hangs occasionally on Linodes.

[Fraser999]

Migrated from maidsafe-archive/MaidSafe#10

root@li522-133:/Vaults# ./TESTrudp --gtest_filter=ManagedConnectionsTest.BEH_API_Bootstrap
Note: Google Test filter = ManagedConnectionsTest.BEH_API_Bootstrap
[==========] Running 1 test from 1 test case.
[----------] Global test environment set-up.
[==========] 1 test from ManagedConnectionsTest
[ RUN ] ManagedConnectionsTest.BEH_API_Bootstrap
E 140689953814336 10:41:43.615933 rudp/managed_connections.cc:119] You must provide a valid MessageReceivedFunctor.
E 140689953814336 10:41:43.640966 rudp/managed_connections.cc:140] You must provide at least one Bootstrap endpoint.
W 140689931781888 10:41:45.665760 rudp/connection.cc:229] Failed to connect from 0.0.0.0:0 / 176.58.120.133:5483 to 176.58.120.133:10000 - timed out.
I 140689953814336 10:41:45.666225 rudp/transport.cc:179] Failed to make bootstrap connection to 176.58.120.133:10000
W 140689953814336 10:41:45.666501 rudp/managed_connections.cc:203] Failed to start a new Transport.
I 140689931781888 10:41:45.666623 rudp/connection.cc:321] Spuriously checking lifespan timeout of connection from 0.0.0.0:0 / 176.58.120.133:5483 to 176.58.120.133:10000 Lifespan remaining: 00:09:57.998820
E 140689953814336 10:41:45.666675 rudp/managed_connections.cc:163] Failed to bootstrap managed connections.
E 140689953814336 10:41:45.666841 rudp/managed_connections.cc:119] You must provide a valid MessageReceivedFunctor.
E 140689953814336 10:41:45.667053 rudp/managed_connections.cc:123] You must provide a valid ConnectionLostFunctor.
E 140689953814336 10:41:45.667197 rudp/managed_connections.cc:133] You must provide a valid private and public key.
E 140689953814336 10:41:45.690399 rudp/managed_connections.cc:133] You must provide a valid private and public key.
E 140689953814336 10:41:45.690596 rudp/managed_connections.cc:133] You must provide a valid private and public key.
E 140689953814336 10:41:45.711413 rudp/managed_connections.cc:133] You must provide a valid private and public key.
I 140689953814336 10:41:45.922466 rudp/tests/test_utils.cc:48] Node 0 has NodeId 7cb0703..9dfa7ec
I 140689953814336 10:41:46.190530 rudp/tests/test_utils.cc:48] Node 1 has NodeId 46f63a7..f9cde77
I 140689953814336 10:41:46.547408 rudp/tests/test_utils.cc:48] Node 2 has NodeId 794cbca..4f5c522
S 140689690056448 10:41:46.577796 rudp/transport.cc:366] Successfully made Bootstrapping connection from [7cb0703 - 176.58.120.133:64366 / 176.58.120.133:64366] to [46f63a7 - 176.58.120.133:18522]
S 140689673271040 10:41:46.578374 rudp/transport.cc:366] Successfully made Bootstrapping connection from [46f63a7 - 176.58.120.133:18522 / 176.58.120.133:18522] to [7cb0703 - 176.58.120.133:64366]
I 140689953814336 10:41:46.828838 rudp/tests/test_utils.cc:83] Calling Add from 176.58.120.133:64366 to 176.58.120.133:18522
I 140689953814336 10:41:46.829571 rudp/tests/test_utils.cc:90] Calling Add from 176.58.120.133:18522 to 176.58.120.133:64366
I 140689673271040 10:41:46.835820 rudp/tests/test_utils.cc:312] Node 1 -- Received: Node 0's validation data
I 140689690056448 10:41:46.836683 rudp/tests/test_utils.cc:312] Node 0 -- Received: Node 1's validation data
I 140689953814336 10:41:46.837095 rudp/tests/test_utils.cc:144] Setting up remaining 1 nodes
S 140689664878336 10:41:46.864262 rudp/transport.cc:366] Successfully made Bootstrapping connection from [794cbca - 176.58.120.133:5483 / 176.58.120.133:5483] to [7cb0703 - 176.58.120.133:64366]
S 140689690056448 10:41:46.864516 rudp/transport.cc:366] Successfully made Bootstrapping connection from [7cb0703 - 176.58.120.133:64366 / 176.58.120.133:64366] to [794cbca - 176.58.120.133:5483]
I 140689953814336 10:41:47.115465 rudp/tests/test_utils.cc:158] Starting attempt to connect Node 2 to Node 0
I 140689953814336 10:41:47.115764 rudp/tests/test_utils.cc:172] GetAvailableEndpoint on Node 2 to Node 0 with peer_id 7cb0703..9dfa7ec returned 176.58.120.133:5483 / 176.58.120.133:5483
I 140689953814336 10:41:47.115930 rudp/tests/test_utils.cc:188] Calling GetAvailableEndpoint on Node 0 to Node 2 with peer_endpoint 176.58.120.133:5483 returned 176.58.120.133:64366 / 176.58.120.133:64366
I 140689953814336 10:41:47.116109 rudp/tests/test_utils.cc:198] Calling Add from Node 0 on 176.58.120.133:64366 to Node 2 on 176.58.120.133:5483
I 140689953814336 10:41:47.116513 rudp/tests/test_utils.cc:210] Calling Add from Node 2 on 176.58.120.133:5483 to Node 0 on 176.58.120.133:64366
I 140689690056448 10:41:47.123300 rudp/tests/test_utils.cc:312] Node 0 -- Received: Node 2's validation data
I 140689706841856 10:41:47.123535 rudp/tests/test_utils.cc:312] Node 2 -- Received: Node 0's validation data
I 140689953814336 10:41:47.123770 rudp/tests/test_utils.cc:158] Starting attempt to connect Node 2 to Node 1
I 140689953814336 10:41:47.125717 rudp/tests/test_utils.cc:172] GetAvailableEndpoint on Node 2 to Node 1 with peer_id 46f63a7..f9cde77 returned 176.58.120.133:45032 / 176.58.120.133:45032
I 140689953814336 10:41:47.127373 rudp/tests/test_utils.cc:188] Calling GetAvailableEndpoint on Node 1 to Node 2 with peer_endpoint 176.58.120.133:45032 returned 176.58.120.133:41166 / 176.58.120.133:41166
I 140689953814336 10:41:47.127527 rudp/tests/test_utils.cc:198] Calling Add from Node 1 on 176.58.120.133:41166 to Node 2 on 176.58.120.133:45032
I 140689953814336 10:41:47.128123 rudp/connection_manager.cc:129] Not currently connected to 794cbca..4f5c522
I 140689953814336 10:41:47.128275 rudp/tests/test_utils.cc:210] Calling Add from Node 2 on 176.58.120.133:45032 to Node 1 on 176.58.120.133:41166
I 140689953814336 10:41:47.128470 rudp/connection_manager.cc:129] Not currently connected to 46f63a7..f9cde77
S 140689681663744 10:41:47.130093 rudp/transport.cc:366] Successfully made Unvalidated connection from [46f63a7 - 176.58.120.133:41166 / 176.58.120.133:41166] to [794cbca - 176.58.120.133:45032]
I 140689673271040 10:41:47.131183 rudp/connection_manager.cc:238] Received a packet "0x80" for unknown connection 1077074784 from 176.58.120.133:45032
S 140689706841856 10:41:47.131512 rudp/transport.cc:366] Successfully made Unvalidated connection from [794cbca - 176.58.120.133:45032 / 176.58.120.133:45032] to [46f63a7 - 176.58.120.133:41166]
I 140689664878336 10:41:47.134203 rudp/connection_manager.cc:238] Received a packet "0x80" for unknown connection 243435049 from 176.58.120.133:41166
I 140689706841856 10:41:47.139676 rudp/tests/test_utils.cc:312] Node 2 -- Received: Node 1's validation data
I 140689673271040 10:41:47.140715 rudp/tests/test_utils.cc:312] Node 1 -- Received: Node 2's validation data
E 140689953814336 10:41:47.164003 common/asio_service.cc:47] AsioService is already running with 2 threads.
S 140689931781888 10:41:47.165740 rudp/transport.cc:366] Successfully made Bootstrapping connection from [169a0fb - 176.58.120.133:52143 / 176.58.120.133:52143] to [7cb0703 - 176.58.120.133:64366]
S 140689690056448 10:41:47.165817 rudp/transport.cc:366] Successfully made Bootstrapping connection from [7cb0703 - 176.58.120.133:64366 / 176.58.120.133:64366] to [169a0fb - 176.58.120.133:52143]
W 140689706841856 10:41:55.769172 rudp/connection.cc:547] Failed to probe from 176.58.120.133:5483 / 176.58.120.133:5483 to 176.58.120.133:64366 error - Operation canceled
I 140689664878336 10:41:55.769865 rudp/tests/test_utils.cc:319] Node 2 -- Lost connection to 794cbca..4f5c522
W 140689673271040 10:41:55.984901 rudp/connection.cc:547] Failed to probe from 176.58.120.133:18522 / 176.58.120.133:18522 to 176.58.120.133:64366 error - Operation canceled
I 140689681663744 10:41:55.985374 rudp/tests/test_utils.cc:319] Node 1 -- Lost connection to 46f63a7..f9cde77
W 140689931781888 10:41:56.069870 rudp/connection.cc:547] Failed to probe from 176.58.120.133:52143 / 176.58.120.133:52143 to 176.58.120.133:64366 error - Operation canceled
I 140689931781888 10:41:56.070518 rudp/connection.cc:321] Spuriously checking lifespan timeout of connection from 176.58.120.133:52143 / 176.58.120.133:52143 to 176.58.120.133:64366 Lifespan remaining: 00:09:51.094150