Skip to content

feat: adding provider optimizer tiers #2470

feat: adding provider optimizer tiers

feat: adding provider optimizer tiers #2470

GitHub Actions / Test Results failed Sep 9, 2024 in 0s

6 fail, 1 941 pass in 23m 8s

1 947 tests  ±0   1 941 ✅ ±0   23m 8s ⏱️ +57s
  143 suites ±0       0 💤 ±0 
    6 files   ±0       6 ❌ ±0 

Results for commit 0e059af. ± Comparison against earlier commit 034c194.

Annotations

Check warning on line 0 in github.com/lavanet/lava/v3/protocol/integration

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestConsumerProviderBasic (github.com/lavanet/lava/v3/protocol/integration) failed

artifacts/Test Results (Protocol)/protocol-report.xml [took 0s]
Raw output
Failed
Sep  9 21:31:05 INF setting log level loglevel=debug
Sep  9 21:31:05 INF Finished adding Clients Asynchronously free clients=1 url=http://127.0.0.1:33947
Sep  9 21:31:05 INF Finished adding Clients Asynchronously free clients=1 url="ws://127.0.0.1:45559, addons: (websocket)"
badger 2024/09/09 21:31:05 INFO: Set nextTxnTs to 0
Sep  9 21:31:05 DBG Chain Tracker Updated block hashes ApiInterface= ChainID= blocksKept=1 blocksQueried=0 blocksQueueLen=1 latestHash=stubHash-1000 latest_block=1000 nextBlocksUpdate=1100
Sep  9 21:31:05 DBG ChainTracker fetched init data successfully
Sep  9 21:31:05 WRN Warning: Using Self signed certificate is not recommended, this will not allow https connections to be established
Sep  9 21:31:05 INF [++] Provider Listening on Address Address="{Address:localhost:1025 KeyPem: CertPem: DisableTLS:false}" apiInterface=tendermintrpc chainID=LAV1
Sep  9 21:31:05 INF New provider listener active address="{Address:localhost:1025 KeyPem: CertPem: DisableTLS:false}"
Sep  9 21:31:05 INF setting log level loglevel=debug
Sep  9 21:31:05 INF Finished adding Clients Asynchronously free clients=1 url=http://127.0.0.1:40471
Sep  9 21:31:05 INF Finished adding Clients Asynchronously free clients=1 url="ws://127.0.0.1:41799, addons: (websocket)"

Check warning on line 0 in github.com/lavanet/lava/v3/protocol/lavasession

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestHappyFlow (github.com/lavanet/lava/v3/protocol/lavasession) failed

artifacts/Test Results (Protocol)/protocol-report.xml [took 0s]
Raw output
Failed

Check warning on line 0 in github.com/lavanet/lava/v3/protocol/provideroptimizer

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestProviderOptimizerBasic (github.com/lavanet/lava/v3/protocol/provideroptimizer) failed

artifacts/Test Results (Protocol)/protocol-report.xml [took 0s]
Raw output
Failed

Check warning on line 0 in github.com/lavanet/lava/v3/protocol/rpcconsumer

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestRelayInnerProviderUniqueIdFlow (github.com/lavanet/lava/v3/protocol/rpcconsumer) failed

artifacts/Test Results (Protocol)/protocol-report.xml [took 0s]
Raw output
Failed
Sep  9 21:31:16 INF setting log level loglevel=debug
Sep  9 21:31:16 INF Finished adding Clients Asynchronously free clients=1 url=http://127.0.0.1:45107
Sep  9 21:31:16 INF Finished adding Clients Asynchronously free clients=1 url="ws://127.0.0.1:40959, addons: (websocket)"

Check warning on line 0 in github.com/lavanet/lava/v3/testutil/e2e

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestLavaProtocol (github.com/lavanet/lava/v3/testutil/e2e) failed

artifacts/Test Results (Protocol E2E)/protocol-e2e-report.xml [took 9m 3s]
Raw output
Failed
Sep  9 21:30:31 INF Starting Lava
Sep  9 21:30:31 INF Executing Command: ./scripts/start_env_dev.sh
Sep  9 21:30:31 INF Waiting for Lava
Sep  9 21:30:41 INF Waiting for Lava
Sep  9 21:30:51 INF Waiting for Lava
Sep  9 21:31:01 INF Waiting for Lava
Sep  9 21:31:11 INF Waiting for Lava
Sep  9 21:31:21 INF Waiting for Lava
Sep  9 21:31:31 INF Waiting for Lava
Sep  9 21:31:41 INF Waiting for Lava
Sep  9 21:31:51 INF Waiting for Lava
Sep  9 21:32:01 INF Waiting for Lava
Sep  9 21:32:11 INF Waiting for Lava
Sep  9 21:32:21 INF Waiting for Lava
Sep  9 21:32:31 INF Starting Lava OK
Sep  9 21:32:31 INF Staking Lava
Sep  9 21:32:31 INF Executing Command: ./scripts/test/init_e2e.sh
Sep  9 21:33:41 INF stakeLava OK
ETH1
provider lava@145aecv3e0u0uf6lulz8dkhzzp508drhykegj0t [{127.0.0.1:2222 1 [] [jsonrpc] []}]
provider lava@1ejpy45c4klf035nhwmp9lt40ypwgsm6nccqyad [{127.0.0.1:2224 1 [] [jsonrpc] []}]
provider lava@1uez4ckgnrfm9h3mc8g9s33w4t6zdcj4dzdn7n2 [{127.0.0.1:2225 1 [] [jsonrpc] []}]
provider lava@1vdkcj6rjy7pyn2w7laav4azpw9ukcqwfs350mj [{127.0.0.1:2223 1 [] [jsonrpc] []}]
provider lava@1y5an8yrmur0v3844434csgsq4lysrs0n36dkwz [{127.0.0.1:2221 1 [debug] [jsonrpc] [archive]}]
LAV1
provider lava@173wncyyfhk50762rrmnea0kxtgwaera0ljr5s0 [{127.0.0.1:2264 1 [] [grpc rest tendermintrpc] []}]
provider lava@1jk6uj4srp54evkm4623z83q0vzv5v886cm6skk [{127.0.0.1:2263 1 [] [grpc rest tendermintrpc] []}]
provider lava@1nu7sn5fd6enx5ygacwesue6v04uuwxwataydhl [{127.0.0.1:2265 1 [] [grpc rest tendermintrpc] []}]
provider lava@1q5mk6q4vfjf42z5hq34n3u8twhjr7n5c3jau80 [{127.0.0.1:2262 1 [] [grpc rest tendermintrpc] []}]
provider lava@1qz40y9yhykf3xc9u79mwum6zczttwe2zp6mxf2 [{127.0.0.1:2261 1 [] [grpc rest tendermintrpc] []}]
Sep  9 21:33:42 INF Staking Lava OK
Sep  9 21:33:42 INF RUNNING TESTS
Sep  9 21:33:42 INF Executing Command: /opt/hostedtoolcache/go/1.20.14/x64/bin/go test ./testutil/e2e/proxy/. -v -timeout 0 eth
Sep  9 21:33:42 INF startJSONRPCProxy OK
Sep  9 21:33:42 INF Waiting JSONRPC Consumer
Sep  9 21:33:43 INF Waiting JSONRPC Consumer
Sep  9 21:33:44 INF Waiting JSONRPC Consumer
Sep  9 21:33:45 INF Waiting JSONRPC Consumer
Sep  9 21:33:46 INF Waiting JSONRPC Consumer
Sep  9 21:33:47 INF Waiting JSONRPC Consumer
Sep  9 21:33:48 INF Waiting JSONRPC Consumer
Sep  9 21:33:49 INF Waiting JSONRPC Consumer
Sep  9 21:33:50 INF Waiting JSONRPC Consumer
Sep  9 21:33:51 INF Waiting JSONRPC Consumer
Sep  9 21:33:52 INF Waiting JSONRPC Consumer
Sep  9 21:33:53 INF Waiting JSONRPC Consumer
Sep  9 21:33:54 INF Waiting JSONRPC Consumer
Sep  9 21:33:55 INF Waiting JSONRPC Consumer
Sep  9 21:33:56 INF Waiting JSONRPC Consumer
Sep  9 21:33:57 INF Waiting JSONRPC Consumer
Sep  9 21:33:58 INF Waiting JSONRPC Consumer
Sep  9 21:33:59 INF Waiting JSONRPC Consumer
Sep  9 21:34:00 INF Waiting JSONRPC Consumer
Sep  9 21:34:00 INF JSONRPCProxy OK
Sep  9 21:34:00 INF Validated proxy is alive got response res=16482926
Sep  9 21:34:00 DBG Executing command /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/jsonrpcProvider1.yml --chain-id=lava --from servicer1 --geolocation 1 --log_level debug
Sep  9 21:34:00 DBG Executing command /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/jsonrpcProvider2.yml --chain-id=lava --from servicer2 --geolocation 1 --log_level debug
Sep  9 21:34:00 DBG Executing command /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/jsonrpcProvider3.yml --chain-id=lava --from servicer3 --geolocation 1 --log_level debug
Sep  9 21:34:00 DBG Executing command /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/jsonrpcProvider4.yml --chain-id=lava --from servicer4 --geolocation 1 --log_level debug
Sep  9 21:34:00 DBG Executing command /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/jsonrpcProvider5.yml --chain-id=lava --from servicer5 --geolocation 1 --log_level debug
Sep  9 21:34:00 INF Waiting Provider 127.0.0.1:2221
Sep  9 21:34:02 INF Waiting Provider 127.0.0.1:2221
Sep  9 21:34:04 INF Waiting Provider 127.0.0.1:2221
Sep  9 21:34:06 INF Waiting Provider 127.0.0.1:2221
Sep  9 21:34:08 INF Waiting Provider 127.0.0.1:2221
Sep  9 21:34:10 INF Waiting Provider 127.0.0.1:2221
Sep  9 21:34:12 INF Waiting Provider 127.0.0.1:2221
Sep  9 21:34:14 INF Waiting Provider 127.0.0.1:2221
Sep  9 21:34:16 INF Waiting Provider 127.0.0.1:2221
Sep  9 21:34:18 INF Waiting Provider 127.0.0.1:2221
Sep  9 21:34:20 INF Waiting Provider 127.0.0.1:2221
Sep  9 21:34:22 INF Waiting Provider 127.0.0.1:2221
Sep  9 21:34:22 INF Waiting Provider 127.0.0.1:2222
Sep  9 21:34:22 INF Waiting Provider 127.0.0.1:2223
Sep  9 21:34:22 INF Waiting Provider 127.0.0.1:2224
Sep  9 21:34:22 INF startJSONRPCProvider OK
Sep  9 21:34:22 INF Executing Command: /home/runner/go/bin/lavap rpcconsumer ./testutil/e2e/e2eConfigs/consumer/ethConsumer1.yml --chain-id=lava --from user1 --geolocation 1 --log_level debug --allow-insecure-provider-dialing
Sep  9 21:34:22 INF startJSONRPCConsumer OK
Sep  9 21:34:22 INF Waiting JSONRPC Consumer
Sep  9 21:34:23 INF Waiting JSONRPC Consumer
Sep  9 21:34:24 INF JSONRPCConsumer1 OK
Sep  9 21:34:24 INF Validated proxy is alive got response res=16482926
Sep  9 21:34:24 INF Executing Command: /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/lavaProvider6 --chain-id=lava --from servicer6 --geolocation 1 --log_level debug
Sep  9 21:34:24 INF Executing Command: /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/lavaProvider7 --chain-id=lava --from servicer7 --geolocation 1 --log_level debug
Sep  9 21:34:24 INF Executing Command: /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/lavaProvider8 --chain-id=lava --from servicer8 --geolocation 1 --log_level debug
Sep  9 21:34:24 INF Executing Command: /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/lavaProvider9 --chain-id=lava --from servicer9 --geolocation 1 --log_level debug
Sep  9 21:34:24 INF Executing Command: /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/lavaProvider10 --chain-id=lava --from servicer10 --geolocation 1 --log_level debug
Sep  9 21:34:24 INF Waiting Provider 127.0.0.1:2261
Sep  9 21:34:26 INF Waiting Provider 127.0.0.1:2261
Sep  9 21:34:26 INF Waiting Provider 127.0.0.1:2262
Sep  9 21:34:26 INF Waiting Provider 127.0.0.1:2263
Sep  9 21:34:26 INF Waiting Provider 127.0.0.1:2264
Sep  9 21:34:26 INF Waiting Provider 127.0.0.1:2265
Sep  9 21:34:26 INF startLavaProviders OK
Sep  9 21:34:26 INF Executing Command: /home/runner/go/bin/lavap rpcconsumer ./testutil/e2e/e2eConfigs/consumer/lavaConsumer1.yml --chain-id=lava --from user3 --geolocation 1 --log_level debug --allow-insecure-provider-dialing
Sep  9 21:34:26 INF startRPCConsumer OK
Sep  9 21:34:26 INF Waiting TENDERMINT Consumer
Sep  9 21:34:27 INF Waiting TENDERMINT Consumer
Sep  9 21:34:27 INF checkTendermintConsumer OK
Sep  9 21:34:27 INF Waiting REST Consumer
Sep  9 21:34:28 INF Waiting REST Consumer
Sep  9 21:34:28 INF checkRESTConsumer OK
Sep  9 21:34:28 INF Waiting GRPC Consumer
Sep  9 21:34:28 INF checkGRPCConsumer OK
Sep  9 21:34:28 INF Starting JSONRPC Tests
Sep  9 21:35:01 INF JSONRPC TEST OK
Sep  9 21:35:01 INF Starting TENDERMINT Tests
Sep  9 21:35:31 INF TENDERMINTRPC TEST OK
Sep  9 21:35:31 INF Starting TENDERMINTRPC URI Tests
Sep  9 21:36:01 INF TENDERMINTRPC URI TEST OK
Sep  9 21:36:01 INF Starting Lava over Lava Tests
Sep  9 21:36:01 INF Executing Command: ./scripts/test/init_e2e_lava_over_lava.sh
SEP1
provider lava@145aecv3e0u0uf6lulz8dkhzzp508drhykegj0t [{127.0.0.1:2122 1 [] [jsonrpc] []}]
provider lava@1ejpy45c4klf035nhwmp9lt40ypwgsm6nccqyad [{127.0.0.1:2124 1 [] [jsonrpc] []}]
provider lava@1uez4ckgnrfm9h3mc8g9s33w4t6zdcj4dzdn7n2 [{127.0.0.1:2125 1 [] [jsonrpc] []}]
provider lava@1vdkcj6rjy7pyn2w7laav4azpw9ukcqwfs350mj [{127.0.0.1:2123 1 [] [jsonrpc] []}]
provider lava@1y5an8yrmur0v3844434csgsq4lysrs0n36dkwz [{127.0.0.1:2121 1 [] [jsonrpc] []}]
Sep  9 21:36:22 INF Lava Over Lava Test OK
Sep  9 21:36:22 INF Starting REST Tests
Sep  9 21:36:53 INF REST TEST OK
Sep  9 21:36:53 INF Starting GRPC Tests
Sep  9 21:36:58 INF GRPC TEST OK
Sep  9 21:36:58 INF Starting Relay Response Integrity Tests
Sep  9 21:36:58 INF TENDERMINT RESPONSE CROSS VERIFICATION OK
Sep  9 21:36:58 INF REST RESPONSE CROSS VERIFICATION OK
Sep  9 21:36:58 INF GRPC RESPONSE CROSS VERIFICATION OK
Sep  9 21:36:58 INF Starting WebSocket Subscription Test
Sep  9 21:36:58 INF Setting up web socket client 1
Sep  9 21:36:58 DBG Dialed WebSocket Successful response="&{Status:101 Switching Protocols StatusCode:101 Proto:HTTP/1.1 ProtoMajor:1 ProtoMinor:1 Header:map[Access-Control-Allow-Origin:[*] Connection:[Upgrade] Date:[Mon, 09 Sep 2024 21:36:57 GMT] Sec-Websocket-Accept:[ScGP6kxSbkT1g3ATJ2DRdeeJa6U=] Upgrade:[websocket]] Body:{Reader:0xc0078e4390} ContentLength:0 TransferEncoding:[] Close:false Uncompressed:false Trailer:map[] Request:0xc0078e3300 TLS:<nil>}" url=ws://127.0.0.1:3340/websocket
Sep  9 21:36:58 INF Start listening for NewBlock messages on web socket 1
Sep  9 21:36:58 INF Subscribing to NewBlock events on web socket 1
Sep  9 21:36:58 INF Setting up web socket client 2
Sep  9 21:36:58 DBG Dialed WebSocket Successful response="&{Status:101 Switching Protocols StatusCode:101 Proto:HTTP/1.1 ProtoMajor:1 ProtoMinor:1 Header:map[Access-Control-Allow-Origin:[*] Connection:[Upgrade] Date:[Mon, 09 Sep 2024 21:36:57 GMT] Sec-Websocket-Accept:[0h69coddZg/F1TlUGgbnWups6kI=] Upgrade:[websocket]] Body:{Reader:0xc0078e4870} ContentLength:0 TransferEncoding:[] Close:false Uncompressed:false Trailer:map[] Request:0xc0078e3600 TLS:<nil>}" url=ws://127.0.0.1:3340/websocket
Sep  9 21:36:58 INF Start listening for NewBlock messages on web socket 2
Sep  9 21:36:58 INF Subscribing to NewBlock events on web socket 2
Sep  9 21:36:58 INF Setting up web socket client 3
Sep  9 21:36:58 DBG Dialed WebSocket Successful response="&{Status:101 Switching Protocols StatusCode:101 Proto:HTTP/1.1 ProtoMajor:1 ProtoMinor:1 Header:map[Access-Control-Allow-Origin:[*] Connection:[Upgrade] Date:[Mon, 09 Sep 2024 21:36:57 GMT] Sec-Websocket-Accept:[vaMyNvTXR4FHGO4y/LSLV5qWCOc=] Upgrade:[websocket]] Body:{Reader:0xc007831f80} ContentLength:0 TransferEncoding:[] Close:false Uncompressed:false Trailer:map[] Request:0xc0078e3900 TLS:<nil>}" url=ws://127.0.0.1:3340/websocket
Sep  9 21:36:58 INF Start listening for NewBlock messages on web socket 3
Sep  9 21:36:58 INF Subscribing to NewBlock events on web socket 3
Sep  9 21:36:58 INF Setting up web socket client 4
Sep  9 21:36:58 DBG Dialed WebSocket Successful response="&{Status:101 Switching Protocols StatusCode:101 Proto:HTTP/1.1 ProtoMajor:1 ProtoMinor:1 Header:map[Access-Control-Allow-Origin:[*] Connection:[Upgrade] Date:[Mon, 09 Sep 2024 21:36:57 GMT] Sec-Websocket-Accept:[uzGWZUWCFd4ECeL8SxvSMNW7rB4=] Upgrade:[websocket]] Body:{Reader:0xc0076b3830} ContentLength:0 TransferEncoding:[] Close:false Uncompressed:false Trailer:map[] Request:0xc007912000 TLS:<nil>}" url=ws://127.0.0.1:3340/websocket
Sep  9 21:36:58 INF Start listening for NewBlock messages on web socket 4
Sep  9 21:36:58 INF Subscribing to NewBlock events on web socket 4
Sep  9 21:36:58 INF Setting up web socket client 5
Sep  9 21:36:58 DBG Dialed WebSocket Successful response="&{Status:101 Switching Protocols StatusCode:101 Proto:HTTP/1.1 ProtoMajor:1 ProtoMinor:1 Header:map[Access-Control-Allow-Origin:[*] Connection:[Upgrade] Date:[Mon, 09 Sep 2024 21:36:57 GMT] Sec-Websocket-Accept:[QF7gBKanLO7vOwm7niQzL1S1q6Q=] Upgrade:[websocket]] Body:{Reader:0xc0078e4d20} ContentLength:0 TransferEncoding:[] Close:false Uncompressed:false Trailer:map[] Request:0xc00763ef00 TLS:<nil>}" url=ws://127.0.0.1:3340/websocket
Sep  9 21:36:58 INF Start listening for NewBlock messages on web socket 5
Sep  9 21:36:58 INF Subscribing to NewBlock events on web socket 5
Sep  9 21:36:58 INF Sleeping for 12 seconds to receive blocks
Sep  9 21:37:10 DBG Looping through subscription containers subscriptionContainers="[0xc0078ec210 0xc0078ec910 0xc00785f810 0xc0076b51d0 0xc0078ed000]"
Sep  9 21:37:10 INF Making sure both clients received at least 10 blocks
Sep  9 21:37:10 INF Making sure both clients received at least 10 blocks
Sep  9 21:37:10 INF Making sure both clients received at least 10 blocks
Sep  9 21:37:10 INF Making sure both clients received at least 10 blocks
Sep  9 21:37:10 INF Making sure both clients received at least 10 blocks
Sep  9 21:37:10 INF Unsubscribing from NewBlock events on web socket 1
Sep  9 21:37:10 INF Sleeping for 7 seconds to make sure unsubscribed client stops receiving blocks
Sep  9 21:37:17 INF Closing web socket 1
Sep  9 21:37:17 INF Closing web socket 2
Sep  9 21:37:17 INF Closing web socket 3
Sep  9 21:37:17 INF Closing web socket 4
Sep  9 21:37:17 INF Closing web socket 5
Sep  9 21:37:17 INF WebSocket Subscription Test OK
Sep  9 21:37:17 INF Starting QoS Tests
Sep  9 21:37:18 INF QOS CHECK OK
Sep  9 21:37:18 INF Sleeping Until All Rewards are collected
Sep  9 21:37:23 INF sleepUntilNextEpoch OK
Sep  9 21:37:43 INF sleepUntilNextEpoch OK
Sep  9 21:38:03 INF sleepUntilNextEpoch OK
Sep  9 21:38:23 INF sleepUntilNextEpoch OK
Sep  9 21:38:23 INF Restarting lava to emergency mode
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=9_QoS_00
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=9_QoS_00
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=9_QoS_08
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=9_QoS_08
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=00_StartLava
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=00_StartLava
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=02_jsonProxy
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=02_jsonProxy
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=03_EthProvider_01
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=03_EthProvider_01
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=05_LavaProvider_04
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=05_LavaProvider_04
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=9_QoS_06
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=9_QoS_06
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=8_authAccount07
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=1 log_name=8_authAccount07
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=05_LavaProvider_01
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=05_LavaProvider_01
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=05_LavaProvider_02
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=05_LavaProvider_02
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=05_LavaProvider_03
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=05_LavaProvider_03
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=8_authAccount02
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=1 log_name=8_authAccount02
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=9_QoS_05
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=9_QoS_05
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=8_authAccount09
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=1 log_name=8_authAccount09
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=9_QoS_03
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=9_QoS_03
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=9_QoS_04
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=9_QoS_04
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=8_authAccount06
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=1 log_name=8_authAccount06
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=01_stakeLava
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=01_stakeLava
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=07_lavaOverLava
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=07_lavaOverLava
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=8_authAccount01
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=1 log_name=8_authAccount01
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=8_authAccount03
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=1 log_name=8_authAccount03
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=04_jsonConsumer_01
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=04_jsonConsumer_01
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=06_RPCConsumer_01
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=06_RPCConsumer_01
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=9_QoS_01
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=9_QoS_01
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=8_authAccount05
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=1 log_name=8_authAccount05
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=03_EthProvider_03
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=03_EthProvider_03
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=8_authAccount00
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=1 log_name=8_authAccount00
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=9_QoS_02
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=9_QoS_02
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=8_authAccount04
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=1 log_name=8_authAccount04
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=9_QoS_07
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=9_QoS_07
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=8_authAccount08
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=1 log_name=8_authAccount08
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=9_QoS_09
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=9_QoS_09
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=03_EthProvider_02
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=03_EthProvider_02
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=03_EthProvider_04
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=03_EthProvider_04
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=03_EthProvider_05
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=03_EthProvider_05
Sep  9 21:38:23 INF Adding EmergencyMode Start Line to log_name=05_LavaProvider_05
Sep  9 21:38:23 INF Successfully verified EmergencyMode Start Line in the last 20 lines line=19 log_name=05_LavaProvider_05
Sep  9 21:38:23 INF stopLava OK
Sep  9 21:38:23 INF Executing Command: ./scripts/test/emergency_mode.sh 100000
Sep  9 21:38:23 INF Waiting for Lava
Sep  9 21:38:23 INF startLava OK
Sep  9 21:38:33 INF Starting Lava OK
Sep  9 21:38:33 INF Executing Command: /home/runner/go/bin/lavap rpcconsumer ./testutil/e2e/e2eConfigs/consumer/lavaConsumerEmergency1.yml --chain-id=lava --from user5 --geolocation 1 --log_level debug --allow-insecure-provider-dialing
Sep  9 21:38:33 INF startRPCEmergencyConsumer OK
Sep  9 21:38:33 INF Waiting REST Consumer
Sep  9 21:38:34 INF Waiting REST Consumer
Sep  9 21:38:34 INF checkRESTConsumer OK
Sep  9 21:38:34 INF getLastBlockTime OK
Sep  9 21:38:34 INF Waiting for finishing current epoch and waiting for 2 more virtual epochs
Sep  9 21:38:46 INF 0 : VIRTUAL EPOCH ENDED
Sep  9 21:39:10 INF 1 : VIRTUAL EPOCH ENDED
Sep  9 21:39:34 INF 2 : VIRTUAL EPOCH ENDED
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=04_jsonConsumer_01
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=06_RPCConsumer_01
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=9_QoS_01
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=8_authAccount05
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=11_RPCEmergencyConsumer_01
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=03_EthProvider_03
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=8_authAccount00
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=9_QoS_02
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=8_authAccount04
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=9_QoS_07
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=8_authAccount08
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=9_QoS_09
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=03_EthProvider_02
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=03_EthProvider_04
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=03_EthProvider_05
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=05_LavaProvider_05
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=9_QoS_00
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=9_QoS_08
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=00_StartLava
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=02_jsonProxy
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=03_EthProvider_01
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=05_LavaProvider_04
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=9_QoS_06
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=8_authAccount07
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=05_LavaProvider_01
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=05_LavaProvider_02
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=05_LavaProvider_03
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=8_authAccount02
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=9_QoS_05
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=8_authAccount09
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=9_QoS_03
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=9_QoS_04
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=8_authAccount06
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=10_StartLavaInEmergencyMode
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=01_stakeLava
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=07_lavaOverLava
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=8_authAccount01
Sep  9 21:39:34 INF Adding EmergencyMode End Line to log_name=8_authAccount03
Sep  9 21:39:34 INF REST RELAY TESTS OK
Sep  9 21:39:34 DBG success writing to file bytesWritten=9488 fileName=9_QoS_07 lines=9488
Sep  9 21:39:34 INF Found Emergency start line Line index=297 file=9_QoS_07
Sep  9 21:39:34 INF Found Emergency end line Line index=298 file=9_QoS_07
Sep  9 21:39:34 DBG success writing to file bytesWritten=29096 fileName=03_EthProvider_04 lines=29096
Sep  9 21:39:34 INF Found Emergency start line Line index=208 file=03_EthProvider_04
Sep  9 21:39:34 INF Found Emergency end line Line index=218 file=03_EthProvider_04
Sep  9 21:39:34 DBG success writing to file bytesWritten=28319 fileName=03_EthProvider_05 lines=28319
Sep  9 21:39:34 INF Found Emergency start line Line index=205 file=03_EthProvider_05
Sep  9 21:39:34 INF Found Emergency end line Line index=215 file=03_EthProvider_05
Sep  9 21:39:34 DBG success writing to file bytesWritten=4784171 fileName=05_LavaProvider_05 lines=4784171
Sep  9 21:39:34 INF Found Emergency start line Line index=21726 file=05_LavaProvider_05
Sep  9 21:39:34 INF Found Emergency end line Line index=21929 file=05_LavaProvider_05
Sep  9 21:39:34 DBG success writing to file bytesWritten=332 fileName=8_authAccount08 lines=332
Sep  9 21:39:34 INF Found Emergency start line Line index=1 file=8_authAccount08
Sep  9 21:39:34 INF Found Emergency end line Line index=2 file=8_authAccount08
Sep  9 21:39:34 DBG success writing to file bytesWritten=8901 fileName=9_QoS_09 lines=8901
Sep  9 21:39:34 INF Found Emergency start line Line index=273 file=9_QoS_09
Sep  9 21:39:34 INF Found Emergency end line Line index=274 file=9_QoS_09
Sep  9 21:39:34 DBG success writing to file bytesWritten=26967 fileName=03_EthProvider_02 lines=26967
Sep  9 21:39:34 INF Found Emergency start line Line index=198 file=03_EthProvider_02
Sep  9 21:39:34 INF Found Emergency end line Line index=207 file=03_EthProvider_02
Sep  9 21:39:34 DBG success writing to file bytesWritten=9930327 fileName=02_jsonProxy lines=9930327
Sep  9 21:39:34 INF Found Emergency start line Line index=6491 file=02_jsonProxy
Sep  9 21:39:34 INF Found Emergency end line Line index=8082 file=02_jsonProxy
Sep  9 21:39:34 DBG success writing to file bytesWritten=49542 fileName=03_EthProvider_01 lines=49542
Sep  9 21:39:34 INF Found Emergency start line Line index=308 file=03_EthProvider_01
Sep  9 21:39:34 INF Found Emergency end line Line index=318 file=03_EthProvider_01
Sep  9 21:39:34 DBG success writing to file bytesWritten=5668103 fileName=05_LavaProvider_04 lines=5668103
Sep  9 21:39:34 INF Found Emergency start line Line index=25834 file=05_LavaProvider_04
Sep  9 21:39:34 INF Found Emergency end line Line index=25942 file=05_LavaProvider_04
Sep  9 21:39:34 DBG success writing to file bytesWritten=8905 fileName=9_QoS_00 lines=8905
Sep  9 21:39:34 INF Found Emergency start line Line index=273 file=9_QoS_00
Sep  9 21:39:34 INF Found Emergency end line Line index=274 file=9_QoS_00
Sep  9 21:39:34 DBG success writing to file bytesWritten=8891 fileName=9_QoS_08 lines=8891
Sep  9 21:39:34 INF Found Emergency start line Line index=273 file=9_QoS_08
Sep  9 21:39:34 INF Found Emergency end line Line index=274 file=9_QoS_08
Sep  9 21:39:34 DBG success writing to file bytesWritten=901616 fileName=00_StartLava lines=901616
Sep  9 21:39:34 DBG success writing to file bytesWritten=5113401 fileName=05_LavaProvider_02 lines=5113401
Sep  9 21:39:34 INF Found Emergency start line Line index=23385 file=05_LavaProvider_02
Sep  9 21:39:34 INF Found Emergency end line Line index=23439 file=05_LavaProvider_02
Sep  9 21:39:34 DBG success writing to file bytesWritten=936274 fileName=05_LavaProvider_03 lines=936274
Sep  9 21:39:34 INF Found Emergency start line Line index=4370 file=05_LavaProvider_03
Sep  9 21:39:34 INF Found Emergency end line Line index=4480 file=05_LavaProvider_03
Sep  9 21:39:34 DBG success writing to file bytesWritten=332 fileName=8_authAccount02 lines=332
Sep  9 21:39:34 INF Found Emergency start line Line index=1 file=8_authAccount02
Sep  9 21:39:34 INF Found Emergency end line Line index=2 file=8_authAccount02
Sep  9 21:39:34 DBG success writing to file bytesWritten=14065 fileName=9_QoS_06 lines=14065
Sep  9 21:39:34 INF Found Emergency start line Line index=414 file=9_QoS_06
Sep  9 21:39:34 INF Found Emergency end line Line index=415 file=9_QoS_06
Sep  9 21:39:34 DBG success writing to file bytesWritten=332 fileName=8_authAccount07 lines=332
Sep  9 21:39:34 INF Found Emergency start line Line index=1 file=8_authAccount07
Sep  9 21:39:34 INF Found Emergency end line Line index=2 file=8_authAccount07
Sep  9 21:39:34 DBG success writing to file bytesWritten=6108958 fileName=05_LavaProvider_01 lines=6108958
Sep  9 21:39:34 INF Found Emergency start line Line index=27401 file=05_LavaProvider_01
Sep  9 21:39:34 INF Found Emergency end line Line index=27511 file=05_LavaProvider_01
Sep  9 21:39:34 DBG success writing to file bytesWritten=332 fileName=8_authAccount09 lines=332
Sep  9 21:39:34 INF Found Emergency start line Line index=1 file=8_authAccount09
Sep  9 21:39:34 INF Found Emergency end line Line index=2 file=8_authAccount09
Sep  9 21:39:34 DBG success writing to file bytesWritten=9488 fileName=9_QoS_05 lines=9488
Sep  9 21:39:34 INF Found Emergency start line Line index=297 file=9_QoS_05
Sep  9 21:39:34 INF Found Emergency end line Line index=298 file=9_QoS_05
Sep  9 21:39:34 DBG success writing to file bytesWritten=2202 fileName=07_lavaOverLava lines=2202
Sep  9 21:39:34 INF Found Emergency start line Line index=96 file=07_lavaOverLava
Sep  9 21:39:34 INF Found Emergency end line Line index=97 file=07_lavaOverLava
Sep  9 21:39:34 DBG success writing to file bytesWritten=332 fileName=8_authAccount01 lines=332
Sep  9 21:39:34 INF Found Emergency start line Line index=1 file=8_authAccount01
Sep  9 21:39:34 INF Found Emergency end line Line index=2 file=8_authAccount01
Sep  9 21:39:34 DBG success writing to file bytesWritten=331 fileName=8_authAccount03 lines=331
Sep  9 21:39:34 INF Found Emergency start line Line index=1 file=8_authAccount03
Sep  9 21:39:34 INF Found Emergency end line Line index=2 file=8_authAccount03
Sep  9 21:39:34 DBG success writing to file bytesWritten=9488 fileName=9_QoS_03 lines=9488
Sep  9 21:39:34 INF Found Emergency start line Line index=297 file=9_QoS_03
Sep  9 21:39:34 INF Found Emergency end line Line index=298 file=9_QoS_03
Sep  9 21:39:34 DBG success writing to file bytesWritten=9488 fileName=9_QoS_04 lines=9488
Sep  9 21:39:34 INF Found Emergency start line Line index=297 file=9_QoS_04
Sep  9 21:39:34 INF Found Emergency end line Line index=298 file=9_QoS_04
Sep  9 21:39:34 DBG success writing to file bytesWritten=332 fileName=8_authAccount06 lines=332
Sep  9 21:39:34 INF Found Emergency start line Line index=1 file=8_authAccount06
Sep  9 21:39:34 INF Found Emergency end line Line index=2 file=8_authAccount06
Sep  9 21:39:34 DBG success writing to file bytesWritten=8057 fileName=10_StartLavaInEmergencyMode lines=8057
Sep  9 21:39:34 INF Found Emergency end line Line index=53 file=10_StartLavaInEmergencyMode
Sep  9 21:39:34 DBG success writing to file bytesWritten=8453 fileName=01_stakeLava lines=8453
Sep  9 21:39:34 INF Found Emergency start line Line index=413 file=01_stakeLava
Sep  9 21:39:34 INF Found Emergency end line Line index=414 file=01_stakeLava
Sep  9 21:39:34 DBG success writing to file bytesWritten=49529484 fileName=06_RPCConsumer_01 lines=49529484
Sep  9 21:39:35 INF Found Emergency start line Line index=156362 file=06_RPCConsumer_01
Sep  9 21:39:35 INF Found Emergency end line Line index=156370 file=06_RPCConsumer_01
Sep  9 21:39:35 DBG success writing to file bytesWritten=8905 fileName=9_QoS_01 lines=8905
Sep  9 21:39:35 INF Found Emergency start line Line index=273 file=9_QoS_01
Sep  9 21:39:35 INF Found Emergency end line Line index=274 file=9_QoS_01
Sep  9 21:39:35 DBG success writing to file bytesWritten=74977 fileName=04_jsonConsumer_01 lines=74977
Sep  9 21:39:35 INF Found Emergency start line Line index=202 file=04_jsonConsumer_01
Sep  9 21:39:35 INF Found Emergency end line Line index=210 file=04_jsonConsumer_01
Sep  9 21:39:35 DBG success writing to file bytesWritten=332 fileName=8_authAccount00 lines=332
Sep  9 21:39:35 INF Found Emergency start line Line index=1 file=8_authAccount00
Sep  9 21:39:35 INF Found Emergency end line Line index=2 file=8_authAccount00
Sep  9 21:39:35 DBG success writing to file bytesWritten=9488 fileName=9_QoS_02 lines=9488
Sep  9 21:39:35 INF Found Emergency start line Line index=297 file=9_QoS_02
Sep  9 21:39:35 INF Found Emergency end line Line index=298 file=9_QoS_02
Sep  9 21:39:35 DBG success writing to file bytesWritten=331 fileName=8_authAccount04 lines=331
Sep  9 21:39:35 INF Found Emergency start line Line index=1 file=8_authAccount04
Sep  9 21:39:35 INF Found Emergency end line Line index=2 file=8_authAccount04
Sep  9 21:39:35 DBG success writing to file bytesWritten=331 fileName=8_authAccount05 lines=331
Sep  9 21:39:35 INF Found Emergency start line Line index=1 file=8_authAccount05
Sep  9 21:39:35 INF Found Emergency end line Line index=2 file=8_authAccount05
Sep  9 21:39:35 DBG success writing to file bytesWritten=265484 fileName=11_RPCEmergencyConsumer_01 lines=265484
Sep  9 21:39:35 INF Found Emergency end line Line index=770 file=11_RPCEmergencyConsumer_01
Sep  9 21:39:35 DBG success writing to file bytesWritten=23842 fileName=03_EthProvider_03 lines=23842
Sep  9 21:39:35 INF Found Emergency start line Line index=182 file=03_EthProvider_03
Sep  9 21:39:35 INF Found Emergency end line Line index=192 file=03_EthProvider_03
ERROR:  Sep  9 21:34:26 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@173wncyyfhk50762rrmnea0kxtgwaera0ljr5s0 Score:0.30577387071979517 Part:1} {Address:lava@1q5mk6q4vfjf42z5hq34n3u8twhjr7n5c3jau80 Score:0.38974926333244064 Part:1} {Address:lava@1jk6uj4srp54evkm4623z83q0vzv5v886cm6skk Score:0.39574896517340746 Part:1} {Address:lava@1qz40y9yhykf3xc9u79mwum6zczttwe2zp6mxf2 Score:0.39843653969317494 Part:1}]" totalWeight=2500000000000
Sep  9 21:34:27 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@1q5mk6q4vfjf42z5hq34n3u8twhjr7n5c3jau80 Score:0.36510147850415325 Part:1} {Address:lava@173wncyyfhk50762rrmnea0kxtgwaera0ljr5s0 Score:0.4266952423493712 Part:1}]" totalWeight=2500000000000
Sep  9 21:34:27 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@1q5mk6q4vfjf42z5hq34n3u8twhjr7n5c3jau80 Score:0.40461571326257745 Part:1}]" totalWeight=2500000000000
Sep  9 21:34:27 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@173wncyyfhk50762rrmnea0kxtgwaera0ljr5s0 Score:0.001726128445242028 Part:1} {Address:lava@1nu7sn5fd6enx5ygacwesue6v04uuwxwataydhl Score:0.001993415501823646 Part:1}]" totalWeight=2500000000000
Sep  9 21:34:27 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@1qz40y9yhykf3xc9u79mwum6zczttwe2zp6mxf2 Score:0.0013431564854303995 Part:1} {Address:lava@1jk6uj4srp54evkm4623z83q0vzv5v886cm6skk Score:0.0013563097212722212 Part:1}]" totalWeight=2500000000000
ERROR:  Sep  9 21:34:24 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@1ejpy45c4klf035nhwmp9lt40ypwgsm6nccqyad Score:5.633529182003811 Part:1}]" totalWeight=1500000000000
Sep  9 21:34:38 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@1y5an8yrmur0v3844434csgsq4lysrs0n36dkwz Score:1.0457533141208666 Part:1}]" totalWeight=1500000000000
Sep  9 21:34:45 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@1vdkcj6rjy7pyn2w7laav4azpw9ukcqwfs350mj Score:0.0026906862912858954 Part:1} {Address:lava@145aecv3e0u0uf6lulz8dkhzzp508drhykegj0t Score:0.0034053369509961335 Part:1} {Address:lava@1y5an8yrmur0v3844434csgsq4lysrs0n36dkwz Score:0.17372407385197025 Part:1}]" totalWeight=2500000000000
Sep  9 21:34:46 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@1vdkcj6rjy7pyn2w7laav4azpw9ukcqwfs350mj Score:0.0037306229712028636 Part:1} {Address:lava@145aecv3e0u0uf6lulz8dkhzzp508drhykegj0t Score:0.0037803574403804012 Part:1} {Address:lava@1y5an8yrmur0v3844434csgsq4lysrs0n36dkwz Score:0.1955026027536377 Part:1}]" totalWeight=2500000000000
Sep  9 21:34:49 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@1y5an8yrmur0v3844434csgsq4lysrs0n36dkwz Score:0.917926961081641 Part:1}]" totalWeight=2500000000000
ERROR:  Sep  9 21:38:34 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@1qz40y9yhykf3xc9u79mwum6zczttwe2zp6mxf2 Score:0.38540292191833003 Part:1} {Address:lava@1jk6uj4srp54evkm4623z83q0vzv5v886cm6skk Score:0.38912492931971454 Part:1} {Address:lava@1nu7sn5fd6enx5ygacwesue6v04uuwxwataydhl Score:0.3900810447058414 Part:1} {Address:lava@1q5mk6q4vfjf42z5hq34n3u8twhjr7n5c3jau80 Score:0.4366171264518344 Part:1}]" totalWeight=2500000000000
Sep  9 21:38:34 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@1qz40y9yhykf3xc9u79mwum6zczttwe2zp6mxf2 Score:0.36114328880253344 Part:1} {Address:lava@1nu7sn5fd6enx5ygacwesue6v04uuwxwataydhl Score:0.38551941144577945 Part:1} {Address:lava@1jk6uj4srp54evkm4623z83q0vzv5v886cm6skk Score:0.40654137932577317 Part:1} {Address:lava@173wncyyfhk50762rrmnea0kxtgwaera0ljr5s0 Score:0.43543060958750746 Part:1}]" totalWeight=2500000000000
Sep  9 21:38:34 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@1nu7sn5fd6enx5ygacwesue6v04uuwxwataydhl Score:0.42110635432809873 Part:1}]" totalWeight=2500000000000
Sep  9 21:38:34 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@173wncyyfhk50762rrmnea0kxtgwaera0ljr5s0 Score:0.0018959096992163117 Part:1} {Address:lava@1nu7sn5fd6enx5ygacwesue6v04uuwxwataydhl Score:0.00206026436514474 Part:1}]" totalWeight=2500000000000
Sep  9 21:38:34 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@1q5mk6q4vfjf42z5hq34n3u8twhjr7n5c3jau80 Score:0.0023046167658256553 Part:1} {Address:lava@1jk6uj4srp54evkm4623z83q0vzv5v886cm6skk Score:0.002363148161380557 Part:1} {Address:lava@1qz40y9yhykf3xc9u79mwum6zczttwe2zp6mxf2 Score:0.0028268853685434864 Part:1}]" totalWeight=2500000000000

Check warning on line 0 in github.com/lavanet/lava/v3/testutil/e2e

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestLavaProtocolPayment (github.com/lavanet/lava/v3/testutil/e2e) failed

artifacts/Test Results (Payment E2E)/payment-e2e-report.xml [took 7m 56s]
Raw output
Failed
Sep  9 21:30:28 INF Starting Lava
Sep  9 21:30:28 INF Executing Command: ./scripts/test/start_env_dev_for_payment_e2e.sh
Sep  9 21:30:28 INF Waiting for Lava
Sep  9 21:30:38 INF Waiting for Lava
Sep  9 21:30:48 INF Waiting for Lava
Sep  9 21:30:58 INF Waiting for Lava
Sep  9 21:31:08 INF Waiting for Lava
Sep  9 21:31:18 INF Waiting for Lava
Sep  9 21:31:28 INF Waiting for Lava
Sep  9 21:31:38 INF Waiting for Lava
Sep  9 21:31:48 INF Waiting for Lava
Sep  9 21:31:58 INF Waiting for Lava
Sep  9 21:32:08 INF Waiting for Lava
Sep  9 21:32:18 INF Waiting for Lava
Sep  9 21:32:28 INF Waiting for Lava
Sep  9 21:32:38 INF Waiting for Lava
Sep  9 21:32:48 INF Waiting for Lava
Sep  9 21:32:58 INF Waiting for Lava
Sep  9 21:33:08 INF Waiting for Lava
Sep  9 21:33:18 INF Starting Lava OK
Sep  9 21:33:18 INF Staking Lava
Sep  9 21:33:18 INF Executing Command: ./scripts/test/init_payment_e2e.sh
Sep  9 21:33:42 INF stakeLavaForPayment OK
LAV1
provider lava@13udzp4wemdywdr4qvhp7vvq27prfr0ccw7t4l8 [{127.0.0.1:2261 1 [] [grpc rest tendermintrpc] []}]
provider lava@1zjxnn2xfv4hlh4kmvcvrenk44aeskja7awkkra [{127.0.0.1:2262 1 [] [grpc rest tendermintrpc] []}]
Sep  9 21:33:42 INF Staking Lava OK
Sep  9 21:33:42 INF RUNNING TESTS
Sep  9 21:33:42 INF Executing Command: /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/lavaProvider6 --chain-id=lava --from servicer1 --geolocation 1 --log_level debug
Sep  9 21:33:42 INF Executing Command: /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/lavaProvider7 --chain-id=lava --from servicer2 --geolocation 1 --log_level debug
Sep  9 21:33:42 INF Waiting Provider 127.0.0.1:2261
Sep  9 21:33:44 INF Waiting Provider 127.0.0.1:2261
Sep  9 21:33:44 INF Waiting Provider 127.0.0.1:2262
Sep  9 21:33:44 INF startLavaProvidersForPayment OK
Sep  9 21:33:44 INF Executing Command: /home/runner/go/bin/lavap rpcconsumer ./testutil/e2e/e2eConfigs/consumer/lavaConsumer1.yml --chain-id=lava --from user1 --geolocation 1 --log_level debug --allow-insecure-provider-dialing --concurrent-providers 1
Sep  9 21:33:44 INF startLavaConsumerForPayment OK
Sep  9 21:33:44 INF Waiting TENDERMINT Consumer
Sep  9 21:33:45 INF Waiting TENDERMINT Consumer
Sep  9 21:33:45 INF checkTendermintConsumer OK
Sep  9 21:33:45 INF Starting TENDERMINT Tests
Sep  9 21:34:05 INF TENDERMINTRPC TEST OK
Sep  9 21:34:05 INF Starting TENDERMINTRPC URI Tests
Sep  9 21:34:25 INF TENDERMINTRPC URI TEST OK
Sep  9 21:34:25 INF CHECKING PAYMENT
Sep  9 21:38:25 INF PAYMENT TEST OK
Sep  9 21:38:25 DBG writing file fileName=00_StartLava lines=781237
Sep  9 21:38:25 DBG writing file fileName=01_stakeLavaForPayment lines=2718
Sep  9 21:38:25 DBG writing file fileName=05_LavaProvider_01 lines=7118518
Sep  9 21:38:25 DBG writing file fileName=05_LavaProvider_02 lines=7119756
Sep  9 21:38:25 DBG writing file fileName=06_RPCConsumer_01 lines=28684361
ERROR:  Sep  9 21:34:05 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@1zjxnn2xfv4hlh4kmvcvrenk44aeskja7awkkra Score:0.0009223962149595903 Part:1}]" totalWeight=1000000000000
Sep  9 21:34:05 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@13udzp4wemdywdr4qvhp7vvq27prfr0ccw7t4l8 Score:0.0008270856914018938 Part:1}]" totalWeight=1000000000000
Sep  9 21:34:05 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@1zjxnn2xfv4hlh4kmvcvrenk44aeskja7awkkra Score:0.000875221886958942 Part:1}]" totalWeight=1000000000000
Sep  9 21:34:05 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@1zjxnn2xfv4hlh4kmvcvrenk44aeskja7awkkra Score:0.0008682020086954007 Part:1}]" totalWeight=1000000000000
Sep  9 21:34:05 ERR invalid weighted choice, no address chosen, fallback to last one addresses="[{Address:lava@13udzp4wemdywdr4qvhp7vvq27prfr0ccw7t4l8 Score:0.0008262112231359492 Part:1}]" totalWeight=1000000000000