Skip to content
Lava Build

feat: PRT - add relay retry atttempts flag #1686

Sign in to view logs

feat: PRT - add relay retry atttempts flag

feat: PRT - add relay retry atttempts flag #1686

GitHub Actions / Test Results failed Aug 26, 2024 in 0s

9 errors, 1 977 pass in 6m 41s

1 986 tests   1 977 ✅  6m 41s ⏱️
  143 suites      0 💤
    6 files        0 ❌  9 🔥

Results for commit 1e2beaf.

Annotations

Check failure on line 0 in github.com/lavanet/lava/v2/testutil/e2e

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestLavaProtocol (github.com/lavanet/lava/v2/testutil/e2e) with error 

artifacts/Test Results (Protocol E2E)/protocol-e2e-report.xml [took 0s]
Raw output 
No test result found
Aug 26 16:49:28 INF Starting Lava
Aug 26 16:49:28 INF Executing Command: ./scripts/start_env_dev.sh
Aug 26 16:49:28 INF Waiting for Lava
Aug 26 16:49:38 INF Waiting for Lava
Aug 26 16:49:48 INF Waiting for Lava
Aug 26 16:49:58 INF Waiting for Lava
Aug 26 16:50:08 INF Waiting for Lava
Aug 26 16:50:18 INF Waiting for Lava
Aug 26 16:50:28 INF Waiting for Lava
Aug 26 16:50:38 INF Waiting for Lava
Aug 26 16:50:48 INF Waiting for Lava
Aug 26 16:50:58 INF Waiting for Lava
Aug 26 16:51:03 DBG success writing to file bytesWritten=4272 fileName=00_StartLava lines=4272
panic: startLava failed exit status 127 [recovered]
	panic: Panic happened with command: ./scripts/start_env_dev.sh

goroutine 50 [running]:
github.com/lavanet/lava/v2/testutil/e2e.(*lavaTest).execCommand.func1()
	/home/runner/work/lava/lava/testutil/e2e/protocolE2E.go:135 +0xb4
panic({0x2210540, 0xc000fe26d0})
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/panic.go:884 +0x213
github.com/lavanet/lava/v2/testutil/e2e.(*lavaTest).execCommand(0xc000f874a0, {0x315d8d0, 0xc000fda120}, {0x265dfde, 0x9}, {0x26615a2, 0xc}, {0x2681ef2, 0x1a}, 0x1)
	/home/runner/work/lava/lava/testutil/e2e/protocolE2E.go:155 +0x41f
github.com/lavanet/lava/v2/testutil/e2e.(*lavaTest).startLava(0xc000b007b0?, {0x315d8d0?, 0xc000fda120?})
	/home/runner/work/lava/lava/testutil/e2e/protocolE2E.go:184 +0x51
created by github.com/lavanet/lava/v2/testutil/e2e.runProtocolE2E
	/home/runner/work/lava/lava/testutil/e2e/protocolE2E.go:1423 +0x4e5

Check failure on line 0 in github.com/lavanet/lava/v2/testutil/e2e

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestLavaProtocolPayment (github.com/lavanet/lava/v2/testutil/e2e) with error 

artifacts/Test Results (Payment E2E)/payment-e2e-report.xml [took 0s]
Raw output 
No test result found
Aug 26 16:49:16 INF Starting Lava
Aug 26 16:49:16 INF Executing Command: ./scripts/test/start_env_dev_for_payment_e2e.sh
Aug 26 16:49:16 INF Waiting for Lava
Aug 26 16:49:26 INF Waiting for Lava
Aug 26 16:49:36 INF Waiting for Lava
Aug 26 16:49:46 INF Waiting for Lava
Aug 26 16:49:56 INF Waiting for Lava
Aug 26 16:50:06 INF Waiting for Lava
Aug 26 16:50:16 INF Waiting for Lava
Aug 26 16:50:26 INF Waiting for Lava
Aug 26 16:50:36 INF Waiting for Lava
Aug 26 16:50:46 INF Waiting for Lava
Aug 26 16:50:51 DBG success writing to file bytesWritten=4405 fileName=00_StartLava lines=4405
panic: startLava failed exit status 127 [recovered]
	panic: Panic happened with command: ./scripts/test/start_env_dev_for_payment_e2e.sh

goroutine 50 [running]:
github.com/lavanet/lava/v2/testutil/e2e.(*lavaTest).execCommand.func1()
	/home/runner/work/lava/lava/testutil/e2e/protocolE2E.go:135 +0xb4
panic({0x2210540, 0xc001040210})
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/panic.go:884 +0x213
github.com/lavanet/lava/v2/testutil/e2e.(*lavaTest).execCommand(0xc000feb2c0, {0x315d8d0, 0xc001023bf0}, {0x265dfde, 0x9}, {0x26615a2, 0xc}, {0x26dbac4, 0x2f}, 0x1)
	/home/runner/work/lava/lava/testutil/e2e/protocolE2E.go:155 +0x41f
github.com/lavanet/lava/v2/testutil/e2e.(*lavaTest).startLavaForPayment(0xc00101eb80?, {0x315d8d0?, 0xc001023bf0?})
	/home/runner/work/lava/lava/testutil/e2e/paymentE2E.go:35 +0x52
created by github.com/lavanet/lava/v2/testutil/e2e.runPaymentE2E
	/home/runner/work/lava/lava/testutil/e2e/paymentE2E.go:310 +0x4ea

Check failure on line 0 in github.com/lavanet/lava/v2/protocol/chainlib

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestMatchSpecApiByName (github.com/lavanet/lava/v2/protocol/chainlib) with error 

artifacts/Test Results (Protocol)/protocol-report.xml [took 0s]
Raw output 
No test result found

Check failure on line 0 in github.com/lavanet/lava/v2/protocol/chainlib

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestConvertToJsonError (github.com/lavanet/lava/v2/protocol/chainlib) with error 

artifacts/Test Results (Protocol)/protocol-report.xml [took 0s]
Raw output 
No test result found

Check failure on line 0 in github.com/lavanet/lava/v2/protocol/chainlib

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestAddAttributeToError (github.com/lavanet/lava/v2/protocol/chainlib) with error 

artifacts/Test Results (Protocol)/protocol-report.xml [took 0s]
Raw output 
No test result found

Check failure on line 0 in github.com/lavanet/lava/v2/protocol/chainlib

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestSubscriptionManager_MultipleParallelSubscriptionsWithTheSameParamsAndNodeMessageFailure (github.com/lavanet/lava/v2/protocol/chainlib) with error 

artifacts/Test Results (Protocol)/protocol-report.xml [took 0s]
Raw output 
No test result found

Check failure on line 0 in github.com/lavanet/lava/v2/protocol/chainlib

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestSubscriptionManager_MultipleParallelSubscriptionsWithTheSameParamsAndNodeMessageFailure/TendermintRPC (github.com/lavanet/lava/v2/protocol/chainlib) with error 

artifacts/Test Results (Protocol)/protocol-report.xml [took 0s]
Raw output 
No test result found
Reproduce With testing seed:  1724690979
Aug 26 16:49:39 INF setting log level loglevel=debug
Aug 26 16:49:39 DBG Waiting wait group
Aug 26 16:49:39 DBG No Pending subscriptions, creating a new one hash="���ew\b6\x17�Jj\x1exOX�~B�o�\x1dd\x13\b�NȄ���"
Aug 26 16:49:39 INF Finished adding Clients Asynchronously free clients=0 url="ws://127.0.0.1:43013, addons: (websocket)"
Aug 26 16:49:39 INF Finished adding Clients Asynchronously free clients=1 url=http://127.0.0.1:46667
Aug 26 16:49:41 DBG got error from node GUID= nodeErr="websocket: close 1006 (abnormal closure): unexpected EOF"
Aug 26 16:49:41 ERR ProviderNodeSubscriptionManager: Subscription failed error="websocket: close 1006 (abnormal closure): unexpected EOF" GUID= params="{\"query\":\"tm.event='NewBlock'\"}"
Aug 26 16:49:41 WRN Failed the subscription attempt, retrying with the incoming message hash="���ew\b6\x17�Jj\x1exOX�~B�o�\x1dd\x13\b�NȄ���"
Aug 26 16:49:41 DBG No Pending subscriptions, creating a new one hash="���ew\b6\x17�Jj\x1exOX�~B�o�\x1dd\x13\b�NȄ���"
Aug 26 16:49:41 WRN Failed the subscription attempt, retrying with the incoming message hash="���ew\b6\x17�Jj\x1exOX�~B�o�\x1dd\x13\b�NȄ���"
Aug 26 16:49:41 WRN Failed the subscription attempt, retrying with the incoming message hash="���ew\b6\x17�Jj\x1exOX�~B�o�\x1dd\x13\b�NȄ���"
Aug 26 16:49:41 WRN Failed the subscription attempt, retrying with the incoming message hash="���ew\b6\x17�Jj\x1exOX�~B�o�\x1dd\x13\b�NȄ���"
Aug 26 16:49:41 WRN Failed the subscription attempt, retrying with the incoming message hash="���ew\b6\x17�Jj\x1exOX�~B�o�\x1dd\x13\b�NȄ���"
Aug 26 16:49:41 WRN Failed the subscription attempt, retrying with the incoming message hash="���ew\b6\x17�Jj\x1exOX�~B�o�\x1dd\x13\b�NȄ���"
Aug 26 16:49:41 WRN Failed the subscription attempt, retrying with the incoming message hash="���ew\b6\x17�Jj\x1exOX�~B�o�\x1dd\x13\b�NȄ���"
Aug 26 16:49:41 WRN Failed the subscription attempt, retrying with the incoming message hash="���ew\b6\x17�Jj\x1exOX�~B�o�\x1dd\x13\b�NȄ���"
Aug 26 16:49:41 DBG write message
Aug 26 16:49:41 WRN Failed the subscription attempt, retrying with the incoming message hash="���ew\b6\x17�Jj\x1exOX�~B�o�\x1dd\x13\b�NȄ���"
Aug 26 16:49:41 DBG No Pending subscriptions, creating a new one hash="���ew\b6\x17�Jj\x1exOX�~B�o�\x1dd\x13\b�NȄ���"
Aug 26 16:49:41 DBG write message
2024/08/26 16:49:41 http: panic serving 127.0.0.1:39966: sync: negative WaitGroup counter
goroutine 4974 [running]:
net/http.(*conn).serve.func1()
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:1854 +0xbf
panic({0x1bf96c0, 0x23067e0})
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/panic.go:890 +0x263
sync.(*WaitGroup).Add(0x1f4afac?, 0xd?)
	/opt/hostedtoolcache/go/1.20.14/x64/src/sync/waitgroup.go:62 +0xe5
sync.(*WaitGroup).Done(...)
	/opt/hostedtoolcache/go/1.20.14/x64/src/sync/waitgroup.go:87
github.com/lavanet/lava/v2/protocol/chainlib.TestSubscriptionManager_MultipleParallelSubscriptionsWithTheSameParamsAndNodeMessageFailure.func1.1({0x2323630?, 0xc000d04460?}, 0x1d13f80?)
	/home/runner/work/lava/lava/protocol/chainlib/provider_node_subscription_manager_test.go:376 +0x1e5
net/http.HandlerFunc.ServeHTTP(0x0?, {0x2323630?, 0xc000d04460?}, 0x47088e?)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:2122 +0x2f
net/http.serverHandler.ServeHTTP({0xc000d7e840?}, {0x2323630, 0xc000d04460}, 0xc002cd4900)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:2936 +0x316
net/http.(*conn).serve(0xc0004d4ab0, {0x2324df8, 0xc0014b6e10})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:1995 +0x612
created by net/http.(*Server).Serve
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:3089 +0x5ed
Aug 26 16:49:41 DBG got error from node GUID= nodeErr="websocket: close 1006 (abnormal closure): unexpected EOF"
Aug 26 16:49:41 ERR ProviderNodeSubscriptionManager: Subscription failed error="websocket: close 1006 (abnormal closure): unexpected EOF" GUID= params="{\"query\":\"tm.event='NewBlock'\"}"
Aug 26 16:49:41 WRN ProviderNodeSubscriptionManager:startListeningForSubscription() got error from node, ending subscription error="websocket: close 1006 (abnormal closure): unexpected EOF" GUID= hashedParams=8681ac65770836178a4a6a1e784f58cc7e429c6feb1d641308e34ec8848e8def
panic: test timed out after 10m0s
running tests:
	TestSubscriptionManager_MultipleParallelSubscriptionsWithTheSameParamsAndNodeMessageFailure (9m55s)
	TestSubscriptionManager_MultipleParallelSubscriptionsWithTheSameParamsAndNodeMessageFailure/TendermintRPC (9m55s)

goroutine 5410 [running]:
testing.(*M).startAlarm.func1()
	/opt/hostedtoolcache/go/1.20.14/x64/src/testing/testing.go:2241 +0x3c5
created by time.goFunc
	/opt/hostedtoolcache/go/1.20.14/x64/src/time/sleep.go:176 +0x32

goroutine 1 [chan receive, 9 minutes]:
testing.(*T).Run(0xc0005664e0, {0x1fdb500?, 0x540fa5?}, 0x20ca2b0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/testing/testing.go:1630 +0x405
testing.runTests.func1(0xc000500000?)
	/opt/hostedtoolcache/go/1.20.14/x64/src/testing/testing.go:2036 +0x45
testing.tRunner(0xc0005664e0, 0xc000c17ba0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/testing/testing.go:1576 +0x10b
testing.runTests(0xc000abdc20?, {0x33a0e40, 0x38, 0x38}, {0x15c34d1?, 0x23112b8?, 0x33c4da0?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/testing/testing.go:2034 +0x489
testing.(*M).Run(0xc000abdc20)
	/opt/hostedtoolcache/go/1.20.14/x64/src/testing/testing.go:1906 +0x63a
github.com/lavanet/lava/v2/protocol/chainlib.TestMain(0xffffffffffffffff?)
	/home/runner/work/lava/lava/protocol/chainlib/chain_router_test.go:1201 +0x19f
main.main()
	_testmain.go:159 +0x1d3

goroutine 12 [IO wait, 10 minutes]:
internal/poll.runtime_pollWait(0x7f5584db89d8, 0x72)
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/netpoll.go:306 +0x89
internal/poll.(*pollDesc).wait(0xc00024f180?, 0xc000268700?, 0x0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(...)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).ReadMsg(0xc00024f180, {0xc000268700, 0x10, 0x10}, {0xc000280020, 0x1000, 0x1000}, 0x1?)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_unix.go:304 +0x3aa
net.(*netFD).readMsg(0xc00024f180, {0xc000268700?, 0x1ce?, 0xc000517ce0?}, {0xc000280020?, 0x2000?, 0x0?}, 0x184bc88c8?)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/fd_posix.go:78 +0x37
net.(*UnixConn).readMsg(0xc000014bc8, {0xc000268700?, 0xc000517d50?, 0x425405?}, {0xc000280020?, 0x40f6fe?, 0x7f55af3e47e8?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/unixsock_posix.go:115 +0x4f
net.(*UnixConn).ReadMsgUnix(0xc000014bc8, {0xc000268700?, 0x418290?, 0x41d6b1?}, {0xc000280020?, 0x40fe8a?, 0xc0000133b0?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/unixsock.go:143 +0x3c
github.com/godbus/dbus.(*oobReader).Read(0xc000280000, {0xc000268700?, 0xc000517e28?, 0x410267?})
	/home/runner/go/pkg/mod/github.com/godbus/[email protected]/transport_unix.go:21 +0x45
io.ReadAtLeast({0x2308520, 0xc000280000}, {0xc000268700, 0x10, 0x10}, 0x10)
	/opt/hostedtoolcache/go/1.20.14/x64/src/io/io.go:332 +0x9a
io.ReadFull(...)
	/opt/hostedtoolcache/go/1.20.14/x64/src/io/io.go:351
github.com/godbus/dbus.(*unixTransport).ReadMessage(0xc00039f248)
	/home/runner/go/pkg/mod/github.com/godbus/[email protected]/transport_unix.go:91 +0x11e
github.com/godbus/dbus.(*Conn).inWorker(0xc0004ff200)
	/home/runner/go/pkg/mod/github.com/godbus/[email protected]/conn.go:294 +0x3b
created by github.com/godbus/dbus.(*Conn).Auth
	/home/runner/go/pkg/mod/github.com/godbus/[email protected]/auth.go:118 +0x9ee

goroutine 34 [sleep]:
time.Sleep(0x2540be400)
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/time.go:195 +0x135
github.com/valyala/fasthttp.(*workerPool).Start.func2()
	/home/runner/go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:67 +0x56
created by github.com/valyala/fasthttp.(*workerPool).Start
	/home/runner/go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:59 +0xdd

goroutine 14 [select]:
github.com/golang/glog.(*fileSink).flushDaemon(0x33c4cb8)
	/home/runner/go/pkg/mod/github.com/golang/[email protected]/glog_file.go:351 +0xcd
created by github.com/golang/glog.init.1
	/home/runner/go/pkg/mod/github.com/golang/[email protected]/glog_file.go:166 +0x145

goroutine 15 [select, 10 minutes]:
github.com/desertbit/timer.timerRoutine()
	/home/runner/go/pkg/mod/github.com/desertbit/[email protected]/timers.go:119 +0xba
created by github.com/desertbit/timer.init.0
	/home/runner/go/pkg/mod/github.com/desertbit/[email protected]/timers.go:15 +0x25

goroutine 18 [IO wait, 10 minutes]:
internal/poll.runtime_pollWait(0x7f5584db88e8, 0x72)
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/netpoll.go:306 +0x89
internal/poll.(*pollDesc).wait(0xc0006ff480?, 0x4?, 0x0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(...)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc0006ff480)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_unix.go:614 +0x2bd
net.(*netFD).accept(0xc0006ff480)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/fd_unix.go:172 +0x35
net.(*TCPListener).accept(0xc000b00a08)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/tcpsock_posix.go:148 +0x25
net.(*TCPListener).Accept(0xc000b00a08)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/tcpsock.go:297 +0x3d
github.com/valyala/fasthttp.acceptConn(0xc000bc0400, {0x2323420, 0xc000b00a08}, 0xc00052dee8)
	/home/runner/go/pkg/mod/github.com/valyala/[email protected]/server.go:1923 +0x62
github.com/valyala/fasthttp.(*Server).Serve(0xc000bc0400, {0x2323420?, 0xc000b00a08})
	/home/runner/go/pkg/mod/github.com/valyala/[email protected]/server.go:1816 +0x4f4
github.com/gofiber/fiber/v2.(*App).Listener(0xc000bf8000, {0x2323420, 0xc000b00a08})
	/home/runner/go/pkg/mod/github.com/gofiber/fiber/[email protected]/listen.go:57 +0x20c
created by github.com/lavanet/lava/v2/protocol/chainlib.createRPCServer
	/home/runner/work/lava/lava/protocol/chainlib/chain_router_test.go:1175 +0x395

goroutine 20 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0x7f5584db87f8, 0x72)
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/netpoll.go:306 +0x89
internal/poll.(*pollDesc).wait(0xc0006ff600?, 0xc000bfa000?, 0x0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(...)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0006ff600, {0xc000bfa000, 0x400, 0x400})
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_unix.go:167 +0x299
net.(*netFD).Read(0xc0006ff600, {0xc000bfa000?, 0x0?, 0x72?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/fd_posix.go:55 +0x29
net.(*conn).Read(0xc000511e78, {0xc000bfa000?, 0x0?, 0x0?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/net.go:183 +0x45
bufio.(*Reader).fill(0xc000b6fc80)
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:106 +0xff
bufio.(*Reader).Peek(0xc000b6fc80, 0x2)
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:144 +0x5d
github.com/gorilla/websocket.(*Conn).read(0xc000144000, 0xc0005be060?)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:371 +0x2c
github.com/gorilla/websocket.(*Conn).advanceFrame(0xc000144000)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:809 +0x7b
github.com/gorilla/websocket.(*Conn).NextReader(0xc000144000)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:1009 +0xcc
github.com/gorilla/websocket.(*Conn).ReadJSON(0x18?, {0x1ca70c0, 0xc000012150})
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/json.go:50 +0x27
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*jsonCodec).readBatch(0xc000726000)
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/json.go:236 +0x4d
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*Client).read(0xc000726080, {0x2329aa8, 0xc0002d86c0})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/client.go:741 +0xa2
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*Client).dispatch
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/client.go:665 +0x155

goroutine 36 [sleep]:
time.Sleep(0x3b9aca00)
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/time.go:195 +0x135
github.com/valyala/fasthttp.updateServerDate.func1()
	/home/runner/go/pkg/mod/github.com/valyala/[email protected]/header.go:2289 +0x1e
created by github.com/valyala/fasthttp.updateServerDate
	/home/runner/go/pkg/mod/github.com/valyala/[email protected]/header.go:2287 +0x25

goroutine 37 [IO wait, 1 minutes]:
internal/poll.runtime_pollWait(0x7f5584db8708, 0x72)
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/netpoll.go:306 +0x89
internal/poll.(*pollDesc).wait(0xc000710080?, 0xc00056a000?, 0x0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(...)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc000710080, {0xc00056a000, 0x1000, 0x1000})
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_unix.go:167 +0x299
net.(*netFD).Read(0xc000710080, {0xc00056a000?, 0x33c4d01?, 0x0?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/fd_posix.go:55 +0x29
net.(*conn).Read(0xc0000142c0, {0xc00056a000?, 0xc00056e000?, 0xc000536248?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/net.go:183 +0x45
bufio.(*Reader).Read(0xc0000a6420, {0xc00057a000, 0x400, 0xc0000b1680?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:237 +0x1bb
github.com/valyala/fasthttp.(*hijackConn).Read(0xc00008ac58?, {0xc00057a000?, 0xc000530dc0?, 0x0?})
	/home/runner/go/pkg/mod/github.com/valyala/[email protected]/server.go:2544 +0x27
bufio.(*Reader).fill(0xc0000a64e0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:106 +0xff
bufio.(*Reader).Peek(0xc0000a64e0, 0x2)
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:144 +0x5d
github.com/fasthttp/websocket.(*Conn).read(0xc000530dc0, 0xc0007c9d28?)
	/home/runner/go/pkg/mod/github.com/fasthttp/[email protected]/conn.go:371 +0x2c
github.com/fasthttp/websocket.(*Conn).advanceFrame(0xc000530dc0)
	/home/runner/go/pkg/mod/github.com/fasthttp/[email protected]/conn.go:809 +0x7b
github.com/fasthttp/websocket.(*Conn).NextReader(0xc000530dc0)
	/home/runner/go/pkg/mod/github.com/fasthttp/[email protected]/conn.go:1009 +0xcc
github.com/fasthttp/websocket.(*Conn).ReadMessage(0xc000710080?)
	/home/runner/go/pkg/mod/github.com/fasthttp/[email protected]/conn.go:1093 +0x19
github.com/lavanet/lava/v2/protocol/chainlib.createRPCServer.func2(0xc00052e270)
	/home/runner/work/lava/lava/protocol/chainlib/chain_router_test.go:1151 +0x85
github.com/gofiber/websocket/v2.New.func2.4(0x0?)
	/home/runner/go/pkg/mod/github.com/gofiber/websocket/[email protected]/websocket.go:109 +0x75
github.com/fasthttp/websocket.(*FastHTTPUpgrader).Upgrade.func1({0x232fe48, 0xc00052e360})
	/home/runner/go/pkg/mod/github.com/fasthttp/[email protected]/server_fasthttp.go:201 +0x1ad
github.com/valyala/fasthttp.hijackConnHandler(0x0?, {0x2307520?, 0xc0000a6420}, {0x2330210, 0xc0000142c0}, 0xc000bc0400, 0xc000550140)
	/home/runner/go/pkg/mod/github.com/valyala/[email protected]/server.go:2499 +0x68
created by github.com/valyala/fasthttp.(*Server).serveConn
	/home/runner/go/pkg/mod/github.com/valyala/[email protected]/server.go:2454 +0x1c1c

goroutine 50 [select, 1 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*websocketCodec).pingLoop(0xc0002d86c0)
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/websocket.go:307 +0x115
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.newWebsocketCodec
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/websocket.go:275 +0x34a

goroutine 51 [select, 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*Client).dispatch(0xc000726080, {0x2329aa8?, 0xc0002d86c0})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/client.go:668 +0x2cc
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.initClient
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/client.go:241 +0x311

goroutine 557 [chan receive, 10 minutes]:
testing.(*T).Parallel(0xc0010c01a0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/testing/testing.go:1384 +0x225
github.com/lavanet/lava/v2/protocol/chainlib.TestMatchSpecApiByName(0xc000eb0030?)
	/home/runner/work/lava/lava/protocol/chainlib/common_test.go:22 +0x33
testing.tRunner(0xc0010c01a0, 0x20ca220)
	/opt/hostedtoolcache/go/1.20.14/x64/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
	/opt/hostedtoolcache/go/1.20.14/x64/src/testing/testing.go:1629 +0x3ea

goroutine 558 [chan receive, 10 minutes]:
testing.(*T).Parallel(0xc0010c0340)
	/opt/hostedtoolcache/go/1.20.14/x64/src/testing/testing.go:1384 +0x225
github.com/lavanet/lava/v2/protocol/chainlib.TestConvertToJsonError(0xc000eb0030?)
	/home/runner/work/lava/lava/protocol/chainlib/common_test.go:113 +0x30
testing.tRunner(0xc0010c0340, 0x20ca148)
	/opt/hostedtoolcache/go/1.20.14/x64/src/testing/testing.go:1576 +0x10b
created by testing.(*T).Run
	/opt/hostedtoolcache/go/1.20.14/x64/src/testing/testing.go:1629 +0x3ea

goroutine 53 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 54 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 52 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 39 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 55 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 38 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 56 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 57 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0x0?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 41 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 40 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 58 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 42 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 43 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 59 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 45 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 44 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 46 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 60 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 61 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 47 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 48 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 62 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 63 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 49 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 64 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 114 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 65 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 115 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 130 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 131 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 132 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 134 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 133 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 116 [chan receive (nil chan), 10 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connecto… github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 2959 [select, 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*Client).dispatch(0xc0023c0900, {0x2329aa8?, 0xc002cf6a20})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/client.go:668 +0x2cc
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.initClient
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/client.go:241 +0x311

goroutine 3434 [IO wait]:
internal/poll.runtime_pollWait(0x7f5584c06c80, 0x72)
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/netpoll.go:306 +0x89
internal/poll.(*pollDesc).wait(0xc002cd8f80?, 0xc000fbf000?, 0x0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(...)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc002cd8f80, {0xc000fbf000, 0x1000, 0x1000})
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_unix.go:167 +0x299
net.(*netFD).Read(0xc002cd8f80, {0xc000fbf000?, 0x33c4da0?, 0x0?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/fd_posix.go:55 +0x29
net.(*conn).Read(0xc002762628, {0xc000fbf000?, 0x0?, 0xc001b2bda0?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/net.go:183 +0x45
bufio.(*Reader).fill(0xc000c74c60)
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:106 +0xff
bufio.(*Reader).Peek(0xc000c74c60, 0x2)
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:144 +0x5d
github.com/gorilla/websocket.(*Conn).read(0xc000e829a0, 0x0?)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:371 +0x2c
github.com/gorilla/websocket.(*Conn).advanceFrame(0xc000e829a0)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:809 +0x7b
github.com/gorilla/websocket.(*Conn).NextReader(0xc000e829a0)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:1009 +0xcc
github.com/gorilla/websocket.(*Conn).ReadMessage(0xc000e829a0?)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:1093 +0x19
github.com/lavanet/lava/v2/protocol/chainlib.TestSubscriptionManager_HappyFlow.func1.1({0x2323630?, 0xc0010e21c0?}, 0x1d13f80?)
	/home/runner/work/lava/lava/protocol/chainlib/provider_node_subscription_manager_test.go:100 +0xff
net/http.HandlerFunc.ServeHTTP(0x0?, {0x2323630?, 0xc0010e21c0?}, 0x47088e?)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:2122 +0x2f
net/http.serverHandler.ServeHTTP({0xc001d59ce0?}, {0x2323630, 0xc0010e21c0}, 0xc0023ba500)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:2936 +0x316
net/http.(*conn).serve(0xc0018517a0, {0x2324df8, 0xc001d59bc0})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:1995 +0x612
created by net/http.(*Server).Serve
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:3089 +0x5ed

goroutine 3435 [chan receive (nil chan), 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 3437 [select]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*websocketCodec).pingLoop(0xc001b022d0)
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/websocket.go:307 +0x115
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.newWebsocketCodec
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/websocket.go:275 +0x34a

goroutine 3436 [IO wait]:
internal/poll.runtime_pollWait(0x7f5584c06b90, 0x72)
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/netpoll.go:306 +0x89
internal/poll.(*pollDesc).wait(0xc00161ad80?, 0xc001b06000?, 0x0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(...)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00161ad80, {0xc001b06000, 0x1000, 0x1000})
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_unix.go:167 +0x299
net.(*netFD).Read(0xc00161ad80, {0xc001b06000?, 0x33c4da0?, 0x0?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/fd_posix.go:55 +0x29
net.(*conn).Read(0xc002762648, {0xc001b06000?, 0x0?, 0xc000ec20c0?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/net.go:183 +0x45
bufio.(*Reader).fill(0xc000c74cc0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:106 +0xff
bufio.(*Reader).Peek(0xc000c74cc0, 0x2)
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:144 +0x5d
github.com/gorilla/websocket.(*Conn).read(0xc000e83ce0, 0x0?)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:371 +0x2c
github.com/gorilla/websocket.(*Conn).advanceFrame(0xc000e83ce0)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:809 +0x7b
github.com/gorilla/websocket.(*Conn).NextReader(0xc000e83ce0)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:1009 +0xcc
github.com/gorilla/websocket.(*Conn).ReadMessage(0xc000e83ce0?)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:1093 +0x19
github.com/lavanet/lava/v2/protocol/chainlib.TestSubscriptionManager_HappyFlow.func1.1({0x2323630?, 0xc0010e2620?}, 0x1d13f80?)
	/home/runner/work/lava/lava/protocol/chainlib/provider_node_subscription_manager_test.go:100 +0xff
net/http.HandlerFunc.ServeHTTP(0x0?, {0x2323630?, 0xc0010e2620?}, 0x47088e?)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:2122 +0x2f
net/http.serverHandler.ServeHTTP({0xc000d7ffb0?}, {0x2323630, 0xc0010e2620}, 0xc0023ba600)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:2936 +0x316
net/http.(*conn).serve(0xc001b02240, {0x2324df8, 0xc000d7fe90})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:1995 +0x612
created by net/http.(*Server).Serve
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:3089 +0x5ed

goroutine 3125 [IO wait]:
internal/poll.runtime_pollWait(0x7f5584c06d70, 0x72)
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/netpoll.go:306 +0x89
internal/poll.(*pollDesc).wait(0xc002cd8f00?, 0xc000fd0c00?, 0x0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(...)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc002cd8f00, {0xc000fd0c00, 0x400, 0x400})
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_unix.go:167 +0x299
net.(*netFD).Read(0xc002cd8f00, {0xc000fd0c00?, 0x0?, 0x72?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/fd_posix.go:55 +0x29
net.(*conn).Read(0xc002c80008, {0xc000fd0c00?, 0x0?, 0x0?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/net.go:183 +0x45
bufio.(*Reader).fill(0xc002926000)
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:106 +0xff
bufio.(*Reader).Peek(0xc002926000, 0x2)
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:144 +0x5d
github.com/gorilla/websocket.(*Conn).read(0xc000e82580, 0x1d83f80?)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:371 +0x2c
github.com/gorilla/websocket.(*Conn).advanceFrame(0xc000e82580)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:809 +0x7b
github.com/gorilla/websocket.(*Conn).NextReader(0xc000e82580)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:1009 +0xcc
github.com/gorilla/websocket.(*Conn).ReadJSON(0x18?, {0x1ca70c0, 0xc001728330})
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/json.go:50 +0x27
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*jsonCodec).readBatch(0xc0023c0880)
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/json.go:236 +0x4d
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*Client).read(0xc0023c0900, {0x2329aa8, 0xc002cf6a20})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/client.go:741 +0xa2
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*Client).dispatch
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/client.go:665 +0x155

goroutine 3126 [chan receive (nil chan), 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 4373 [select]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*websocketCodec).pingLoop(0xc0021423f0)
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/websocket.go:307 +0x115
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.newWebsocketCodec
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/websocket.go:275 +0x34a

goroutine 3443 [chan receive (nil chan), 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 2919 [select, 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib.(*ProviderNodeSubscriptionManager).listenForSubscriptionMessages(0xc002926120, {0x2324d50?, 0xc0024320a0}, 0xc001d5d800, 0xc0028aeea0, {0xc00241b2e0, 0x20})
	/home/runner/work/lava/lava/protocol/chainlib/provider_node_subscription_manager.go:368 +0x375
created by github.com/lavanet/lava/v2/protocol/chainlib.(*ProviderNodeSubscriptionManager).AddConsumer
	/home/runner/work/lava/lava/protocol/chainlib/provider_node_subscription_manager.go:348 +0x14a5

goroutine 3130 [chan receive (nil chan), 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 3441 [IO wait]:
internal/poll.runtime_pollWait(0x7f5584c06aa0, 0x72)
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/netpoll.go:306 +0x89
internal/poll.(*pollDesc).wait(0xc0021eea00?, 0xc000ec7000?, 0x0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(...)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0021eea00, {0xc000ec7000, 0x400, 0x400})
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_unix.go:167 +0x299
net.(*netFD).Read(0xc0021eea00, {0xc000ec7000?, 0x0?, 0x72?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/fd_posix.go:55 +0x29
net.(*conn).Read(0xc000d95260, {0xc000ec7000?, 0x0?, 0x0?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/net.go:183 +0x45
bufio.(*Reader).fill(0xc001c68720)
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:106 +0xff
bufio.(*Reader).Peek(0xc001c68720, 0x2)
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:144 +0x5d
github.com/gorilla/websocket.(*Conn).read(0xc001ec58c0, 0x7f55af3dba68?)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:371 +0x2c
github.com/gorilla/websocket.(*Conn).advanceFrame(0xc001ec58c0)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:809 +0x7b
github.com/gorilla/websocket.(*Conn).NextReader(0xc001ec58c0)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:1009 +0xcc
github.com/gorilla/websocket.(*Conn).ReadJSON(0x18?, {0x1ca70c0, 0xc00190f170})
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/json.go:50 +0x27
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*jsonCodec).readBatch(0xc00161ae00)
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/json.go:236 +0x4d
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*Client).read(0xc00161ae80, {0x2329aa8, 0xc001b022d0})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/client.go:741 +0xa2
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*Client).dispatch
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/client.go:665 +0x155

goroutine 3906 [chan receive (nil chan), 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 3135 [select, 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib.(*ProviderNodeSubscriptionManager).listenForSubscriptionMessages(0xc00296f200, {0x2324d50?, 0xc001b16320}, 0xc00298a000, 0xc00296f320, {0xc00241a2c0, 0x20})
	/home/runner/work/lava/lava/protocol/chainlib/provider_node_subscription_manager.go:368 +0x375
created by github.com/lavanet/lava/v2/protocol/chainlib.(*ProviderNodeSubscriptionManager).AddConsumer
	/home/runner/work/lava/lava/protocol/chainlib/provider_node_subscription_manager.go:348 +0x14a5

goroutine 4372 [IO wait]:
internal/poll.runtime_pollWait(0x7f5584c068c0, 0x72)
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/netpoll.go:306 +0x89
internal/poll.(*pollDesc).wait(0xc0019c4b00?, 0xc0001e9000?, 0x0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(...)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0019c4b00, {0xc0001e9000, 0x1000, 0x1000})
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_unix.go:167 +0x299
net.(*netFD).Read(0xc0019c4b00, {0xc0001e9000?, 0x33c4da0?, 0x0?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/fd_posix.go:55 +0x29
net.(*conn).Read(0xc002c80010, {0xc0001e9000?, 0x0?, 0xc001b3e840?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/net.go:183 +0x45
bufio.(*Reader).fill(0xc000c740c0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:106 +0xff
bufio.(*Reader).Peek(0xc000c740c0, 0x2)
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:144 +0x5d
github.com/gorilla/websocket.(*Conn).read(0xc001914420, 0x0?)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:371 +0x2c
github.com/gorilla/websocket.(*Conn).advanceFrame(0xc001914420)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:809 +0x7b
github.com/gorilla/websocket.(*Conn).NextReader(0xc001914420)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:1009 +0xcc
github.com/gorilla/websocket.(*Conn).ReadMessage(0xc001914420?)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:1093 +0x19
github.com/lavanet/lava/v2/protocol/chainlib.TestSubscriptionManager_MultipleParallelSubscriptionsWithTheSameParams.func1.1({0x2323630?, 0xc0010e2460?}, 0x1d13f80?)
	/home/runner/work/lava/lava/protocol/chainlib/provider_node_subscription_manager_test.go:240 +0x10a
net/http.HandlerFunc.ServeHTTP(0x0?, {0x2323630?, 0xc0010e2460?}, 0x47088e?)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:2122 +0x2f
net/http.serverHandler.ServeHTTP({0xc001b090b0?}, {0x2323630, 0xc0010e2460}, 0xc0023ba000)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:2936 +0x316
net/http.(*conn).serve(0xc002142360, {0x2324df8, 0xc001b08ea0})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:1995 +0x612
created by net/http.(*Server).Serve
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:3089 +0x5ed

goroutine 3923 [select, 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib.(*ProviderNodeSubscriptionManager).listenForSubscriptionMessages(0xc000c74d80, {0x2324d50?, 0xc001ca2640}, 0xc00180cea0, 0xc001c688a0, {0xc0020dccc0, 0x20})
	/home/runner/work/lava/lava/protocol/chainlib/provider_node_subscription_manager.go:368 +0x375
created by github.com/lavanet/lava/v2/protocol/chainlib.(*ProviderNodeSubscriptionManager).AddConsumer
	/home/runner/work/lava/lava/protocol/chainlib/provider_node_subscription_manager.go:348 +0x14a5

goroutine 3924 [select, 9 minutes]:
reflect.rselect({0xc001f40d70, 0x2, 0xc00292d560?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/select.go:589 +0x2ee
reflect.Select({0xc001f40eb8?, 0x2, 0x0?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/reflect/value.go:3052 +0x58a
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*ClientSubscription).forward(0x0?)
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/subscription.go:330 +0x2fe
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*ClientSubscription).run(0xc001eb3320)
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/subscription.go:298 +0x65
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*handler).handleResponse
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/handler.go:303 +0x2ea

goroutine 3132 [chan receive (nil chan), 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc002cf17d0?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 4374 [select, 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*Client).dispatch(0xc0019c4c00, {0x2329aa8?, 0xc0021423f0})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/client.go:668 +0x2cc
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.initClient
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/client.go:241 +0x311

goroutine 3133 [select, 9 minutes]:
reflect.rselect({0xc002de8d70, 0x2, 0xc002cf2d60?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/select.go:589 +0x2ee
reflect.Select({0xc002de8eb8?, 0x2, 0x0?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/reflect/value.go:3052 +0x58a
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*ClientSubscription).forward(0x0?)
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/subscription.go:330 +0x2fe
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*ClientSubscription).run(0xc002142630)
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/subscription.go:298 +0x65
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*handler).handleResponse
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/handler.go:300 +0x1d5

goroutine 4369 [chan receive (nil chan), 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 4883 [select, 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib.(*ProviderNodeSubscriptionManager).listenForSubscriptionMessages(0xc0019fbaa0, {0x2324d50?, 0xc001c46280}, 0xc001d6c420, 0xc000c74900, {0xc0020dc920, 0x20})
	/home/runner/work/lava/lava/protocol/chainlib/provider_node_subscription_manager.go:368 +0x375
created by github.com/lavanet/lava/v2/protocol/chainlib.(*ProviderNodeSubscriptionManager).AddConsumer
	/home/runner/work/lava/lava/protocol/chainlib/provider_node_subscription_manager.go:348 +0x14a5

goroutine 3136 [chan receive (nil chan), 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 4854 [select]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*websocketCodec).pingLoop(0xc001ca1ef0)
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/websocket.go:307 +0x115
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.newWebsocketCodec
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/websocket.go:275 +0x34a

goroutine 4855 [select, 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*Client).dispatch(0xc0010b9380, {0x2329aa8?, 0xc001ca1ef0})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/client.go:668 +0x2cc
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.initClient
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/client.go:241 +0x311

goroutine 5352 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f5584a01fc8, 0x72)
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/netpoll.go:306 +0x89
internal/poll.(*pollDesc).wait(0xc001dfb380?, 0xc002bd0558?, 0x0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(...)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc001dfb380)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_unix.go:614 +0x2bd
net.(*netFD).accept(0xc001dfb380)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/fd_unix.go:172 +0x35
net.(*TCPListener).accept(0xc0019824e0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/tcpsock_posix.go:148 +0x25
net.(*TCPListener).Accept(0xc0019824e0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/tcpsock.go:297 +0x3d
net/http.(*Server).Serve(0xc000b44d20, {0x2323420, 0xc0019824e0})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:3059 +0x385
net/http/httptest.(*Server).goServe.func1()
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/httptest/server.go:310 +0x6a
created by net/http/httptest.(*Server).goServe
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/httptest/server.go:308 +0x6a

goroutine 4879 [select, 9 minutes]:
reflect.rselect({0xc002de7d70, 0x2, 0xc001f66560?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/select.go:589 +0x2ee
reflect.Select({0xc002de7eb8?, 0x2, 0x0?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/reflect/value.go:3052 +0x58a
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*ClientSubscription).forward(0xc001f66788?)
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/subscription.go:330 +0x2fe
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*ClientSubscription).run(0xc001b14a20)
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/subscription.go:298 +0x65
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*handler).handleResponse
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/handler.go:303 +0x2ea

goroutine 4396 [IO wait]:
internal/poll.runtime_pollWait(0x7f5584c066e0, 0x72)
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/netpoll.go:306 +0x89
internal/poll.(*pollDesc).wait(0xc00112cb00?, 0xc001e4a000?, 0x0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(...)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00112cb00, {0xc001e4a000, 0x1000, 0x1000})
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_unix.go:167 +0x299
net.(*netFD).Read(0xc00112cb00, {0xc001e4a000?, 0x33c4da0?, 0x0?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/fd_posix.go:55 +0x29
net.(*conn).Read(0xc002c80030, {0xc001e4a000?, 0x0?, 0xc001d6c0c0?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/net.go:183 +0x45
bufio.(*Reader).fill(0xc001378000)
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:106 +0xff
bufio.(*Reader).Peek(0xc001378000, 0x2)
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:144 +0x5d
github.com/gorilla/websocket.(*Conn).read(0xc0015e0580, 0x0?)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:371 +0x2c
github.com/gorilla/websocket.(*Conn).advanceFrame(0xc0015e0580)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:809 +0x7b
github.com/gorilla/websocket.(*Conn).NextReader(0xc0015e0580)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:1009 +0xcc
github.com/gorilla/websocket.(*Conn).ReadMessage(0xc0015e0580?)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:1093 +0x19
github.com/lavanet/lava/v2/protocol/chainlib.TestSubscriptionManager_MultipleParallelSubscriptionsWithTheSameParams.func1.1({0x2323630?, 0xc0010e27e0?}, 0x1d13f80?)
	/home/runner/work/lava/lava/protocol/chainlib/provider_node_subscription_manager_test.go:240 +0x10a
net/http.HandlerFunc.ServeHTTP(0x0?, {0x2323630?, 0xc0010e27e0?}, 0x47088e?)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:2122 +0x2f
net/http.serverHandler.ServeHTTP({0xc001367110?}, {0x2323630, 0xc0010e27e0}, 0xc000712800)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:2936 +0x316
net/http.(*conn).serve(0xc001cb57a0, {0x2324df8, 0xc001366f00})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:1995 +0x612
created by net/http.(*Server).Serve
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:3089 +0x5ed

goroutine 5378 [chan receive (nil chan), 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 5355 [select, 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*Client).dispatch(0xc001dfb580, {0x2329aa8?, 0xc000c2d9e0})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/client.go:668 +0x2cc
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.initClient
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/client.go:241 +0x311

goroutine 5351 [IO wait, 9 minutes]:
internal/poll.runtime_pollWait(0x7f5584a688c0, 0x72)
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/netpoll.go:306 +0x89
internal/poll.(*pollDesc).wait(0xc001dfb300?, 0x4?, 0x0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(...)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc001dfb300)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_unix.go:614 +0x2bd
net.(*netFD).accept(0xc001dfb300)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/fd_unix.go:172 +0x35
net.(*TCPListener).accept(0xc001982468)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/tcpsock_posix.go:148 +0x25
net.(*TCPListener).Accept(0xc001982468)
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/tcpsock.go:297 +0x3d
net/http.(*Server).Serve(0xc000b44b40, {0x2323420, 0xc001982468})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/server.go:3059 +0x385
net/http/httptest.(*Server).goServe.func1()
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/httptest/server.go:310 +0x6a
created by net/http/httptest.(*Server).goServe
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/http/httptest/server.go:308 +0x6a

goroutine 4877 [IO wait]:
internal/poll.runtime_pollWait(0x7f5584c067d0, 0x72)
	/opt/hostedtoolcache/go/1.20.14/x64/src/runtime/netpoll.go:306 +0x89
internal/poll.(*pollDesc).wait(0xc0010b9280?, 0xc001b13400?, 0x0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(...)
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0010b9280, {0xc001b13400, 0x400, 0x400})
	/opt/hostedtoolcache/go/1.20.14/x64/src/internal/poll/fd_unix.go:167 +0x299
net.(*netFD).Read(0xc0010b9280, {0xc001b13400?, 0x0?, 0x72?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/fd_posix.go:55 +0x29
net.(*conn).Read(0xc002762c48, {0xc001b13400?, 0x0?, 0x0?})
	/opt/hostedtoolcache/go/1.20.14/x64/src/net/net.go:183 +0x45
bufio.(*Reader).fill(0xc0019fb9e0)
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:106 +0xff
bufio.(*Reader).Peek(0xc0019fb9e0, 0x2)
	/opt/hostedtoolcache/go/1.20.14/x64/src/bufio/bufio.go:144 +0x5d
github.com/gorilla/websocket.(*Conn).read(0xc001ec49a0, 0xc00240dd40?)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:371 +0x2c
github.com/gorilla/websocket.(*Conn).advanceFrame(0xc001ec49a0)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:809 +0x7b
github.com/gorilla/websocket.(*Conn).NextReader(0xc001ec49a0)
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/conn.go:1009 +0xcc
github.com/gorilla/websocket.(*Conn).ReadJSON(0x18?, {0x1ca70c0, 0xc001a93338})
	/home/runner/go/pkg/mod/github.com/gorilla/[email protected]/json.go:50 +0x27
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*jsonCodec).readBatch(0xc0010b9300)
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/json.go:236 +0x4d
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*Client).read(0xc0010b9380, {0x2329aa8, 0xc001ca1ef0})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/client.go:741 +0xa2
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy/rpcclient.(*Client).dispatch
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/rpcclient/client.go:665 +0x155

goroutine 4878 [chan receive (nil chan), 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.(*Connector).connectorLoop(0xc000060150?, {0x2324d88?, 0xc000060150?})
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:148 +0x33
created by github.com/lavanet/lava/v2/protocol/chainlib/chainproxy.addClientsAsynchronously
	/home/runner/work/lava/lava/protocol/chainlib/chainproxy/connector.go:90 +0x38a

goroutine 5360 [chan receive, 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib.TestSubscriptionManager_MultipleParallelSubscriptionsWithTheSameParamsAndNodeMessageFailure.func1.2()
	/home/runner/work/lava/lava/protocol/chainlib/provider_node_subscription_manager_test.go:416 +0x4a
created by github.com/lavanet/lava/v2/protocol/chainlib.TestSubscriptionManager_MultipleParallelSubscriptionsWithTheSameParamsAndNodeMessageFailure.func1
	/home/runner/work/lava/lava/protocol/chainlib/provider_node_subscription_manager_test.go:415 +0x66c

goroutine 5372 [chan receive, 9 minutes]:
github.com/lavanet/lava/v2/protocol/chainlib.TestSubscriptionManager_MultipleParallelSubscriptionsWithTheSameParamsAndNodeMessageFailure.func1.2()
	/home/runner/work/lava/lava/protocol/chainlib/provider_node_subscription_manager_test.go:416 +0x4a
created by github.com/lavanet/lava/v2/protocol/chainlib.TestSubscriptionManager_MultipleParallelSubscriptionsWithTheSameParamsAndNodeMessageFailure.func1
	/home/runner/work/lava/lava/protocol/chainlib/provider_node_subscription_manager_test.go:415 +0x66c

Check failure on line 0 in github.com/lavanet/lava/v2/protocol/integration

See this annotation in the file changed.

@github-actions github-actions / Test Results

Failure (github.com/lavanet/lava/v2/protocol/integration) with error 

artifacts/Test Results (Protocol)/protocol-report.xml [took 0s]
Raw output 
Runtime error

Check failure on line 0 in github.com/lavanet/lava/v2/protocol/rpcconsumer

See this annotation in the file changed.

@github-actions github-actions / Test Results

Failure (github.com/lavanet/lava/v2/protocol/rpcconsumer) with error 

artifacts/Test Results (Protocol)/protocol-report.xml [took 0s]
Raw output 
Runtime error
View more details on GitHub Actions