Viewchanges failing

[ineiti]

At some moment during the reshuffling and decryption, the nodes decide to do a viewchange, which often fails. The shuffling and decryption run through normally, but it would still be nice to know why a viewchange is happening, and how to make it happen.

Also, restarting the nodes fixes it.

dela-worker-4_1  | 2024-02-28T07:44:33Z INF ../../../go/d-voting/services/dkg/pedersen/handler.go:520 > submission of pubShares denied: watch timeout
dela-worker-3_1  | 2024-02-28T07:44:33Z INF ../../../go/d-voting/services/dkg/pedersen/handler.go:520 > submission of pubShares denied: watch timeout
dela-worker-3_1  | 2024-02-28T07:44:39Z INF ../../../go/d-voting/services/dkg/pedersen/handler.go:520 > submission of pubShares denied: watch timeout
dela-worker-3_1  | 2024-02-28T07:44:39Z WRN ../../../go/pkg/mod/github.com/c4dt/[email protected]/core/ordering/cosipbft/proc.go:210 > view message refused error="invalid view: mismatch leader 3 != 2" addr=https://node.dela-3.c4dt.org:443
dela-worker-2_1  | 2024-02-28T07:44:39Z WRN ../../../go/pkg/mod/github.com/c4dt/[email protected]/core/ordering/cosipbft/proc.go:210 > view message refused error="invalid view: mismatch leader 3 != 2" addr=https://node.dela-2.c4dt.org:443
dela-worker-4_1  | 2024-02-28T07:44:39Z INF ../../../go/d-voting/services/dkg/pedersen/handler.go:520 > submission of pubShares denied: watch timeout
dela-worker-3_1  | 2024-02-28T07:44:45Z INF ../../../go/d-voting/services/dkg/pedersen/handler.go:520 > submission of pubShares denied: watch timeout
dela-worker-4_1  | 2024-02-28T07:44:47Z INF ../../../go/d-voting/services/dkg/pedersen/handler.go:520 > submission of pubShares denied: watch timeout
dela-worker-3_1  | 2024-02-28T07:44:47Z ERR ../../../go/pkg/mod/github.com/c4dt/[email protected]/core/ordering/cosipbft/cosipbft.go:524 > round failed error="pbft failed: prepare signature failed: couldn't receive more messages: context deadline exceeded" addr=https://node.dela-3.c4dt.org:443
dela-worker-4_1  | 2024-02-28T07:44:48Z WRN ../../../go/pkg/mod/github.com/c4dt/[email protected]/core/ordering/cosipbft/cosipbft.go:669 > found a rotten transaction addr=https://node.dela-4.c4dt.org:443
dela-worker-4_1  | 2024-02-28T07:44:48Z INF ../../../go/pkg/mod/github.com/c4dt/[email protected]/core/ordering/cosipbft/cosipbft.go:603 > round has failed, do a view change ! addr=https://node.dela-4.c4dt.org:443
dela-worker-4_1  | 2024-02-28T07:44:48Z WRN ../../../go/pkg/mod/github.com/c4dt/[email protected]/core/ordering/cosipbft/pbft/pbft.go:524 > expire: current leader is 2 addr=https://node.dela-4.c4dt.org:443
dela-worker-2_1  | 2024-02-28T07:44:48Z WRN ../../../go/pkg/mod/github.com/c4dt/[email protected]/core/ordering/cosipbft/proc.go:210 > view message refused error="invalid view: mismatch leader 3 != 2" addr=https://node.dela-2.c4dt.org:443
dela-worker-3_1  | 2024-02-28T07:44:48Z WRN ../../../go/pkg/mod/github.com/c4dt/[email protected]/core/ordering/cosipbft/proc.go:210 > view message refused error="invalid view: mismatch leader 3 != 2" addr=https://node.dela-3.c4dt.org:443
dela-worker-3_1  | 2024-02-28T07:44:51Z INF ../../../go/d-voting/services/dkg/pedersen/handler.go:520 > submission of pubShares denied: watch timeout
dela-worker-4_1  | 2024-02-28T07:44:54Z INF ../../../go/d-voting/services/dkg/pedersen/handler.go:520 > submission of pubShares denied: watch timeout
dela-worker-3_1  | 2024-02-28T07:44:56Z INF ../../../go/d-voting/services/dkg/pedersen/handler.go:520 > submission of pubShares denied: watch timeout
dela-worker-2_1  | 2024-02-28T07:45:01Z WRN ../../../go/pkg/mod/github.com/c4dt/[email protected]/cosi/threshold/handler.go:51 > error="couldn't hash message: pbft prepare failed: cannot be in view change state during prepare" addr=https://node.dela-2.c4dt.org:443
dela-worker-4_1  | 2024-02-28T07:45:01Z WRN ../../../go/pkg/mod/github.com/c4dt/[email protected]/cosi/threshold/handler.go:51 > error="couldn't hash message: pbft prepare failed: cannot be in view change state during prepare" addr=https://node.dela-4.c4dt.org:443