fix(iroh-net): fix extra delay (#2330) #8440

Job	Run time
Cross Build Only (armv7-linux-androideabi)	1m 5s
Cross Build Only (aarch64-linux-android)	1m 1s
Cross Build Only (x86_64-unknown-freebsd)	1m 6s
check_semver	5m 21s
Cross Build Only (x86_64-unknown-netbsd)	2m 1s
Checking docs	1m 41s
Checking fmt	11s
Cross Test (i686-unknown-linux-gnu)	2m 50s
clippy_check	3m 3s
Minimal Supported Rust Version	2m 8s
Build wasm32	30s
cargo deny	35s
Run network simulations/benchmarks	2m 56s
CI Test Suite / Tests (ubuntu-latest, stable, all)	1m 52s
CI Test Suite / Tests (ubuntu-latest, stable, none)	42s
CI Test Suite / Tests (windows-latest, stable, all, x86_64-pc-windows-msvc)	38s
CI Test Suite / Tests (ubuntu-latest, stable, default)	1m 25s
CI Test Suite / Tests (windows-latest, stable, none, x86_64-pc-windows-msvc)	25s
CI Test Suite / Tests (macOS-arm-latest, stable, all)	3m 6s
CI Test Suite / Tests (windows-latest, stable, default, x86_64-pc-windows-msvc)	3m 56s
CI Test Suite / Tests (macOS-arm-latest, stable, none)	2m 52s
CI Test Suite / Tests (macOS-arm-latest, stable, default)	2m 57s
	42m 21s

Provide feedback