Speed up Jump detection #1380

Job	Run time
check / Load tox environments	6s
test_downstream / Load tox environments	9s
test / Load tox environments	6s
test / py39-oldestdeps-cov-xdist (ubuntu-latest)	1m 48s
test / py39-xdist (ubuntu-latest)	1m 22s
test / py310-xdist (ubuntu-latest)	1m 10s
test / py311-xdist (ubuntu-latest)	1m 11s
test / py311-xdist (macos-latest)	2m 30s
test / py3-cov-xdist (ubuntu-latest)	2m 4s
check / check-style (ubuntu-latest)	14s
check / check-security (ubuntu-latest)	17s
check / check-build (ubuntu-latest)	1m 8s
test_downstream / py311-jwst-cov-xdist (ubuntu-latest)	40m 56s
test_downstream / py311-romancal-cov-xdist (ubuntu-latest)	9m 6s
	1h 2m 7s

Provide feedback