Clean up test dependencies, add python 3.12 testing #2666

Job	Run time
jsonschema	0s
asdf-schemas / Load tox environments	6s
core / Load tox environments	28s
asdf-schemas / asdf-standard (ubuntu-latest)	1m 7s
asdf-schemas / asdf-transform-schemas (ubuntu-latest)	1m 23s
asdf-schemas / asdf-unit-schemas (ubuntu-latest)	42s
core / Python 3.11 coverage	2m 38s
core / Python 3.10 coverage	2m 50s
core / Python 3.9 coverage	2m 38s
package / Build source and wheel distribution	3m 24s
compatibility / Load tox environments	5s
oldest / Load tox environments	5s
dev / Load tox environments	6s
test / Load tox environments	6s
oldest / py39-oldestdeps-parallel (ubuntu-latest)	1m 20s
compatibility / compatibility (ubuntu-latest)	3m 50s
test / py39-parallel (macos-latest)	2m 10s
test / py39-parallel (windows-latest)	2m 48s
dev / py39-devdeps-parallel (ubuntu-latest)	1m 59s
dev / py310-devdeps-parallel (ubuntu-latest)	1m 58s
dev / py311-devdeps-parallel (ubuntu-latest)	2m 18s
dev / py312-devdeps-parallel (ubuntu-latest)	1m 59s
	34m 0s

Provide feedback