Move quantized weight handling out of the `Weights` class #299

Job	Run time
build (cuda) / build-and-push	9m 8s
build (intel) / build-and-push	1h 13m 57s
build (rocm) / build-and-push	14m 53s
build (cuda) / integration_tests	8m 7s
build (intel) / integration_tests	0s
build (rocm) / integration_tests	0s
	1h 46m 5s

Provide feedback