Parametrize tests with shapes and dtypes used in models instead of randomly chosen ones

[kmitrovicTT]

Summary

Majority of currently existing tests use either some random shape like 3x3 or some tile-size-divisible ones like 32x32.
We should change this so that ops are tested with shapes and dtypes actually used in models.

There is a PR currently in progress which will report, among other things, input and output shapes of ops like this

which will make it easier to procure a set of important parameters. This issue is blocked until that PR is merged.