Skip to content
On PR

Improved test infrastructure. #198

Sign in to view logs

Improved test infrastructure.

Improved test infrastructure. #198

GitHub Actions / TT-XLA Tests failed Dec 17, 2024 in 0s

361 tests run, 339 passed, 19 skipped, 3 failed.

Annotations

Check failure on line 21 in tests/TTIR/test_device.py

See this annotation in the file changed.

@github-actions github-actions / TT-XLA Tests

test_device.test_to_device 

AssertionError: assert 'cpu' == 'wormhole'
  
  - wormhole
  + cpu
Raw output 
def test_to_device():
        cpu_array = random_input_tensor((32, 32))
        device = jax.devices()[0]
        tt_array = jax.device_put(cpu_array, device)
>       assert tt_array.device.device_kind == "wormhole"
E       AssertionError: assert 'cpu' == 'wormhole'
E         
E         - wormhole
E         + cpu

tests/TTIR/test_device.py:21: AssertionError

Check failure on line 53 in tests/jax/models/flax_distil_bert_for_masked_lm/test_flax_distil_bert_for_masked_lm.py

See this annotation in the file changed.

@github-actions github-actions / TT-XLA Tests

test_flax_distil_bert_for_masked_lm.test_flax_distil_bert_for_masked_lm_inference 

failed on setup with "TypeError: Can't instantiate abstract class FlaxDistilBertForMaskedLMTester with abstract method _get_model_forward_pass_method_name"
Raw output 
comparison_config = ComparisonConfig(equal=EqualConfig(enabled=False), atol=AtolConfig(enabled=False, required_atol=0.1), pcc=PccConfig(enabled=True, required_pcc=0.99), allclose=AllcloseConfig(enabled=False, rtol=0.01, atol=0.01))

    @pytest.fixture
    def inference_tester(
        comparison_config: ComparisonConfig,
    ) -> FlaxDistilBertForMaskedLMTester:
>       return FlaxDistilBertForMaskedLMTester(comparison_config)
E       TypeError: Can't instantiate abstract class FlaxDistilBertForMaskedLMTester with abstract method _get_model_forward_pass_method_name

tests/jax/models/flax_distil_bert_for_masked_lm/test_flax_distil_bert_for_masked_lm.py:53: TypeError

Check failure on line 73 in tests/jax/models/test_simple_nn.py

See this annotation in the file changed.

@github-actions github-actions / TT-XLA Tests

test_simple_nn.test_simple_nn_inference 

failed on setup with "TypeError: Can't instantiate abstract class SimpleNNTester with abstract methods _get_model_forward_pass_method_name, _get_model_kwargs"
Raw output 
comparison_config = ComparisonConfig(equal=EqualConfig(enabled=False), atol=AtolConfig(enabled=False, required_atol=0.1), pcc=PccConfig(enabled=True, required_pcc=0.99), allclose=AllcloseConfig(enabled=False, rtol=0.01, atol=0.01))

    @pytest.fixture
    def inference_tester(comparison_config: ComparisonConfig) -> SimpleNNTester:
>       return SimpleNNTester(comparison_config)
E       TypeError: Can't instantiate abstract class SimpleNNTester with abstract methods _get_model_forward_pass_method_name, _get_model_kwargs

tests/jax/models/test_simple_nn.py:73: TypeError
View more details on GitHub Actions