Skip to content
test

test(weave): Add large input tests for scorers #19478

Sign in to view logs

test(weave): Add large input tests for scorers

test(weave): Add large input tests for scorers #19478

Triggered via push December 13, 2024 16:56
@devin-ai-integrationdevin-ai-integration[bot]
pushed 68c1b5e
xtra-scorers
Status Failure
Total duration 3m 18s
Artifacts –

test.yaml

on: push
check-which-tests-to-run  /  check
24s
check-which-tests-to-run / check
Matrix: Trace nox tests
Python lint
1m 3s
Python lint
Trace docs
1m 21s
Trace docs
Build Legacy (Query Service) test container
3s
Build Legacy (Query Service) test container
WeaveJS Lint and Compile
26s
WeaveJS Lint and Compile
trace-tests-matrix-check
7s
trace-tests-matrix-check
Matrix: Legacy (Query Service) Python unit tests
test-query-service-matrix-check
3s
test-query-service-matrix-check
Fit to window
Zoom out
Zoom in

Annotations

66 errors and 102 warnings
Python lint
Process completed with exit code 1.
Trace nox tests (3, 10, anthropic)
Process completed with exit code 1.
Trace nox tests (3, 10, trace_server)
Process completed with exit code 1.
Trace nox tests (3, 11, mistral0)
Process completed with exit code 1.
Trace nox tests (3, 10, mistral1)
Process completed with exit code 1.
Trace nox tests (3, 11, cerebras)
Process completed with exit code 1.
Trace nox tests (3, 10, cohere)
Process completed with exit code 1.
Trace nox tests (3, 10, mistral0)
Process completed with exit code 1.
Trace nox tests (3, 11, google_ai_studio)
Process completed with exit code 1.
Trace nox tests (3, 10, groq)
Process completed with exit code 1.
Trace nox tests (3, 10, google_ai_studio)
Process completed with exit code 1.
Trace nox tests (3, 11, trace_server)
Process completed with exit code 1.
Trace nox tests (3, 11, mistral1)
Process completed with exit code 1.
Trace nox tests (3, 11, cohere)
Process completed with exit code 1.
Trace docs
Process completed with exit code 2.
Trace nox tests (3, 12, groq)
Process completed with exit code 1.
Trace nox tests (3, 9, cerebras)
Process completed with exit code 1.
Trace nox tests (3, 12, mistral0)
Process completed with exit code 1.
Trace nox tests (3, 11, pandas-test)
Process completed with exit code 1.
Trace nox tests (3, 10, pandas-test)
Process completed with exit code 1.
Trace nox tests (3, 10, cerebras)
Process completed with exit code 1.
Trace nox tests (3, 12, google_ai_studio)
Process completed with exit code 1.
Trace nox tests (3, 10, trace)
Process completed with exit code 1.
Trace nox tests (3, 9, trace)
Process completed with exit code 1.
Trace nox tests (3, 9, mistral0)
Process completed with exit code 1.
Trace nox tests (3, 11, trace)
Process completed with exit code 1.
Trace nox tests (3, 12, mistral1)
Process completed with exit code 1.
Trace nox tests (3, 9, groq)
Process completed with exit code 1.
Trace nox tests (3, 9, mistral1)
Process completed with exit code 1.
Trace nox tests (3, 11, anthropic)
Process completed with exit code 1.
Trace nox tests (3, 9, cohere)
Process completed with exit code 1.
Trace nox tests (3, 12, cohere)
Process completed with exit code 1.
Trace nox tests (3, 12, anthropic)
Process completed with exit code 1.
Trace nox tests (3, 9, trace_server)
Process completed with exit code 1.
Trace nox tests (3, 12, cerebras)
Process completed with exit code 1.
Trace nox tests (3, 9, google_ai_studio)
Process completed with exit code 1.
Trace nox tests (3, 11, vertexai)
Process completed with exit code 1.
Trace nox tests (3, 9, llamaindex)
Process completed with exit code 1.
Trace nox tests (3, 9, instructor)
Process completed with exit code 1.
Trace nox tests (3, 12, trace_server)
Process completed with exit code 1.
Trace nox tests (3, 9, anthropic)
Process completed with exit code 1.
Trace nox tests (3, 12, pandas-test)
Process completed with exit code 1.
Trace nox tests (3, 11, groq)
Process completed with exit code 1.
Trace nox tests (3, 9, dspy)
Process completed with exit code 1.
Trace nox tests (3, 12, trace)
Process completed with exit code 1.
Trace nox tests (3, 10, vertexai)
Process completed with exit code 1.
Trace nox tests (3, 9, pandas-test)
Process completed with exit code 1.
Trace nox tests (3, 9, openai)
Process completed with exit code 1.
Trace nox tests (3, 12, vertexai)
Process completed with exit code 1.
Trace nox tests (3, 9, litellm)
Process completed with exit code 1.
Trace nox tests (3, 9, notdiamond)
Process completed with exit code 1.
Trace nox tests (3, 9, langchain)
Process completed with exit code 1.
Trace nox tests (3, 9, vertexai)
Process completed with exit code 1.
Trace nox tests (3, 13, mistral0)
Process completed with exit code 1.
Trace nox tests (3, 13, mistral1)
Process completed with exit code 1.
Trace nox tests (3, 13, trace)
Process completed with exit code 1.
Trace nox tests (3, 13, trace_server)
Process completed with exit code 1.
Trace nox tests (3, 13, groq)
Process completed with exit code 1.
Trace nox tests (3, 13, pandas-test)
Process completed with exit code 1.
Trace nox tests (3, 13, cerebras)
Process completed with exit code 1.
Trace nox tests (3, 13, vertexai)
Process completed with exit code 1.
Trace nox tests (3, 11, scorers_tests)
Process completed with exit code 1.
Trace nox tests (3, 10, scorers_tests)
Process completed with exit code 1.
Trace nox tests (3, 9, scorers_tests)
Process completed with exit code 1.
Trace nox tests (3, 12, scorers_tests)
Process completed with exit code 1.
trace-tests-matrix-check
Process completed with exit code 1.
check-which-tests-to-run / check
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Python lint
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
WeaveJS Lint and Compile
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace docs
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Legacy (Query Service) Python unit tests (0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Legacy (Query Service) Python unit tests (1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
test-query-service-matrix-check
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636