Skip to content
test

test(weave): Add large input tests for scorers #19479

Sign in to view logs

test(weave): Add large input tests for scorers

test(weave): Add large input tests for scorers #19479

Triggered via push December 13, 2024 17:21
@devin-ai-integrationdevin-ai-integration[bot]
pushed 87820b4
xtra-scorers
Status Failure
Total duration 3m 32s
Artifacts –

test.yaml

on: push
check-which-tests-to-run  /  check
23s
check-which-tests-to-run / check
Matrix: Trace nox tests
Python lint
1m 35s
Python lint
Trace docs
1m 22s
Trace docs
Build Legacy (Query Service) test container
3s
Build Legacy (Query Service) test container
WeaveJS Lint and Compile
21s
WeaveJS Lint and Compile
trace-tests-matrix-check
2s
trace-tests-matrix-check
Matrix: Legacy (Query Service) Python unit tests
test-query-service-matrix-check
2s
test-query-service-matrix-check
Fit to window
Zoom out
Zoom in

Annotations

59 errors and 102 warnings
Trace nox tests (3, 10, mistral1)
Process completed with exit code 1.
Trace nox tests (3, 10, anthropic)
Process completed with exit code 1.
Trace nox tests (3, 10, trace)
Process completed with exit code 1.
Trace nox tests (3, 10, trace_server)
Process completed with exit code 1.
Trace nox tests (3, 11, trace_server)
Process completed with exit code 1.
Trace nox tests (3, 10, groq)
Process completed with exit code 1.
Trace nox tests (3, 11, groq)
Process completed with exit code 1.
Trace nox tests (3, 11, anthropic)
Process completed with exit code 1.
Trace nox tests (3, 11, cohere)
Process completed with exit code 1.
Trace nox tests (3, 10, cohere)
Process completed with exit code 1.
Trace docs
Process completed with exit code 2.
Trace nox tests (3, 11, cerebras)
Process completed with exit code 1.
Trace nox tests (3, 10, mistral0)
Process completed with exit code 1.
Trace nox tests (3, 10, cerebras)
Process completed with exit code 1.
Trace nox tests (3, 12, cerebras)
Process completed with exit code 1.
Trace nox tests (3, 9, anthropic)
Process completed with exit code 1.
Trace nox tests (3, 12, pandas-test)
Process completed with exit code 1.
Trace nox tests (3, 10, google_ai_studio)
Process completed with exit code 1.
Trace nox tests (3, 10, pandas-test)
Process completed with exit code 1.
Trace nox tests (3, 11, pandas-test)
Process completed with exit code 1.
Trace nox tests (3, 12, mistral1)
Process completed with exit code 1.
Trace nox tests (3, 12, mistral0)
Process completed with exit code 1.
Trace nox tests (3, 12, trace_server)
Process completed with exit code 1.
Trace nox tests (3, 12, trace)
Process completed with exit code 1.
Trace nox tests (3, 11, trace)
Process completed with exit code 1.
Trace nox tests (3, 11, google_ai_studio)
Process completed with exit code 1.
Trace nox tests (3, 10, vertexai)
Process completed with exit code 1.
Trace nox tests (3, 9, cerebras)
Process completed with exit code 1.
Trace nox tests (3, 11, mistral0)
Process completed with exit code 1.
Trace nox tests (3, 9, mistral1)
Process completed with exit code 1.
Trace nox tests (3, 12, cohere)
Process completed with exit code 1.
Trace nox tests (3, 9, mistral0)
Process completed with exit code 1.
Trace nox tests (3, 12, groq)
Process completed with exit code 1.
Trace nox tests (3, 12, anthropic)
Process completed with exit code 1.
Trace nox tests (3, 12, google_ai_studio)
Process completed with exit code 1.
Trace nox tests (3, 9, trace_server)
Process completed with exit code 1.
Trace nox tests (3, 9, pandas-test)
Process completed with exit code 1.
Trace nox tests (3, 9, groq)
Process completed with exit code 1.
Trace nox tests (3, 9, trace)
Process completed with exit code 1.
Trace nox tests (3, 9, google_ai_studio)
Process completed with exit code 1.
Trace nox tests (3, 9, cohere)
Process completed with exit code 1.
Python lint
Process completed with exit code 1.
Trace nox tests (3, 11, vertexai)
Process completed with exit code 1.
Trace nox tests (3, 11, mistral1)
Process completed with exit code 1.
Trace nox tests (3, 9, vertexai)
Process completed with exit code 1.
Trace nox tests (3, 12, vertexai)
Process completed with exit code 1.
Trace nox tests (3, 13, cerebras)
Process completed with exit code 1.
Trace nox tests (3, 13, trace_server)
Process completed with exit code 1.
Trace nox tests (3, 13, trace)
Process completed with exit code 1.
Trace nox tests (3, 13, mistral0)
Process completed with exit code 1.
Trace nox tests (3, 13, pandas-test)
Process completed with exit code 1.
Trace nox tests (3, 13, mistral1)
Process completed with exit code 1.
Trace nox tests (3, 13, groq)
Process completed with exit code 1.
Trace nox tests (3, 13, vertexai)
Process completed with exit code 1.
Trace nox tests (3, 11, scorers_tests)
Process completed with exit code 1.
Trace nox tests (3, 10, scorers_tests)
Process completed with exit code 1.
Trace nox tests (3, 9, scorers_tests)
Process completed with exit code 1.
Trace nox tests (3, 12, scorers_tests)
Process completed with exit code 1.
trace-tests-matrix-check
Process completed with exit code 1.
check-which-tests-to-run / check
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
WeaveJS Lint and Compile
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace docs
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Python lint
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Legacy (Query Service) Python unit tests (1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Legacy (Query Service) Python unit tests (0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
test-query-service-matrix-check
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636