Skip to content
test

implemented scorer tests except for new score call method #19396

Sign in to view logs

implemented scorer tests except for new score call method

implemented scorer tests except for new score call method #19396

Triggered via push December 12, 2024 09:17
@tssweeneytssweeney
pushed d64802a
tim/scorer_mega_pr
Status Failure
Total duration 4m 10s
Artifacts –

test.yaml

on: push
check-which-tests-to-run  /  check
36s
check-which-tests-to-run / check
Matrix: Trace nox tests
Python lint
1m 8s
Python lint
Trace docs
3m 24s
Trace docs
Build Legacy (Query Service) test container
2s
Build Legacy (Query Service) test container
WeaveJS Lint and Compile
3m 6s
WeaveJS Lint and Compile
trace-tests-matrix-check
2s
trace-tests-matrix-check
Matrix: Legacy (Query Service) Python unit tests
test-query-service-matrix-check
3s
test-query-service-matrix-check
Fit to window
Zoom out
Zoom in

Annotations

77 errors and 102 warnings
Python lint
Process completed with exit code 1.
Trace nox tests (3, 11, trace)
Process completed with exit code 1.
Trace nox tests (3, 11, instructor)
Process completed with exit code 1.
Trace nox tests (3, 10, trace)
Process completed with exit code 1.
Trace nox tests (3, 10, mistral0)
Process completed with exit code 1.
Trace nox tests (3, 12, pandas-test)
Process completed with exit code 1.
Trace nox tests (3, 9, pandas-test)
Process completed with exit code 1.
Trace nox tests (3, 10, pandas-test)
Process completed with exit code 1.
Trace nox tests (3, 11, cohere)
Process completed with exit code 1.
Trace nox tests (3, 10, instructor)
Process completed with exit code 1.
Trace nox tests (3, 10, mistral1)
Process completed with exit code 1.
Trace nox tests (3, 11, anthropic)
Process completed with exit code 1.
Trace nox tests (3, 10, openai)
Process completed with exit code 1.
Trace nox tests (3, 9, cerebras)
Process completed with exit code 1.
Trace nox tests (3, 11, mistral1)
Process completed with exit code 1.
Trace nox tests (3, 11, mistral0)
Process completed with exit code 1.
Trace nox tests (3, 9, trace)
Process completed with exit code 1.
Trace nox tests (3, 12, groq)
Process completed with exit code 1.
Trace nox tests (3, 9, groq)
Process completed with exit code 1.
Trace nox tests (3, 11, cerebras)
Process completed with exit code 1.
Trace nox tests (3, 9, mistral0)
Process completed with exit code 1.
Trace nox tests (3, 12, cerebras)
Process completed with exit code 1.
Trace nox tests (3, 10, cerebras)
Process completed with exit code 1.
Trace nox tests (3, 10, notdiamond)
Process completed with exit code 1.
Trace nox tests (3, 11, groq)
Process completed with exit code 1.
Trace nox tests (3, 10, dspy)
Process completed with exit code 1.
Trace nox tests (3, 11, notdiamond)
Process completed with exit code 1.
Trace nox tests (3, 11, dspy)
Process completed with exit code 1.
Trace nox tests (3, 9, cohere)
Process completed with exit code 1.
Trace nox tests (3, 10, anthropic)
Process completed with exit code 1.
Trace nox tests (3, 9, instructor)
Process completed with exit code 1.
Trace nox tests (3, 12, trace)
Process completed with exit code 1.
Trace nox tests (3, 10, cohere)
Process completed with exit code 1.
Trace nox tests (3, 11, openai)
Process completed with exit code 1.
Trace nox tests (3, 9, dspy)
Process completed with exit code 1.
Trace nox tests (3, 11, pandas-test)
Process completed with exit code 1.
Trace nox tests (3, 11, langchain)
Process completed with exit code 1.
Trace nox tests (3, 10, litellm)
Process completed with exit code 1.
Trace nox tests (3, 11, litellm)
Process completed with exit code 1.
Trace nox tests (3, 9, mistral1)
Process completed with exit code 1.
Trace nox tests (3, 9, notdiamond)
Process completed with exit code 1.
Trace nox tests (3, 12, instructor)
Process completed with exit code 1.
Trace nox tests (3, 9, langchain)
Process completed with exit code 1.
Trace nox tests (3, 9, openai)
Process completed with exit code 1.
Trace nox tests (3, 11, llamaindex)
Process completed with exit code 1.
Trace nox tests (3, 12, anthropic)
Process completed with exit code 1.
Trace nox tests (3, 12, openai)
Process completed with exit code 1.
Trace nox tests (3, 12, cohere)
Process completed with exit code 1.
Trace nox tests (3, 12, mistral0)
Process completed with exit code 1.
Trace nox tests (3, 10, llamaindex)
Process completed with exit code 1.
Trace nox tests (3, 12, mistral1)
Process completed with exit code 1.
Trace nox tests (3, 9, litellm)
Process completed with exit code 1.
Trace nox tests (3, 9, anthropic)
Process completed with exit code 1.
Trace nox tests (3, 10, langchain)
Process completed with exit code 1.
Trace nox tests (3, 12, notdiamond)
Process completed with exit code 1.
Trace nox tests (3, 10, groq)
Process completed with exit code 1.
Trace nox tests (3, 13, trace)
Process completed with exit code 1.
Trace nox tests (3, 12, langchain)
Process completed with exit code 1.
Trace nox tests (3, 12, dspy)
Process completed with exit code 1.
Trace nox tests (3, 9, llamaindex)
Process completed with exit code 1.
Trace nox tests (3, 12, litellm)
Process completed with exit code 1.
Trace nox tests (3, 13, groq)
Process completed with exit code 1.
Trace nox tests (3, 13, mistral0)
Process completed with exit code 1.
Trace nox tests (3, 13, pandas-test)
Process completed with exit code 1.
Trace nox tests (3, 13, mistral1)
Process completed with exit code 1.
Trace nox tests (3, 12, llamaindex)
Process completed with exit code 1.
Trace nox tests (3, 13, openai)
Process completed with exit code 1.
Trace nox tests (3, 13, instructor)
Process completed with exit code 1.
Trace nox tests (3, 13, cerebras)
Process completed with exit code 1.
Trace nox tests (3, 13, llamaindex)
Process completed with exit code 1.
Trace nox tests (3, 10, trace_server)
Process completed with exit code 1.
Trace nox tests (3, 11, trace_server)
Process completed with exit code 1.
Trace nox tests (3, 9, trace_server)
Process completed with exit code 1.
Trace nox tests (3, 12, trace_server)
Process completed with exit code 1.
Trace nox tests (3, 13, trace_server)
Process completed with exit code 1.
trace-tests-matrix-check
Process completed with exit code 1.
WeaveJS Lint and Compile
Process completed with exit code 1.
check-which-tests-to-run / check
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Python lint
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Legacy (Query Service) Python unit tests (1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Legacy (Query Service) Python unit tests (0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
test-query-service-matrix-check
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace docs
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
WeaveJS Lint and Compile
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636