fix: Remove load agent in recall cursor (#2286) #5640

Job	Run time
unit-run (test_vector_embeddings.py)	44s
unit-run (test_client.py)	1m 48s
unit-run (test_client_legacy.py)	2m 29s
unit-run (test_server.py)	1m 19s
unit-run (test_v1_routes.py)	47s
unit-run (test_local_client.py)	1m 7s
unit-run (test_managers.py)	1m 9s
unit-run (test_base_functions.py)	1m 4s
unit-run (test_tool_schema_parsing.py)	1m 54s
unit-run (test_tool_rule_solver.py)	46s
unit-run (test_memory.py)	43s
unit-run (test_utils.py)	52s
unit-run (test_stream_buffer_readers.py)	51s
unit-run (test_summarize.py)	2m 4s
	17m 37s

Provide feedback