Installing Elastic Defend in tests can fail: Transform with id [endpoint.metadata_current-default-8.9.0] could not be found

[cmacknz]

Flaky Test

• Test Name: TestInstallWithEndpointSecurityAndRemoveEndpointIntegration
• Link: https://buildkite.com/elastic/elastic-agent/builds/3732#018afc1a-0977-4c4d-98b1-424f368e09b3
• Branch: 8.11

Stack Trace

endpoint_security_test.go:362: Error installing fleet package: Error installing endpoint 8.9.0: resource_not_found_exception
        	Root causes:
        		resource_not_found_exception: Transform with id [endpoint.metadata_current-default-8.9.0] could not be found
    endpoint_security_test.go:363: 
        	Error Trace:	/home/ubuntu/agent/testing/integration/endpoint_security_test.go:363
        	            				/home/ubuntu/agent/testing/integration/endpoint_security_test.go:325
        	Error:      	Received unexpected error:
        	            	error installing fleet package: Error installing endpoint 8.9.0: resource_not_found_exception
        	            		Root causes:
        	            			resource_not_found_exception: Transform with id [endpoint.metadata_current-default-8.9.0] could not be found
        	Test:       	TestInstallWithEndpointSecurityAndRemoveEndpointIntegration/protected

In a following test:

    endpoint_security_test.go:362: Error installing fleet package: Error installing endpoint 8.9.0: runtime_exception
        	Caused by:
        		version_conflict_engine_exception: [data_frame_transform_state_and_stats-endpoint.metadata_current-default-8.9.0]: version conflict, document already exists (current version [1])
        	Root causes:
        		runtime_exception: Failed to persist transform statistics for transform [endpoint.metadata_current-default-8.9.0]
    endpoint_security_test.go:363: 
        	Error Trace:	/home/ubuntu/agent/testing/integration/endpoint_security_test.go:363
        	            				/home/ubuntu/agent/testing/integration/endpoint_security_test.go:325
        	Error:      	Received unexpected error:
        	            	error installing fleet package: Error installing endpoint 8.9.0: runtime_exception
        	            		Caused by:
        	            			version_conflict_engine_exception: [data_frame_transform_state_and_stats-endpoint.metadata_current-default-8.9.0]: version conflict, document already exists (current version [1])
        	            		Root causes:
        	            			runtime_exception: Failed to persist transform statistics for transform [endpoint.metadata_current-default-8.9.0]
        	Test:       	TestInstallWithEndpointSecurityAndRemoveEndpointIntegration/unprotected
        	Messages:   	Policy Response was: kibana.PackagePolicyResponse{Item:kibana.PackagePolicy{ID:"", Revision:0, Enabled:false, Inputs:[]map[string]interface {}(nil), Package:kibana.PackagePolicyRequestPackage{Name:"", Version:""}, Namespace:"", OutputID:"", PolicyID:"", Name:"", Description:""}}

[elasticmachine]

Pinging @elastic/elastic-agent (Team:Elastic-Agent)

[cmacknz]

First thing to try is updating the version of the defend package we install https://github.com/elastic/endpoint-package/releases/tag/v8.11.0

[belimawr]

I'm kind fixing this as part of my PR: #3465

[belimawr]

If it fixes the issue I might just create a standalone PR to get it into main quicker.