Add Ubuntu 24.04 to CI

[dliappis]

Release notes

[rn:skip]

What does this PR do?

Now that we have custom VM images for Ubuntu 24.04, this commit adds CI for Ubuntu 24.04.

This is a revert of #16279

How to test this PR locally

BK Link:

• exhaustive job: https://buildkite.com/elastic/logstash-exhaustive-tests-pipeline/builds/605
• jdk matrix job: https://buildkite.com/elastic/logstash-linux-jdk-matrix-pipeline/builds/236

Unfortunately some steps in the above jobs fail as there is no 8.16.0 Elasticsearch artifact yet.

[elasticmachine]

💔 Build Failed

• Buildkite Build
• Commit: ecda287

Failed CI Steps

• 🥼 Integration Tests / part 1
• 🥼 Integration Tests / part 1
• 🥼 Integration Tests / part 1
• 🥼 Integration Tests / part 1
• 🥼 Integration Tests / part 2
• 🥼 Integration Tests / part 2
• 🥼 Integration Tests / part 2
• 🥼 Integration Tests / part 2
• 🥼 IT Persistent Queues / part 1
• 🥼 IT Persistent Queues / part 1
• 🥼 IT Persistent Queues / part 1
• 🥼 IT Persistent Queues / part 1
• 🥼 IT Persistent Queues / part 2
• 🥼 IT Persistent Queues / part 2
• 🥼 IT Persistent Queues / part 2
• 🥼 IT Persistent Queues / part 2
• 🥼 x-pack integration
• 🥼 x-pack integration
• 🥼 x-pack integration
• 🥼 x-pack integration

History

cc @dliappis

[elastic-sonarqube]

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarQube

[jsvd]

LGTM

[dliappis]

@logstashmachine backport 8.15

[dliappis]

@logstashmachine backport 8.14

[dliappis]

@jsvd / @flexitrev thinking a bit more abt backports here: should they be limited to main and 8.15 or go further back?

[jsvd]

No need to go further back for now, but I believe we may need to revisit this. Both Logstash, Kibana and Beats are not adding support for newer OSes in 7.17, but in the meantime OSes are going EOL, making the range of supported OS for 7.17 to get smaller and smaller. A good example is exactly Ubuntu, where 20.04 is going EOL next year, but we didn't add Ubuntu 22.04 support to 7.17.

[dliappis]

No need to go further back for now, but I believe we may need to revisit this. Both Logstash, Kibana and Beats are not adding support for newer OSes in 7.17, but in the meantime OSes are going EOL, making the range of supported OS for 7.17 to get smaller and smaller. A good example is exactly Ubuntu, where 20.04 is going EOL next year, but we didn't add Ubuntu 22.04 support to 7.17.

Thanks @jsvd ; based on this I'll only backport to 8.15