Skip to content

Latest commit

 

History

History
2333 lines (1398 loc) · 86.3 KB

data-prepper.change-log-2.0.0.md

File metadata and controls

2333 lines (1398 loc) · 86.3 KB
Raw

  • Increase the default buffer configurations by 25. Capacity to 12,800 and batch size to 200. (#1906) (#1907)

    opensearch-trigger-bot[bot] - Mon, 10 Oct 2022 12:10:16 -0500

    EAD -> refs/heads/2.0, refs/remotes/upstream/2.0, refs/remotes/origin/2.0 Signed-off-by: David Venable <[email protected]> (cherry picked from commit 29a4a9750c5448cc7ecf27246f6565fb483fa724) Co-authored-by: David Venable <[email protected]>

  • Conditional routing documentation (#1894) (#1905)

    opensearch-trigger-bot[bot] - Mon, 10 Oct 2022 10:40:13 -0500

    Add documentation for conditional routing. Resolves #1890 Signed-off-by: David Venable <[email protected]> (cherry picked from commit 11dd3a01b6e4f7f86e348a8dc5f9a205074e0f22) Co-authored-by: David Venable <[email protected]>

  • Adds a stack-trace to failures from OpenSearch to help with debugging issues. (#1899) (#1902)

    opensearch-trigger-bot[bot] - Mon, 10 Oct 2022 09:27:52 -0500

    Signed-off-by: David Venable <[email protected]> (cherry picked from commit bd8a7fa6950f954737c2a9c77875eaaa7b735872) Co-authored-by: David Venable <[email protected]>

  • Added change log (#1901) (#1903)

    opensearch-trigger-bot[bot] - Sat, 8 Oct 2022 12:56:59 -0500

    Signed-off-by: Asif Sohail Mohammed <[email protected]> (cherry picked from commit 6f0b7cf04b4f7a13603d0fdad956848b6d90ca55) Co-authored-by: Asif Sohail Mohammed <[email protected]>

  • Update gradle version to 2.0.0 (#1900)

    Hai Yan - Fri, 7 Oct 2022 18:28:50 -0500

    Signed-off-by: Hai Yan <[email protected]>

  • Updated protobuf dependency (#1896)

    Asif Sohail Mohammed - Fri, 7 Oct 2022 11:45:19 -0500

    Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Updates Trace Analytics documentation for Data Prepper 2.0 (#1748)

    David Venable - Fri, 7 Oct 2022 11:37:52 -0500

    • Updates Trace Analytics examples to set the record_type to event in our documentation. Also includes a short guide to migrating to Data Prepper 2.0 for Trace Analytics. Signed-off-by: David Venable <[email protected]>

    • Updated the documentation for the OTel Trace Source to show how to run on either Data Prepper 2.0 or 1.x. Signed-off-by: David Venable <[email protected]> Signed-off-by: David Venable <[email protected]>

  • Data Prepper 2.0.0 Release notes (#1895)

    Asif Sohail Mohammed - Fri, 7 Oct 2022 11:25:06 -0500

  • MAINT: rename grok match metrics (#1893)

    Qi Chen - Thu, 6 Oct 2022 17:11:30 -0500

    Signed-off-by: Qi Chen <[email protected]> Signed-off-by: Qi Chen <[email protected]>

  • Added core peer forwarder e2e tests (#1866)

    Asif Sohail Mohammed - Thu, 6 Oct 2022 11:22:53 -0500

    • Added e2e tests for core peer forwarder Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Using the file sink is causing build failures in valid_multiple_sinks_with_routes.yml. Use stdout instead. (#1889)

    David Venable - Thu, 6 Oct 2022 10:42:51 -0500

    Signed-off-by: David Venable <[email protected]>

  • adding bufferUsage to BlockingBuffer plugin (#1882)

    Christopher Manning - Thu, 6 Oct 2022 10:05:50 -0500

    Signed-off-by: Christopher Manning <[email protected]>

  • Implementation of conditional routing of sinks (#1832)

    David Venable - Wed, 5 Oct 2022 18:25:16 -0500

    Implementation of conditional routing of sinks. Signed-off-by: David Venable <[email protected]>

  • Core peer forwarder performance inprovement (#1880)

    Asif Sohail Mohammed - Wed, 5 Oct 2022 11:39:33 -0500

    • Updated call to setPeerClientPool Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Fixes file sink to work with multiple threads (#1842)

    David Venable - Wed, 5 Oct 2022 11:04:23 -0500

    • This fixes an issue with file sink. Each processor thread would overwrite the other threads which prevents it from working as expected. Now, it keeps a Writer open as long as it is running. It will flush on each output() call. Signed-off-by: David Venable <[email protected]>

    • Updated test files to use stdout instead of file sink since the file sink now will attempt to write to the file on construction. Signed-off-by: David Venable <[email protected]>

    • Additional test to improve code coverage. Signed-off-by: David Venable <[email protected]>

  • Updates the bin/data-prepper script to use "readlink -f" instead of "realpath" since this is available by default on more systems. (#1883)

    David Venable - Wed, 5 Oct 2022 11:02:07 -0500

    Signed-off-by: David Venable <[email protected]>

  • Use Apache AWS client exclusively to fix AWS Java SDK (#1877)

    David Venable - Wed, 5 Oct 2022 10:34:54 -0500

    Fixes Data Prepper with AWS services by setting the Java system property. Resolves #1876 Signed-off-by: David Venable <[email protected]>

  • Updated http source documentation (#1875)

    Asif Sohail Mohammed - Wed, 5 Oct 2022 10:32:36 -0500

    • Updated http source documentation Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Bump com.diffplug.spotless from 6.7.1 to 6.11.0 (#1884)

    dependabot[bot] - Wed, 5 Oct 2022 10:29:01 -0500

    Bumps com.diffplug.spotless from 6.7.1 to 6.11.0.

    updated-dependencies:

    • dependency-name: com.diffplug.spotless dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump spring-test from 5.3.22 to 5.3.23 in /data-prepper-core (#1885)

    dependabot[bot] - Wed, 5 Oct 2022 10:22:07 -0500

    Bumps spring-test from 5.3.22 to 5.3.23.

    Commits

    updated-dependencies:

    • dependency-name: org.springframework:spring-test dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Removed peer forwarder processor plugin (#1874)

    Asif Sohail Mohammed - Wed, 5 Oct 2022 10:02:15 -0500

    Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Bump byte-buddy in /data-prepper-plugins/opensearch (#1851)

    dependabot[bot] - Wed, 5 Oct 2022 09:50:47 -0500

    Bumps byte-buddy from 1.12.16 to 1.12.17.

    Commits

    updated-dependencies:

    • dependency-name: net.bytebuddy:byte-buddy dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump micrometer-bom from 1.9.3 to 1.9.4 (#1858)

    dependabot[bot] - Wed, 5 Oct 2022 09:20:31 -0500

    Bumps micrometer-bom from 1.9.3 to 1.9.4.

    Commits

    updated-dependencies:

    • dependency-name: io.micrometer:micrometer-bom dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Updated ssl to true by default for core peer forwarder (#1835)

    Asif Sohail Mohammed - Tue, 4 Oct 2022 10:29:23 -0500

  • Do not fail all GitHub Actions when other similar ones fail to help reduce the number of builds we have to re-run from flaky tests. (#1879)

    David Venable - Tue, 4 Oct 2022 09:46:13 -0500

    Signed-off-by: David Venable <[email protected]>

  • Jackson 2.13.4. Resolves #1839 (#1871)

    David Venable - Tue, 4 Oct 2022 08:28:17 -0500

    Signed-off-by: David Venable <[email protected]>

  • Updated the OTel Metrics plugins to the org.opensearch.dataprepper package. (#1872)

    David Venable - Tue, 4 Oct 2022 08:18:20 -0500

    Signed-off-by: David Venable <[email protected]>

  • Added metrics documentation (#1873)

    Asif Sohail Mohammed - Tue, 4 Oct 2022 00:12:59 -0500

    Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Bump byte-buddy-agent in /data-prepper-plugins/opensearch (#1850)

    dependabot[bot] - Mon, 3 Oct 2022 18:16:46 -0500

    Bumps byte-buddy-agent from 1.12.14 to 1.12.17.

    Commits

    updated-dependencies:

    • dependency-name: net.bytebuddy:byte-buddy-agent dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump spring-core from 5.3.22 to 5.3.23 in /data-prepper-core (#1855)

    dependabot[bot] - Mon, 3 Oct 2022 18:16:05 -0500

    Bumps spring-core from 5.3.22 to 5.3.23.

    Commits

    updated-dependencies:

    • dependency-name: org.springframework:spring-core dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump spring-context from 5.3.22 to 5.3.23 in /data-prepper-expression (#1862)

    dependabot[bot] - Mon, 3 Oct 2022 18:13:44 -0500

    Bumps spring-context from 5.3.22 to 5.3.23.

    Commits

    updated-dependencies:

    • dependency-name: org.springframework:spring-context dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump spring-test from 5.3.22 to 5.3.23 in /data-prepper-expression (#1860)

    dependabot[bot] - Mon, 3 Oct 2022 18:13:27 -0500

    Bumps spring-test from 5.3.22 to 5.3.23.

    Commits

    updated-dependencies:

    • dependency-name: org.springframework:spring-test dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump spring-context from 5.3.22 to 5.3.23 in /data-prepper-core (#1856)

    dependabot[bot] - Mon, 3 Oct 2022 18:13:04 -0500

    Bumps spring-context from 5.3.22 to 5.3.23.

    Commits

    updated-dependencies:

    • dependency-name: org.springframework:spring-context dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump spring-core from 5.3.22 to 5.3.23 in /data-prepper-expression (#1861)

    dependabot[bot] - Mon, 3 Oct 2022 18:11:15 -0500

    Bumps spring-core from 5.3.22 to 5.3.23.

    Commits

    updated-dependencies:

    • dependency-name: org.springframework:spring-core dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump log4j-bom from 2.18.0 to 2.19.0 in /data-prepper-core (#1853)

    dependabot[bot] - Mon, 3 Oct 2022 18:10:00 -0500

    Bumps log4j-bom from 2.18.0 to 2.19.0.

    updated-dependencies:

    • dependency-name: org.apache.logging.log4j:log4j-bom dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump log4j-bom from 2.18.0 to 2.19.0 in /data-prepper-expression (#1864)

    dependabot[bot] - Mon, 3 Oct 2022 18:09:31 -0500

    Bumps log4j-bom from 2.18.0 to 2.19.0.

    updated-dependencies:

    • dependency-name: org.apache.logging.log4j:log4j-bom dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Use exec command to run application (#1847)

    Hai Yan - Mon, 3 Oct 2022 17:49:33 -0500

    Signed-off-by: Hai Yan <[email protected]>

  • BUG FIX: Core peer forwarder trace pipeline bug (#1865)

    Asif Sohail Mohammed - Mon, 3 Oct 2022 16:49:42 -0500

    • Fix: Core peer forwarder trace pipeline bug Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Bump jackson-databind from 2.13.3 to 2.13.4 (#1857)

    dependabot[bot] - Mon, 3 Oct 2022 16:18:54 -0500

    Bumps jackson-databind from 2.13.3 to 2.13.4.

    updated-dependencies:

    • dependency-name: com.fasterxml.jackson.core:jackson-databind dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Updates log4j configurations to use the org.opensearch.dataprepper package. Updates documentation to this package as well to help clarify expected outcomes for users. Contributes toward #344. (#1841)

    David Venable - Sat, 1 Oct 2022 13:57:21 -0500

    Signed-off-by: David Venable <[email protected]>

  • Add fingerprint trust store implementation to PeerForwarderHttpServer (#1848)

    Chase - Fri, 30 Sep 2022 14:27:25 -0500

    Signed-off-by: Chase Engelbrecht <[email protected]> Signed-off-by: Chase Engelbrecht <[email protected]>

  • Update plugin names to use processor (#1838)

    Hai Yan - Fri, 30 Sep 2022 10:30:24 -0500

    Signed-off-by: Hai Yan <[email protected]>

  • Added additional metrics to peer forwarder (#1836)

    Asif Sohail Mohammed - Fri, 30 Sep 2022 09:22:54 -0500

    Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Support evaluating conditional expressions in multiple threads by using a ThreadLocal ParseTreeParser. Resolves #1189 (#1840)

    David Venable - Thu, 29 Sep 2022 18:39:17 -0500

    Signed-off-by: David Venable <[email protected]>

  • Update Armeria to 1.19.0 from 1.16.0. (#1837)

    David Venable - Thu, 29 Sep 2022 14:43:51 -0500

    Signed-off-by: David Venable <[email protected]>

  • Decompose archive smoke-tests (#1808)

    David Venable - Thu, 29 Sep 2022 13:18:56 -0500

    • Decompose the archive smoke tests by having the different combinations available as command-line arguments. This allows us to split up the release GitHub Action to test each archive file independently of each other. Signed-off-by: David Venable <[email protected]>

    • Updated the release smoke test strategy to use specific inclusions. Signed-off-by: David Venable <[email protected]> Update release/smoke-tests/README.md Signed-off-by: David Venable <[email protected]> Co-authored-by: Hai Yan <[email protected]>

    • Other README corrections. Signed-off-by: David Venable <[email protected]> Signed-off-by: David Venable <[email protected]> Co-authored-by: Hai Yan <[email protected]>

  • Replace example pipeline yaml with a README (#1830)

    Hai Yan - Thu, 29 Sep 2022 12:21:07 -0500

    Signed-off-by: Hai Yan <[email protected]>

  • Updates otel-proto-common to org.opensearch.dataprepper. (#1834)

    David Venable - Thu, 29 Sep 2022 12:07:18 -0500

    Signed-off-by: David Venable <[email protected]>

  • Updates data-prepper-api to the org.opensearch.dataprepper package. (#1833)

    David Venable - Thu, 29 Sep 2022 09:01:34 -0500

    Signed-off-by: David Venable <[email protected]>

  • Added metrics for peer forwarder (#1812)

    Asif Sohail Mohammed - Wed, 28 Sep 2022 23:15:56 -0500

    • Added existing metrics to peer forwarder Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Refactor Processor shutdown behavior to wait until buffers are empty before preparing for shutdown (#1792)

    Chase - Wed, 28 Sep 2022 22:49:54 -0500

    • Add drainTimeout to PeerForwarderConfiguration, refactor ProcessWorker shutdown behavior Signed-off-by: Chase Engelbrecht <[email protected]>

  • Corrected the way that PipelineModel deserializes the route property. It was previously using a setter approach and used a different property name in the constructor. (#1825)

    David Venable - Wed, 28 Sep 2022 18:36:24 -0500

    Signed-off-by: David Venable <[email protected]>

  • Bug fix: peer forwarder not decorating processors (#1831)

    Asif Sohail Mohammed - Wed, 28 Sep 2022 17:21:44 -0500

    Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Updated third party file (#1828)

    Asif Sohail Mohammed - Wed, 28 Sep 2022 16:06:50 -0500

    Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Update examples (#1796)

    Hai Yan - Wed, 28 Sep 2022 14:40:15 -0500

    • Update examples for directory change
    • Fix analytics sample app
    • Exclude javax.json dependency from antlr4 Signed-off-by: Hai Yan <[email protected]>

  • Updated the PipelineModel to return a SinkModel for sinks (#1802)

    David Venable - Wed, 28 Sep 2022 11:31:24 -0500

    Updated the PipelineModel to return a SinkModel for sinks. This includes fields for conditional routing. Signed-off-by: David Venable <[email protected]>

  • Updated default peer forwarder port (#1823)

    Asif Sohail Mohammed - Wed, 28 Sep 2022 09:48:43 -0500

    Signed-off-by: Asif Sohail Mohammed <[email protected]> Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Change CMD to exec form in Dockerfile (#1822)

    Hai Yan - Wed, 28 Sep 2022 09:38:53 -0500

    Signed-off-by: Hai Yan <[email protected]>

  • Fix: Peer forwarder exception with single thread annotated processors (#1821)

    Asif Sohail Mohammed - Wed, 28 Sep 2022 09:36:51 -0500

    • Fix: Peer forwarder exception with single thread annotated processors Signed-off-by: Asif Sohail Mohammed <[email protected]>

    • Addressed feedback Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Updated the package for most of the remaining plugins to org.opensearch.dataprepper. This excludes the metrics plugins, proto-commons, and the classic peer-forwarder plugin. Contributes toward #344. (#1815)

    David Venable - Tue, 27 Sep 2022 22:05:00 -0500

    Signed-off-by: David Venable <[email protected]>

  • Add sslVerifyFingerprintOnly flag to PeerForwarderConfiguration (#1818)

    Chase - Tue, 27 Sep 2022 22:04:39 -0500

    • Add sslVerifyFingerprintOnly flag to PeerForwarderConfiguration Signed-off-by: Chase Engelbrecht <[email protected]>

    • Move getFingerprint() functionality into Certificate model, add tests for getFingerprint() Signed-off-by: Chase Engelbrecht <[email protected]>

    • Add PeerForwarderConfiguration tests for sslFingerprintVerificationOnly Signed-off-by: Chase Engelbrecht <[email protected]>

    • Wire isSslFingerprintVerificationOnly into PeerForwarderClientFactory, add tests for it Signed-off-by: Chase Engelbrecht <[email protected]>

    • Add documentation for sslFingerprintVerificationOnly Signed-off-by: Chase Engelbrecht <[email protected]>

    • Add PeerForwarder_ClientServer integration tests for sslFingerprintVerificationOnly Signed-off-by: Chase Engelbrecht <[email protected]> Signed-off-by: Chase Engelbrecht <[email protected]>

  • Fix jdk version check in script (#1819)

    Hai Yan - Tue, 27 Sep 2022 21:18:09 -0500

    Signed-off-by: Hai Yan <[email protected]>

  • Added demo cert and key files (#1813)

    Asif Sohail Mohammed - Tue, 27 Sep 2022 18:41:50 -0500

  • Make HTTP source request timeout transparent (#1814)

    Hai Yan - Tue, 27 Sep 2022 15:43:54 -0500

  • Updated the package for trace analytics plugins to org.opensearch.dataprepper. (#1810)

    David Venable - Tue, 27 Sep 2022 09:45:48 -0500

    Signed-off-by: David Venable <[email protected]>

  • Updated the package for data-prepper-test-common to org.opensearch.dataprepper. (#1809)

    David Venable - Tue, 27 Sep 2022 09:45:27 -0500

    Signed-off-by: David Venable <[email protected]>

  • Parse JSON Processor: README, more testing, support for JSON Pointer (#1696)

    Finn - Mon, 26 Sep 2022 18:36:57 -0500

    Signed-off-by: Finn Roblin <[email protected]>

  • S3 Event Consistency via metadata and JSON changes (#1803)

    David Venable - Mon, 26 Sep 2022 17:30:06 -0500

    Support a configurable key for S3 metadata and make this base key s3/ by default. Moved the output of JSON from S3 objects into the root of the Event from the message key. Resolves #1687 Signed-off-by: David Venable <[email protected]>

  • Added documentation for core peer forwarder (#1797)

    Asif Sohail Mohammed - Mon, 26 Sep 2022 09:31:32 -0500

    • Added documentation for core peer forwarder Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Implement AggregateProcessor shutdown behavior (#1794)

    Chase - Mon, 26 Sep 2022 08:39:16 -0500

    • Implement AggregateProcessor shutdown behavior Signed-off-by: Chase Engelbrecht <[email protected]>

    • Move branching on isShuttingDown to existing loop Signed-off-by: Chase Engelbrecht <[email protected]>

    • Add missing imports Signed-off-by: Chase Engelbrecht <[email protected]>

    • Remove bound from nextLong Signed-off-by: Chase Engelbrecht <[email protected]>

    • Refactor test case to support either order of map iteration Signed-off-by: Chase Engelbrecht <[email protected]>

    • Add isShuttingDown flag to conclude group check in AggregateActionSynchronizer Signed-off-by: Chase Engelbrecht <[email protected]>

    • Rename isShuttingDown flag to forceConclude, add test for groups size == 1 Signed-off-by: Chase Engelbrecht <[email protected]> Signed-off-by: Chase Engelbrecht <[email protected]>

  • Bump protobuf in /examples/trace-analytics-sample-app/sample-app (#1801)

    dependabot[bot] - Sat, 24 Sep 2022 09:39:19 -0500

    Bumps protobuf from 3.15.6 to 3.18.3.

    Changelog

    Commits

    updated-dependencies:

    • dependency-name: protobuf dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump protobuf in /release/smoke-tests/otel-span-exporter (#1800)

    dependabot[bot] - Fri, 23 Sep 2022 17:59:49 -0500

    Bumps protobuf from 3.19.1 to 3.19.5.

    Changelog

    Commits

    updated-dependencies:

    • dependency-name: protobuf dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Updates to several plugins to move to the org.opensearch.dataprepper package (#1787)

    David Venable - Thu, 22 Sep 2022 14:52:32 -0700

    Updates many plugins to the org.opensearch package: csv, date, log-generator, mutate, aggregate, drop, grok, http, key-value. #344 Signed-off-by: David Venable <[email protected]>

  • Fix ignored Logstash config file when loading from directory (#1788)

    Hai Yan - Thu, 22 Sep 2022 14:27:42 -0500

    Signed-off-by: Hai Yan <[email protected]>

  • Fix otel config (#1790)

    bryan-aguilar - Thu, 22 Sep 2022 10:35:57 -0700

    Signed-off-by: Bryan Aguilar <[email protected]>

  • updated aws-cdk to version ^2.42.1 (#1793)

    Steven Bayer - Thu, 22 Sep 2022 10:29:13 -0500

    Fix cve-2022-36067

  • Update docs to reflect recent changes on directory structure (#1786)

    Hai Yan - Tue, 20 Sep 2022 13:42:34 -0500

    Signed-off-by: Hai Yan <[email protected]>

  • Removed io.pebbletemplates dependency (#1784)

    Steven Bayer - Mon, 19 Sep 2022 16:50:57 -0500

    Signed-off-by: Steven Bayer <[email protected]>

  • Refactor GrokPrepper shutdown behavior to prevent ExecutorService from terminating prematurely (#1776)

    Chase - Mon, 19 Sep 2022 15:22:10 -0500

    Signed-off-by: Chase Engelbrecht <[email protected]> Signed-off-by: Chase Engelbrecht <[email protected]>

  • Adds the Data Prepper icon to the start of the README.md file. (#1783)

    David Venable - Mon, 19 Sep 2022 15:17:41 -0500

    Signed-off-by: David Venable <[email protected]>

  • Updated the OpenSearch sink to use the org.opensearch.dataprepper package name. Contributes to #344. (#1780)

    David Venable - Mon, 19 Sep 2022 10:37:16 -0500

    Signed-off-by: David Venable <[email protected]>

  • Adds the Data Prepper horizontal icon with auto light/dark mode as an SVG. (#1782)

    David Venable - Mon, 19 Sep 2022 10:33:29 -0500

    Signed-off-by: David Venable <[email protected]>

  • Added Java time module to object mapper (#1779)

    Asif Sohail Mohammed - Sat, 17 Sep 2022 19:14:43 -0500

  • Support hostname verification in core peer-forwarding. Provide the ability to disable hostname verification. Generate test certificates with a SAN and document how to do it. (#1778)

    David Venable - Sat, 17 Sep 2022 14:53:29 -0500

    Signed-off-by: David Venable <[email protected]>

  • Integration testing against latest OpenSearch versions (#1754)

    David Venable - Fri, 16 Sep 2022 15:19:55 -0500

    Renamed the GitHub action for OpenSearch targets and support the latest versions in the 2.x series as of now. Test OpenSearch 1.3.5 as the latest version in that series. Signed-off-by: David Venable <[email protected]>

  • Support Mutual TLS authentication for Core Peer Forwarding. Resolves #1758. (#1771)

    David Venable - Fri, 16 Sep 2022 15:19:03 -0500

    Signed-off-by: David Venable <[email protected]>

  • Create a runnable distribution from assemble task (#1774)

    Hai Yan - Fri, 16 Sep 2022 15:17:25 -0500

    • Configure install task and add to assemble task Signed-off-by: Hai Yan <[email protected]>

  • Load pipeline configurations from directory (#1760)

    Hai Yan - Fri, 16 Sep 2022 14:11:41 -0500

    • Load one or more pipeline configs from directory
    • Add back the support for command line arguments to specify configs
    • Update docker for smoke tests
    • Update relevant documentation Signed-off-by: Hai Yan <[email protected]>

  • Fix broken PeerForwardingProcessingDecoratorTest by casting object as Processor. (#1777)

    David Venable - Fri, 16 Sep 2022 14:10:19 -0500

    Signed-off-by: David Venable <[email protected]>

  • Added receive records to peer forwarder (#1761)

    Asif Sohail Mohammed - Fri, 16 Sep 2022 10:58:22 -0500

    • Added receive records to peer forwarder Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Implement RequiresPeerForwarding interface (#1767)

    Asif Sohail Mohammed - Fri, 16 Sep 2022 10:14:24 -0500

    • Aggregate processor implements RequiresPeerForwarding interface Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Refactor PluginDurationDeserializer to DataPrepperDurationDeserializer, add processorShutdownTimeout to DataPrepperConfiguration, use processorShutdownTimeout from DataPrepperConfiguration in Pipeline (#1757)

    Chase - Thu, 15 Sep 2022 14:06:10 -0500

    • Refactor PluginDurationDeserializer to DataPrepperDurationDeserializer, add processorShutdownTimeout to DataPrepperConfiguration, use processorShutdownTimeout from DataPrepperConfiguration in Pipeline Signed-off-by: Chase Engelbrecht <[email protected]>

  • Updated config defaults and validations for peer forwarder (#1768)

    Asif Sohail Mohammed - Thu, 15 Sep 2022 13:52:55 -0500

    • Updated config defaults and validations Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Inject PeerForwarderServer in to DataPrepper class (#1764)

    Asif Sohail Mohammed - Thu, 15 Sep 2022 10:25:24 -0500

    • Injected peer forwarder server in to DataPrepper Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Peer Forwarder client-server integration testing and related fixes (#1753)

    David Venable - Wed, 14 Sep 2022 09:08:00 -0500

    Created an integration test which verifies that a PeerForwarderClient can forward events to a PeerForwarderServer. This revealed several bugs which are fixed in this PR. Additionally, client exceptions are thrown as exceptions rather than incorrect status codes. Signed-off-by: David Venable <[email protected]>

  • Updated Opensearch rest high-level client (#1755)

    Asif Sohail Mohammed - Tue, 13 Sep 2022 15:27:15 -0500

    Signed-off-by: Asif Sohail Mohammed <[email protected]> Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Load data prepper configurations from home directory (#1737)

    Hai Yan - Tue, 13 Sep 2022 14:01:32 -0500

    Signed-off-by: Hai Yan <[email protected]>

  • Added Local peer forwarder and updated http servoce class to write to… (#1750)

    Asif Sohail Mohammed - Tue, 13 Sep 2022 13:09:20 -0500

    • Added Local peer forwarder and updated http service class to write to buffer Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Allows the plugin framework to correctly load classes which inherit from PluginSetting. (#1752)

    David Venable - Mon, 12 Sep 2022 16:35:12 -0500

    Signed-off-by: David Venable <[email protected]>

  • Get PeerForwarder from a PeerForwarderProvider (#1717)

    David Venable - Fri, 9 Sep 2022 14:04:35 -0500

    Refactored the PeerForwarder class such that a PeerForwarderProvider is available as the primary means of obtaining a PeerForwarder object. This can yield a dynamic approach to PeerForwarder which can provide solutions for when peer forwarding is not needed or not configured. Includes making PeerForwarder an interface and supplying a package-protected RemotePeerForwarder for configurations requiring peer-forwarding. Signed-off-by: David Venable <[email protected]>

  • Added server proxy for Peer Forwarder Server (#1738)

    Asif Sohail Mohammed - Fri, 9 Sep 2022 13:22:22 -0500

  • Bump gradle-license-report from 1.17 to 2.1 (#1555)

    dependabot[bot] - Fri, 9 Sep 2022 12:30:04 -0500

    Bumps gradle-license-report from 1.17 to 2.1.

    updated-dependencies:

    • dependency-name: com.github.jk1:gradle-license-report dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump byte-buddy from 1.12.14 to 1.12.16 (#1743)

    dependabot[bot] - Fri, 9 Sep 2022 12:27:39 -0500

    Bumps byte-buddy from 1.12.14 to 1.12.16.

    Commits

    updated-dependencies:

    • dependency-name: net.bytebuddy:byte-buddy dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Update Data Prepper to build using JDK 11 making this the minimum sup… (#1739)

    David Venable - Fri, 9 Sep 2022 08:52:45 -0500

    Update Data Prepper to build using JDK 11 making this the minimum supported Java version. Resolves #1422. Includes updated documentation. Signed-off-by: David Venable <[email protected]>

  • Bump guava from 31.0.1-jre to 31.1-jre (#1734)

    dependabot[bot] - Thu, 8 Sep 2022 20:43:31 -0500

    Bumps guava from 31.0.1-jre to 31.1-jre.

    updated-dependencies:

    • dependency-name: com.google.guava:guava dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Update trace analytics sample app pipeline.yaml to include event record type for otel_trace_source (#1741)

    Taylor Gray - Thu, 8 Sep 2022 16:51:12 -0500

    Signed-off-by: Taylor Gray <[email protected]> Signed-off-by: Taylor Gray <[email protected]>

  • Update HTTP source ssl validations (#1740)

    Asif Sohail Mohammed - Thu, 8 Sep 2022 16:46:37 -0500

    Signed-off-by: Asif Sohail Mohammed <[email protected]> Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Update Docker images to use JDK 17 (#1727)

    Hai Yan - Thu, 8 Sep 2022 12:45:02 -0500

    • Update Data Prepper docker to use Temurin jdk17-alpine
    • Update jdk in tar.gz archive file to use Temurin jdk-17
    • Update trace analytics dev sample app and EMF monitoring dev sample Signed-off-by: Hai Yan <[email protected]>

  • Renamed router to route in the PipelineModel (#1721)

    David Venable - Thu, 8 Sep 2022 10:43:10 -0500

    Renamed router to route in the PipelineModel. Improved the tests by including tests that validate the route properties. Signed-off-by: David Venable <[email protected]>

  • Bump byte-buddy-agent in /data-prepper-plugins/opensearch (#1712)

    dependabot[bot] - Wed, 7 Sep 2022 22:02:17 -0500

    Bumps byte-buddy-agent from 1.12.13 to 1.12.14.

    Commits

    updated-dependencies:

    • dependency-name: net.bytebuddy:byte-buddy-agent dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump byte-buddy in /data-prepper-plugins/opensearch (#1711)

    dependabot[bot] - Wed, 7 Sep 2022 20:15:26 -0500

    Bumps byte-buddy from 1.12.12 to 1.12.14.

    Commits

    updated-dependencies:

    • dependency-name: net.bytebuddy:byte-buddy dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump hibernate-validator from 7.0.4.Final to 7.0.5.Final (#1715)

    dependabot[bot] - Wed, 7 Sep 2022 20:14:52 -0500

    Bumps hibernate-validator from 7.0.4.Final to 7.0.5.Final.

    Changelog

    Commits

    updated-dependencies:

    • dependency-name: org.hibernate.validator:hibernate-validator dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump joda-time from 2.10.14 to 2.11.1 (#1714)

    dependabot[bot] - Wed, 7 Sep 2022 19:26:46 -0500

    Bumps joda-time from 2.10.14 to 2.11.1.

    updated-dependencies:

    • dependency-name: joda-time:joda-time dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Deletes PrepperStateTest which is no longer valid after #1707 (#1732)

    David Venable - Wed, 7 Sep 2022 18:10:25 -0500

    Signed-off-by: David Venable <[email protected]>

  • Moved plugins commons projects to org.opensearch.dataprepper package. (#1726)

    David Venable - Wed, 7 Sep 2022 16:54:24 -0500

    Signed-off-by: David Venable <[email protected]>

  • Added apache client for creating s3 and acm client (#1731)

    Asif Sohail Mohammed - Wed, 7 Sep 2022 16:43:44 -0500

    • Added apache client for creating s3 and acm client Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Remove deprecated prepper plugin type (#1707)

    Hai Yan - Wed, 7 Sep 2022 15:52:43 -0500

    • Replace prepper with processor in yaml samples
    • Replace prepper with processor in code comments
    • Remove Prepper interface and related usage
    • Change PepperState to ProcessorState Signed-off-by: Hai Yan <[email protected]>

  • Added the SinkModel class for conditional routing on Sinks (#1681)

    David Venable - Wed, 7 Sep 2022 10:10:41 -0500

    Added the SinkModel class which allows applying conditional routes on sinks without allowing them on other plugin types. Signed-off-by: David Venable <[email protected]>

  • Added peer forwarder http server (#1705)

    Asif Sohail Mohammed - Tue, 6 Sep 2022 12:48:35 -0500

    efs/remotes/oeyh/main

  • Run OpenSearch sink integration tests only when the plugin changes (#1706)

    David Venable - Tue, 6 Sep 2022 11:17:32 -0500

    Configured the OpenSearch integration tests to run only when the OpenSearch sink plugin is actually changed or the root Gradle project changes. Signed-off-by: David Venable <[email protected]>

  • Acm private key password is nullable (#1719)

    Asif Sohail Mohammed - Tue, 6 Sep 2022 10:02:45 -0500

    Signed-off-by: Asif Sohail Mohammed <[email protected]> Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Update the e2e test to the org.opensearch package name. Partially resolves #344 (#1703)

    David Venable - Fri, 2 Sep 2022 14:32:55 -0500

    Signed-off-by: David Venable <[email protected]>

  • Maintenance: remove support for non event data model (#1689)

    Qi Chen - Fri, 2 Sep 2022 09:33:03 -0500

    • MAINT: remove support for OTLP data transport Signed-off-by: Qi Chen <[email protected]>

  • Fix: CVE-2020-36518, CVE-2022-24823 (#1704)

    Asif Sohail Mohammed - Thu, 1 Sep 2022 10:58:09 -0500

    Signed-off-by: Asif Sohail Mohammed <[email protected]> Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Added custom exceptions and code refactoring (#1698)

    Asif Sohail Mohammed - Wed, 31 Aug 2022 15:13:48 -0500

    • Added custom exceptions and code refactoring Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Health check auth bug (#1695)

    David Powers - Wed, 31 Aug 2022 14:21:58 -0500

    • Add more robust username/password check in order to allow auth-free health checks Signed-off-by: David Powers <[email protected]>

  • Allow specific HTTP methods for core API endpoints (#1697)

    Hai Yan - Wed, 31 Aug 2022 13:27:00 -0500

    Allows only specific HTTP methods on core API endpoints; Updates docs and unit tests Signed-off-by: Hai Yan <[email protected]>

  • #1513: Updating antlr versions. (#1700)

    Jeff Zemerick - Wed, 31 Aug 2022 11:42:31 -0500

    Signed-off-by: jzonthemtn <[email protected]>

  • Remove deprecated configurations for OpenSearch sink (#1690)

    Hai Yan - Mon, 29 Aug 2022 09:23:40 -0500

    • Remove deprecated raw and service_map flags from index config
    • Update unit tests, integration tests, and README.md for OpenSearchSink Signed-off-by: Hai Yan <[email protected]>

  • Added Peer Forwarder Client (#1677)

    Asif Sohail Mohammed - Fri, 26 Aug 2022 17:08:36 -0500

  • Add CSV Codec to S3 Source IT & add CSV Processor Integration Tests (#1683)

    Finn - Fri, 26 Aug 2022 15:11:58 -0500

    • Added CSV Codec to S3 Source integration tests & added CSV Processor integration tests Signed-off-by: Finn Roblin <[email protected]>

  • ParseJsonProcessor initial implementation (#1688)

    Finn - Fri, 26 Aug 2022 10:51:49 -0500

    • Initial implementation of parse_json processor Signed-off-by: Finn Roblin <[email protected]>

  • Go back to using bash in the bin/data-prepper, it is a bash script and does not work on all machines using 'sh'. Update the tarball smoke tests to work with the new directory structure. Additionally, changed the tarball smoke tests to create their own image rather than overwriting the normal Data Prepper image. (#1694)

    David Venable - Fri, 26 Aug 2022 10:25:52 -0500

    Signed-off-by: David Venable <[email protected]>

  • Added CsvInvalidEvents metric to CSV Processor (#1684)

    Finn - Fri, 26 Aug 2022 10:18:32 -0500

    • Added CsvInvalidEvent metric to CSV Processor Signed-off-by: Finn Roblin <[email protected]>

  • Updated spring boot version in examples package (#1691)

    Asif Sohail Mohammed - Thu, 25 Aug 2022 10:03:44 -0500

    Signed-off-by: Asif Sohail Mohammed <[email protected]> Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Refactored the PipelineParser and PipelineConfiguration to use the PipelineDataFlowModel for deserializing the pipeline YAML. This makes the deserialization consistent with serialization. It is also necessary for the upcoming conditional routing on sinks work. (#1680)

    David Venable - Tue, 23 Aug 2022 13:46:15 -0500

    Signed-off-by: David Venable <[email protected]>

  • Update Prepper plugins to use Processor (#1686)

    Hai Yan - Tue, 23 Aug 2022 09:51:20 -0500

    • Update prepper to processor for StringPrepper
    • Update prepper to processor for GrokPrepper
    • Update prepper to processor for OTelTraceGroupPrepper
    • Update prepper to processor for OTelTraceRawPrepper
    • Update prepper to processor for NoOpPrepper
    • Update prepper to processor in readme files Signed-off-by: Hai Yan <[email protected]>

  • Created the data-prepper-main project. Updated the tar.gz to pull in all the lib files. Updated the data-prepper script to handle the new installation. Updated end-to-end tests as well. Updated the Data Prepper Docker image to use the Linux distribution including the bin/data-prepper script. (#1682)

    David Venable - Tue, 23 Aug 2022 09:07:23 -0500

    Signed-off-by: David Venable <[email protected]>

  • Added ACM and S3 certificate support for HTTP source (#1678)

    Asif Sohail Mohammed - Mon, 22 Aug 2022 15:24:40 -0500

    Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Some code clean-up to Pipeline and added unit tests to PipelineTests for publishToSinks. (#1674)

    David Venable - Mon, 22 Aug 2022 13:51:12 -0500

    Signed-off-by: David Venable <[email protected]>

  • Added the router to the Data Prepper pipeline model. (#1666)

    David Venable - Thu, 18 Aug 2022 12:51:22 -0500

    Added the router to the Data Prepper pipeline model. Signed-off-by: David Venable <[email protected]>

  • Fixes another incorrect package related to HashRing. (#1676)

    David Venable - Thu, 18 Aug 2022 11:01:31 -0500

    Signed-off-by: David Venable <[email protected]>

  • Fixes an incorrect package related to HashRing. (#1675)

    David Venable - Thu, 18 Aug 2022 10:04:20 -0500

    Signed-off-by: David Venable <[email protected]>

  • Updated the package name to org.opensearch for data-prepper-core. (#1671)

    David Venable - Wed, 17 Aug 2022 18:32:52 -0500

    Updated the package name to org.opensearch for data-prepper-core. Updated the Java main class package name to org.opensearch. Signed-off-by: David Venable <[email protected]>

  • Added certificate provider, peer client pool, hash ring and client factory (#1663)

    Asif Sohail Mohammed - Wed, 17 Aug 2022 10:02:40 -0500

    • Added certificate provider, hash ring, peer client Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Added logstash config conversion for csv processor & added explanatio… (#1659)

    Finn - Wed, 17 Aug 2022 09:55:19 -0500

    • Added logstash config conversion for csv processor & added explanation of boolean to LogstashValueType javadoc Signed-off-by: Finn Roblin <[email protected]>

  • Removes the data-prepper-benchmarks project which is not in use. (#1662)

    David Venable - Mon, 15 Aug 2022 11:13:53 -0500

    Signed-off-by: David Venable <[email protected]>

  • Build with Gradle 7.5.1, the current latest version. (#1667)

    David Venable - Mon, 15 Aug 2022 11:08:32 -0500

    Signed-off-by: David Venable <[email protected]>

  • Health check auth bug (#1625)

    David Powers - Fri, 12 Aug 2022 16:40:57 -0500

    Add auth free health check with a configuration option Signed-off-by: David Powers <[email protected]>

  • Support loading plugins from both org.opensearch.dataprepper and com.amazon.dataprepper to help migrate to the new package name. (#1661)

    David Venable - Fri, 12 Aug 2022 12:26:41 -0500

    Signed-off-by: David Venable <[email protected]>

  • Bump micrometer-bom from 1.9.0 to 1.9.3 (#1646)

    dependabot[bot] - Thu, 11 Aug 2022 20:34:13 -0500

    Bumps micrometer-bom from 1.9.0 to 1.9.3.

    Commits

    updated-dependencies:

    • dependency-name: io.micrometer:micrometer-bom dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump jakarta.validation-api from 3.0.1 to 3.0.2 (#1647)

    dependabot[bot] - Thu, 11 Aug 2022 20:33:22 -0500

    Bumps jakarta.validation-api from 3.0.1 to 3.0.2.

    Commits

    updated-dependencies:

    • dependency-name: jakarta.validation:jakarta.validation-api dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Added javadocs to csv processor & codec, added README to csv processor (#1658)

    Finn - Thu, 11 Aug 2022 16:21:20 -0500

    • Added javadocs to csv processor & codec, added README to csv processor Signed-off-by: Finn Roblin <[email protected]>

    • Addressed David's feedback & rewrote quote_character description Signed-off-by: Finn Roblin <[email protected]> Signed-off-by: Finn Roblin <[email protected]>

  • Created the data-prepper script for the new directory structure (#1655) (#1656)

    David Venable - Thu, 11 Aug 2022 15:14:55 -0500

    Created the data-prepper script from the data-prepper-tar-install script. This now sits in the bin/ directory of the directory structure. Moved the data-prepper-core library to the lib/ directory. Signed-off-by: David Venable <[email protected]>

  • Bump byte-buddy-agent in /data-prepper-plugins/opensearch (#1652)

    dependabot[bot] - Thu, 11 Aug 2022 14:41:50 -0500

    Bumps byte-buddy-agent from 1.12.10 to 1.12.13.

    Commits

    updated-dependencies:

    • dependency-name: net.bytebuddy:byte-buddy-agent dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Removed the deprecated type property on DataPrepperPlugin. Resolves #1657. (#1660)

    David Venable - Thu, 11 Aug 2022 14:33:58 -0500

    Signed-off-by: David Venable <[email protected]> Signed-off-by: David Venable <[email protected]>

  • Bump byte-buddy in /data-prepper-plugins/opensearch (#1552)

    dependabot[bot] - Wed, 10 Aug 2022 17:13:27 -0500

    Bumps byte-buddy from 1.12.10 to 1.12.12.

    Commits

    updated-dependencies:

    • dependency-name: net.bytebuddy:byte-buddy dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump bcpkix-jdk15on in /data-prepper-plugins/otel-metrics-source (#1559)

    dependabot[bot] - Wed, 10 Aug 2022 17:12:51 -0500

    Bumps bcpkix-jdk15on from 1.69 to 1.70.

    Changelog

    updated-dependencies:

    • dependency-name: org.bouncycastle:bcpkix-jdk15on dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump junit-jupiter-engine from 5.8.2 to 5.9.0 (#1649)

    dependabot[bot] - Wed, 10 Aug 2022 17:12:23 -0500

    Bumps junit-jupiter-engine from 5.8.2 to 5.9.0.

    updated-dependencies:

    • dependency-name: org.junit.jupiter:junit-jupiter-engine dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Remove dependency on AWS S3 SDKv1 (#1628)

    Jeff Zemerick - Wed, 10 Aug 2022 16:45:20 -0500

  • Updated pipeline configurations and documentation to prefer the OpenSearch index_type configuration over the trace_analytics_raw and trace_analytics_service_map booleans. The latter two configurations are deprecated and will be removed in 2.0. (#1650)

    David Venable - Wed, 10 Aug 2022 13:10:14 -0500

    Signed-off-by: David Venable <[email protected]> Signed-off-by: David Venable <[email protected]>

  • Implemented CSVCodec for S3 Source, config & unit tests (#1644)

    Finn - Tue, 9 Aug 2022 15:40:28 -0500

    • Implemented CSVCodec for S3 Source, config & unit tests Signed-off-by: Finn Roblin <[email protected]>

    • Addressed Travis's feedback Signed-off-by: Finn Roblin <[email protected]>

    • Addressed David's feedback & fixed NPE if header is null Signed-off-by: Finn Roblin <[email protected]>

    • Renamed all instances of CSVProcessor to CsvProcessor (and offshoots like CsvProcessorConfig) Signed-off-by: Finn Roblin <[email protected]>

  • Added ACM for SLL and Discovery Mode Configurations (#1645)

    Asif Sohail Mohammed - Tue, 9 Aug 2022 15:39:50 -0500

    • Added ACM for SLL and Discovery Mode Configurations Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Enhanced Newline Codec w optional header_destination to add first lin… (#1640)

    Finn - Tue, 9 Aug 2022 15:38:47 -0500

    • Enhanced Newline Codec w optional header_destination to add first line as header to outgoing events Signed-off-by: Finn Roblin <[email protected]>

  • Bump log4j-bom from 2.17.2 to 2.18.0 in /data-prepper-expression (#1637)

    dependabot[bot] - Tue, 9 Aug 2022 13:42:01 -0500

    Bumps log4j-bom from 2.17.2 to 2.18.0.

    updated-dependencies:

    • dependency-name: org.apache.logging.log4j:log4j-bom dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump log4j-bom from 2.17.2 to 2.18.0 in /data-prepper-core (#1634)

    dependabot[bot] - Tue, 9 Aug 2022 13:41:36 -0500

    Bumps log4j-bom from 2.17.2 to 2.18.0.

    updated-dependencies:

    • dependency-name: org.apache.logging.log4j:log4j-bom dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump kotlin-stdlib-common in /data-prepper-plugins/mapdb-prepper-state (#1630)

    dependabot[bot] - Tue, 9 Aug 2022 13:33:19 -0500

    Bumps kotlin-stdlib-common from 1.7.0 to 1.7.10.

    updated-dependencies:

    • dependency-name: org.jetbrains.kotlin:kotlin-stdlib-common dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump kotlin-stdlib-common from 1.7.0 to 1.7.10 (#1635)

    dependabot[bot] - Tue, 9 Aug 2022 13:32:42 -0500

    Bumps kotlin-stdlib-common from 1.7.0 to 1.7.10.

    updated-dependencies:

    • dependency-name: org.jetbrains.kotlin:kotlin-stdlib-common dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump junit-jupiter-api from 5.7.0 to 5.9.0 (#1626)

    dependabot[bot] - Tue, 9 Aug 2022 10:23:23 -0500

    Bumps junit-jupiter-api from 5.7.0 to 5.9.0.

    updated-dependencies:

    • dependency-name: org.junit.jupiter:junit-jupiter-api dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump spring-core from 5.3.21 to 5.3.22 in /data-prepper-core (#1633)

    dependabot[bot] - Tue, 9 Aug 2022 10:22:44 -0500

    Bumps spring-core from 5.3.21 to 5.3.22.

    Commits

    updated-dependencies:

    • dependency-name: org.springframework:spring-core dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump spring-context from 5.3.21 to 5.3.22 in /data-prepper-core (#1631)

    dependabot[bot] - Tue, 9 Aug 2022 10:15:38 -0500

    Bumps spring-context from 5.3.21 to 5.3.22.

    Commits

    updated-dependencies:

    • dependency-name: org.springframework:spring-context dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump spring-context from 5.3.21 to 5.3.22 in /data-prepper-expression (#1638)

    dependabot[bot] - Tue, 9 Aug 2022 10:15:11 -0500

    Bumps spring-context from 5.3.21 to 5.3.22.

    Commits

    updated-dependencies:

    • dependency-name: org.springframework:spring-context dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump spring-core from 5.3.21 to 5.3.22 in /data-prepper-expression (#1639)

    dependabot[bot] - Tue, 9 Aug 2022 10:14:50 -0500

    Bumps spring-core from 5.3.21 to 5.3.22.

    Commits

    updated-dependencies:

    • dependency-name: org.springframework:spring-core dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump spring-test from 5.3.21 to 5.3.22 in /data-prepper-expression (#1636)

    dependabot[bot] - Tue, 9 Aug 2022 10:06:41 -0500

    Bumps spring-test from 5.3.21 to 5.3.22.

    Commits

    updated-dependencies:

    • dependency-name: org.springframework:spring-test dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump spring-test from 5.3.21 to 5.3.22 in /data-prepper-core (#1632)

    dependabot[bot] - Mon, 8 Aug 2022 13:33:46 -0500

    Bumps spring-test from 5.3.21 to 5.3.22.

    Commits

    updated-dependencies:

    • dependency-name: org.springframework:spring-test dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Bump kotlin-stdlib in /data-prepper-plugins/mapdb-prepper-state (#1629)

    dependabot[bot] - Mon, 8 Aug 2022 13:32:28 -0500

    Bumps kotlin-stdlib from 1.7.0 to 1.7.10.

    updated-dependencies:

    • dependency-name: org.jetbrains.kotlin:kotlin-stdlib dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Added buffer for core peer forwarder (#1641)

    Asif Sohail Mohammed - Sun, 7 Aug 2022 22:14:41 -0500

    • Added buffer for core peer forwarder Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Add @JsonProperty to workers and readBatchDelay in PipelineModel (#1642)

    Taylor Gray - Fri, 5 Aug 2022 16:03:33 -0500

    Signed-off-by: Taylor Gray <[email protected]>

  • Implemented CSV Processor w unit tests, added validation that delimit… (#1627)

    Finn - Wed, 3 Aug 2022 10:26:28 -0500

    • Implemented CSV Processor w unit tests, added validation that delimiter and quote char are different Signed-off-by: Finn Roblin <[email protected]>

  • #1457: Adding bulk create option. (#1561)

    Jeff Zemerick - Sat, 30 Jul 2022 11:11:45 -0500

    Signed-off-by: jzonthemtn <[email protected]>

  • Added core peer forwarder config (#1621)

    Asif Sohail Mohammed - Fri, 29 Jul 2022 12:04:55 -0500

    • Added core peer forwarder config Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Created CSVProcessor skeleton & CSVProcessorConfig (#1620)

    Finn - Thu, 28 Jul 2022 13:47:12 -0500

    • Created CSVProcessor skeleton & wrote CSVProcessorConfig Signed-off-by: Finn Roblin <[email protected]>

  • Add buffer PluginModel to PipelineModel, require 1 source and at least 1 sink (#1611)

    Taylor Gray - Wed, 27 Jul 2022 15:37:33 -0500

    • Add buffer PluginModel to PipelineModel, require 1 source and at least 1 sink

    Signed-off-by: Taylor Gray <[email protected]>

  • Updated PipelineParser to create decorator for stateful processors (#1598)

    Asif Sohail Mohammed - Wed, 20 Jul 2022 12:55:44 -0500

    • Updated PipelineParser to create decorator for stateful processors Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Added Core Peer Forwarder decorator and interface (#1592)

    Asif Sohail Mohammed - Mon, 18 Jul 2022 21:07:17 -0500

    • Added Core Peer Forwarder decorator and interface Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Updated integration tests with GZIP compression tests (#1577)

    Asif Sohail Mohammed - Mon, 18 Jul 2022 15:33:50 -0500

    • Updated integration tests with GZIP compression tests Signed-off-by: Asif Sohail Mohammed <[email protected]>

    • Addressed PR feedback Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Wrote unit tests for LogGeneratorSource, updated gradle.build dependencies (#1588)

    Finn - Sat, 16 Jul 2022 12:03:55 -0500

    • Wrote unit tests for LogGeneratorSource, updated dependencies Signed-off-by: Finn Roblin <[email protected]>

  • Updated trace analytics doc URL's (#1583)

    Asif Sohail Mohammed - Wed, 13 Jul 2022 10:06:38 -0500

    Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Remove deprecated PluginFactory classes #1584 (#1585)

    David Venable - Mon, 11 Jul 2022 21:05:04 -0500

    Signed-off-by: David Venable <[email protected]>

  • Bump aws-java-sdk-s3 from 1.12.220 to 1.12.257 (#1586)

    dependabot[bot] - Mon, 11 Jul 2022 13:46:22 -0500

    Bumps aws-java-sdk-s3 from 1.12.220 to 1.12.257.

    updated-dependencies:

    • dependency-name: com.amazonaws:aws-java-sdk-s3 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

  • Create Log Generator Source with common apache log type, move ApacheLogFaker class from e2e-test to log-generator-source (#1548)

    Taylor Gray - Mon, 11 Jul 2022 12:23:04 -0500

    Signed-off-by: graytaylor0 <[email protected]>

  • Added the CHANGELOG for 1.5.1 (#1580)

    David Venable - Fri, 8 Jul 2022 11:44:46 -0500

    Signed-off-by: David Venable <[email protected]>

  • Added release notes for Data Prepper 1.5.1. (#1576)

    David Venable - Fri, 8 Jul 2022 11:09:58 -0500

    Signed-off-by: David Venable <[email protected]>

  • Fix: Updated GZipCompressionEngine to use GzipCompressorInputStream (#1570)

    Asif Sohail Mohammed - Thu, 7 Jul 2022 19:21:02 -0500

    Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Add QueryParameters option to AWS CloudMap-based peer discovery (#1560)

    Chase - Thu, 7 Jul 2022 11:56:10 -0500

    • Implement QueryParameters filter option for AWS CloudMap peer forwarder discovery Signed-off-by: Chase Engelbrecht <[email protected]>

    • Small fixes related to import statements and unit tests. Update README wording to be a bit more specific Signed-off-by: Chase Engelbrecht <[email protected]>

    • Adding some asserts to unit tests Signed-off-by: Chase Engelbrecht <[email protected]>

    • Randomize map generation in AwsCloudMapPeerListProvider and add test case for QueryParameters missing from PluginSetting in AwsCloudMapPeerListProvider_CreateTest Signed-off-by: Chase Engelbrecht <[email protected]>

  • Fix: Added exception handling for S3 processing (#1551)

    Asif Sohail Mohammed - Tue, 5 Jul 2022 11:03:55 -0500

    • Fix: Added exception handling for S3 processing and updated poll delay condition Signed-off-by: Asif Sohail Mohammed <[email protected]>

  • Updated the sample OTel Collector to the current latest version: 0.54.0. (#1545)

    David Venable - Thu, 30 Jun 2022 09:45:01 -0500

    Signed-off-by: David Venable <[email protected]>

  • Enable HTTP Health Check for OTelTraceSource and OTelMetricsSource. (#1547)

    Dinu John - Wed, 29 Jun 2022 11:11:48 -0500

    • Enable HTTP Health Check for OTelTraceSource and OTelMetricsSource.
    • Updated Readme file and added unit test for configurations Signed-off-by: Dinu John <[email protected]>

  • Version bump to 2.0.0-SNAPSHOT on the main branch. (#1534)

    David Venable - Fri, 24 Jun 2022 11:28:06 -0500

    Signed-off-by: David Venable <[email protected]>

  • Fixes a bug in the SqsWorkerIT where an NPE occurs. Updated the README.md to include the new steps. (#1538)

    David Venable - Fri, 24 Jun 2022 11:27:54 -0500

    Signed-off-by: David Venable <[email protected]>

  • Added the auto-generated CHANGELOG for Data Prepper 1.5.0 (#1535)

    David Venable - Thu, 23 Jun 2022 11:12:01 -0500

    Signed-off-by: David Venable <[email protected]>