Skip to content

Commit

Permalink
Update to Storm 2.7.1
Browse files Browse the repository at this point in the history
  • Loading branch information
rzo1 committed Nov 29, 2024
1 parent 94bfadc commit df545b4
Show file tree
Hide file tree
Showing 8 changed files with 50 additions and 56 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ Apache StormCrawler (Incubating) is an open source collection of resources for b

## Quickstart

NOTE: These instructions assume that you have [Apache Maven](https://maven.apache.org/install.html) installed. You will need to install [Apache Storm 2.7.0](http://storm.apache.org/) to run the crawler.
NOTE: These instructions assume that you have [Apache Maven](https://maven.apache.org/install.html) installed. You will need to install [Apache Storm 2.7.1](http://storm.apache.org/) to run the crawler.

StormCrawler requires Java 11 or above. To execute tests, it requires you to have a locally installed and working Docker environment.

Expand Down
80 changes: 40 additions & 40 deletions THIRD-PARTY.txt

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion archetype/src/main/resources/archetype-resources/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ under the License.
<properties>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<stormcrawler.version>${project.version}</stormcrawler.version>
<storm.version>2.7.0</storm.version>
<storm.version>2.7.1</storm.version>
</properties>

<build>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ under the License.
<properties>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<stormcrawler.version>${StormCrawlerVersion}</stormcrawler.version>
<storm.version>2.7.0</storm.version>
<storm.version>2.7.1</storm.version>
</properties>

<build>
Expand Down
2 changes: 1 addition & 1 deletion external/solr/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ You'll be asked to enter a groupId (e.g. com.mycompany.crawler), an artefactId (

This will not only create a fully formed project containing a POM with the dependency above but also a set of resources, configuration files and sample topology classes. Enter the directory you just created (should be the same as the artefactId you specified earlier) and follow the instructions on the README file.

You will of course need to have both Apache Storm (2.7.0) and Apache Solr (9.7.0) installed.
You will of course need to have both Apache Storm (2.7.1) and Apache Solr (9.7.0) installed.

Official references:
* [Apache Storm: Setting Up a Development Environment](https://storm.apache.org/releases/current/Setting-up-development-environment.html)
Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
This has been generated by the StormCrawler Maven Archetype as a starting point for building your own crawler with [Apache Solr](https://solr.apache.org/) as a backend.
Have a look at the code and resources and modify them to your heart's content.

You need to have Apache Storm (2.7.0) installed, as well as a running instance of Apache Solr (9.7.0).
You need to have Apache Storm (2.7.1) installed, as well as a running instance of Apache Solr (9.7.0).

## Generated resources

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ under the License.
<properties>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<stormcrawler.version>${StormCrawlerVersion}</stormcrawler.version>
<storm.version>2.7.0</storm.version>
<storm.version>2.7.1</storm.version>
</properties>

<build>
Expand Down
14 changes: 4 additions & 10 deletions pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -65,13 +65,13 @@ under the License.
<additionalparam>-Xdoclint:none</additionalparam>
<!-- dependency versions -->
<junit.version>5.11.3</junit.version>
<storm-client.version>2.7.0</storm-client.version>
<jackson.version>2.17.2</jackson.version>
<storm-client.version>2.7.1</storm-client.version>
<jackson.version>2.18.1</jackson.version>
<tika.version>3.0.0</tika.version>
<mockito.version>5.14.2</mockito.version>
<jetbrains.annotations.version>26.0.1</jetbrains.annotations.version>
<log4j2.version>2.23.0</log4j2.version>
<commons.io.version>2.14.0</commons.io.version>
<log4j2.version>2.24.1</log4j2.version>
<commons.io.version>2.17.0</commons.io.version>
<git-code-format-maven-plugin.version>5.3</git-code-format-maven-plugin.version>
<testcontainers.version>1.20.3</testcontainers.version>
<maven.mojo.license.plugin>2.4.0</maven.mojo.license.plugin>
Expand Down Expand Up @@ -413,12 +413,6 @@ under the License.
<bannedDependencies>
<excludes>
<exclude>org.apache.logging.log4j:log4j-core:(,2.17.0)</exclude>
<!--
https://github.com/apache/logging-log4j2/issues/3143
https://github.com/apache/logging-log4j2/issues/3196
-->
<exclude>org.apache.logging.log4j:log4j-core:[2.24.1]</exclude>
<exclude>org.apache.logging.log4j:log4j-api:[2.24.1]</exclude>
</excludes>
</bannedDependencies>
</rules>
Expand Down

0 comments on commit df545b4

Please sign in to comment.