Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ci for publish site #1

Closed
wants to merge 317 commits into from
Closed

Ci for publish site #1

wants to merge 317 commits into from

Conversation

pchmielnik
Copy link

Description

Describe what this change achieves.

Issues Resolved

List any issues this PR will resolve, e.g. Closes [...].

Checklist

  • By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and subject to the Developers Certificate of Origin.
    For more information on following Developer Certificate of Origin and signing off your commits, please check here.

kolchfa-aws and others added 30 commits November 14, 2023 18:34
)

* [Doc] new param in rollover action — copy_alias

Signed-off-by: bowenlan-amzn <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
* [Doc] explain ism_template.priority

Signed-off-by: bowenlan-amzn <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
…-project#5398)

* Add new processor documentation

Signed-off-by: Melissa Vagi <[email protected]>
---------

Signed-off-by: Melissa Vagi <[email protected]>
Co-authored-by: Heemin Kim <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
* Change name of normalization processor in text

Signed-off-by: Fanit Kolchina <[email protected]>

* Fix link

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
…->rag-pipeline (opensearch-project#5614)

* Update conversational-search.md

Signed-off-by: Kalyan <[email protected]>

* Update conversational-search.md

Signed-off-by: Kalyan <[email protected]>

* fix connector create  json

Signed-off-by: kalyanr <[email protected]>

---------

Signed-off-by: Kalyan <[email protected]>
Signed-off-by: kalyanr <[email protected]>
* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 os.yml config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 os.yml config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 os.yml config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 os.yml config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 os.yml config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 os.yml config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* fix#214 config file settings

Signed-off-by: cwillum <[email protected]>

* Refactor settings documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Add more settings

Signed-off-by: Fanit Kolchina <[email protected]>

* remove bad commits (opensearch-project#5505)

Signed-off-by: Stephen Crawford <[email protected]>

* Format security settings

Signed-off-by: Fanit Kolchina <[email protected]>

* Add plugin settings and dashboards settings

Signed-off-by: Fanit Kolchina <[email protected]>

* Specify json code highlighter

Signed-off-by: Fanit Kolchina <[email protected]>

* Add gateway and network settings

Signed-off-by: Fanit Kolchina <[email protected]>

* Change heading level

Signed-off-by: Fanit Kolchina <[email protected]>

* Heading text change

Signed-off-by: Fanit Kolchina <[email protected]>

* Fix link

Signed-off-by: Fanit Kolchina <[email protected]>

* Add Notifications plugin settings

Signed-off-by: Fanit Kolchina <[email protected]>

* Implemented tech review comments for search settings

Signed-off-by: Fanit Kolchina <[email protected]>

* Rename directory and implement latest search setting review comment

Signed-off-by: Fanit Kolchina <[email protected]>

* Remove non-existent ml circuit breaker settings

Signed-off-by: Fanit Kolchina <[email protected]>

* Add file system and s3 settings

Signed-off-by: Fanit Kolchina <[email protected]>

* Update nav order

Signed-off-by: Fanit Kolchina <[email protected]>

* Add security analytics settings and specify static/dynamic for security settings

Signed-off-by: Fanit Kolchina <[email protected]>

* Reword correlation time window

Signed-off-by: Fanit Kolchina <[email protected]>

* Implemented tech review comments for network and discovery settings

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Implemented editorial comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Clarify security settings

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update _install-and-configure/configuring-opensearch/security-settings.md

Signed-off-by: kolchfa-aws <[email protected]>

* Add cross links to static and dynamic settings

Signed-off-by: Fanit Kolchina <[email protected]>

* Fix link

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: cwillum <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
Co-authored-by: Stephen Crawford <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
* Refactor ML section - local and remote models

Signed-off-by: Fanit Kolchina <[email protected]>

* Added command to calculate checksum

Signed-off-by: Fanit Kolchina <[email protected]>

* Add ONNX format to register API

Signed-off-by: Fanit Kolchina <[email protected]>

* Add sparse encoding predict example

Signed-off-by: Fanit Kolchina <[email protected]>

* Add API section

Signed-off-by: Fanit Kolchina <[email protected]>

* Refactor the API section

Signed-off-by: Fanit Kolchina <[email protected]>

* Typo

Signed-off-by: Fanit Kolchina <[email protected]>

* Implemented Vale comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Add get connector API

Signed-off-by: Fanit Kolchina <[email protected]>

* Reword heading

Signed-off-by: Fanit Kolchina <[email protected]>

* Addressed tech review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
…#5288)

* Add codec and processor combinations to S3 source.

Signed-off-by: Naarcha-AWS <[email protected]>

* Update s3.md

Signed-off-by: Naarcha-AWS <[email protected]>

* Make codec-processor combinations its own file

Signed-off-by: Naarcha-AWS <[email protected]>

* Make Data Prepper codec page

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix links

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix links

Signed-off-by: Naarcha-AWS <[email protected]>

* Reformat article without tables.

Signed-off-by: Naarcha-AWS <[email protected]>

* fix link

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/common-use-cases/codec-processor-combinations.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update codec-processor-combinations.md

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Naarcha-AWS <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
* readd auth token doc

Signed-off-by: Stephen Crawford <[email protected]>

* Fix vale

Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Signed-off-by: Stephen Crawford <[email protected]>

* Apply suggestions from code review

Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Signed-off-by: Stephen Crawford <[email protected]>

* Apply suggestions from code review

Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Signed-off-by: Stephen Crawford <[email protected]>

* Fix embedded command

Signed-off-by: Stephen Crawford <[email protected]>

* Blank lines after headings

Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* change

Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

* Style guidelines

Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/access-control/authentication-tokens.md

Signed-off-by: Stephen Crawford <[email protected]>

* Apply suggestions from code review

Signed-off-by: Stephen Crawford <[email protected]>

* update cert guidelines

Signed-off-by: Stephen Crawford <[email protected]>

* remove line

Signed-off-by: Stephen Crawford <[email protected]>

* Update _security/configuration/generate-certificates.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>

---------

Signed-off-by: Stephen Crawford <[email protected]>
Signed-off-by: Stephen Crawford <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
* Including info on OpenID Additional Parameters

Signed-off-by: Sam <[email protected]>

* Update _security/authentication-backends/openid-connect.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Sam <[email protected]>

* Update _security/authentication-backends/openid-connect.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Sam <[email protected]>

* PR feedback changes

Signed-off-by: Sam <[email protected]>

---------

Signed-off-by: Sam <[email protected]>
Signed-off-by: Sam <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
* Add Telemetry devices documentation

Signed-off-by: Naarcha-AWS <[email protected]>

* Add additional telemetry changes.

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix formatting. Update typos

Signed-off-by: Naarcha-AWS <[email protected]>

* Add Segment count

Signed-off-by: Naarcha-AWS <[email protected]>

* Add additional feedback

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix links. Reference order

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Naarcha-AWS <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
replace localhost with dynamic site url (`{{site.url}}`)

Signed-off-by: mirgj <[email protected]>
* Add responses to connector APIs

Signed-off-by: Fanit Kolchina <[email protected]>

* Fix heading levels

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
…ch-project#5665)

* Adds documentation for Data Prepper's s3 source visibility_duplication_protection configuration. Includes the necessary permissions.

Signed-off-by: David Venable <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/s3.md

Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/s3.md

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: David Venable <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
* Add 2.11.1 to version history

Signed-off-by: Fanit Kolchina <[email protected]>

* Wording change

Signed-off-by: Fanit Kolchina <[email protected]>

* Add another sentence

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
…ject#5663)

* Add Serverless configuration options for Data Prepper

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Implement additional technical feedback

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix options

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/sinks/opensearch.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Naarcha-AWS <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Fix typo.

Signed-off-by: Thibaut LaBarre <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
* fix java client sample error.

* Revert "fix java client sample error."

* fix java sample error.

Signed-off-by: weinan_gao <[email protected]>

---------

Signed-off-by: weinan_gao <[email protected]>
Co-authored-by: weinan_gao <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
@pchmielnik pchmielnik marked this pull request as draft February 15, 2024 14:10
@salyh
Copy link
Member

salyh commented Feb 15, 2024

@pchmielnik please point the PR to the 2.11.x-ee branch (and later we will also build 1.3.x-ee)

@salyh
Copy link
Member

salyh commented Feb 19, 2024

Maybe rsync would be faster?

@pchmielnik pchmielnik changed the base branch from main to 2.11.x-ee February 19, 2024 13:46
@pchmielnik
Copy link
Author

Maybe rsync would be faster?
@salyh
I need to check this, SFTP was chosen for security reasons as it is configured in such a way as to not expose a shell but only a minimal setup for file transfer.

@salyh
Copy link
Member

salyh commented Feb 19, 2024

Maybe rsync would be faster?
@salyh
I need to check this, SFTP was chosen for security reasons as it is configured in such a way as to not expose a shell but only a minimal setup for file transfer.

+1

@pchmielnik
Copy link
Author

Maybe rsync would be faster?
@salyh
I need to check this, SFTP was chosen for security reasons as it is configured in such a way as to not expose a shell but only a minimal setup for file transfer.

+1

The workflow has been adapted to use lftp with 20 parallel connections, now the upload takes ~2 min instead of 15 min

@pchmielnik
Copy link
Author

closed in favour of #2

@pchmielnik pchmielnik closed this Feb 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.