Skip to content

Commit

Permalink
link to cdarlint/winutils
Browse files Browse the repository at this point in the history
point people at cdarlint/winutils for binaries and call out the fact that we could remove the need for this entirely just to run spark on windows
  • Loading branch information
steveloughran authored Aug 1, 2019
1 parent 19a39b1 commit d4f7151
Showing 1 changed file with 10 additions and 0 deletions.
10 changes: 10 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,16 @@ These are built directly from the same git commit used to create the official AS
and built on a windows VM which is dedicated purely to testing Hadoop/YARN apps on Windows. It is not a day-to-day
used system so is isolated from driveby/email security attacks.

## Status: Go to cdarlint/winutils for current artifacts

I've been too busy with things to work on this for a long time, so I'm grateful for cdarlint to take up this work:
[cdarlint/winutils](https://github.com/cdarlint/winutils).

If you want more current binaries, please go there.

Do note that given some effort it should be possible to avoid the Hadoop `file://` classes (Local and RawLocal) to need the hadoop native
libs except in the special case that you are doing file permissions work. If someone wants to do some effort into cutting the need for
these libs on Windows systems just to run Spark & similar locally, file a JIRA [on Apache](https://issues.apache.org/jira/secure/Dashboard.jspa), then a PR against [apache/hadoop](https://github.com/apache/hadoop). Thanks

## Security: can you trust this release?

Expand Down

0 comments on commit d4f7151

Please sign in to comment.