Skip to content

Latest commit

 

History

History
50 lines (36 loc) · 846 Bytes

README.md

File metadata and controls

50 lines (36 loc) · 846 Bytes

Pyspark Recommendation System

This is a graduate project for Distributed Systems.

Tools and Technology used:

  • Python
  • HDFS
  • Docker
  • Pyspark
  • AWS S3 and EC2
  • Flask API

High Level Architecture

---

Instruction

Install Java 8. We will be installing java 8 using the sdkman.

curl -s “https://get.sdkman.io" | bash
source "$HOME/.sdkman/bin/sdkman-init.sh"

Check if the sdkman is installed properly

sdk version

Look for the java 8 version.

sdk list java

Install java 8 from the list

sdk install java 8.0.352-amzn

Authors