Netflix Clone

• Checkout branch "React-View" for frontend only Netflix Clone with React Redux

Quick Links

Demo

• Live Site Demo
• Video Demo

Tech Stack

Implementation Hightlights

• User Stories
• Current Plans for Expansion
• Future Plans for Expansion

Getting Started

• Prerequisites

  • Tools & Versions

• Building Data Pipeline

  • Data Fetcher

• Serving Application

  • Movie Service
  • User Service
  • Web Server
  • Web Client

Deployment

Author

Acknowledgments

Demo

Live Site Demo

Demo: Link

Video Demo

Tech Stack

• React ∙ Redux
  • web client & client data management
• Node.js ∙ Expressjs ∙ Jayson
  • web server & services in service oriented architecure
• Python ∙ Scrapy
  • web scraper, data pipeline
• ElasticSearch
  • persisted database for movies
• Postgres ∙ Sequelize
  • persisted database for users
• Kibana
  • ElasticSearch analytics data visualization

Implementation Highlights

• single page application web client with React & Redux
• service oriented architecure backend
• REST for client server communication, JSON RPC for inter service communication
• scrape raw movie data from imdb
• provides processed imdb movies data with our movie service API
• persisted ElasticSearch for movie's database for optimized searching capability
• PostgreSQL for user's database

User Stories

• users can register and log in to their account
• landing page has collections of movie for recommendations
• users can search for movies
• users can browse search result by pages
• users can select and view details of a movie
• users can see his/her history of browsed movie
• users can add or remove movie to his/her bookmark

Current Plans for Expansion

• containerize services and database with Docker

Future Plans for Expansion

• seperate search into its own service that utilize ElasticSearch, use MongoDB as persisted database for movie-service and sync data between ElasticSearch and MongoDB
• Machine Learning recommendation system?
• Machine Learning classification for recommended movie collections?
• scrape and stream videos for movies?

Getting Started

Prerequisites

!important .env file is required for setting up environment variables for this project
an example of .env file is located at root directory

Tools & Versions

Building Data Pipeline

Data Fetcher

• install dependencies

pip install -r requirements.txt

• start scraper pipeline for fetching raw data from IMDB, process and store to ElasticSearch

cd data-pipeline/imdb_scraper
scrapy crawl "imdb_spider"

Serving Application

Movie Service

• dependent on ElasticSearch as data source

• install dependencies & start Movie-Service

cd movie-service
npm install
npm start

Application will be serving on http://localhost:3230

User Service

• dependent on PostgreSQL as data source

• install dependencies & start User-Service

cd user-service
npm install
npm start

Application will be serving on http://localhost:3130

Web Server

• install dependencies & start Web-Server

cd web-server
npm install
npm start

Application will be serving on http://localhost:3030

Web Client

• install dependencies & start application

cd web-client
npm install
npm start

Application will be serving on http://localhost:3000

Deployment

• Not setup yet

Author

• Yu Chiu

License

This project is licensed under the MIT License - see the LICENSE file for details

Acknowledgments

• Not setup yet