Module10 BigData PDF

This document provides an overview of Module 10 on Big Data which includes introductions and walkthroughs for Elastic MapReduce, Amazon Machine Learning, and Amazon Elasticsearch. It also includes reviews, assignments, and sample data for Elasticsearch including documents and searches.

Uploaded by

srinubasani

Available Formats

Download as PDF, TXT or read online on Scribd

0% found this document useful (0 votes)

91 views

Module10 BigData PDF

Uploaded by

srinubasani

Available Formats

Download as PDF, TXT or read online on Scribd

You are on page 1/ 4

Module 10 Big Data

Introduction
Walkthroughs
Elastic Map Reduce: Analyze CloudFront logs
Amazon Machine Learning: Banking
Amazon Elasticsearch: Index and search a movie database
Review
Assignments
Elasticsearch data samples
Documents
Search

Introduction

EMR:
https://aws.amazon.com/elasticmapreduce/
Amazon Machine Learning: https://aws.amazon.com/machinelearning/
Amazon Elasticsearch:
https://aws.amazon.com/elasticsearchservice/

Walkthroughs

Elastic Map Reduce: Analyze CloudFront logs
http://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/emrgetstarted.html

Amazon Machine Learning: Banking
Banking example available on Web Console

Amazon Elasticsearch: Index and search a movie database
http://docs.aws.amazon.com/elasticsearchservice/latest/developerguide/esgsg.html

Review
● Use cases or applications for EMR, Elasticsearch, and ML in your domain/area of
expertise

Assignments

EMR: LogAnalyzer for CloudFront
http://aws.amazon.com/articles/ElasticMapReduce/2440

EMR: Contextual advertising
https://aws.amazon.com/articles/ElasticMapReduce/2855

EMR: Finding trending topics
https://aws.amazon.com/articles/ElasticMapReduce/5249664154115844

Machine learning: Predict responses to a marketing offer
http://docs.aws.amazon.com/machinelearning/latest/dg/tutorial.html

Elastic Search: Create a search service for Comics/Superhero data
https://github.com/royrusso/elasticsearchsampleindex

Elasticsearch data samples

Documents

curl XPUT
" /movies/movie/1" d'
searchmoviese5sp3vcoy4pyv5svfdmovah65a.useast1.es.amazonaws.com
{
    "title": "The Godfather",
    "director": "Francis Ford Coppola",
    "year": 1972,
    "genres": ["Crime", "Drama"]
}'

curl XPUT
" /movies/movie/2" d'
searchmoviese5sp3vcoy4pyv5svfdmovah65a.useast1.es.amazonaws.com
{
    "title": "Lawrence of Arabia",
    "director": "David Lean",
    "year": 1962,
    "genres": ["Adventure", "Biography", "Drama"]
}'

curl XPUT
" /movies/movie/3" d'
searchmoviese5sp3vcoy4pyv5svfdmovah65a.useast1.es.amazonaws.com
{
    "title": "To Kill a Mockingbird",
    "director": "Robert Mulligan",
    "year": 1962,
    "genres": ["Crime", "Drama", "Mystery"]
}'

curl XPUT
" /movies/movie/4" d'
searchmoviese5sp3vcoy4pyv5svfdmovah65a.useast1.es.amazonaws.com
{
    "title": "Apocalypse Now",
    "director": "Francis Ford Coppola",
    "year": 1979,
    "genres": ["Drama", "War"]
}'

curl XPUT
"searchmoviese5sp3vcoy4pyv5svfdmovah65a.useast1.es.amazonaws.com /movies/movie/5" d'
{
    "title": "Kill Bill: Vol. 1",
    "director": "Quentin Tarantino",
    "year": 2003,
    "genres": ["Action", "Crime", "Thriller"]
}'

curl XPUT
"searchmoviese5sp3vcoy4pyv5svfdmovah65a.useast1.es.amazonaws.com /movies/movie/6" d'
{
    "title": "The Assassination of Jesse James by the Coward Robert Ford",
    "director": "Andrew Dominik",
    "year": 2007,
    "genres": ["Biography", "Crime", "Drama"]
}'

Search

curl XGET
' /movies/_search?q
searchmoviese5sp3vcoy4pyv5svfdmovah65a.useast1.es.amazonaws.com
=*'

curl XGET
' /movies/_search?q
searchmoviese5sp3vcoy4pyv5svfdmovah65a.useast1.es.amazonaws.com
=andrew'