Data Mining
using
JavaScript
An Overview
• Brief History
Chronicles of • Standards and Framework Wars
the JS Empire • The Arrival of NodeJS and Package
Managers
Industrial • Tools and Methods for collecting data
• Application of DM Algos to mine data
Application of • NPM Alternatives for Python
Data Mining Packages
Console.log("Know your JavaScript");
• Inspired from Flickr file uploader.
• It combines Chrome's V8 Engine, Event
Loop and Low-level I/O API
A Short Story of JavaScript Mocha
vs
Brenden Eich
Three Ages of JavaScript Kingdom
What is ECMAScript/ES
• ECMA (European Computer
Manufacturers Association)
• ECMAScript is the name of the
International standard that defines
JavaScript.
ECMAScript Timeline
ES2017/ES8 is coming!!
Arrival
of
NodeJS
A Brief Intro
• Inspired from Flickr file uploader.
• It combines Chrome's V8 Engine, Event
Loop and Low-level I/O API
• It is Opensource.
• Single-thread application.
Ryan Dahl
Pros and Cons of NodeJS
Asynchronous event-driver Large Nested callbacks can
IO support concurrent lead to spaghetti code.
handling. No Multi-threading support.
Both Server and Client use Not compliant with high-
JavaScript hence ease of computational tasks.
development.
It is consistent.(API's code
Pack Managers for easy change for each version.)
installation and maintenance.
Large Open-source
Community backing.
Frameworks
WH's of Framework
• WHAT - A set of functionalities that provides solution to a particular
problem.
• WHY - To save effort and time. To ensure guidelines are met.
• WHEN – To make a solution reusable and efficient.
• WHERE – Problems that have solutions.
Advantages of Using JS Framework
• Efficiency — projects that used to take months and hundreds of
lines of code now can be achieved much faster with well-
structured prebuilt patterns and functions.
• Safety — top JavaScript frameworks have firm security
arrangements and are supported by large communities where
members and users also act as testers.
• Cost — most frameworks are open source and free. Since they
help programmers to build custom solutions faster, the ultimate
price for web app will be lower.
A Game of thrones: Framework wars
• Angular2
• React
• Vue.js
• Meteor
House Angular2
o Model-View-Whatever Pattern.
Dependency Injection
Opinionation: Flexible
Data Binding: Two-way
Fast Rendering: Static Lists.
Painful Third-party Integration
Performance concerns because of DOM Elements.
Many Interactive Elements makes the page slow.
House React
o Model-View Pattern
Virtual DOM
Opinionation: Less Opinionated making Development Flexible.
Data Binding: One-way
Good Code Reuse
JSX
Debugging is easy.
It is not a full-framework, It’s a library.
Flux architectures are a different paradigm that what developers are used to.
House Vue.js
Virtual DOM
Fast Routing
Two-way Binding
Server-side Rendering
Good for SPAs.
Performance is put forth ahead of Code Organization or App
Structure.
House Meteor JS
Database – UI Synchronization
Features for Front-end, Back-end, Database and Business Logic.
Used by IKEA, Honeywell, Mazda and Many others.
Useful for good Starter.
Mobile + Web Development.
No other DB support except MongoDB.
Budding Framework.
http://todomvc.com/
Industrial Usage of Data Mining
Web Scrapping
• Process of Programmatically retrieving information from the
Internet.
Promise
• The Promise object represents the eventual completion (or failure) of
an asynchronous operation, and its resulting value.
Request
• While Node.js does provide simple methods of downloading data
from the Internet via HTTP and HTTPS interfaces, you have to handle
them separately, to say nothing of redirects and other issues that
appear when you start working with web scraping.
npm install request
Cheerio
• A fast, flexible and lean implementation of jQuery designed
specifically for the server.
• It enables us to focus on the data we download directly, rather
than on parsing it.
npm install cheerio
A Small Bot to mine Weather
var request = require("request"),
cheerio = require("cheerio"),
url = "http://www.wunderground.com/cgi-bin/findweather/getForecast?&query=" + 02888;
request(url, function (error, response, body) {
if (!error) {
var $ = cheerio.load(body),
temperature = $("[data-variable='temperature'] .wx-value").html();
console.log("It’s " + temperature + " degrees Fahrenheit.");
} else {
console.log("We’ve encountered an error: " + error);
}
});
WHAT IF I TOLD YOU WE HAVE
PYTHON EQUIVALENT PACKAGE IN
NODE.JS
https://github.com/NaturalNode/natural
Overall Summary
