Scribd
Upload
29 views11 pages

4.step1 AccessingAndRetrievingData Altintas

The document discusses techniques and technologies for acquiring data from various sources, including traditional databases accessed with SQL, text files accessed with scripting languages, and remote data accessed through web services, web sockets, and REST. It provides an example of acquiring historical weather data from SQL, current weather from web sockets, and real-time tweets from fires using REST.

Uploaded by

Vinodshankar Bhat
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
29 views11 pages

4.step1 AccessingAndRetrievingData Altintas

The document discusses techniques and technologies for acquiring data from various sources, including traditional databases accessed with SQL, text files accessed with scripting languages, and remote data accessed through web services, web sockets, and REST. It provides an example of acquiring historical weather data from SQL, current weather from web sockets, and real-time tweets from fires using REST.

Uploaded by

Vinodshankar Bhat
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 11

Step 1:

Acquiring Data
After this video you will be able to..
• List techniques and technologies to access
and retrieve the data you need
• Describe an example scenario that
accesses data from a variety of sources
using different technologies
Big Data Engineering Computational Big Data Science
ACQUIRE PREPARE ANALYZE REPORT ACT
Where’s the data?

Identify suitable data

Acquire all available data


Data comes from many places…

…with many ways to access it


Traditional databases

SQL and query browsers


Text files

Scripting languages
Remote data
SOAP
REST
WebSocket

Web Services
NoSQL storage

API WebServices
Acquiring Data From WIFIRE

Historical weather SQL

Current weather
WebSocket

Real-time tweets
near fires REST
Traditional databases Remote data

SQL and query browsers Web Services

Text files NoSQL storage


Scripting languages Web Services
Programming Interfaces

You might also like