Acquire and Access Data Using

NoSQL Database
 Course Road Map

Lesson 5: Introduction to the Hadoop

Module 1: Big Data Management System Distributed File System (HDFS)

Lesson 6: Acquire Data using CLI, Fuse-

Module 2: Data Acquisition and Storage DFS, and Flume

Lesson 07: Acquire and Access Data

Module 3: Data Access and Processing
Using NoSQL Database

Module 4: Data Unification and Analysis Lesson 08: Primary Administrative Tasks
for NoSQL Database

Module 5: Using and Managing Oracle

Big Data Appliance

7-2
 Objectives

After completing this lesson, you should be able to:

• Describe NoSQL Database characteristics
• Differentiate NoSQL from RDBMS and HDFS
• Describe NoSQL Database benefits
• Load and remove data in an NoSQL DB
• Retrieve data from an NoSQL DB

7-3
 What is a NoSQL Database?

• Is a key-value database
• Is accessible by using Java APIs
• Stores unstructured or semi-structured data
KVStore
as byte arrays
• NoSQL Database is a nonrelational database

Benefits
• Easy to install and configure
• Highly reliable
• General-purpose database system
• Scalable throughput and predictable latency
• Configurable consistency and durability

7-4
 RDBMS Compared to NoSQL

RDBMS NoSQL

High-value, high-density, complex data Low-value, low-density, simple data

Complex data relationships Very simple relationships

Joins Avoids joins

Schema-centric, structured data Unstructured or semi-structured data

Designed to scale up (not out) Distributed storage and processing

Well-defined standards Standards not yet evolved

Database-centric Application- and developer-centric

High security Minimal or no security

7-5
 RDBMS Compared to NoSQL

7-6
 HDFS Compared to NoSQL

HDFS NoSQL

File system Database

No inherent structure Simple data structure

Batch-oriented Real-time

Processes data to use Delivers a service

Bulk storage Fast access to specific records

Write once, read many Read, write, delete, update

7-7
 Points to Consider Before Choosing NoSQL

When deciding on an applications database technology,

you should analyze:
• The data to be stored
– High volume with low value?
If answer is “yes,” NoSQL is a good choice.
• The application schema
– Dynamic?
If answer is “yes,” NoSQL is a good choice.

7-8
 NoSQL Key-Value Data Model
Each record consists of a key-value pair.

Key Component Value Component

Major keys Minor Keys - Byte Array OR AVRO Schema

{“name" : “User",
name fname lname "namespace" :
"com.company. avro",
"type" : "record“,
"fields":
user/userid subscriptions expiration date [{"name": “userId",
"type": “Integer",
"default": 0}
picture .jpg ]
}

7-9
 Acquiring and Accessing Data in a NoSQL DB

Primary Tasks
• Creating Tables
– Create a table (parent or child)
– Add the table to the KVStore
• Adding or Removing Data
– Use the Table API
– Insert Rows
– Delete Rows
• Reading Data
– Retrieve a single record
– Retrieve multiple records

7 - 10
 Primary (Parent) Table Data Model

Table Name
Primary Key1 Field 1 Field 2 Field 3

Table Name : User

Primary Key “Value”

userId firstName lastName

7 - 11
 Table Data Model: Child Tables

Table Name : User

Primary Key “Value”

userId firstName lastName

Child Table Name: Folder

Primary Key “Value”

UserID Folder Arrival From To Sender CC Subject Msg

Name Date Body

7 - 12
 Creating Tables

7 - 13
 Creating Tables: Two Options

1 2

CLI APIs

7 - 14
 Accessing the CLI

Access the CLI by invoking the runadmin utility or the

kvcli.jar file.
1
java -jar $KVHOME/lib/kvstore.jar runadmin
-port <port number>
-host <host name>

2
java -jar $KVHOME/lib/kvcli.jar
-port <port number>
-host <host name>
-store kvstore

7 - 15
 Executing a DDL Command

7 - 16
 Viewing Table Descriptions

All Tables in KVStore

execute "show tables"
execute "show AS JSON
tables"

Specific Table
execute "describe AS
JSON table <tablename>
[fields]"

7 - 17
 Recommendation: Using Scripts

Use scripts for all database operations:

• This is the recommended approach.
• Prevents accidental errors/typos.
• Consistent store environment through
all cycles of development, testing,
and deployment.
1
java -jar $KVHOME/lib/kvstore.jar runadmin
-port <port number>
-host <host name>
load –file <path to script>

2
kv> load –file <path to script>

7 - 18
 Loading Data Into Tables

7 - 19
 Write Operations: put() Methods

put putIfAbsent putIfPresent putIfVersion

Writes to the table Writes to the table
Writes to the table Writes to the table
irrespective of only if the record
only if the record is only if the record is
whether the record present is same as
not already present already present
is present or not a specified version
Conditional
Definite write Creation Updates
Update

7 - 20
 Writing Rows to Tables: Steps

To write a row into a table, perform the following steps:

1. Obtain TableAPI handle.
2. Construct handle to the table.
3. Create a Row object.
4. Add field values to the row.
5. Write the row to the table.

7 - 21
 Reading Data from Tables

7 - 22
 Read Operations: get() Methods

get multiGet multiGetIterator tableIterator

Retrieves a Retrieves a set Retrieves a set of
Retrieves a set of records
single record of records from records or indexes
from the table in batches
from the table the table from the table
- Atomic non-atomic non-atomic
- - single thread multiple threads

7 - 23
 Removing Data From Tables

7 - 24
 Delete Operations: 3 TableAPIs

delete multiDelete deleteIfVersion

Deletes a single record
Deletes a single record Deletes multiple records from a table if the version
from a table from tables of the record is same as a
specified version

7 - 25
 Summary

After completing this lesson, you learned how to:

• Describe NoSQL Database characteristics
• Differentiate NoSQL from RDBMS and HDFS
• Describe NoSQL Database benefits
• Load and remove data in an Oracle NoSQL DB
• Retrieve data from an NoSQL DB

7 - 26