Course code : CSE3009

Course title : No SQL Data Bases

Module :3
Topic :4

Redis - Key-Value Database

24-02-2023 Dr. S. Gopikrishnan 1

Objectives

This session will give the knowledge about

• Redis introduction and basics
• Redis installation on Windows

24-02-2023 Dr. S. Gopikrishnan 2

What is Redis?

Redis is an open source (BSD licensed), in-memory data structure store,

used as a database, cache and message broker.

It supports data structures such as strings, hashes, lists, sets, sorted sets
with range queries, bitmaps, hyperloglogs, geospatial indexes with radius
queries and streams.

Redis has built-in replication, Lua scripting, LRU eviction, transactions and
different levels of on-disk persistence, and provides high availability via
Redis Sentinel and automatic partitioning with Redis Cluster.

24-02-2023 Dr. S. Gopikrishnan 3

Redis – The Background

Redis is written in ANSI C and works in most POSIX systems like Linux,
*BSD, OS X without external dependencies.

Linux and OS X are the two operating systems where Redis is developed
and tested the most, and we recommend using Linux for deploying.

Redis may work in Solaris-derived systems like SmartOS, but the support is
best effort.

There is no official support for Windows builds.

24-02-2023 Dr. S. Gopikrishnan 4

How Redis works?

In order to achieve its outstanding performance, Redis works with an in-

memory dataset.

Depending on your use case:

• you can persist it either by dumping the dataset to disk every once in a
while, or by appending each command to a log.

• Persistence can be optionally disabled, if you just need a feature-rich,

networked, in-memory cache.

24-02-2023 Dr. S. Gopikrishnan 5

Redis – In memory DB

When we say in-memory key-value store, by that we mean that the key-value
pairs are stored in primary memory(RAM).

So we can say that Redis stored data in RAM in form of key-value pairs. In Redis,
key has to be a string but value can be a string, list, set, sorted set or hash.

These are some example of Redis key-values pairs

name="narayan"
profession=["web", "mobile"]

Here name and profession are keys. And we have their respective values on right.

24-02-2023 Dr. S. Gopikrishnan 6

How Redis works?

24-02-2023 Dr. S. Gopikrishnan 7

Redis Single Instance Architecture

Redis architecture contains two main processes: Redis client and Redis
Server.

24-02-2023 Dr. S. Gopikrishnan 8

Redis Single Instance Architecture

Redis client and server can be in the same computer or in two different
computers.

Redis server is responsible for storing data in memory. It handles all kinds of
management and forms the major part of architecture. Redis client can be
Redis console client or any other programming language’s Redis API.

As we saw that Redis stores everything in primary memory. Primary memory

is volatile and therefore we will loose all stored data once we restart our
Redis server or computer. Therefore we need a way for datastore
persistance.

24-02-2023 Dr. S. Gopikrishnan 9

Redis Persistance

There are three different ways to make Redis persistance: RDB, AOF and
SAVE command.

RDB Mechanism:

RDB makes a copy of all the data in memory and stores them in secondary
storage(permanent storage). This happens in a specified interval. So there
is chance that you will loose data that are set after RDB’s last snapshot.

24-02-2023 Dr. S. Gopikrishnan 10

Redis Persistance

AOF
AOF logs all the write operations received by the server. Therefore everything is
persistance. The problem with using AOF is that it writes to disk for every operation
and it is a expensive task and also size of AOF file is large than RDB file.

SAVE Command
You can force redis server to create a RDB snapshot anytime using the redis
console client SAVE command.

You can use AOF and RDB together to get best persistance result.

24-02-2023 Dr. S. Gopikrishnan 11

Redis Master/Slave

Redis replication is very simple to use and configure master-slave replication that
allows slave Redis servers to be exact copies of master servers.

24-02-2023 Dr. S. Gopikrishnan 12

Redis Master/Slave

When using Master-Slave architecture

• There will be only one Master with multiple slaves for replication.
• All write goes to Master, which creates more load on the master node.
• If the Master goes down, the whole architecture is prone to SPOF
(Single point of failure).
• M-S architecture does not help in scaling when your user base grows.
• So we need a process to Monitor Master in case of failure or shutdown,
that is Sentinel.

24-02-2023 Dr. S. Gopikrishnan 13

Redis Sentinel

Redis Sentinel provides high availability for Redis. In practical terms this means
that using Sentinel you can create a Redis deployment that resists without human
intervention certain kinds of failures.

Redis Sentinel also provides other collateral tasks such as

• Monitoring. Sentinel constantly checks if your master and replica instances are
working as expected.

• Notification. Sentinel can notify the system administrator, or other computer

programs, via an API, that something is wrong with one of the monitored Redis
instances.

24-02-2023 Dr. S. Gopikrishnan 14

Redis Sentinel

• Automatic failover. If a master is not working as expected, Sentinel can

start a failover process where a replica is promoted to master, the other
additional replicas are reconfigured to use the new master, and the
applications using the Redis server are informed about the new address
to use when connecting.

• Configuration provider. Sentinel acts as a source of authority for clients

service discovery: clients connect to Sentinels in order to ask for the
address of the current Redis master responsible for a given service. If a
failover occurs, Sentinels will report the new address.

24-02-2023 Dr. S. Gopikrishnan 15

Redis Sentinel

Initial Setup Failover Handling

24-02-2023 Dr. S. Gopikrishnan 16

Redis Cluster

Redis Cluster is an active-passive cluster implementation that consists of

master and slave nodes.

The cluster uses hash partitioning to split the keyspace into 16,384 key
slots, with each master responsible for a subset of those slots.

Each slave replicates a specific master and can be reassigned to replicate

another master or be elected to a master node as needed.

24-02-2023 Dr. S. Gopikrishnan 17

Ports Communication

Each node in a cluster requires two TCP ports.

One port is used for client connections and communications. This is the port
you would configure into client applications or command-line tools.

The second required port is reserved for node-to-node communication that

occurs in a binary protocol and allows the nodes to discuss configuration
and node availability.

24-02-2023 Dr. S. Gopikrishnan 18

Redis Cluster

Failover

When a master fails or is found to be unreachable by the majority of the

cluster as determined by the nodes communication via the gossip port, the
remaining masters hold a vote and elect one of the failing masters’ slaves to
take its place.

Rejoining The Cluster

When the failing master eventually rejoins the cluster, it will join as a slave
and begin to replicate another master.

24-02-2023 Dr. S. Gopikrishnan 19

Sharding

Redis sharded data automatically into the servers.

Redis has a concept of the hash slot in order to split data. All the data are divided
into slots.

There are 16384 slots. These slots are divided by the number of servers.

If there are 3 servers; A, B and C then

• Server 1 contains hash slots from 0 to 5500.
• Server 2 contains hash slots from 5501 to 11000.
• Server 3 contains hash slots from 11001 to 16383.

24-02-2023 Dr. S. Gopikrishnan 20

Sharding with 6 Node M/S Cluster

In a 6 node cluster mode, 3 nodes will

be serving as a master and the 3 nodes
will be their respective slave.

Here, Redis service will be running on

port 6379 on all servers in the cluster.

Each master server is replicating the

keys to its respective Redis slave node
assigned during the cluster creation
process.

24-02-2023 Dr. S. Gopikrishnan 21

Sharding with 3 Node M/S Cluster

In a 3 node cluster mode, there will be

2 redis services running on each server
on different ports.

All 3 nodes will be serving as a master

with redis slave on cross nodes.

Here, two redis services will be running

on each server on two different ports
and each master is replicating the keys
to its respective redis slave running on
other nodes.

24-02-2023 Dr. S. Gopikrishnan 22

WHAT IF Redis Goes Down

1 node goes down in a 6 node

Redis Cluster

If one of the nodes goes down in the

Redis 6-node cluster setup, its
respective slave will be promoted as
the master.

In the above example, master

Server3 goes down and its slave
Server6 is promoted as the master.

24-02-2023 Dr. S. Gopikrishnan 23

WHAT IF Redis Goes Down

1 node goes down in a 3 node Redis

Cluster

If one of the nodes goes down in the

Redis 3-node cluster setup, its
respective slave running on the
separate node will be promoted to
master.

In the above example, Server 3 goes

down and slave running on Server1 is
promoted to master.

24-02-2023 Dr. S. Gopikrishnan 24

WHAT IF Redis Goes Down

If Redis service goes down on one of the nodes in Redis 3-node cluster
setup, its respective slave will be promoted as the master.

24-02-2023 Dr. S. Gopikrishnan 25

Redis over DBMS

Database Management systems store everything in second storage which

makes read and write operations very slow. But Redis stores everything in
primary memory which is very fast in read and write of data.

Primary memory is limited(much lesser size and expensive than secondary)

therefore Redis cannot store large files or binary data. It can only store
those small textual information which needs to be accessed, modified and
inserted at a very fast rate. If we try to write more data than available
memory then we will receive errors.

24-02-2023 Dr. S. Gopikrishnan 26

Redis – Programming Support

You can use Redis from

24-02-2023 Dr. S. Gopikrishnan 27

Clients of Redis

• Twitter
• GitHub
• Weibo
• Pinterest
• Snapchat
• StackOverflow
• Flickr
• Digg

24-02-2023 Dr. S. Gopikrishnan 28

Redis installation

• Linux (Any distro)

• Follow the steps in : https://redis.io/topics/quickstart

• For online DB: http://try.redis.io/

24-02-2023 Dr. S. Gopikrishnan 29

Redis installation in Windows

• Download Redis from: https://github.com/dmajkic/redis/downloads

• Unzip the folder
• Start Redis server (Do not close the terminal)
• Start Redis client

24-02-2023 Dr. S. Gopikrishnan 30

Summary

This session will give the knowledge about

• Redis introduction and basics
• Redis installation on Windows
• Reference: https://redis.io/documentation
• Reference: Redis for Dummies

24-02-2023 Dr. S. Gopikrishnan 31