TOP LEVEL VIEW OF

COMPUTER
FUNCTION
ABEBE A. FEBRUARY, 2021
INTRODUCTION

Today we will focus on presenting a top-level view of

computer function.
• Main components of computer and their function?
• How are these components organized?
• How do these components communicate with each
other?
INTRODUCTION

• At a top level, a computer consists of:

• Central Processing Unit;
• Memory;
• I/O components.

• The components are interconnected in order to

execute programs.
COMPUTER COMPONENTS

Does anyone know who this person is?

COMPUTER COMPONENTS

• Most computer concepts were developed by John von

Neumann:
• Von Neumann architecture is based on three concepts:
• Ability to write/read data from memory;
• Ability to execute instruction sequentially;
• Ability to process inputs/outputs;
 • Consider the original method for
computation based on digital
circuits:
• Employs a small set of logical gates:
• AND, OR, NOT, NAND, NOR, XOR, XNOR
• Employ some type of memory:
• Flip-flop SR, JK, D
COMPUTER
COMPONENTS
DISADVANTAGE WITH USING DIGITAL
CIRCUITS…
• Rigid design (hardwired program):
• Only works for a specific function...

• What if we need to calculate additional functions?

• Requires generating a new circuit...
• producing new truth tables;
• algebraic simplification;
• circuit design.
• Basically a lot of work...
SOLUTION…

• Suppose that instead of having such an hardwired circuit

we have:
• A module capable of calculating arithmetic/logic
functions:
• Logic functions:
• AND, OR, NOT, NAND, NOR, XOR, XNOR
• Arithmetic functions:
• addition, subtraction, multiplication, division, SHL, SHR,...
 SOLUTION…

• We also need a way to control such a module:

• Hardware will perform various functions on data
depending on control signals applied to the
hardware
• The system accepts data and control signals
and produces results.
• Thus, instead of rewiring the hardware for each
new program, the programmer merely needs to
supply a new set of control signals  General
Purpose computer

How shall the control signals be

supplied?
 ANSWER…

• Program is a sequence of steps;

• At each step, an arithmetic/logical operation is
performed on data;
• Each instruction thus requires its own set of control
signals
• Hardware interprets each instruction and generates
control signals
 COMPUTER COMPONENTS

• An instruction interpreter capable

of generating control signals;
• A general-purpose module for
arithmetic/logic functions.
• These two constitute the CPU
• Is this capability enough to have a
functional computer
 COMPUTER COMPONENTS

• Data and instructions must be provided to the system:

• Input module:
• contains basic components for accepting data and instructions
• Output module:
• contains the means of reporting results.

• Taken together, these are referred to as I/O components.

• Are these two components enough for a functional
computer?
 COMPUTER COMPONENTS

• Data operations may require access to more

than one element:
• there must be a place to store both instructions
and data.
• that module is called main memory
• to distinguish it from external storage
 COMPUTER COMPONENTS

• We have thus the main components of the von

Neumann architecture:
• Memory module
• I/O module
• CPU
We will be having a more detailed look at these
components
COMPUTER
COMPONENTS

A top Level view of

the main computer
components (Source
Stallings)
 COMPUTER COMPONENTS -CPU

• CPU has a set of internal registers :

• Program Counter (PC):
• specifies the memory address of the next instruction
to be executed.
• Instruction Register (IR):
• holds the instruction currently being executed or
decoded.
 COMPUTER COMPONENTS -CPU

• memory address register (MAR):

• specifies memory address to be read/written;
• memory buffer register (MBR):
• contains the data to be written into memory or...
• receives the data read from memory;
 COMPUTER COMPONENTS - CPU

• I/O address register (I/OAR):

• specifies a particular I/O device;
• I/O buffer (I/OBR) register:
• used for the exchange of data between an I/O module
and the CPU;
 COMPUTER COMPONENTS -MEMORY

• Memory module consists of:

• Set of sequentially numbered addresses;
• Each location contains binary information (word);
• Data;
• Or instructions.
 COMPUTER COMPONENTS – I/O

• I/O module responsible for:

• Transfers data from external devices to CPU and
memory;
• and vice versa
• Containing internal buffers for temporarily holding data
how do these components function together to
execute programs?
COMPUTER FUNCTION

• Basic function performed by a computer is

execution of a program:
• Consisting of a set of instructions stored in memory;
• Processor does the actual work by executing the
specified instructions;
• This gives us a hint of how to perform instruction
processing...
BASIC INSTRUCTION CYCLE

• In its simplest form, instruction processing consists of two

steps:
• Fetch stage:
• processor reads instructions from memory one at a
time
• Execution stage:
• processor executes the instruction
BASIC INSTRUCTION CYCLE

• Program execution consists of

a loop:
• 1 Fetch instruction stage;
• 2 Execute instruction stage
BASIC INSTRUCTION CYCLE

• At the beginning of each instruction cycle:

• Program counter holds the address of the
instruction to be fetched;
• Processor fetches an instruction from memory;
• After each instruction fetch the PC is incremented.
• In order to fetch the memory address of next instruction
 EXAMPLE

• Consider a computer where each instruction occupies 16-bits in memory.

• Assume that the PC is set to memory location 300;
• Each location address contains a 16-bit word;
• The processor will next fetch the instruction at location 300.
• On succeeding instruction cycles, it will fetch instructions from locations:
• 301;
• 302;
• 303 and so on.

• This sequence may be altered.

 BASIC INSTRUCTION CYCLE

• The fetched instruction is loaded into a register in

the processor
• Known as the instruction register (IR);
• Instruction specifies control signals for the processor;
• Processor interprets the instruction and performs the
required action.
• What types of actions are usually performed?
BASIC INSTRUCTION CYCLE

• In general, these actions fall into four categories:

• Processor ↔ memory data transfers;
• Processor ↔ I/O peripherals data transfers;
• Data processing: arithmetic or logic operations on data;
• Control: E.g. alter the PC because of conditional jumps
(IF’s)
• Let’s see those in an example
EXAMPLE

• Consider a processor:
• Containing a single data register, called an
accumulator (AC).
• Both instructions and data are 16 bits long;
• Convenient to organize memory using 16-bit
words;
EXAMPLE

• Instruction format is the following:

• Opcode: code of the operation to be executed (+,-,×, ÷,etc...);

• How many bits are reserved for the opcode? Total combinations?
• Addressing memory,
• How many bits are reserved for the addressing memory? Total
combinations?
EXAMPLE

• Opcode: code of the operation to be executed

(+,-,×, ÷,etc...);
• 4 bits are reserved, i.e there can be different opcodes;
• Addressing memory,
• 12 bits are reserved, i.e. memory words can be
addressed.
EXAMPLE

• Consider that we have the following opcodes:

• Also, each data requires 16 bits and has the following

representation:1 bit for sign and 15 bits for magnitude
EXAMPLE

• Now lets try to execute the following instructions

(assume PC=300):
• Add memory contents at address 940 to the contents at
address 941;
• Store the result in the latter location.
EXAMPLE
EXAMPLE
EXAMPLE
EXAMPLE
EXAMPLE
EXAMPLE
EXAMPLE

• In textual form:
• The PC contains value 300, the address of the first instruction.
• This instruction (the value 1940 in hexadecimal) is loaded into the instruction register
IR, and the PC is incremented;
• The first 4 bits (first hexadecimal digit) in the IR indicate that the AC is to be loaded.
• The remaining 12 bits (three hexadecimal digits) specify the address (940) from
which data are to be loaded.
• The next instruction (5941) is fetched from location 301, and the PC is incremented.
• The old contents of the AC and the contents of location 941 are added, and the result is
stored in the AC.
• The next instruction (2941) is fetched from location 302, and the PC is incremented.
• The contents of the AC are stored in location 941.
CLASS WORK

• Now lets try to execute the following instructions

(assume PC=300):
• Add memory contents at address 940 to the contents at
address 941;
• Add memory contents at address 941 to the contents at
address 942;
• Store the result in the latter location -942.
?
BASIC INSTRUCTION CYCLE

• Some important notes:

• Last example was very simplified;
• But the overall control structure and information
flow is present;
• However, there are a lot of details missing;
• Lets look into a more detailed instruction
cycle...
DETAILED INSTRUCTION CYCLE
DETAILED INSTRUCTION CYCLE

• The states can be described as follows:

• Instruction address calculation (IAC):
• Determine address of next instruction to be executed;

• Instruction fetch (IF):

• Read instruction from memory into the processor;

• Instruction operation decoding (IOD):

• Determine type of operation to be performed and operand(s) to be used.
DETAILED INSTRUCTION CYCLE

• Operand address calculation (OAC):

• Determine the address of the operand.

• Operand fetch (OF):

• Fetch the operand from memory or read it in from I/O.

• Data operation (DO):

• Perform the operation indicated in the instruction.

• Operand store (OS):

• Write the result into memory or to I/O.
DETAILED INSTRUCTION CYCLE

• Do you think those steps are enough?

Should we add other states? Is there
something missing?
DETAILED INSTRUCTION CYCLE

• There exists some situations where we may want to interrupt

the CPU:
• Program: arithmetic overflow, division by zero, segfault, etc..
• Timer: execute something periodically;
• I/O: exchange communication between I/O devices and the
processor;
• Hardware: generated by a hardware failure
• e.g.: power, memory parity error, etc;
INTERRUPTS

• Because of these reasons (and some others):

• Computers provide a mechanism to interrupt
the processing;
• Virtually all computers provide a mechanism
to interrupt the normal processing of the
processor.
• How does that work?
 INTERRUPTS

1. An interrupt request signal is sent to the processor.

2. The processor responds by suspending current program execution;
3. The processor executes a routine capable of dealing with the
interrupt;
• A.k.a. interrupt handler.

4. After the handler finishes, the program returns to the original

execution.
INTERRUPTS

There is some overhead involved in this process:

• Extra instructions must be executed:
• to determine the nature of the interrupt;
• decide the appropriate action.
• But what if multiple interruptions being generated at
the same time?
• Example:
• A key is pressed;
• A segfault is generated;
MULTIPLE INTERRUPTS

• Suppose that multiple interrupts can occur, e.g.: a

program may be
• receiving data from a communications line:
• an interruption is generated every time a unit of data arrives.
• printing:
• an interruption is generated every time a print operation is
completed;
• How should the system deal with such cases? (2 possibilities)
FIRST POSSIBILITY

• Disable interrupts while an interrupt is being processed:

• The processor will ignore interrupt request signals;
• Emphasis on the ‘‘ignore’’, interrupt signals can still be
generated.
• After the interrupt handler routine completes:
• Interrupts are enabled;
• the processor checks to see if any interrupts have occurred.
 ISSUES OF THE FIRST ONE

• Can you see any problem with this approach of

disabling interrupts while processing an
interruption?
• Ignoring interruptions may have serious
implications
SECOND POSSIBILITY

• Don’t ignore and allow each interruption to

have a priority:
• Higher priority interruptions can interrupt
lower-priority interruptions.
• This strategy is referred to as nested
interrupt processing
EXAMPLE
EXAMPLE
• Program begins at t = 0 and at t = 10, a printer
interrupt occurs:
1. context is saved;
2. execution goes to the printer interrupt service routine
(ISR);
3. While this routine is executing (t = 15), a
communications interrupt occurs:
1. Higher priority than the printer;
2. Printer ISR is interrupted, context is saved;
3. Execution goes to the communication ISR;
1. While this routine is executing, a disk interrupt occurs (t = 20);
2. Because this interrupt is of lower priority, it is simply held;
3. and the communications ISR runs to completion.
 EXAMPLE

4. When the communications ISR completes (t =

25):
1. printer ISR state is restored;
2. However, there is a pending higher-priority
interruption (disk);
1. Processor transfers control to the disk ISR;
2. disk ISR completes at t = 35;
3. printer ISR is resumed;
4. printer ISR terminates at t = 40;

5. control returns to the original program.

 INTERCONNECTION
ISSUES

• A computer consists of a set

basic types of components:
• These modules need to
communicate with each other in
order to :
• exchange data and address;
• exchange control signals;

• Any idea how this communication

can be performed?
 BUS INTERCONNECTION

• A bus is a communication pathway connecting two or

more devices:
• shared transmission medium;
• connected devices can pickup data from all other devices
• If several devices transmit during the same time period:
• their signals will overlap and become garbled:
• thus, only one device at a time can successfully transmit.
 BUS INTERCONNECTION

• A bus consists of multiple communication lines:

• Each line transmits binary signals.
• A sequence of binary digits can be transmitted:
• using a single line over time (i.e. sequentially);
• several lines can be used (i.e. in parallel ).

• A bus connecting major computer components is called a

system bus.
• What type of information does the bus carry?
BUS STRUCTURE

• Bus lines can be classified into three functional

groups:
• data:
• for moving data among system modules
• address
• for specifying the source or destination of the data:
• control
• for transmitting command information among the
modules.
BUS STRUCTURE
 DATA LINES

• The data bus may consist of 32, 64, 128, or even more separate
lines:
• a.k.a. width of the data bus;

• Each line can carry only 1 bit at a time:

• the number of lines determines how many bits can be transferred at a time.

• Data bus width is key to system performance, e.g.:

• if the data bus is 32 bits wide and each instruction is 64 bits long;
• Each instruction requires two memory accesses.

• Lets have a quick look into each one of these...

 ADDRESS LINES

• Used to designate the source or destination of the data on the

data bus:
• The width of the address bus determines the maximum system
memory;
• How much memory the CPU can address directly Ex. 32 bits
• The address lines are generally also used to address I/O addresses;
• Higher-order bits are used to select a particular module on the bus;
• Lower-order bits select a memory location or I/O port within the
module.
 CONTROL LINES

• Command signals specify operations to be performed, e.g.:

• Memory write: write bus data to a memory address;
• Memory read: read memory at memory address;
• I/O write: write bus data to an I/O address;
• I/O read: read data from an I/O address;
• Bus request: a module needs to gain control of the bus;
• Bus grant: a requesting module has been granted bus control;
• Many more control signals...
 BUS STRUCTURE

• What happens if a great number of devices are

connected to the bus?
• If a great number of devices are connected bus
performance will suffer.
 SINGLE BUS PROBLEMS

• Single Bus Problems

• Lots of devices on one bus leads to:
• Propagation delays
• Long data paths mean that co-ordination of bus use
can adversely affect performance
• Bus may become bottleneck
• Most systems use multiple buses to overcome these
problems
 MULTIPLE-BUS HIERARCHIES

•Idea: Use several buses

to distribute
communication effort;
• This implies that there needs to
be a bus hierarchy, e.g.:
 MULTIPLE-BUS
HIERARCHIES
• Local bus connecting:
• processor;
• cache memory;
• one or more local devices.

•System bus:
• where the main memory module is attached;
• that also connects to the cache;

•Note: in contemporary systems, the

cache is in the same chip as the
processor.
ELEMENTS OF BUS DESIGN

• Parameters that can be used to classify

and differentiate buses e.g.:

• Lets have a look at some of these...

 BUS TYPE

• Bus lines can be separated into two generic types:

• dedicated: line is used for a single purpose:
• e.g.: the use of separate dedicated address and data lines
• multiplexed: line is used for multiple purposes:
• e.g.: address and data information may be transmitted over the same
lines
• Idea: use an Address Valid control line:
• Activate Address Valid line;
• Place the address on the bus lines;
• Transfer the data after.
• Can you see any advantages / disadvantages with multiplexing?
 BUS TYPE

• Multiplexing advantage:
• use of fewer lines, which saves space and, usually,
cost.
• Multiplexing disadvantage:
• more complex circuitry is needed within each module;
• potential reduction in performance:
• certain events that share the same lines cannot take
place in parallel.
ELEMENTS OF BUS DESIGN – READING ASSIGNMENT

Design two buses based on the

parameter. Compare and
contrast each design based on
the parameters selected.
CACHE MEMORY
ABEBE A. APRIL, 2019
 REMEMBER THIS GUY

Von Neumann Architecture:

• CPU ;
• Memory;
• I/O Module
 INTRODUCTION

• Today’s focus: Memory Module of von

Neumann’s architecture
 INTRODUCTION

• Although simple in concept computer memory exhibits

wide range of:
• Type: internal/external, permanent/temporary
• Technology: optical/magnetic/semiconductor
• Organization: words/bytes/blocks
• Performance: fast/slow
• and cost: Expensive/cheap
• No single technology is optimal in satisfying all of these
 INTRODUCTION

Typically:
• Higher performance → higher cost;
• Lower performance → lower cost
 INTRODUCTION

A computer has a hierarchy of memory

subsystems:
• some internal to the system
• i.e. directly accessible by the processor;
• some external
• accessible via an I/O module;
CLASSIFICATION OF MEMORY SYSTEMS ACCORDING TO THEIR KEY
CHARACTERISTICS:
 CHARACTERISTICS OF MEMORY SYSTEMS

Location: either internal or external to the processor.

• Forms of internal memory:
• registers;
• cache;
• RAM
• Forms of external memory:
• disk;
• magnetic tape
• devices that are accessible to the processor via I/O controllers.
 CHARACTERISTICS OF MEMORY SYSTEMS

• Capacity: amount of information the memory is

capable of holding.
• Typically expressed in terms of bytes (1 byte = 8 bits) or
words;
• A word represents each addressable block of the
memory
• common word lengths are 8, 16, and 32 bits;
• External memory capacity is typically expressed in terms
of bytes;
 CHARACTERISTICS OF MEMORY SYSTEMS

• Unity of transfer:
• For internal memory, the unit of transfer is equal to the
number of electrical lines into and out of the memory
module.
• This may be equal to the word length, but is often larger,
such as 64,128,or 256 bits.
• To clarify this point, consider three related concepts for
internal memory:
 CHARACTERISTICS OF MEMORY SYSTEMS
• Word:
• The “natural” unit of organization of memory.
• The size of the word is typically equal to the number of bits used to represent an integer and to the
instruction length.
• there are many exceptions.

• Addressable units:
• the addressable unit is the word.
• However, many systems allow addressing at the byte level.
• In any case, the relationship between the length in bits A of an address and the number N of
addressable units is N.

• Unit of transfer:
• this is the number of bits read out of or written into memory at a time.
• The unit of transfer need not equal a word or an addressable unit.
• For external memory,
 CHARACTERISTICS OF MEMORY SYSTEMS

• Access Method: How are the units of memory accessed?

• Sequential Method: Memory is organized into units of data, called
records.
• Access must be made in a specific linear sequence;
• Stored addressing information is used to assist in the retrieval process.
• A shared read-write head is used;
• The head must be moved from its one location to the another;
• Passing and rejecting each intermediate record;
• Highly variable times.
 CHARACTERISTICS OF MEMORY SYSTEMS

• Direct Access Memory:

• Involves a shared read-write mechanism;
• Individual records have a unique address;
• Requires accessing general record vicinity
plus sequential searching, counting, or
waiting to reach the final location; Magnetic Disk

• Access time is also variable;

 CHARACTERISTICS OF MEMORY SYSTEMS

• Random Access: Each addressable location in memory

has a unique, physically wired-in addressing
mechanism.
• Constant time;
• independent of the sequence of prior accesses;
• Any location can be selected at random and directly accessed;
• Main memory and some cache systems are random access
 CHARACTERISTICS OF MEMORY SYSTEMS

• Associative: a memory whose storage locations are

identified by their contents, or by a part of their
contents, rather than by their names or positions
• Word is retrieved based on a portion of its contents rather
than its address;
• Retrieval time is constant independent of location or prior
access patterns
 CHARACTERISTICS OF MEMORY SYSTEMS

• Performance:
• Access time ( latency ):
• For RAM: time to perform a read or write operation;
• For Non-RAM: time to position the read-write head at desired location;
• Memory cycle time: Primarily applied to RAM:
• Access time + additional time required before a second access;
• Required for electrical signals to be terminated/regenerated;
• Concerns the system bus.
 CHARACTERISTICS OF MEMORY SYSTEMS

• Transfer time: Rate at which data can be transferred in / out of

memory;
• For RAM:
• For Non-RAM: Tn = TA + , where:
• Tn: Average time to read or write n bits;
• TA: Average access time;
• n: Number of bits
• R: Transfer rate, in bits per second (bps.)
 CHARACTERISTICS OF MEMORY SYSTEMS

• Physical characteristics:
• Volatile: information decays naturally or is lost when powered off;
• Nonvolatile: information remains without deterioration until
changed:
• no electrical power is needed to retain information.;
• E.g.: Magnetic-surface memories are nonvolatile;
• Semiconductor memory (memory on integrated circuits) may be
either volatile or nonvolatile.
 MEMORY HIERARCHY

Design constraints on memory can be summed up by three questions:

• How much?
• If memory exists, applications will likely be developed to use it.
• How fast?
• Best performance achieved when memory keeps up with the processor;
• I.e. as the processor execute instructions, memory should minimize
pausing / waiting for instructions or operands.
• How expensive?
• Cost of memory must be reasonable in relationship to other components
 MEMORY HIERARCHY

Memory tradeoffs are a sad part of reality

• Faster access time, greater cost per bit;
• Greater capacity:
• Smaller cost per bit;
• Slower access time;
 MEMORY HIERARCHY

These tradeoff imply a dilemma:

• Large capacity memories are desired:
• low cost and because the capacity is needed;
• However, to meet performance requirements, the
designer needs:
• to use expensive, relatively lower-capacity memories
with short access times
How can we solve this issue? Or at least mitigate the problem? Any
ideas?
 MEMORY
HIERARCHY
The way out of this dilemma:
• Don’t rely on a single
memory;
• Instead employ a memory
hierarchy;
• Supplement:
• smaller, more expensive, faster
memories with...
• ...larger, cheaper, slower
memories;
 MEMORY
HIERARCHY

As one goes down the hierarchy:

• Decreasing cost per bit;
• Increasing capacity;
• Increasing access time;
• Decreasing frequency of access
of memory by processor
Decreasing frequency of memory access by
processor.
But why is this key to success?
 MEMORY HIERARCHY

But why is this key to success?

• As we go down the hierarchy we gain in size but lose in
speed;
• Therefore: not efficient for the processor to access these
memories;
• Requires having specific strategies to minimize such
accesses;
How can we develop strategies to minimize these
accesses?
 MEMORY HIERARCHY

How can we develop strategies to minimize these accesses?

Space and Time locality of reference principle:

• Space:
• if we access a memory location, close by addresses will very
likely be accessed;
• Time:
• if we access a memory location, we will very likely access it
again;
But why does this happen?
 MEMORY HIERARCHY

Suppose that the processor has access to two levels of memory:

• Level 1 - L1:
• contains 1000 words and has an access time of 0.01µs;
• Level 2 - L2:
• contains 100,000 words and has an access time of 0.1µs.
• Assume that:
• if word ∈ L1, then the processor accesses it directly;
• If word ∈ L2, then word is transferred to L1 and then accessed by
the processor.
 MEMORY HIERARCHY

Strategy to minimize accesses should be:

• Organize data across the hierarchy such that
• % of accesses to lower levels is substantially less than that of upper
levels
• I.e. L2 memory contains all program instructions and data:
• Data that is currently being used should be in L1;
• Eventually:
• Data ∈ L1 will be swapped to L2 to make room for new data;
• On average, most references will be to data contained in L1.
 MEMORY HIERARCHY

This principle can be applied across more than two levels of memory:
• Processor registers:
• Fastest, smallest, and most expensive type of memory
• Followed immediately by the cache:
• Stages data movement between registers and main memory;
• Improves performance;
• Is not usually visible to the processor;
• Is not usually visible to the programmer.
• Followed by main memory:
• Principal internal memory system of the computer;
• Each location has a unique address
 CACHE MEMORY PRINCIPLES

Cache memory is designed to

combine :
•Memory access time of expensive,
high-speed memory combined with...
• ...the large memory size of less
expensive, lower-speed memory.
 CACHE MEMORY

Typically:
• Higher performance → higher cost;
• Lower performance → lower cost
INTERNAL MEMORY
ABEBE A. JUNE, 2019
 INTRODUCTION

• Previous chapter discussed memory. This chapter presents:

• semiconductor main memory subsystems.
• ROM;
• DRAM;
• SRAM memories
• But why do we need these types of memories? Any ideas?
 INTRODUCTION

• Remember these guys?

• Serial memory takes different lengths of time to access

information:
• depends on where the desired location is relative to the current
position;
 SEMICONDUCTOR MAIN MEMORY

• Memory is a collection of cells with the following

properties
• They exhibit two stable states, used to represent binary 1 and 0;
• They are capable of being written into (at least once), to set the
state;
• They are capable of being read to sense the state;
• Access time is the same regardless of the location;
 SEMICONDUCTOR MAIN MEMORY

• Cell has three terminals capable of carrying an

electrical signal:
• select: selects a memory cell for a read / write operation;
• control: indicates whether a read / write operation is being
performed;
• read/write:
• For writing, terminal sets the state of the cell to 1 or 0.
• For reading, terminal is used for output of the cell’s state.
 SEMICONDUCTOR MAIN MEMORY

• Consider, a memory with a capacity of 1K words of 16 bits

each:
• Capacity:
• 1K × 16 = 16Kbits = 2Kbytes;
• Each word has an address:
• 0 to 1023
• When a word is read or written:
• memory acts on all 16 bits;
• Based on these concepts how do you think a write operation works? Any ideas?
 SEMICONDUCTOR MAIN MEMORY

• Write operation steps:

• Apply the binary address of the desired word to the address lines.
• Apply the data bits that must be stored in memory to the data input
lines.
• Activate the Write control line.

• Memory unit will then transfer the bits to that address.

 SEMICONDUCTOR MAIN MEMORY

• Read operation steps:

• Apply the binary address of the desired word to the
address lines.
• Activate the Read control line.
• Memory unit will then transfer the bits to the data
output lines.
TIMING WAVEFORMS

• Memory unit operation is controlled by an external device (1/2):

• • CPU is synchronized by its own clock pulses;
• • Control signals are employed for memory read / write.
• • Access time - time required for specifying an address and obtaining the
word;
• • Write time - time required for specifying an address and storing the word;

• • CPU must provide the control signals

TIMING WAVEFORMS

• Memory unit operation is controlled by an external device (2/2):

• • CPU provides the control signals synchronized with its clock:
• • This implies that:
• • read / write operations will take a certain number of clock periods;

• • What does this mean? Lets see with an example =)

EXAMPLE (1/7)

• Assume:
• • CPU with a clock frequency of 50 Mhz;
• • Memory access time: 65ns;
• • Memory write time: 75ns
• How many clock pulses do we need for read / write operations?
EXAMPLE (2/7)

• CPU with a clock frequency of 50 Mhz:

• • How long does one clock pulse take? Any Ideas?
• f =1/p⇔
• p =1/f⇔
• p =1/50Mhz⇔
• p =1 /50 × hz⇔
• p = 2 × s ⇔ 20ns
EXAMPLE (3/7)

• CPU clock pulse: 20ns;

• • Assume:
• • Memory access time: 65ns;
• • Memory write time: 75ns
• How many clock pulses do we need for read / write
operations?
• • 4 clock pulses for read / write operations;
EXAMPLE (4/7)
EXAMPLE (5/7)

• For the write operation:

• 1 CPU must provide the address (T1 pulse);
• 2 Memory enable is set (T1 pulse);
• 3 Data is supplied (T2 pulse);
• 4 Read/Write signal set to 0 for write operation (T2 pulse):
• • CPU waits for T2 to let the address signals stabilize:
• • Otherwise: wrong address may be used!
• • Signal must stay activated long enough for the operation to finish;
• 5 When T4 completes, write operation has ended with 5ns to spare
EXAMPLE (6/7)
EXAMPLE (7/7)

• For the read operation:

• 1 CPU must provide the address (T1 pulse);
• 2 Memory enable is set (T1 pulse);
• 3 Read/Write signal set to 1 for read operation (T2 pulse):
• • Signal must stay activated long enough for the operation to
finish;
• • Selected word is placed onto the data output lines;
• 4 When T4 completes, write operation has ended with 15ns to spare
MAJOR TYPES OF SEMICONDUCTOR MEMORY

• For the read operation:

• 1 CPU must provide the address (T1 pulse);
• 2 Memory enable is set (T1 pulse);
• 3 Read/Write signal set to 1 for read operation (T2 pulse):
• • Signal must stay activated long enough for the operation to
finish;
• • Selected word is placed onto the data output lines;
• 4 When T4 completes, write operation has ended with 15ns to spare
MAJOR TYPES OF SEMICONDUCTOR MEMORY
LETS HAVE A LOOK AT THE DIFFERENT TYPES OF MEMORY TECHNOLOGIES:
RANDOM-ACCESS MEMORY

• Randomly access any possible address;

• • Possible both to read and write data;
• • Volatile: requires a power supply;
• • For a chip with m words with n bits per word:
• • Consists of an array with m × n binary storage cells
• • E.g.: DRAM and SRAM.
• • Lets have a look at these
DYNAMIC RAM (DRAM)

• Made with cells that store data as charge on

capacitors:
• • Capacitor charge presence or absence is interpreted
as a binary 1 or 0;
• • Capacitors have a natural tendency to discharge;
• • Requires periodic charge refreshing to maintain data
storage
DRAM CELL COMPONENTS:

• If voltage goes to the address line:

• • Transistor closes:
• • Current flows to capacitor;
• If no voltage goes to the address line:
• • Transistor opens:
• • No current flows to capacitor
• Based on the DRAM cell components:
• How do you think a write operation works?
DYNAMIC RAM (DRAM)

• Write operation:
• 1 Voltage signal is applied to the bit line
• • Low voltage = 0;
• • High voltage = 1;
• 2 A signal is then applied to the address line:
• • transistor closes...
• • ...charge goes to the capacitor
• How do you think a read operation works?
DYNAMIC RAM (DRAM)

• Read operation:
• 1 Address line is activated
• 2 Transistor turns on
• 3 Capacitor charge goes to bit line...;
• • ...Low voltage = 0
• • ...High voltage = 1
• 4 Cell readout discharges the capacitor:
• • state must be restored;
• Do you have any idea of other type of technology that
can be employed?
STATIC RAM (SRAM)

• Binary values are stored using SR flip-flop

configurations:
• • Remember flip-flops?
• • Same logic elements used in the
processor registers;
• • will hold its data as long as power is
supplied to it.
RAM

• How to choose between DRAM and SRAM? Any ideas?

• • What are the pros / cons of DRAM?
• • What are the pros / cons of SRAM?
DRAM VS SRAM

• Both are volatile:

• • power must be continuously supplied to preserve the bit values;

• • DRAMs:
• • Periodically refresh capacitor’s charge;

• • SRAM:
• • No need to periodically refresh;
DRAM VS SRAM

• DRAM cell is simpler and smaller than a SRAM cell:

• • (1 transistor, 1 capacitor) vs. SR flip-flop
• • DRAM is denser (smaller cells = more cells per unit area) ;
• • Due to its simplicity:
• • DRAM is cheaper than corresponding SRAM;
DRAM VS SRAM

• • DRAM requires the supporting refresh circuitry (readout):

• • This is a fixed cost, does not increase with size
• • This cost is more than compensated by the smaller cost of
DRAM cells;
• • Thus, DRAMs tend to be favored for large memory
requirements;
DRAM VS SRAM

• SRAMs are faster and more expensive than DRAMs

• • No need to refresh the circuitry after a readout;

• • Because of these characteristics:

• • DRAM: used in main memory;
• • SRAM: used in cache;
DRAM VS SRAM

•
READ-ONLY MEMORY (ROM)

• Contains a permanent pattern of data that cannot be changed;

• • Therefore:
• • Possible to read a ROM;
• • Not possible to write data more than once;
• • Advantage:
• • Data / Program is permanently in main memory;
• • No need to load from a secondary storage device;
• • Original BIOS were stored in ROM chips.
• • Nonvolatile: no power source is required;
READ-ONLY MEMORY (ROM)

• Not possible to write data more than once:

• • Data is wired into the chip as part of the fabrication
process
• • Data insertion is expensive;
• • No room for error:
• • If one bit is wrong, the whole batch of ROMs must be
thrown out.
READ-ONLY MEMORY (ROM)

• Different types of ROM (1/4):

• • Programmable ROM (PROM):
• • nonvolatile and may be written into only once;
• • Writing may be performed at a later time than the
original chip fabrication.
• • Special equipment is required for the writing process;
• • More expensive than ROM;
READ-ONLY MEMORY (ROM)

• Different types of ROM (2/4):

• • Erasable programmable read-only memory (EPROM):
• • Can be altered multiple times;
• • Entire memory contents need to be erased;
• • Special equipment is required for the erasure process:
• • Ultra-violet radiation;
• • Slow erasure procedure (>20 minutes);
• • More expensive than PROM;
READ-ONLY MEMORY (ROM)

• Different types of ROM (3/4):

• • Electrically erasable programmable read-only memory (EEPROM):
• • Can be altered multiple times;
• • Special equipment is required for the erasure process:
• • No need to erase prior contents...
• • ...only the byte or bytes addressed are updated.
• • Ultra-violet radiation;
• • Faster erasure procedure than EPROM;
• • More expensive than EPROM;
READ-ONLY MEMORY (ROM)

• Different types of ROM (4/4):

• • Flash memory:
• • named because of the speed with which it can be
reprogrammed;
• • between EPROM and EEPROM in both cost and functionality:
• • Uses an electrical erasing technology;
• • Possible to erase blocks of memory;
• • Does not provide byte-level erasure;
• • Technology used in pendrives;
ERROR CORRECTION

• Semiconductor memory systems are subject to errors (1/2):

• Hard Failures: • Permanent physical defect;
• • Damaged memory cell(s) cannot reliably store data:
• • become stuck at 0 or 1 or...
• • ...switch erratically between 0 and 1
• • Caused by:
• • Harsh environmental abuse;
• • Manufacturing defects;
• • Wear and tear;
ERROR CORRECTION

• Semiconductor memory systems are subject to errors (2/2):

• Soft Failures: • Random, nondestructive event
• • Alters the contents of one or more memory cells
• • Without damaging the memory.
• • Caused by:
• • Power supply problems;
• • Alpha particles (radioactive decay).
• Hard and soft errors are clearly undesirable...So what can we do to address them?
ERROR CORRECTION
ERROR CORRECTION

• From the previous picture (1/3):

• 1 M-bit data is to be written into memory;
• 2 Computation f(M) is performed on the data (K check
bits);
• 3 Both the data and the code (M + K bits) are stored in
memory;
ERROR CORRECTION

• From the previous picture (2/3):

• 4 Eventually, the stored word will be read out;
• 5 Computation f(M) is again performed on the data (K
check bits);
• 6 A comparison is made between both check bits;
ERROR CORRECTION

• From the previous picture (3/3):

• 7 The comparison yields one of three results:
• • No errors are detected:
• • Fetched data bits are sent out;
• • An error is detected, and it is possible to correct the error:
• • Data bits plus error correction bits are fed into a corrector
• • Producing a corrected set of M bits to be sent out.
• • An error is detected, but it is not possible to correct it:
• This condition is reported.
•
Error-correcting codes