Parallel Programming Paradigms
Multithreading
Task level parallelism
By
Apex TG India Pvt Ltd
http://www.apextgi.in
1
Serial Vs. Parallel
COUNTER 2
COUNTER
COUNTER 1
Q
Please
Single and Multithreaded
Processes
Single-threaded Process
Multiplethreaded
Threads of Process
Execution
Multiple instruction stream
Single instruction stream Common
Address Space
3
OS:
Multi-Processing, Multi-Threaded
Threaded Libraries, Multi-threaded I/O
Application
Application
Application
Application
CPU
CPU
CPU
Better Response Times in
Multiple Application
Environments
CPU
CPU
CPU
Higher Throughput for
Parallelizeable Applications
Multi-threading, continued...
Multi-threaded OS enables parallel, scalable I/O
Application
Application
Application
OS Kernel
CPU
CPU
CPU
Multiple, independent I/O
requests can be satisfied
simultaneously because all the
major disk, tape, and network
drivers have been multithreaded, allowing any given
driver to run on multiple
CPUs simultaneously.
Basic Process Model
STACK
DATA
DATA
TEXT
TEXT
processes
processes
STACK
Shared
Shared
memory
memory
segments,
segments,
pipes,
pipes,open
open
files
filesor
or
mmapd
mmapd
files
files
Shared
SharedMemory
Memory
maintained
maintainedby
bykernel
kernel
DATA
DATA
TEXT
TEXT
processes
processes
6
What are Threads?
Thread is a piece of code that can execute in
concurrence with other threads.
It is a schedule entity on a processor
Hardware
Context
Registers
Registers
Status
StatusWord
Word
Local state
Global/ shared state
PC
Hard/Software Context
Program
ProgramCounter
Counter
Running
Thread Object
7
Threaded Process Model
THREAD
THREAD
STACK
STACK
SHARED
SHARED
MEMORY
MEMORY
Threads within a process
THREAD
THREAD
DATA
DATA
THREAD
THREAD
TEXT
TEXT
Independent executables
All threads are parts of a process hence communication
easier and simpler.
Levels
Levels of
of Parallelism
Parallelism
Task
Taski-l
i-l
func1
func1( () )
{{
....
....
....
....
}}
Task
Task
Control
Control
Data
Data
MultipleIssue
Issue
Multiple
aa( (00) )=..
=..
bb( (00) )=..
=..
++
Task
Taskii
func2
func2( () )
{{
....
....
....
....
}}
aa( (11)=..
)=..
bb( (11)=..
)=..
xx
Task
Taski+1
i+1
func3
func3( () )
{{
....
....
....
....
}}
aa( (22)=..
)=..
bb( (22)=..
)=..
Load
Load
Code-Granularity
Code-Granularity
Code
CodeItem
Item
Large
Largegrain
grain
(task
(tasklevel)
level)
Program
Program
Medium
Mediumgrain
grain
(control
(controllevel)
level)
Function
Function(thread)
(thread)
Fine
Finegrain
grain
(data
(datalevel)
level)
Loop
Loop
Very
Veryfine
finegrain
grain
(multiple
(multipleissue)
issue)
With
Withhardware
hardware
Java
Multithreading in Java
10
Java - An Introduction
Java - The new programming language from Sun
Microsystems
Java -Allows anyone to publish a web page with
Java code in it
Java - CPU Independent language
Created for consumer electronics
Java - James , Arthur Van , and others
Java -The name that survived a patent search
Oak -The predecessor of Java
Java is C++ -- ++
11
Object Oriented Languages
-A comparison
Feature
Encapsulation
Inheritance
Multiple Inherit.
Polymorphism
Binding (Early or Late)
Concurrency
Garbage Collection
Genericity
Class Libraries
C++
Yes
Yes
Yes
Yes
Both
Poor
No
Yes
Yes
Objective
C
Yes
Yes
Yes
Yes
Both
Poor
Yes
No
Yes
Ada
Yes
No
No
Yes
Early
Difficult
No
Yes
Limited
Java
Yes
Yes
No
Yes
Late
Yes
Yes
No
Yes
12
Sun defines Java as:
Simple and Powerful
Safe
Object Oriented
Robust
Architecture Neutral and Portable
Interpreted and High Performance
Threaded
Dynamic
13
Java Integrates
Power of Compiled Languages
and
Flexibility of Interpreted Languages
14
Threads
Java has built in thread support for Multithreading
Synchronization
Thread Scheduling
Inter-Thread Communication:
currentThread
start
setPriority
yield
run
getPriority
sleep
stop
suspend
resume
Java Garbage Collector is a low-priority thread
15
Ways of Multithreading in Java
Create a class that extends the Thread class
Create a class that implements the Runnable interface
1st Method: Extending the Thread class
class MyThread
{
public void
{
// thread
}
}
Creating thread:
MyThread thr1 =
Start Execution:
thr1.start();
extends Thread
run()
body of execution
new MyThread();
16
2nd method: Threads by implementing
Runnable interface
class ClassName implements Runnable
{
.....
public void run()
{
// thread body of execution
}
}
Creating Object:
ClassName myObject = new ClassName();
Creating Thread Object:
Thread thr1 = new Thread( myObject );
Start Execution:
thr1.start();
17
Thread Class Members...
public class java.lang.Thread extends java.lang.Object
implements java.lang.Runnable
{
// Fields
public final static int MAX_PRIORITY;
public final static int MIN_PRIORITY;
public final static int NORM_PRIORITY;
// Constructors
public Thread();
public Thread(Runnable target);
public Thread(Runnable target, String name);
public Thread(String name);
public Thread(ThreadGroup group, Runnable target);
public Thread(ThreadGroup group, Runnable target, String
public Thread(ThreadGroup group, String name);
// Methods
public static int activeCount();
public void checkAccess();
public int countStackFrames();
public static Thread currentThread();
public void destroy();
public static void dumpStack();
public static int enumerate(Thread tarray[]);
public final String getName();
name);
18
...Thread Class Members.
public
public
public
public
public
public
public
public
public
public
public
public
public
public
public
public
public
public
public
public
public
public
public
}
final int getPriority(); // 1 to 10 priority-pre-emption at mid.
final ThreadGroup getThreadGroup();
void interrupt();
static boolean interrupted();
final boolean isAlive();
final boolean isDaemon();
boolean isInterrupted();
final void join();
final void join(long millis);
final void join(long millis, int nanos);
final void resume();
void run();
final void setDaemon(boolean on);
final void setName(String name);
final void setPriority(int newPriority);
static void sleep(long millis);
static void sleep(long millis, int nanos);
void start();
final void stop();
final void stop(Throwable obj);
final void suspend();
String toString();
static void yield();
19
Manipulation of Current Thread
// CurrentThreadDemo.java
class CurrentThreadDemo {
public static void main(String arg[])
{
Thread ct = Thread.currentThread();
ct.setName( "My Thread" );
System.out.println("Current Thread : "+ct);
try {
for(int i=5; i>0; i--) {
System.out.println(" " + i);
Thread.sleep(1000);
}
}
catch(InterruptedException e) {
System.out.println("Interrupted.");
}
}
}
Run:
Current Thread : Thread[My Thread,5,main]
5
4
3
2
1
20
Creating new Thread...
// ThreadDemo.java
class ThreadDemo implements Runnable
{
ThreadDemo()
{
Thread ct = Thread.currentThread();
System.out.println("Current Thread : "+ct);
Thread t = new Thread(this,"Demo Thread");
t.start();
try
{
Thread.sleep(3000);
}
catch(InterruptedException e)
{
System.out.println("Interrupted.");
}
System.out.println("Exiting main thread.");
}
21
...Creating new Thread.
public void run()
{
try
{
for(int i=5; i>0; i--)
{
System.out.println(" " + i);
Thread.sleep(1000);
}
}
catch(InterruptedException e)
{
System.out.println("Child interrupted.");
}
System.out.println("Exiting child thread.");
}
public static void main(String args[]) {
new ThreadDemo();
}
}
Run:
Current Thread : Thread[main,5,main]
5
4
3
Exiting main thread.
2
1
Exiting child thread.
22
Thread Priority...
// HiLoPri.java
class Clicker implements Runnable {
int click = 0;
private Thread t;
private boolean running = true;
public Clicker(int p)
{
t = new Thread(this);
t.setPriority(p);
}
public void run()
{
while(running)
click++;
}
public void start()
{
t.start();
}
public void stop()
{
running = false;
}
}
23
...Thread Priority
class HiLoPri
{
public static void main(String args[])
{
Thread.currentThread().setPriority(Thread.MAX_PRIORITY);
Clicker Hi = new Clicker(Thread.NORM_PRIORITY+2);
Clicker Lo = new Clicker(Thread.NORM_PRIORITY-2);
Lo.start();
Hi.start();
try
{
Thread.sleep(10000);
}
catch (Exception e)
{
}
Lo.stop();
Hi.stop();
System.out.println(Lo.click + " vs. " + Hi.click);
}
}
Run1: (on Solaris)
0 vs. 956228
Run2: (Window 95)
304300 vs. 4066666
24
The Java monitor model
Method 1
Method 2
Key
Block 1
Threads
Monitor (synchronised) solves race-condition problem
25
26
