Scribd
Upload
39 views24 pages

Unit 3 SC

The biological nervous system, particularly in humans, is centered around the brain and consists of interconnected neurons that communicate via electrical impulses. Neurons have distinct parts, including dendrites, soma, axons, and synapses, which work together to transmit signals using neurotransmitters. Artificial neural networks (ANNs) are simplified models of biological neurons that mimic their functions, allowing for parallel processing, learning, and generalization in computational tasks.

Uploaded by

Ha Yanga
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
39 views24 pages

Unit 3 SC

The biological nervous system, particularly in humans, is centered around the brain and consists of interconnected neurons that communicate via electrical impulses. Neurons have distinct parts, including dendrites, soma, axons, and synapses, which work together to transmit signals using neurotransmitters. Artificial neural networks (ANNs) are simplified models of biological neurons that mimic their functions, allowing for parallel processing, learning, and generalization in computational tasks.

Uploaded by

Ha Yanga
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 24

Biological nervous system

Biological nervous system is the most important part of


many living things, in particular, human beings.

There is a part called brain at the center of human


nervous system.

In fact, any biological nervous system consists of a large


number of interconnected processing units called
neurons.

Each neuron is approximately 10µm long and they can


operate in parallel.

Typically, a human brain consists of approximately 1011


neurons communicating with each other with the help of
electrical impulses.
Brain: Center of the nervous system
Neuron: Basic unit of nervous system

Dendrite of
another neuron

Synapse

soma
Neuron and its working

Dendrit of
e neuro
n

Synapse

soma

Figure shows a schematic of a biological neuron. There are


different parts in it : dendrite, soma, axon and synapse.
Dendrite : A bush of very thin fibre.
Axon : A long cylindrical fibre.
Soma : It is also called a cell body, and just like as a
nucleus of cell.
Synapse : It is a junction where axon makes contact with
the dendrites of neighboring dendrites.
Neuron and its working
There is a chemical in each neuron called
neurotransmitter.
A signal (also called sense) is transmitted across
neurons by this chemical.
That is, all inputs from other neuron arrive to a neurons
through dendrites.
These signals are accumulated at the synapse of the
neuron and then serve as the output to be transmitted
through the neuron.
An action may produce an electrical impulse, which
usually lasts for about a millisecond.
Note that this pulse generated due to an incoming signal
and all signal may not produce pulses in axon unless it
crosses a threshold value.
Neuron and its working
Also, note that an action signal in axon of a neuron is
commutative signals arrive at dendrites which summed up
at soma.
Neuron and its working
Artificial neural network

In fact, the human brain is a highly complex structure


viewed as a massive, highly interconnected network of
simple processing elements called neurons.

Artificial neural networks (ANNs) or simply we refer it as


neural network (NNs), which are simplified models (i.e.
imitations) of the biological nervous system, and obviously,
therefore, have been motivated by the kind of computing
performed by the human brain.

The behavior of a biolgical neural network can be


captured by a simple model called artificial neural
network.
Analogy between BNN and ANN

x1
w1

x2 w
2

x3 w3

wn

xn
Artificial neural network

We may note that a neutron is a part of an interconnected


network of nervous system and serves the following.

Compute input signals

Transportation of signals (at a very high

speed) Storage of information

Perception, automatic training and learning

We also can see the analogy between the biological neuron


and artificial neuron. Truly, every component of the model
(i.e. artificial neuron) bears a direct analogy to that of a
biological neuron. It is this model which forms the basis of
neural network (i.e. artificial neural network).
Artificial neural network

x1
w1

x2 w
2

x3 w3
…..

wn

xn
input
weight Threshold unit output
Summation
unit

Here, x1, x2, · · · , xn are the n inputs to the artificial neuron.

w1, w2, · · · , wn are weights attached to the input links.


Artificial neural network

Note that, a biological neuron receives all inputs through


the dendrites, sums them and produces an output if the
sum is greater than a threshold value.

The input signals are passed on to the cell body through


the synapse, which may accelerate or retard an arriving
signal.

It is this acceleration or retardation of the input signals


that is modeled by the weights.

An effective synapse, which transmits a stronger signal will


have a correspondingly larger weights while a weak
synapse will have smaller weights.

Thus, weights here are multiplicative factors of the


Artificial neural network
inputs to account for the strength of the synapse.
Artificial neural network

Hence, the total input say I received by the soma of the


artificial neuron is
Σn
I = w1x1 + w2x2 + · · · + wnxn = i wi xi
To generate the final output y , the sum is =1passed to a filter
ϕ
called transfer function, which releases the output.
That is, y = ϕ(I)

x1 Ø(I)
w1

x2

w3
w2
I y
x3
…..

wn

xn unit
input
weight
Summation
Artificial neural network
Threshold unit output
Artificial neural network

A very commonly known transfer function is the


thresholding function.

In this thresholding function, sum (i.e. I) is compared


with a threshold value θ.

If the value of I is greater than θ, then the output is 1


else it is 0 (this is just like a simple linear filter).
In other words,

Σi wi xi − θ)
n=1
wher y = ϕ(
e
ϕ
1 , if I > θ
(I ) = 0 , if I ≤ θ
Artificial neural network
Such a Φ is called step function (also known as Heaviside
function).
Artificial neural network

Following figures illustrates two simple thresholding functions.

outpu
t
+1.0

(I)
(I)

0 input -1.0

(a) Hard-limit transfer function (b) Signum transfer function


Transformation functions

Hard-limit transfer function : The transformation we have


just discussed is called hard-limit transfer function. It is
generally used in perception neuron.
In other words,
ϕI 1 , if I > θ
0 , if I ≤ θ
()=
Linear transfer function : The output of the transfer
function is made equal to its input (normalized) and its
lies in the range of
−1.0 to +1.0. It is also known as Signum or Quantizer
function and it defined as
+1 , if I > θ
ϕI −1 , if I ≤ θ
()=
Other transformation functions

Sigmoid transfer function : This function is a continuous


function that varies gradually between the asymptotic
values 0 and 1 (called log-sigmoid) or -1 and +1 (called
Tan-sigmoid) threshold function and is given by
ϕ(I) = 1
[log-Sigmoid]
1+e−α
I
αI
−e−αI
ϕ(I) = tanh(I) = e
[tan-Sigmoid]
eαI
Here, α is the coefficient of transfer
+e−αI function.
Transfer functions in ANN

α=1
1
0

(I) α=0.
α=1
3 1
α=1.0 0
-1 α=0.5 1
-1
(I) α=0. 1
3
0 α=1.0
α=0.5

-1
-1

(a) Log-Sigmoid transfer


(b)Tan-Sigmoid transfer function
function
Advantages of ANN

ANNs exhibits mapping capabilities, that is, they can


map input patterns to their associated output pattern.

The ANNs learn by examples. Thus, an ANN architecture


can be trained with known example of a problem before
they are tested for their inference capabilities on unknown
instance of the problem. In other words, they can identify
new objects previous untrained.

The ANNs posses the capability to generalize. This is the


power to apply in application where exact mathematical
model to problem are not possible.
Advantages of ANN

The ANNs are robust system and fault tolerant. They can
therefore, recall full patterns from incomplete, partial or
noisy patterns.

The ANNS can process information in parallel, at high


speed and in a distributed manner. Thus a massively
parallel distributed processing system made up of highly
interconnected (artificial) neural computing elements
having ability to learn and acquire knowledge is
possible.

You might also like