Linux - Shell Scripting Tutorial - A Beginner's Handbook
Linux - Shell Scripting Tutorial - A Beginner's Handbook
Table of Contents
Chapter 1: Quick Introduction to Linux
What Linux is?
Who developed the Linux?
How to get Linux?
How to Install Linux
Where I can use Linux?
What Kernel Is?
What is Linux Shell?
How to use Shell
What is Shell Script ?
Why to Write Shell Script ?
More on Shell...
Chapter 2: Getting started with Shell Programming
How to write shell script
Variables in shell
How to define User defined variables (UDV)
Rules for Naming variable name (Both UDV and System Variable)
How to print or access value of UDV (User defined variables)
echo Command
Shell Arithmetic
More about Quotes
Exit Status
The read Statement
Wild cards (Filename Shorthand or meta Characters)
More commands on one command line
Command Line Processing
Why Command Line arguments required
Redirection of Standard output/input i.e. Input - Output redirection
Pipes
Filter
What is Processes
Why Process required
Linux Command(s) Related with Process
Chapter 3: Shells (bash) structured Language Constructs
Decision making in shell script ( i.e. if command)
test command or [ expr ]
if...else...fi
Nested ifs
Multilevel if-then-else
Loops in Shell Scripts
for loop
Nested for loop
while loop
The case Statement
How to de-bug the shell script?
Chapter 4: Advanced Shell Scripting Commands
/dev/null - to send unwanted output of program
Local and Global Shell variable (export command)
Conditional execution i.e. && and ||
I/O Redirection and file descriptors
Functions
User Interface and dialog utility-Part I
User Interface and dialog utility-Part II
Message Box (msgbox) using dialog utility
Confirmation Box (yesno box) using dialog utility
Input (inputbox) using dialog utility
User Interface using dialog Utility - Putting it all together
trap command
The shift Command
getopts command
Chapter 5: Essential Utilities for Power User
Preparing for Quick Tour of essential utilities
Selecting portion of a file using cut utility
Putting lines together using paste utility
The join utility
Translating range of characters using tr utility
Data manipulation using awk utility
sed utility - Editing file without using editor
Removing duplicate lines from text database file using uniq utility
Finding matching pattern using grep utility
Chapter 6: Learning expressions with ex
Getting started with ex
Printing text on-screen
Deleting lines
Copying lines
Searching the words
Find and Replace (Substituting regular expression)
Replacing word with confirmation from user
Finding words
Using range of characters in regular expressions
Using & as Special replacement character
Converting lowercase character to uppercase
Chapter 7: awk Revisited
Getting Starting with awk
Predefined variables of awk
Doing arithmetic with awk
User Defined variables in awk
Use of printf statement
Use of Format Specification Code
if condition in awk
Loops in awk
Real life examples in awk
awk miscellaneous
sed - Quick Introduction
Redirecting the output of sed command
How to write sed scripts?
More examples of sed
Chapter 8: Examples of Shell Scripts
Logic Development:
Shell script to print given numbers sum of all digit
Shell script to print contains of file from given line number to next given number of lines
Shell script to say Good morning/Afternoon/Evening as you log in to system
Shell script to find whether entered year is Leap or not
Sort the given five number in ascending order (use of array)
Command line (args) handling:
Adding 2 nos. suppiled as command line args
Calculating average of given numbers on command line args
Finding out biggest number from given three nos suppiled as command line args
Shell script to implement getopts statement.
Basic math Calculator (case statement)
Loops using while & for loop:
Print nos. as 5,4,3,2,1 using while loop
Printing the patterns using for loop.
Arithmetic in shell scripting:
Performing real number calculation in shell script
Converting decimal number to hexadecimal number
Calculating factorial of given number
File handling:
Shell script to determine whether given file exist or not.
Screen handling/echo command with escape sequence code:
Shell script to print "Hello World" message, in Bold, Blink effect, and in different colors like red,
brown etc.
Background process implementation:
Digital clock using shell script
User interface and Functions in shell script:
Shell script to implements menu based system.
System Administration:
Getting more information about your working environment through shell script
Shell script to gathered useful system information such as CPU, disks, Ram and your environment
etc.
Shell script to add DNS Entery to BIND Database with default Nameservers, Mail Servers (MX)
and host
Integrating awk script with shell script:
Script to convert file names from UPPERCASE to lowercase file names or vice versa.
Chapter 9: Other Resources
Appendix - A : Linux File Server Tutorial (LFST) version b0.1 Rev. 2
Appendix - B : Linux Command Reference (LCR)
About the author
About this Document
Home Next
Up Quick Introduction to Linux
( Cyeberciti Computers & nixCraft has years of experince in Linux / Unix / FreeBSD. If you need any
assistance, education, support for Linux / Unix, write to [email protected] )
Introduction
This tutorial is designed for beginners who wish to learn the basics of shell scripting/programming plus
introduction to power tools such as awk, sed, etc. It is not help or manual for the shell; while reading this
tutorial you can find manual quite useful (type man bash at $ prompt to see manual pages). Manual
contains all necessary information you need, but it won't have that much examples, which makes idea
more clear. For this reason, this tutorial contains examples rather than all the features of shell.
Chapter Organization
Chapter 1 to 4 shows most of the useful and important shell scripting concepts. Chapter 5 introduction to
tools & utilities which can be used while programming the Linux shell smartly. Chapter 6 and 7 is all
about expression and expression mostly used by tools such as sed and awk. Chapter 8 is loaded with tons
of shell scripting examples divided into different categories. Chapter 9 gives more resources information
which can be used while learning the shell scripting like information on Linux file system, common
Linux command reference and other resources.
Chapter 1 introduces to basic concepts such as what is Linux, where Linux can used and continue
explaning the shell, shell script and kernel etc.
Chapter 2 shows how to write the shell script and execute them. It explains many basic concepts which
requires to write shell script.
Chapter 3 is all about making decision in shell scripting as well as loops in shell. It explains what
expression are, how shell understands the condition/decisions. It also shows you nesting concept for if
and for loop statement and debugging of shell script.
Chapter 4 introduces the many advanced shell scripting concepts such as function, user interface, File
Descriptors, signal handling, Multiple command line arguments etc.
Chapter 5 introduces to powerful utility programs which can be used variety of purpose while
programming the shell.
Chapter 6 and 7 gives more information on patterns, filters, expressions, and off course sed and awk is
covered in depth.
Chapter 8 contains lot of example of shell scripting divided into various category such as logic
development, system administration etc.
Note that indicates advanced shell scripting concepts, you can skip this if you are really new to Linux
or Programming, though this is not RECOMMENDED by me.
I hope you get as much pleasure reading this tutorial, as I had writing it. After reading this tutorial if you
are able to write your own powerful shell scripts, then I think the purpose of writing this tutorial is served
and finally if you do get time after reading this tutorial drop me an e-mail message about your
comment/suggestion/questions and off course bugs (errors) you find regarding this tutorial.
Mandrake Linux:
http://www.mandrakesoft.com/
Caldera Linux:
http://www.calderasystems.com/
Debian GNU/Linux:
http://www.debian.org/
Slackware Linux:
http://www.slackware.com/
Note: If you are in India then you can get Linux Distribution from the Leading Computer magazine such
as PC Quest (Even PCQuest has got its own Linux flavour) or if you are in Pune, India please visit our
web site to obtained the Red Hat Linux or any other official Linux distribution. Note that you can also
obtained your Linux distribution with Linux books which you purchase from local book store.
● Robust
● Secure
● High Performance
Linux offers all of the above characteristics plus its Open Source and Free OS. So Linux can be used as:
(1) On stand alone workstation/PC for word processing, graphics, software development, internet,
e-mail, chatting, small personal database management system etc.
(2) In network environment as:
(A) File and Print or Application Server
Share the data, Connect the expensive device like printer and share it, e-mail within the LAN/intranet etc
are some of the application.
(B) Linux sever can be connected to Internet, So that PC's on intranet can share the internet/e-mail etc.
You can put your web sever that run your web site or transmit the information on the internet.
● Web Server
● Workgroup Server
● In Data Center for various server activities such as FTP, Telnet, SSH, Web, Mail, Proxy, Proxy
Cache Appliance etc
See the LESSBS project for more information on Linux Essential Services (as mentioned above) and
how to implement them in easy manner for you or your organization.
● Process management
● Device management
● File management
● Memory management
Tip: To find all available shells in your system type following command:
$ cat /etc/shells
Note that each shell does the same job, but each understand a different command syntax and provides
different built-in functions.
In MS-DOS, Shell name is COMMAND.COM which is also used for same purpose, but it's not as
powerful as our Linux Shells are!
Any of the above shell reads command from user (via Keyboard or Mouse) and tells Linux Os what users
want. If we are giving commands from keyboard it is called command line interface ( Usually in-front of
$ prompt. This prompt is depend upon your shell and Environment that you set or by your System
Administrator, therefore you may get different prompt ).
This will not run script since we have not set execute permission for our script first; to do this type command
$ chmod 755 first
$ ./first
First screen will be clear, then Knowledge is Power is printed on screen.
Script Command(s) Meaning
$ vi first Start vi editor
# followed by any text is considered as
comment. Comment gives more
#
information about script, logical
# My first shell script
explanation about shell script.
#
Syntax:
# comment-text
clear clear the screen
To print message or value of variables on
screen, we use echo command, general
echo "Knowledge is Power" form of echo command is as follows
syntax:
echo "Message"
How Shell Locates the file (My own bin directory to execute script)
Tip: For shell script file try to give file extension such as .sh, which can be easily identified by you as shell script.
Exercise:
1)Write following shell script, save it, execute it and note down it's output.
$ vi ginfo
#
#
# Script to print user information who currently login , current date
& time
#
clear
echo "Hello $USER"
echo "Today is \c ";date
echo "Number of user login : \c" ; who | wc -l
echo "Calendar"
cal
exit 0
Future Point: At the end why statement exit 0 is used? See exit status for more information.
Variables in Shell
To process our data/information, data must be kept in computers RAM memory. RAM memory is
divided into small locations, and each location had unique number called memory location/address,
which is used to hold our data. Programmer can give a unique name to this memory location/address
called memory variable or variable (Its a named storage location that may take different values, but only
one at a time).
In Linux (Shell), there are two types of variable:
(1) System variables - Created and maintained by Linux itself. This type of variable defined in
CAPITAL LETTERS.
(2) User defined variables (UDV) - Created and maintained by user. This type of variable defined in
lower letters.
You can see system variables by giving command like $ set, some of the important System variables are:
System Variable Meaning
BASH=/bin/bash Our shell name
BASH_VERSION=1.14.7(1) Our shell version name
COLUMNS=80 No. of columns for our screen
HOME=/home/vivek Our home directory
LINES=25 No. of columns for our screen
LOGNAME=students students Our logging name
OSTYPE=Linux Our Os type
PATH=/usr/bin:/sbin:/bin:/usr/sbin Our path settings
PS1=[\u@\h \W]\$ Our prompt settings
PWD=/home/students/Common Our current working directory
SHELL=/bin/bash Our shell name
USERNAME=vivek User name who is currently login to this PC
NOTE that Some of the above settings can be different in your PC/Linux environment. You can print any
of the above variables contains as follows:
$ echo $USERNAME
$ echo $HOME
Exercise:
1) If you want to print your home directory location then you give command:
a) $ echo $HOME
OR
Caution: Do not modify System variable this can some time create problems.
Example:
$ no=10 # this is ok
$ 10=no # Error, NOT Ok, Value must be on right side of = sign.
To define variable called 'vech' having value Bus
$ vech=Bus
To define variable called n having value 10
$ n=10
How to define User defined variables How to print or access value of UDV
Up
(UDV) (User defined variables)
echo Command
Use echo command to display text or value of variable.
echo [options] [string, variables...]
Displays text or variables value on screen.
Options
-n Do not output the trailing new line.
-e Enable interpretation of the following backslash escaped characters in the strings:
\a alert (bell)
\b backspace
\c suppress trailing new line
\n new line
\r carriage return
\t horizontal tab
\\ backslash
For e.g. $ echo -e "An apple a day keeps away \a\t\tdoctor\n"
How to display colorful text on screen with bold or blink effects, how to print text on any row, column
on screen, click here for more!
Shell Arithmetic
Use to perform arithmetic operations.
Syntax:
expr op1 math-operator op2
Examples:
$ expr 1 + 3
$ expr 2 - 1
$ expr 10 / 2
$ expr 20 % 3
$ expr 10 \* 3
$ echo `expr 6 + 3`
Note:
expr 20 %3 - Remainder read as 20 mod 3 and remainder is 2.
expr 10 \* 3 - Multiplication use \* and not * since its wild card.
For the last statement not the following points
(1) First, before expr keyword we used ` (back quote) sign not the (single quote i.e. ') sign. Back quote is
generally found on the key under tilde (~) on PC keyboard OR to the above of TAB key.
(2) Second, expr is also end with ` i.e. back quote.
(3) Here expr 6 + 3 is evaluated to 9, then echo command prints 9 as sum
(4) Here if you use double quote or single quote, it will NOT work
For e.g.
$ echo "expr 6 + 3" # It will print expr 6 + 3
$ echo 'expr 6 + 3' # It will print expr 6 + 3
Example:
$ echo "Today is date"
Can't print message with today's date.
$ echo "Today is `date`".
It will print today's date as, Today is Tue Jan ....,Can you see that the `date` statement uses back quote?
Exit Status
By default in Linux if particular command/shell script is executed, it return two type of values which is
used to see whether command or shell script executed is successful or not.
(1) If return value is zero (0), command is successful.
(2) If return value is nonzero, command is not successful or some sort of error executing command/shell
script.
This value is know as Exit Status.
But how to find out exit status of command or shell script?
Simple, to determine this exit Status you can use $? special variable of shell.
For e.g. (This example assumes that unknow1file doest not exist on your hard drive)
$ rm unknow1file
It will show error as follows
rm: cannot remove `unkowm1file': No such file or directory
and after that if you give command
$ echo $?
it will print nonzero value to indicate error. Now give command
$ ls
$ echo $?
It will print 0 to indicate command is successful.
Exercise
Try the following commands and not down the exit status:
$ expr 1 + 3
$ echo $?
$ echo Welcome
$ echo $?
$ wildwest canwork?
$ echo $?
$ date
$ echo $?
$ echon $?
$ echo $?
$? useful variable, want to know more such Linux variables click here to explore them!
Wild card
Meaning Examples
/Shorthand
$ ls * will show all files
will show all files whose first
$ ls a*
name is starting with letter 'a'
Matches any string or group of will show all files having
* $ ls *.c
characters. extension .c
will show all files having
$ ls ut*.c extension .c but file name must
begin with 'ut'.
will show all files whose names
$ ls ?
are 1 character long
? Matches any single character. will show all files whose names
$ ls fo? are 3 character long and file name
begin with fo
Matches any one of the will show all files beginning with
[...] $ ls [abc]*
enclosed characters letters a,b,c
Note:
[..-..] A pair of characters separated by a minus sign denotes a range.
Example:
$ ls /bin/[a-c]*
Will show all files name beginning with letter a,b or c like
/bin/arch /bin/awk /bin/bsh /bin/chmod /bin/cp
/bin/ash /bin/basename /bin/cat /bin/chown /bin/cpio
/bin/ash.static /bin/bash /bin/chgrp /bin/consolechars /bin/csh
But
$ ls /bin/[!a-o]
$ ls /bin/[^a-o]
If the first character following the [ is a ! or a ^ ,then any character not enclosed is matched i.e. do not
show us file name that beginning with a,b,c,e...o, like
NOTE:
$# holds number of arguments specified on command line. And $* or $@ refer to all arguments passed to
script.
In shell if we wish to refer this command line argument we refer above as follows
myshell it is $0
foo it is $1
bar it is $2
Here $# (built in shell variable ) will be 2 (Since foo and bar only two Arguments), Please note at a time
such 9 arguments can be used from $1..$9, You can also refer all of them by using $* (which expand to
`$1,$2...$9`). Note that $1..$9 i.e command line arguments to shell script is know as "positional
parameters".
Exercise
Try to write following for commands
Shell Script Name ($0),
No. of Arguments (i.e. $#),
And actual argument (i.e. $1,$2 etc)
$ sum 11 20
$ math 4 - 7
$ d
$ bp -5 myf +20
$ Ls *
$ cal
$ findBS 4 8 24 BIG
Answer
Following script is used to print command ling argument and will show you how to access them:
$ vi demo
#!/bin/sh
#
# Script that demos, command line args
#
echo "Total number of command line argument are $#"
echo "$0 is script name"
echo "$1 is first argument"
echo "$2 is second argument"
echo "All of them are :- $* or $@"
Run it as follows
$ ls > filename
It means put output of ls command to filename.
There are three main redirection symbols >,>>,<
(1) > Redirector Symbol
Syntax:
Linux-command > filename
To output Linux-commands result (output of command or shell script) to file. Note that if file already
exist, it will be overwritten else new file is created. For e.g. To send output of ls command give
$ ls > myfiles
Now if 'myfiles' file exist in your current directory it will be overwritten without any type of warning.
(2) >> Redirector Symbol
Syntax:
Linux-command >> filename
To output Linux-commands result (output of command or shell script) to END of file. Note that if file
exist , it will be opened and new information/data will be written to END of file, without losing previous
information/data, And if file is not exist, then new file is created. For e.g. To send output of date
command to already exist file give command
$ date >> myfiles
(3) < Redirector Symbol
Syntax:
Linux-command < filename
To take input to Linux-command from file instead of key-board. For e.g. To take input for cat command
give
$ cat < myfiles
Pipes
A pipe is a way to connect the output of one program to the input of another program without any
temporary file.
Filter
If a Linux command accepts its input from the standard input and produces its output on standard output
is know as a filter. A filter performs some kind of process on the input and gives output. For e.g..
Suppose you have file called 'hotel.txt' with 100 lines data, And from 'hotel.txt' you would like to print
contains from line number 20 to line number 30 and store this result to file called 'hlist' then give
command:
$ tail +20 < hotel.txt | head -n30 >hlist
Here head command is filter which takes its input from tail command (tail command start selecting from
line number 20 of given file i.e. hotel.txt) and passes this lines as input to head, whose output is
redirected to 'hlist' file.
Consider one more following example
$ sort < sname | uniq > u_sname
Here uniq is filter which takes its input from sort command and passes this lines as input to uniq; Then
uniqs output is redirected to "u_sname" file.
What is Processes
Process is kind of program or task carried out by your PC. For e.g.
$ ls -lR
ls command or a request to list files in a directory and all subdirectory in your current directory - It is a
process.
Process defined as:
"A process is program (command given by user) to perform specific Job. In Linux when you start
process, it gives a number to process (called PID or process-id), PID starts from 0 to 65535."
$ ls / -R | wc -l
This command will take lot of time to search all files on your system. So you can run such command in
Background or simultaneously by giving command like
$ ls / -R | wc -l &
The ampersand (&) at the end of command tells shells start process (ls / -R | wc -l) and run it in
background takes next command immediately.
Process & PID defined as:
"An instance of running command is called process and the number printed by shell is called process-id
(PID), this PID can be use to refer specific running process."
1) Is it example of Multitasking?
2) How you will you find out the both running process (MP3 Playing & Letter typing)?
3) "Currently only two Process are running in your Linux/PC environment", Is it True or False?, And
how you will verify this?
4) You don't want to listen music (MP3 Files) but want to continue with other work on PC, you will take
any of the following action:
1. Turn off Speakers
2. Turn off Computer / Shutdown Linux Os
3. Kill the MP3 playing process
4. None of the above
Click here for answers.
Introduction
Making decision is important part in ONCE life as well as in computers logical driven program. In fact
logic is not LOGIC until you use decision making. This chapter introduces to the bash's structured
language constructs such as:
● Decision making
● Loops
Is there any difference making decision in Real life and with Computers? Well real life decision are quite
complicated to all of us and computers even don't have that much power to understand our real life
decisions. What computer know is 0 (zero) and 1 that is Yes or No. To make this idea clear, lets play
some game (WOW!) with bc - Linux calculator program.
$ bc
After this command bc is started and waiting for your commands, i.e. give it some calculation as follows
type 5 + 2 as:
5+2
7
7 is response of bc i.e. addition of 5 + 2 you can even try
5-2
5/2
See what happened if you type 5 > 2 as follows
5>2
1
1 (One?) is response of bc, How? bc compare 5 with 2 as, Is 5 is greater then 2, (If I ask same question to
you, your answer will be YES), bc gives this 'YES' answer by showing 1 value. Now try
5<2
0
0 (Zero) indicates the false i.e. Is 5 is less than 2?, Your answer will be no which is indicated by bc by
showing 0 (Zero). Remember in bc, relational expression always returns true (1) or false (0 - zero).
Try following in bc to clear your Idea and not down bc's response
5 > 12
5 == 10
5 != 2
5 == 5
12 < 2
Expression Meaning to us Your Answer BC's Response
5 > 12 Is 5 greater than 12 NO 0
5 == 10 Is 5 is equal to 10 NO 0
5 != 2 Is 5 is NOT equal to 2 YES 1
5 == 5 Is 5 is equal to 5 YES 1
1<2 Is 1 is less than 2 Yes 1
It means when ever there is any type of comparison in Linux Shell It gives only two answer one is YES
and NO is other.
In Linux Shell Value Meaning Example
Zero Value (0) Yes/True 0
Remember both bc and Linux Shell uses different ways to show True/False values
Value Shown in bc as Shown in Linux Shell as
True/Yes 1 0
False/No 0 Non - zero value
if condition
if condition which is used for decision making in shell script, If given condition is true then command1 is
executed.
Syntax:
if condition
then
command1 if condition is true or if exit status
of condition is 0 (zero)
...
...
fi
Condition is defined as:
"Condition is nothing but comparison between two values."
For compression you can use test or [ expr ] statements or even exist status can be also used.
Example:
Following script determine whether given argument number is positive.
$ cat > ispositive
#!/bin/sh
#
# Script to see whether argument is positive
#
if test $1 -gt 0
then
echo "$1 number is positive"
fi
Run it as follows
$ chmod 755 ispostive
$ ispostive 5
5 number is positive
$ispostive -45
Nothing is printed
$ispostive
./ispostive: test: -gt: unary operator expected
Detailed explanation
The line, if test $1 -gt 0 , test to see if first command line argument($1) is greater than 0. If it is true(0)
then test will return 0 and output will printed as 5 number is positive but for -45 argument there is no
output because our condition is not true(0) (no -45 is not greater than 0) hence echo statement is skipped.
And for last statement we have not supplied any argument hence error ./ispostive: test: -gt: unary
operator expected, is generated by shell , to avoid such error we can test whether command line argument
is supplied or not.
test or [ expr ] works with
1.Integer ( Number without decimal point)
2.File types
3.Character strings
Logical Operators
Logical operators are used to combine two or more condition at a time
Operator Meaning
! expression Logical NOT
expression1 -a expression2 Logical AND
if...else...fi
If given condition is true then command1 is executed otherwise command2 is executed.
Syntax:
if condition
then
condition is zero (true - 0)
execute all commands up to else statement
else
if condition is not true then
execute all commands up to fi
fi
For e.g. Write Script as follows:
$ vi isnump_n
#!/bin/sh
#
# Script to see whether argument is positive or negative
#
if [ $# -eq 0 ]
then
echo "$0 : You must give/supply one integers"
exit 1
fi
if test $1 -gt 0
then
echo "$1 number is positive"
else
echo "$1 number is negative"
fi
Try it as follows:
$ chmod 755 isnump_n
$ isnump_n 5
5 number is positive
$ isnump_n -45
$ isnump_n
./ispos_n : You must give/supply one integers
$ isnump_n 0
0 number is negative
Detailed explanation
First script checks whether command line argument is given or not, if not given then it print error
message as "./ispos_n : You must give/supply one integers". if statement checks whether number of
argument ($#) passed to script is not equal (-eq) to 0, if we passed any argument to script then this if
statement is false and if no command line argument is given then this if statement is true. The echo
command i.e.
echo "$0 : You must give/supply one integers"
| |
| |
1 2
1 will print Name of script
2 will print this error message
And finally statement exit 1 causes normal program termination with exit status 1 (nonzero means script
is not successfully run).
The last sample run $ isnump_n 0 , gives output as "0 number is negative", because given argument is
not > 0, hence condition is false and it's taken as negative number. To avoid this replace second if
statement with if test $1 -ge 0.
Nested if-else-fi
You can write the entire if-else construct within either the body of the if statement of the body of an else
statement. This is called the nesting of ifs.
$ vi nestedif.sh
osch=0
if condition
then
if condition
then
.....
..
do this
else
....
..
do this
fi
else
...
.....
do this
fi
Multilevel if-then-else
Syntax:
if condition
then
condition is zero (true - 0)
execute all commands up to elif statement
elif condition1
then
condition1 is zero (true - 0)
execute all commands up to elif statement
elif condition2
then
condition2 is zero (true - 0)
execute all commands up to elif statement
else
None of the above condtion,condtion1,condtion2 are true (i.e.
all of the above nonzero or false)
execute all commands up to fi
fi
For multilevel if-then-else statement try the following script:
$ cat > elf
#
#!/bin/sh
# Script to test if..elif...else
#
if [ $1 -gt 0 ]; then
echo "$1 is positive"
elif [ $1 -lt 0 ]
then
echo "$1 is negative"
elif [ $1 -eq 0 ]
then
echo "$1 is zero"
else
echo "Opps! $1 is not number, give number"
fi
Try above script as follows:
$ chmod 755 elf
$ ./elf 1
$ ./elf -2
$ ./elf 0
$ ./elf a
Here o/p for last sample run:
./elf: [: -gt: unary operator expected
./elf: [: -lt: unary operator expected
./elf: [: -eq: unary operator expected
Opps! a is not number, give number
Above program gives error for last run, here integer comparison is expected therefore error like "./elf: [: -gt: unary operator
expected" occurs, but still our program notify this error to user by providing message "Opps! a is not number, give number".
● while loop
for Loop
Syntax:
for { variable name } in { list }
do
execute one for each item in the list until the list is
not finished (And repeat all statement between do and done)
done
Before try to understand above syntax try the following script:
$ cat > testfor
for i in 1 2 3 4 5
do
echo "Welcome $i times"
done
Run it above script as follows:
$ chmod +x testfor
$ ./testfor
The for loop first creates i variable and assigned a number to i from the list of number from 1 to 5, The shell execute
echo statement for each assignment of i. (This is usually know as iteration) This process will continue until all the items
in the list were not finished, because of this it will repeat 5 echo statements. To make you idea more clear try following
script:
$ cat > mtable
#!/bin/sh
#
#Script to test for loop
#
#
if [ $# -eq 0 ]
then
echo "Error - Number missing form command line argument"
echo "Syntax : $0 number"
echo "Use to print multiplication table for given number"
exit 1
fi
n=$1
for i in 1 2 3 4 5 6 7 8 9 10
do
echo "$n * $i = `expr $i \* $n`"
done
Save above script and run it as:
$ chmod 755 mtable
$ ./mtable 7
$ ./mtable
For first run, above script print multiplication table of given number where i = 1,2 ... 10 is multiply by given n (here
done
Run the above script as follows:
$ chmod +x nestedfor.sh
$ ./nestefor.sh
11111
22222
33333
44444
55555
Here, for each value of i the inner loop is cycled through 5 times, with the varible j taking values from 1 to 5. The inner
for loop terminates when the value of j exceeds 5, and the outer loop terminets when the value of i exceeds 5.
Following script is quite intresting, it prints the chess board on screen.
$ vi chessboard
for (( i = 1; i <= 9; i++ )) ### Outer for loop ###
do
for (( j = 1 ; j <= 9; j++ )) ### Inner for loop ###
do
tot=`expr $i + $j`
tmp=`expr $tot % 2`
if [ $tmp -eq 0 ]; then
echo -e -n "\033[47m "
else
echo -e -n "\033[40m "
fi
done
echo -e -n "\033[40m" #### set back background colour to black
echo "" #### print the new line ###
done
Run the above script as follows:
$ chmod +x chessboard
$ ./chessboard
Exercise
Try to understand the shell scripts (for loops) shown in exercise chapter.
while loop
Syntax:
while [ condition ]
do
command1
command2
command3
..
....
done
Loop is executed as long as given condition is true. For e.g.. Above for loop program (shown in last
section of for loop) can be written using while loop as:
$cat > nt1
#!/bin/sh
#
#Script to test while statement
#
#
if [ $# -eq 0 ]
then
echo "Error - Number missing form command line argument"
echo "Syntax : $0 number"
echo " Use to print multiplication table for given number"
exit 1
fi
n=$1
i=1
while [ $i -le 10 ]
do
echo "$n * $i = `expr $i \* $n`"
i=`expr $i + 1`
done
Save it and try as
$ chmod 755 nt1
$./nt1 7
Above loop can be explained as follows:
case $variable-name in
pattern1) command
...
..
command;;
pattern2) command
...
..
command;;
patternN) command
...
..
command;;
*) command
...
..
command;;
esac
The $variable-name is compared against the patterns until a match is found. The shell then executes all
the statements up to the two semicolons that are next to each other. The default is *) and its executed if
no match is found. For e.g. write script as follows:
$ cat > car
#
# if no vehicle name is given
# i.e. -z $1 is defined and it is NULL
#
# if no command line arg
if [ -z $1 ]
then
rental="*** Unknown vehicle ***"
elif [ -n $1 ]
then
# otherwise make first arg as rental
rental=$1
fi
case $rental in
"car") echo "For $rental Rs.20 per k/m";;
"van") echo "For $rental Rs.10 per k/m";;
"jeep") echo "For $rental Rs.5 per k/m";;
"bicycle") echo "For $rental 20 paisa per k/m";;
*) echo "Sorry, I can not gat a $rental for you";;
esac
Save it by pressing CTRL+D and run it as follows:
$ chmod +x car
$ car van
$ car car
$ car Maruti-800
First script will check, that if $1(first command line argument) is given or not, if NOT given set value of
rental variable to "*** Unknown vehicle ***",if command line arg is supplied/given set value of rental
variable to given value (command line arg). The $rental is compared against the patterns until a match is
found.
For first test run its match with van and it will show output "For van Rs.10 per k/m."
For second test run it print, "For car Rs.20 per k/m".
And for last run, there is no match for Maruti-800, hence default i.e. *) is executed and it prints, "Sorry, I
can not gat a Maruti-800 for you".
Note that esac is always required to indicate end of case statement.
See the one more example of case statement in chapter 4 of section shift command.
$ sh -v dsh1.sh 4 5
Use -v option to debug complex shell script.
Introduction
After learning basis of shell scripting, its time to learn more advance features of shell scripting/command
such as:
● Functions
● User interface
● Conditional execution
● File Descriptors
● traps
Examples:
$ vech=Bus
$ echo $vech
Bus
$ export vech
$ /bin/bash
$ echo $vech
Bus
$ exit
$ echo $vech
Bus
Command Meaning
$ vech=Bus Create new local variable 'vech' with Bus as value in first shell
$ echo $vech Print the contains of variable vech
$ export
Export first shells variable to second shell i.e. global varible
vech
Now load second shell in memory (Old shell's variable is accessed from second shell,
$ /bin/bash
if they are exported )
$ echo $vech Print the contains of variable vech
$ exit Exit from second shell return to first shell
$ echo $vech Print the contains of variable vech
$ cal
Above command prints calendar on screen, but if you wish to store this calendar to file then give
command
$ cal > mycal
The cal command send output to mycal file. This is called output redirection.
$ sort
10
-20
11
2
^D
-20
2
10
11
sort command takes input from keyboard and then sorts the number and prints (send) output to screen
itself. If you wish to take input from file (for sort command) give command as follows:
$ cat > nos
10
-20
11
2
^D
$ sort < nos
-20
2
10
11
First you created the file nos using cat command, then nos file given as input to sort command which
prints sorted numbers. This is called input redirection.
In Linux (And in C programming Language) your keyboard, screen etc are all treated as files. Following
are name of such files
File Descriptors
Standard File Use Example
number
as Standard
stdin 0 Keyboard
input
as Standard
stdout 1 Screen
output
as Standard
stderr 2 Screen
error
By default in Linux every program has three files associated with it, (when we start our program these
three files are automatically opened by your shell). The use of first two files (i.e. stdin and stdout) , are
already seen by us. The last file stderr (numbered as 2) is used by our program to print error on screen.
You can redirect the output from a file descriptor directly to file with following syntax
Syntax:
file-descriptor-number>filename
Examples: (Assume the file bad_file_name111 does not exists)
$ rm bad_file_name111
rm: cannot remove `bad_file_name111': No such file or directory
Above command gives error as output, since you don't have file. Now if we try to redirect this
error-output to file, it can not be send (redirect) to file, try as follows:
$ rm bad_file_name111 > er
Still it prints output on stderr as rm: cannot remove `bad_file_name111': No such file or directory, And if
you see er file as $ cat er , this file is empty, since output is send to error device and you can not redirect
it to copy this error-output to your file 'er'. To overcome this problem you have to use following
command:
$ rm bad_file_name111 2>er
Note that no space are allowed between 2 and >, The 2>er directs the standard error output to file. 2
number is default number (file descriptors number) of stderr file. To clear your idea onsider another
example by writing shell script as follows:
$ cat > demoscr
if [ $# -ne 2 ]
then
echo "Error : Number are not supplied"
echo "Usage : $0 number1 number2"
exit 1
fi
ans=`expr $1 + $2`
echo "Sum is $ans"
Run it as follows:
$ chmod 755 demoscr
$ ./demoscr
Error : Number are not supplied
Usage : ./demoscr number1 number2
Functions
Humans are intelligent animals. They work together to perform all of life's task, in fact most of us depend
upon each other. For e.g. you rely on milkman to supply milk, or teacher to learn new technology (if
computer teacher). What all this mean is you can't perform all of life's task alone. You need somebody to
help you to solve specific task/problem.
The above logic also applies to computer program (shell script). When program gets complex we need to
use divide and conquer technique. It means whenever programs gets complicated, we divide it into small
chunks/entities which are known as functions.
Function is series of instruction/commands. Function performs particular activity in shell i.e. it had
specific work to do or simply say task. To define function use following syntax:
Syntax:
function-name ( )
{
command1
command2
.....
...
commandN
return
}
Where function-name is name of you function, that executes series of commands. A return statement will
terminate the function. Example:
Type SayHello() at $ prompt as follows
$ SayHello()
{
echo "Hello $LOGNAME, Have nice computing"
return
}
To execute this SayHello() function just type it name as follows:
$ SayHello
Hello vivek, Have nice computing.
This way you can call function. Note that after restarting your computer you will loss this SayHello()
function, since its created for current session only. To overcome this problem and to add you own
function to automate some of the day today life task, add your function to /etc/bashrc file. To add
function to this file you must logon as root. Following is the sample /etc/bashrc file with today() function
, which is used to print formatted date. First logon as root or if you already logon with your name (your
login is not root), and want to move to root account, then you can type following command , when asked
To run function first completely logout by typing exit at the $ prompt (Or press CTRL + D, Note you
may have to type exit (CTRL +D) twice if you login to root account by using su command) ,then login
and type $ today , this way today() is available to all user in your system, If you want to add particular
function to particular user then open .bashrc file in users home directory as follows:
# vi .bashrc
OR
# mcedit .bashrc
At the end of file add following in .bashrc file
SayBuy()
{
echo "Buy $LOGNAME ! Life never be the same, until you login again!"
echo "Press a key to logout. . ."
read
return
}
Save the file and exit it, after all this modification your file may look like as follows (type command cat
.bashrc)
# cat .bashrc
# .bashrc
#
# User specific aliases and functions
# Source global definitions
if [ -f /etc/bashrc ]; then
. /etc/bashrc
fi
SayBuy()
{
echo "Buy $LOGNAME ! Life never be the same, until you login again!"
echo "Press a key to logout. . ."
read
return
}
To run function first logout by typing exit at the $ prompt (Or press CTRL + D ) ,then logon and type $
SayBuy , this way SayBuy() is available to only in your login and not to all user in system, Use .bashrc
file in your home directory to add User specific aliases and functions only.
Tip: If you want to show some message or want to perform some action when you logout, Open file
.bash_logout in your home directory and add your stuff here For e.g. When ever I logout, I want to show
message Buy! Then open your .bash_logout file using text editor such as vi and add statement:
echo "Buy $LOGNAME, Press a key. . ."
read
Save and exit from the file. Then to test this logout from your system by pressing CTRL + D (or type
exit) immediately you will see message "Buy xxxxx, Press a key. . .", after pressing key you will be
logout and login prompt will be shown to you. :-)
echo "-------------------------------------"
echo " Main Menu "
echo "-------------------------------------"
echo "[1] Show Todays date/time"
Show menu on screen with menu
echo "[2] Show files in current directory"
items
echo "[3] Show calendar"
echo "[4] Start editor to write letters"
echo "[5] Exit/Stop"
echo "======================="
Ask user to enter menu item
echo -n "Enter your menu choice [1-5]: "
number
read yourch Read menu item number from user
case $yourch in
1) echo "Today is `date` , press a key. . ." ; read ;;
2) echo "Files in `pwd`" ; ls -l ;
Take appropriate action according
echo "Press a key. . ." ; read ;;
to selected menu item, If menu item
3) cal ; echo "Press a key. . ." ; read ;;
is not between 1 - 5, then show
4) vi ;;
error and ask user to input number
5) exit 0 ;;
between 1-5 again
*) echo "Opps!!! Please select choice 1,2,3,4, or 5";
echo "Press a key. . ." ; read ;;
esac
Stop loop , if menu item number is
done
5 ( i.e. Exit/Stop)
User interface usually includes, menus, different type of boxes like info box, message box, Input box etc.
In Linux shell (i.e. bash) there is no built-in facility available to create such user interface, But there is
one utility supplied with Red Hat Linux version 6.0 called dialog, which is used to create different type
of boxes like info box, message box, menu box, Input box etc. Next section shows you how to use dialog
utility.
After installation you can start to use dialog utility. Before understanding the syntax of dialog utility try the following script:
$ cat > dia1
dialog --title "Linux Dialog Utility Infobox" --backtitle "Linux Shell
Script\
Tutorial" --infobox "This is dialog box called infobox, which is used
\
to show some information on screen, Thanks to Savio Lam and\
Stuart Herbert to give us this utility. Press any key. . . " 7 50 ;
read
Save the shell script and run it as:
$ chmod +x dia1
$ ./dia1
After executing this dialog statement you will see box on screen with titled as "Welcome to Linux Dialog Utility" and message "This is
dialog....Press any key. . ." inside this box. The title of box is specified by --title option and infobox with --infobox "Message" with this option.
Here 7 and 50 are height-of-box and width-of-box respectively. "Linux Shell Script Tutorial" is the backtitle of dialog show on upper left side of
screen and below that line is drawn. Use dialog utility to Display dialog boxes from shell scripts.
Syntax:
dialog --title {title} --backtitle {backtitle} {Box options}
where Box options can be any one of following
--yesno {text} {height} {width}
--msgbox {text} {height} {width}
--infobox {text} {height} {width}
--inputbox {text} {height} {width} [{init}]
--textbox {file} {height} {width}
--menu {text} {height} {width} {menu} {height} {tag1} item1}...
Above script creates yesno type dialog box, which is used to ask some questions to the user , and answer to those question either
yes or no. After asking question how do we know, whether user has press yes or no button ? The answer is exit status, if user
press yes button exit status will be zero, if user press no button exit status will be one and if user press Escape key to cancel
dialog box exit status will be one 255. That is what we have tested in our above shell script as
Statement Meaning
sel=$? Get exit status of dialog utility
sel=$?
na=`cat /tmp/input.$$`
case $sel in
0) echo "Hello $na" ;;
1) echo "Cancel is Press" ;;
255) echo "[ESCAPE] key pressed" ;;
esac
rm -f /tmp/input.$$
Run it as follows:
$ chmod +x dia4
$ ./dia4
Inputbox is used to take input from user, In this example we are taking Name of user as input. But where we are going to store
menuitem=`cat /tmp/menuitem.$$`
opt=$?
case $menuitem in
Date/time) date;;
Calendar) cal;;
Editor) vi;;
esac
Save it and run as:
$ rm -f /tmp/menuitem.$$
$ chmod +x smenu
$ ./smenu
--menu option is used of dialog utility to create menus, menu option take
--menu options Meaning
"Move using [UP] [DOWN],[Enter] to
This is text shown before menu
Select"
15 Height of box
50 Width of box
3 Height of menu
First menu item called as tag1 (i.e. Date/time) and
Date/time "Shows Date and Time" description for menu item called as item1 (i.e. "Shows
Date and Time")
First menu item called as tag2 (i.e. Calendar) and
description for menu item called as item2 (i.e. "To see
Calendar "To see calendar "
calendar")
First menu item called as tag3 (i.e. Editor) and
Editor "To start vi editor " description for menu item called as item3 (i.e."To start
vi editor")
2>/tmp/menuitem.$$ Send selected menu item (tag) to this temporary file
After creating menus, user selects menu-item by pressing the ENTER key, selected choice is redirected to temporary file, Next
this menu-item is retrieved from temporary file and following case statement compare the menu-item and takes appropriate step
according to selected menu item. As you see, dialog utility allows more powerful user interaction then the older read and echo
statement. The only problem with dialog utility is it work slowly.
trap command
Consider following script example:
$ cat > testsign
ls -R /
Save and run it as
$ chmod +x testsign
$ ./testsign
Now if you press ctrl + c , while running this script, script get terminated. The ctrl + c here work as
signal, When such signal occurs its send to all process currently running in your system. Now consider
following shell script:
$ cat > testsign1
#
# Why to trap signal, version 1
#
Take_input1()
{
recno=0
clear
echo "Appointment Note keeper Application for Linux"
echo -n "Enter your database file name : "
read filename
if [ ! -f $filename ]; then
echo "Sorry, $filename does not exit, Creating $filename database"
echo "Appointment Note keeper Application database file" > $filename
fi
echo "Data entry start data: `date`" >/tmp/input0.$$
#
# Set a infinite loop
#
while :
do
echo -n "Appointment Title:"
read na
echo -n "time :"
read ti
echo -n "Any Remark :"
read remark
echo -n "Is data okay (y/n) ?"
read ans
if [ $ans = y -o $ans = Y ]; then
recno=`expr $recno + 1`
echo "$recno. $na $ti $remark" >> /tmp/input0.$$
fi
echo -n "Add next appointment (y/n)?"
read isnext
if [ $isnext = n -o $isnext = N ]; then
cat /tmp/input0.$$ >> $filename
rm -f /tmp/input0.$$
return # terminate loop
fi
done
}
#
#
# Call our user define function : Take_input1
#
Take_input1
Save it and run as
$ chmod +x testsign1
$ ./testsign1
It first ask you main database file where all appointment of the day is stored, if no such database file
found, file is created, after that it open one temporary file in /tmp directory, and puts today's date in that
file. Then one infinite loop begins, which ask appointment title, time and remark, if this information is
correct its written to temporary file, After that, script asks user , whether he/she wants to add next
appointment record, if yes then next record is added , otherwise all records are copied from temporary
file to database file and then loop will be terminated. You can view your database file by using cat
command. Now problem is that while running this script, if you press CTRL + C, your shell script gets
terminated and temporary file are left in /tmp directory. For e.g. try it as follows
$./testsign1
After given database file name and after adding at least one appointment record to temporary file press
CTRL+C, Our script get terminated, and it left temporary file in /tmp directory, you can check this by
giving command as follows
$ ls /tmp/input*
Our script needs to detect such signal (event) when occurs; To achieve this we have to first detect Signal
using trap command.
Syntax:
trap {commands} {signal number list}
Signal Number When occurs
0 shell exit
1 hangup
2 interrupt (CTRL+C)
3 quit
9 kill (cannot be caught)
To catch signal in above script, put trap statement before calling Take_input1 function as trap del_file 2 .,
Here trap command called del_file() when 2 number interrupt ( i.e. CTRL+C ) occurs. Open above script
in editor and modify it so that at the end it will look like as follows:
$ vi testsign1
#
# signal is trapped to delete temporary file , version 2
#
del_file()
{
echo "* * * CTRL + C Trap Occurs (removing temporary file)* * *"
rm -f /tmp/input0.$$
exit 1
}
Take_input1()
{
recno=0
clear
echo "Appointment Note keeper Application for Linux"
echo -n "Enter your database file name : "
read filename
if [ ! -f $filename ]; then
echo "Sorry, $filename does not exit, Creating $filename database"
echo "Appointment Note keeper Application database file" > $filename
fi
echo "Data entry start data: `date`" >/tmp/input0.$$
#
# Set a infinite loop
#
while :
do
echo -n "Appointment Title:"
read na
echo -n "time :"
read ti
echo -n "Any Remark :"
read remark
echo -n "Is data okay (y/n) ?"
read ans
if [ $ans = y -o $ans = Y ]; then
recno=`expr $recno + 1`
$ vi convert
while [ "$1" ]
do
if [ "$1" = "-b" ]; then
ob="$2"
case $ob in
16) basesystem="Hex";;
8) basesystem="Oct";;
2) basesystem="bin";;
*) basesystem="Unknown";;
esac
shift 2
elif [ "$1" = "-n" ]
then
num="$2"
shift 2
else
echo "Program $0 does not recognize option $1"
exit 1
fi
done
output=`echo "obase=$ob;ibase=10; $num;" | bc`
echo "$num Decimal number = $output in $basesystem number
system(base=$ob)"
Above script is run in variety of ways. First three sample run converts the number 500 ( -n 500 ) to
respectively 1F4 (hexadecimal number i.e. -b 16), 764 (octal number i.e. -b 16) , 111110100 (binary
number i.e. -b 16). It use -n and -b as command line option which means:
-b {base-system i.e. 16,8,2 to which -n number to convert}
As you can see shift command can use to parse the command line (args) option. This is useful if you
have limited number of command line option. If command line options are too many then this approach
works slowly as well as complex to write and maintained. You need to use another shell built in
command - getopts. Next section shows the use of getopts command. You still need the shift command in
conjunction with getopts for other shell scripting work.
getopts command
This command is used to check valid command line argument are passed to script. Usually used in while
loop.
Syntax:
getopts {optstring} {variable1}
Examlpe:
We have script called ani which has syntax as
ani -n -a -s -w -d
Options: These are optional argument
-n name of animal
-a age of animal
-s sex of animal
-w weight of animal
-d demo values (if any of the above options are used their values are not taken)
Above ani script is as follows:
$ vi ani
#
# Usage: ani -n -a -s -w -d
#
#
# help_ani() To print help
#
help_ani()
{
echo "Usage: $0 -n -a -s -w -d"
echo "Options: These are optional argument"
echo " -n name of animal"
echo " -a age of animal"
echo " -s sex of animal "
See because of getopts, we can pass command line argument in different style. Following are invalid
options for ani script
$ ani -nLassie -a4 -sFemal -w20Kg
No space between option and their value.
$ ani -nLassie-a4-sFemal-w20Kg
$ ani -n Lassie -a 4 -s Female -w 20Kg -c Mammal
-c is not one of the valid options.
Introduction
Linux contains powerful utility programs. You can use these utility to
● Locate system information
Following section introduce you to some of the essential utilities as well as expression. While
programming shell you need to use these essential utilities. Some of these utilities (especially sed & awk)
requires understanding of expression. After the quick introduction to utilities, you will learn the
expression.
Sr.No Name
11 Vivek
12 Renuka
13 Prakash
14 Ashish
15 Rani
smark
Sr.No Mark
11 67
12 55
13 96
14 36
15 67
cut utility cuts out selected data from sname file. To select Sr.no. field from sname give command as
follows:
$cut -f1 sname
11
12
13
14
15
Command Explanation
cut Name of cut utility
Using (-f) option, you are specifying the extraction field number. (In this example
-f1
its 1 i.e. first field)
sname File which is used by cut utility and which is use as input for cut utility.
egg order 4
cacke good 10
cheese okay 4
pen good 12
floppy good 5
After crating file issue command
$ awk '/good/ { print $3 }' inventory
10
12
5
awk utility, select each record from file containing the word "good" and performs the action of printing
the third field (Quantity of available goods.). Now try the following and note down its output.
$ awk '/good/ { print $1 " " $3 }' inventory
General Syntax of awk utility:
Syntax:
awk 'pattern action' {file-name}
For $ awk '/good/ { print $3 }' inventory example,
/good/ Is the pattern used for selecting lines from file.
{print This is the action; if pattern found, print on of such action. Here $3 means third record in
$3} selected record. (What $1 and $2 mean?)
inventory File which is used by awk utility which is use as input for awk utility.
Syntax:
sed {expression} {file}
Use of sed utility: sed is used to edit (text transformation) on given stream i.e a file or may be input from
a pipeline.
Hello I am vivek
12333
12333
welcome
to
sai computer academy, a'bad.
what still I remeber that name.
oaky! how are u luser?
what still I remeber that name.
hello world!
cartoons are good
especially toon like tom (cat)
what
the number one song
12221
they love us
I too
After saving file, issue following command,
$ grep "too" demofile
cartoons are good
especially toon like tom (cat)
I too
grep will locate all lines for the "too" pattern and print all (matched) such line on-screen. grep prints too,
as well as cartoons and toon; because grep treat "too" as expression. Expression by grep is read as the
letter t followed by o and so on. So if this expression is found any where on line its printed. grep don't
understand words.
Syntax:
grep "word-to-find" {file-name}
Introduction
In the chpater 5, "Quick Tour of essential utilities", you have seen basic utilities. If you use them with
other tools, these utilities are very useful for data processing or for other works. In rest part of tutorial we
will learn more about patterns, filters, expressions, and off course sed and awk in depth.
● awk
● sed
So you must know how to construct regular expression. In the next part of LSST you will learn how to
construct regular expression using ex editor.
For this part of chapter/tutorial create 'demofile' - text file using any text editor.
Example:
$ ex demofile
The : (colon) is ex prompt where you can type ex text editor command or regular expression. Its time to
open our demofile, use ex as follows:
$ ex demofile
"demofile" [noeol] 20L, 387C
Entering Ex mode. Type "visual" to go to Normal mode.
:
As you can see, you will get : prompt, here you can type ex command, type q and press ENTER key to
exit from ex as shown follows: (remember commands are case sensetive)
:q
vivek@ls vivek]$
After typing the q command you are exit to shell prompt.
.....
...
.....
Okay! I will stop.
NOTE Here 1 is 1st line and $ is the special character of ex which mean last-line character. So 1,$ means
print from 1st line to last-line character (i.e. end of file). Here p stands print.
Deleting lines
Give command
:1, d
I love linux.
NOTE
Here 1 is 1st line and d command indicates deletes (Which deletes the 1st line).
You can even delete range of line by giving command as
:1,5 d
Copying lines
Give command as follows
:1,4 co $
:1,$ p
I love linux.
It is different from all other Os
....
.....
. (DOT) is special command of linux.
Okay! I will stop.
I love linux.
It is different from all other Os
My brother Vikrant also loves linux.
NOTE Here 1,4 means copy 1 to 4 lines; co command stands for copy; $ is end of file. So it mean copy
first four line to end of file. You can delete this line as follows
:18,21 d
Okay! I will stop.
:1,$ p
I love linux.
It is different from all other Os
My brother Vikrant also loves linux.
He currently lerarns linux.
Linux is cooool.
Linux is now 10 years old.
Next year linux will be 11 year old.
Rani my sister never uses Linux
She only loves to play games and nothing else.
Do you know?
. (DOT) is special command of linux.
Quitting the ex
Give command
:q
Finding words
Command like
:g/the/p
It is different from all other Os
My brother Vikrant also loves linux who also loves unix.
Will find word like theater, the, brother, other etc. What if you want to just find the word like "the" ? To
find the word (Let's say Linux) you can give command like
:/\<Linux\>
Linux is cooool.
:g/\<Linux\>/p
Linux is cooool.
Linux is now 10 years old.
Rani my sister never uses Linux
The symbol \< and \> respectively match the empty string at the beginning and end of the word. To find
the line which contain Linux pattern at the beginning give command
:/^Linux
Linux is cooool.
As you know $ is end of line character, the ^ (caret) match beginning of line. To find all occurrence of
pattern "Linux" at the beginning of line give command
:g/^Linux
Linux is cooool.
Linux is now 10 years old.
And if you want to find "Linux" at the end of line then give command
:/Linux $
Rani my sister never uses Linux
Following command will find empty line:
:/^$
To find all blank line give command:
:g/^$
To view entire file without blank line you can use command as follows:
:g/[^/^$]
Hello World.
This is vivek from Poona.
I love linux.
It is different from all other Os
[:digit:] Digit (0 to 9)
[:graph:] Printing character, like print, except that a space character is excluded
[:lower:] Lowercase letter (a to z)
[:print:] Printing character (0x20 to 0x7E)
[:punct:] Punctuation character (ctrl or space)
Space, tab, carriage return, new line, vertical tab, or form feed (0x09
[:space:]
to 0x0D, 0x20)
[:upper:] Uppercase letter (A to Z)
[:xdigit:] Hexadecimal digit (0 to 9, A to F, a to f)
For e.g. To find digit or alphabet (Upper as well as lower) you will write
:/[0-9A-Za-Z]
Instead of writing such command you could easily use predefined classes or range as follows
:/[[:alnum:]]
The . (dot) matches any single character.
For e.g. Type following command
:g/\<.o\>
She only loves to play games and nothing else.
Do you know?
This will include lo(ves), Do, no(thing) etc.
* Matches the zero or more times
For e.g. Type following command
:g/L*
Hello World.
This is vivek from Poona.
....
....
:g/Li*
Linux is cooool.
Linux is now 10 years old.
Rani my sister never uses Linux
:g/c.*and
. (DOT) is special command of linux.
Here first c character is matched, then any single character (.) followed by n number of single character
(1 or 100 times even) and finally ends with and. This can found different word as follows command or
catand etc.
In the regular expression metacharacters such as . (DOT) or * loose their special meaning if we use as \.
or \*. The backslash removes the special meaning of such meatcharacters and you can use them as
ordinary characters. For e.g. If u want to search . (DOT) character at the beginning of line, then you can't
In above file fields are Sr.No,Product,Qty,Unit Price. Field is the smallest element of any record. Each
fields has its own attributes. For e.g. Take Qty. field. Qty. fields attribute is its numerical (Can contain
only numerical data). Collection of fields is know as record. So
1. Pen 5 20.00 ----> Is a Record.
Collection of record is know as database file. In above text database file each field is separated using
space (or tab character) and record is separated using new-line character ( i.e. each record is finished at
the end of line ). In the awk, fields are access using special variable. For e.g. In above database $1, $2,
$3, $4 respectively represents Sr.No, Product, Qty, Unit Price fields. (Don't confuse $1,$2 etc with
command line arguments of shell script)
For this part of tutorial create text datafile inven (Shown as above). Now enter following simple awk
program/command at shell prompt:
$ awk '{ print $1 $2 "--> Rs." $3 * $4 }' inven
1.Pen--> Rs.100
2.Pencil--> Rs.20
3.Rubber--> Rs.10.5
4.Cock--> Rs.91
Above awk program/command can be explained as follows:
awk program statement Explanation
print command is used to print contains of variables or text enclose in
" text ". Here $1, $2, $3,$4 are all the special variable. $1, $2, etc all
'{ print $1 $2 "--> Rs." $3 * $4
of the variable contains value of field. Finally we can directly do the
}'
calculation using $3 * $4 i.e. multiplication of third and fourth field in
database. Note that "--> Rs." is string which is printed as its.
Note $1,$2 etc (in awk) also know as predefined variable and can assign any value found in field.
Type following awk program at shell prompt,
In above awk program /Pen/ is the search pattern, if this pattern is found on line (or record) then print the
third field of record.
{ print $3 } is called Action. On shell prompt , $ awk -f prn_pen inven , -f option instruct awk, to read its
command from given file, inven is the name of database file which is taken as input for awk.
Now create following awk program as follows:
$cat > comp_inv
3 > 5 { print $0 }
Run it as follows:
$ awk -f comp_inv inven
2. Pencil 10 2.00
Here third field of database is compared with 5, this the pattern. If this pattern found on any line
database, then entire record is printed.
{
total = $3 * $4
recno = $1
item = $2
gtotal += total
print recno item " Rs." total
}
END {
print "---------------------------"
print "Total Rs." gtotal
print "==========================="
}
Run it as
$awk -f bill2 inven
---------------------------
Bill for the 4-March-2001.
By Vivek G Gite.
---------------------------
1.Pen Rs.100
2.Pencil Rs.20
3.Rubber Rs.10.5
4.Cock Rs.91
---------------------------
Total Rs.221.5
===============
Now the grand total is printed at the end. In above program BEGIN and END patters are used. BEGIN
instruct awk, that perform BEGIN actions before the first line (Record) has been read from database file.
Use BEGIN pattern to set value of variables, to print heading for report etc. General syntax of BEGIN is
as follows
Syntax:
BEGIN {
action 1
action 2
action N
}
END instruct awk, that perform END actions after reading all lines (RECORD) from the database file.
General syntax of END is as follows:
END {
action 1
action 2
action N
}
In our example, BEGIN is used to print heading and END is used print grand total.
{
total = $3 * $4
recno = $1
item = $2
gtotal += total
printf "%d %s Rs.%f\n", recno, item, total
#printf "%2d %-10s Rs.%7.2f\n", recno, item, total
}
END {
printf "---------------------------\n"
printf "Total Rs. %f\n" ,gtotal
#printf "\tTotal Rs. %7.2f\n" ,gtotal
printf "===========================\n"
}
Run it as follows:
$ awk -f bill3 inven
Bill for the 4-March-2001.
By Vivek G Gite.
---------------------------
1 Pen Rs.100.000000
2 Pencil Rs.20.000000
3 Rubber Rs.10.500000
4 Cock Rs.91.000000
---------------------------
Total Rs. 221.500000
===============
In above example printf statement is used to print formatted output of the variables or text. General
syntax of printf as follows:
Syntax:
printf "format" ,var1, var2, var N
If you just want to print any text using printf as follows
printf "Hello"
printf "Hello World\n"
In last example \n is used to print new line. Its Part of escape sequence following may be also used:
\t for tab
\a Alert or bell
\" Print double quote etc
For e.g. printf "\nAn apple a day, keeps away\t\t\tDoctor\n\a\a"
It will print text on new line as :
An apple a day, keeps away Doctor
Notice that twice the sound of bell is produced by \a\a. To print the value of decimal number use %d as
format specification code followed by the variable name. For e.g. printf "%d" , no1
It will print the value of no1. Following table shows such common format specification code:
Format Specification Code Meaning Example
{
isminor = "y"
%c Character
printf "%c" , isminor
}
{
n = 10
%d Decimal number such as 10,-5 etc
printf "%d",n
}
{
Hexadecimal number such as 0xA, n = 10
%x
0xffff etc printf "%x",n
}
{
str1 = "Welcome to Linux!"
%s String such as "vivek", "Good buy" printf "%s", str1
printf "%s", "Can print ?"
}
To run above example simply create any awk program file as follows
$ cat > p_demo
BEGIN {
n = 10
printf "%d", n
printf "\nAn apple a day, keeps away\t\t\tDoctor\n\a\a"
}
Run it as
$ awk -f p_demo
10
An apple a day, keeps away Doctor
Write awk program to test format specification code. According to your choice.
{
total = $3 * $4
recno = $1
item = $2
gtotal += total
printf "%2d %-10s Rs.%7.2f\n", recno, item, total
}
END {
printf "---------------------------\n"
printf "\tTotal Rs. %6.2f\n" ,gtotal
printf "===========================\n"
}
Run it as
$ awk -f bill4 inven
Bill for the 4-March-2001.
By Vivek G Gite.
---------------------------
1 Pen Rs. 100.00
2 Pencil Rs. 20.00
3 Rubber Rs. 10.50
4 Cock Rs. 91.00
---------------------------
Total Rs. 221.50
===============
From the above output you can clearly see that printf can format the output. Let's try to understand
formatting of printf statement. For e.g. %2d, number between % and d, tells the printf that assign 2
spaces for value. Same way if you write following awk program ,
Same technique is used in our bill4 awk program to print formatted output. Also the statement like gtotal
+= total, which is equvalent to gtotal = gtotal + total. Here += is called assignment operator. You can use
following assignment operator:
Assignment
Use for Example Equivalent to
operator
a += 10 a = a + 10
+= Assign the result of addition
d += c a=a+c
Assign the result of a -= 10 a = a - 10
-=
subtraction d -= c a=a-c
Assign the result of a *= 10 a = a * 10
*=
multiplication d *= c a=a*c
a %= 10 a = a % 10
%= Assign the result of modulo
d %= c a=a%c
if condition in awk
General syntax of if condition is as follows:
Syntx:
if ( condition )
{
Statement 1
Statement 2
Statement N
if condition is TRUE
}
else
{
Statement 1
Statement 2
Statement N
if condition is FALSE
}
Above if syntax is selfexplontary, now lets move to next awk program
{
no1 = $1
op = $2
no2 = $3
ans = 0
if ( op == "+" )
{
ans = $1 + $3
printf "%d %c %d = %d\n" ,no1,op,no2,ans
printf "%s" ,myprompt
}
else
{
printf "Opps!Error I only know how to add.\nSyntax: number1 +
number2\n"
printf "%s" ,myprompt
}
}
END {
printf "\nGoodbuy %s\n" , ENVIRON["USER"]
}
Run it as follows (Give input as 5 + 2 and 3 - 1 which is shown in bold words)
$awk -f math2
Welcome to MyAddtion calculation awk program v0.1
(To Stop press CTRL+D) > 5 + 2
5+2=7
(To Stop press CTRL+D) > 3 - 1
Opps!Error I only know how to add.
Syntax: number1 + number2
(To Stop press CTRL+D) >
Goodbuy vivek
In the above program various, new concept are introduce so lets try to understand them step by step
Start of BEGIN
BEGIN {
Pattern
Define user
myprompt = "(To Stop press CTRL+D) > "
defined variable
Print welcome
message and
printf "Welcome to MyAddtion calculation awk program v0.1\n"
value of
printf "%s" ,myprompt
myprompt
variable.
End of BEGIN
}
Pattern
Now start to
{
process input
Assign first,
no1 = $1 second, third,
op = $2 variables value
no2 = $3 to no1, op, no2
ans = 0 variables
respectively
If command is
if ( op == "+" )
used for decision
{
making in awk
ans = no1 + no2
program. Here if
printf "%d %c %d = %d\n" ,no1,op,no2,ans
value of variable
printf "%s" ,myprompt
op is "+" then
}
addition is done
else
and result is
{
printed on
printf "Opps!Error I only know how to add.\nSyntax:number1+ number2\n"
screen, else error
printf "%s" ,myprompt
message is
}
shown on screen.
Stop all inputted
} lines are
process.
END patterns
END { start here.
printf "\nGoodbuy %s\n" , ENVIRON["USER"] Which says
} currently log on
user Goodbuy.
ENVIRON is the one of the predefined system variable that is array. Array is made up of different
element. ENVIRON array is also made of elements. It allows you to access system variable (or variable
in your environment). Give set command at shell prompt to see list of your environment variable. You
can use variable name to reference any element in this array. For e.g. If you want to print your home
directory you can write printf as follows:
printf "%s is my sweet home", ENVIRON["HOME"]
Loops in awk
For loop and while loop are used for looping purpose in awk.
Syntax of for loop
Syntax:
for (expr1; condition; expr2)
{
Statement 1
Statement 2
Statement N
}
Statement(s) are executed repeatedly UNTIL the condition is true. BEFORE the first iteration, expr1 is
evaluated. This is usually used to initialize variables for the loop. AFTER each iteration of the loop,
expr2 is evaluated. This is usually used to increment a loop counter.
Example:
$ cat > while01.awk
BEGIN{
printf "Press ENTER to continue with for loop example from LSST
v1.05r3\n"
}
{
sum = 0
i = 1
for (i=1; i<=10; i++)
{
sum += i; # sum = sum + i
}
printf "Sum for 1 to 10 numbers = %d \nGoodbuy!\n\n", sum
exit 1
}
Run it as follows:
$ awk -f while01.awk
Press ENTER to continue with for loop example from LSST v1.05r3
Sum for 1 to 10 numbers = 55
Goodbuy
Above for loops prints the sum of all numbers between 1 to 10, it does use very simple for loop to
achieve this. It take number from 1 to 10 using i variable and add it to sum variable as sum = previous
sum + current number (i.e. i).
Here i++, is equivalent to i = i + 1 statement. ++ is increment operator which increase the value of
variable by one and -- is decrement operator which decrease the value of variable by one. Don't try i+++,
to increase the value of i by 2 (since +++ is not valid operator), instead try i+= 2.
You can use while loop as follows:
Syntax:
while (condition)
{
statement1
statement2
statementN
Continue as long as given condition is TRUE
}
While loop will continue as long as given condition is TRUE. To understand the while loop lets write
BEGIN{
}
#
# main logic is here
#
{
sfile = $1
dfile = $2
cpcmd = "cp " $1 " " $2
printf "Coping %s to %s\n",sfile,dfile
system(cpcmd)
}
#
# End action, if any, e.g. clean ups
#
END{
}
Run it as follows:
$ awk -f temp2final.awk filelist.conf
Above awk Program can be explained as follows:
sfile = $1 Set source file path i.e. first field ($1) from the file filelist.conf
dfile = $2 Set source file path i.e. second field ($2) from the file filelist.conf
Use your normal cp command for copy file from source to destination.
cpcmd = "cp " $1 " " $2
Here cpcmd, variable is used to construct cp command.
printf "Coping %s to
Now print the message
%s\n",sfile,dfile
system(cpcmd) Issue the actual cp command using system(), function.
system() function execute given system command. For e.g. if you want to remove file using rm command
of Linux, you can write system as follows
system("rm foo")
OR
dcmd = "rm " $1
system(dcmd)
The output of command is not available to program; but system() returns the exit code (error code) using
which you can determine whether command is successful or not. For e.g. We want to see whether rm
command is successful or not, you can write code as follows:
$ cat > tryrmsys
{
dcmd = "rm " $1
if ( system(dcmd) != 0 )
printf "rm command not successful\n"
else
printf "rm command is successful and %s file is removed \n",
$1
}
Run it as (assume that file foo exist and bar does not exist)
$ awk -f tryrmsys
foo
rm command is successful and foo file is removed
bar
rm command not successful
(Press CTRL + D to terminate)
Our Second Example:
As I write visual installation guide, I use to capture lot of images for my work, while capturing images I
saved all images (i.e. file names) in UPPER CASE for e.g.
RH7x01.JPG,RH7x02.JPG,...RH7x138.JPG.
Now I would like to rename all files to lowercase then I tried with following two scripts:
up2low and rename.awk
isdir1 = "[ -d " $1 " ] " This expression is quite tricky. Its
something as follows:
isdir1 = [ -d $1 ]
Which means see if directory exists
using [ expr ]. As you know [ expr ] is
used to test whether expr is true or not.
So we are testing whether directory exist
or not.
What does $1 mean? If you remember,
in awk $1 is the first field.
isdir2 = "[ -d " $2 " ] " As above except it test for second field
as
isdir2 = [ -d $2 ]
i.e. Whether second field is directory or
not.
scriptname = "up2low" Our shell script name (up2low) and awk
awkscriptname = "rename.awk" script name (rename.awk).
sfile = $1 Source file
dfile = $2 Destination file
if ( sfile == scriptname || sfile == awkscriptname ) Make sure we don't accidentally rename
next our own scripts, if scripts are in current
working directory
else if( ( system(isdir1) ) == 0 || system((isdir2)) == 0 ) Make sure source or destination are files
{ and not the directory. We check this
printf "%s or %s is directory can't rename it to lower using [ expr ] command of bash. From
case\n",sfile,dfile the awk script you can called or invoke
next # continue with next recored (as official we called it) the [ expr ] if
} directory do exists it will return true
(indicated by zero) and if not it will
return nonzero value.
else if ( sfile == dfile ) If both source and destination file are
{ same, it mean file already in lower case
printf "Skiping, \"%s\" is alrady in lowercase\n",sfile no need to rename it to lower case.
next
}
else # everythink is okay rename it to lowercase Now if source and destination files are
{ not
mvcmd = "mv " $1 " " $2 ● Directories
printf "Renaming %s to %s\n",sfile,dfile
● Name of our scripts
system(mvcmd)
} ● And File is in UPPER CASE
Note that if you don't have files name in UPPER case for testing purpose you can create files name as
follows:
$ for j in 1 2 3 4 5 6 7 8 9 10; do touch TEMP$j.TXT; done
Above sample command creates files as TEMP1.TXT,TEMP2.TXT,....TEMP10.TXT files.
Run it as follows:
$ up2low
Letters or letters is directory can't rename it to lower case
RH6_FILES or rh6_files is directory can't rename it to lower case
Renaming RH7x01.JPG to rh7x01.jpg
Renaming RH7x02.JPG to rh7x02.jpg
Renaming RH7x03.JPG to rh7x03.jpg
Renaming RH7x04.JPG to rh7x04.jpg
Renaming RH7x05.JPG to rh7x05.jpg
Renaming RH7x06.JPG to rh7x06.jpg
....
..
....
Renaming RH7x138.JPG to rh7x138.jpg
On my workstation above output is shown.
awk miscellaneous
You can even take input from keyboard while running awk script, try the following awk script:
$ cat > testusrip
BEGIN {
printf "Your name please:"
getline na < "-"
printf "%s your age please:",na
getline age < "-"
print "Hello " na, ", next year you will be " age + 1
}
Save it and run as
$ awk -f testusrip
Your name please: Vivek
Vivek your age please: 26
Hello Vivek, next year you will be 27
Here getline function is used to read input from keyboard and then assign the data (inputted from
keyboard) to variable.
Syntax:
getline variable-name < "-"
| | |
1 2 3
1 --> getline is function name
2 --> variable-name is used to assign the value read from input
3 --> Means read from stdin (keyboard)
To reading Input from file use following
Syntax:
getline < "file-name"
Example:
getline < "friends.db"
To reading Input from pipe use following
Syntax:
"command" | getline
Example:
Run it as
$ awk -f awkread_file
Fri Apr 12 00:05:45 IST 2002
Command date is executed and its piped to getline which assign the date command output to variable $0.
If you want your own variable then replace the above program as follows
$ cat > awkread_file1
BEGIN {
"date" | getline today
print today
}
Run it as follows:
$ awk -f awkread_file1
Try to understand the following awk script and note down its output.
temp2final1.awk
Tip: Give .sed extension to sed script, .sh to Shell script and .awk to awk script file(s), this will help you
to identify files quickly.
$ cat > chg1.sed
1i\
Price of all items changes from 1st-April-2001
/Pen/s/20.00/19.5/
/Pencil/s/2.00/2.60/
/Rubber/s/3.50/4.25/
/Cock/s/45.50/51.00/
Run the above sed script as follows:
$ sed -f chg1.sed inven1
Price of all items changes from 1st-April-2001
1. Pen 5 19.5
2. Pencil 10 2.60
3. Rubber 3 4.25
4. Cock 2 51.00
In above sed script, the 1i\ is the (i) insert command. General Syntax is as follows:
Syntax:
[line-address]i\
text
So,
1i\
Price of all items changes from 1st-April-2001
means insert the text "Price of all items changes from 1st-April-2001" at line number 1.
Same way you can use append (a) or change (c) command in your sed script,
General Syntax of append
Syntax:
[line-address]a\
text
Example:
/INDIA/ a\
E-mail: [email protected]
Find the word INDIA and append (a) "E-mail: [email protected]" text.
General Syntax of change as follows:
Syntax:
[line-address]c\
text
Example:
/INDIA/ c\
E-mail: [email protected]
Find the word INDIA and change e-mail id to "[email protected]"
Rest of the statements (like /Pen/s/20.00/19.5/) are general substitute statements.
Even you can use following expression for the same purpose
$ sed -n '/^\*\{2,3\}$/p' demofile2
Now following command will find out lines between *** and *** and then delete all those line
$sed -e '/^\*\{2,3\}$/,/^\*\{2,3\}$/d' demofile2 > /tmp/fi.$$
$cat /tmp/fi.$$
You can group the commands in sed - scripts as shown following example
$ cat > dem_gsed
/^\*\{2,3\}$/,/^\*\{2,3\}$/{
/^$/d
s/Linux/Linux-Unix/
}<
Now save above sed script and run it as follows:
$ sed -f dem_gsed demofile2 > /tmp/fi.$$
$ cat /tmp/fi.$$
Above sed scripts finds all line between *** and *** and performance following operations
1) Delete blank line, if any using /^$/d expression.
2) Substitute "Linux-Unix" for "Linux" word using s/Linux/Linux-Unix/ expression.
Our next example removes all blank line and converts multiple spaces into single space, for this purpose you
need demofile3 file. Write sed script as follows:
$ cat > rmblksp
/^$/d
s/ */ /g<
Run above script as follows:
$ sed -f rmblksp demofile3
Welcome to world of sed what sed is?
I don't know what sed is but I think
Rani knows what sed Is
--------------------------------------------------
Above script can be explained as follows:
Expression Meaning
/^$/d Find all blank line and delete is using d command.
Find two or more than two blank space and replace it with single
s/ */ /g
blank space
Note that indicates two blank space and indicate one blank space.
For our next and last example create database file friends
Our task is as follows for friends database file:
1)Find all occurrence of "A'bad" word replace it with "Aurangabad" word
2)Exapand MH state value to Maharastra
3)Find all blank line and replace with actual line (i.e. ========)
4)Instert e-mail address of each persons at the end of persons postal address. For each person e-mail ID is
different
To achieve all above task write sed script as follows:
$ cat > mkchgfrddb
s/A.bad/Aurangabad/g
s/MH/Maharastra/g
s/^$/===================================================================/g
/V.K. /{
N
N
a\
email:[email protected]
}
/M.M. /{
N
N
a\
email:[email protected]
}
/R.K. /{
N
N
a\
email:[email protected]
}
/A.G. / {
N
N
a\
email:[email protected]
}
/N.K. / {
N
N
a\
email:[email protected]
}
Run it as follows:
$ sed -f mkchgfrddb friends > updated_friendsdb
$ cat updated_friendsdb
Our last examples shows how we can manipulate text data files using sed. Here our tutorial on sed/awk ends
but next version (LSST ver 2.0) will cover more real life examples, case studies using all these tools, plus
integration with shell scripts etc.
Q.2.Write Script to find out biggest number from given three nos. Nos are supplied as command line argument. Print error if sufficient
arguments are not supplied.
Answer: See Q2 shell Script.
Q.12.Write script to determine whether given command line argument ($1) contains "*" symbol or not, if $1 does not contains "*"
symbol add it to $1, otherwise show message "Symbol is not required". For e.g. If we called this script Q12 then after giving ,
$ Q12 /bin
Here $1 is /bin, it should check whether "*" symbol is present or not if not it should print Required i.e. /bin/*, and if symbol present
then Symbol is not required must be printed. Test your script as
$ Q12 /bin
Q.13. Write script to print contains of file from given line number to next given number of lines. For e.g. If we called this script as
Q13 and run as
$ Q13 5 5 myf , Here print contains of 'myf' file from line number 5 to next 5 line of that file.
Answer: See Q13 shell Script
Q.14. Write script to implement getopts statement, your script should understand following command line argument called this script
Q14,
Q14 -c -d -m -e
Where options work as
-c clear the screen
-d show list of files in current working directory
-m start mc (midnight commander shell) , if installed
-e { editor } start this { editor } if installed
Answer: See Q14 shell Script
Q.15. Write script called sayHello, put this script into your startup file called .bash_profile, the script should run as soon as you logon
to system, and it print any one of the following message in infobox using dialog utility, if installed in your system, If dialog utility is
not installed then use echo statement to print message : -
Good Morning
Good Afternoon
Good Evening , according to system time.
Answer: See Q15 shell Script
Q.16. How to write script, that will print, Message "Hello World" , in Bold and Blink effect, and in different colors like red, brown etc
using echo command.
Answer: See Q16 shell Script
Q.17. Write script to implement background process that will continually print current time in upper right corner of the screen , while
user can do his/her normal job at $ prompt.
Answer: See Q17 shell Script.
Q.18. Write shell script to implement menus using dialog utility. Menu-items and action according to select menu-item is as follows:
Menu-Item Purpose Action for Menu-Item
Date/time To see current date time Date and time must be shown using infobox of dialog utility
Calendar To see current calendar Calendar must be shown using infobox of dialog utility
First ask user name of directory where all files are present, if no name
of directory given assumes current directory, then show all files only of
that directory, Files must be shown on screen using menus of dialog
Delete To delete selected file
utility, let the user select the file, then ask the confirmation to user
whether he/she wants to delete selected file, if answer is yes then delete
the file , report errors if any while deleting file to user.
Exit To Exit this shell script Exit/Stops the menu driven program i.e. this script
Note: Create function for all action for e.g. To show date/time on screen create function show_datetime().
Answer: See Q18 shell Script.
Q.20.Write shell script using for loop to print the following patterns on screen
for2 for3 for4
Introduction
This is new chapter added to LSST v1.05r3, its gives more references to other material available on shell
scripting on Net or else ware. It also indicates some other resources which might be useful while
programming the shell.
Appendix - A Information
This tutorial/document is useful for beginners who wish
Appendix - A to learn Linux file system, it covers basic concept of file
system, commands or utilities related with file system. It
Linux File Server Tutorial (LFST) version
will explain basic file concepts such as what is file &
b0.1 Rev. 2
directories, what are the mount points, how to use cdrom
or floppy drive under Linux.
This command reference is specially written for the
Appendix - B LSST. It contains command name, general syntax
followed by an example. This is useful while
Linux Command Reference (LCR)
programming shell and you can use as Quick Linux
Command Reference guide.
About Author
Vivek G. Gite runs small firm called "Cyberciti Computers" and *nix Solution firm nixCraft. He is
freelance software developer and also teaches computer hardware, networking and Linux/Unix to
beginners. He is also working with various Computers Firms as Technology Consultant. Currently he
writes article on Linux/Unix, LSST is one of such article/document. His future plan includes more
article/documents on Linux especially for beginners. If you have any suggestion or new ideas or problem
with this tutorial, please feel free to contact author using following e-mail ID.
How do I contact the author?
I can be contacted by e-mail: [email protected].
All the trademarks are acknowledged and used for identification purpose only.
Last updated Linux Shell Scripting Tutorial v1.05r3 (LSST) - on Thu., July, 04, 2002.
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
# Q1.Script to sum to nos
#
if [ $# -ne 2 ]
then
echo "Usage - $0 x y"
echo " Where x and y are two nos for which I will print sum"
exit 1
fi
echo "Sum of $1 and $2 is `expr $1 + $2`"
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
# Q2. Script to find out bigest number
#
# Algo:
# 1) START: Take three nos as n1,n2,n3.
# 2) Is n1 is greater than n2 and n3, if yes
# print n1 is biggest no goto step 5, otherwise goto next step
# 3) Is n2 is greater than n1 and n3, if yes
# print n2 is biggest no goto step 5, otherwise goto next step
# 4) Is n3 is greater than n1 and n2, if yes
# print n3 is biggest no goto step 5, otherwise goto next step
# 5) END
#
#
if [ $# -ne 3 ]
then
echo "$0: number1 number2 number3 are not given" >&2
exit 1
fi
n1=$1
n2=$2
n3=$3
if [ $n1 -gt $n2 ] && [ $n1 -gt $n3 ]
then
echo "$n1 is Biggest number"
elif [ $n2 -gt $n1 ] && [ $n2 -gt $n3 ]
then
echo "$n2 is Biggest number"
elif [ $n3 -gt $n1 ] && [ $n3 -gt $n2 ]
then
echo "$n3 is Biggest number"
elif [ $1 -eq $2 ] && [ $1 -eq $3 ] && [ $2 -eq $3 ]
then
echo "All the three numbers are equal"
else
echo "I can not figure out which number is bigger"
fi
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
# Q3
# Algo:
# 1) START: set value of i to 5 (since we want to start from 5, if you
# want to start from other value put that value)
# 2) Start While Loop
# 3) Chechk, Is value of i is zero, If yes goto step 5 else
# continue with next step
# 4) print i, decement i by 1 (i.e. i=i-1 to goto zero) and
# goto step 3
# 5) END
#
i=5
while test $i != 0
do
echo "$i
"
i=`expr $i - 1`
done
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
# Q4
#
if test $# = 3
then
case $2 in
+) let z=$1+$3;;
-) let z=$1-$3;;
/) let z=$1/$3;;
x|X) let z=$1*$3;;
*) echo Warning - $2 invalied operator, only +,-,x,/ operator allowed
exit;;
esac
echo Answer is $z
else
echo "Usage - $0 value1 operator value2"
echo " Where, value1 and value2 are numeric values"
echo " operator can be +,-,/,x (For Multiplication)"
fi
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
# Q5
#
echo "Hello, $LOGNAME"
echo "Current date is `date`"
echo "User is `who i am`"
echo "Current direcotry `pwd`"
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
# Script to reverse given no
#
# Algo:
# 1) Input number n
# 2) Set rev=0, sd=0
# 3) Find single digit in sd as n % 10 it will give (left most digit)
# 4) Construct revrse no as rev * 10 + sd
# 5) Decrment n by 1
# 6) Is n is greater than zero, if yes goto step 3, otherwise next step
# 7) Print rev
#
if [ $# -ne 1 ]
then
echo "Usage: $0 number"
echo " I will find reverse of given number"
echo " For eg. $0 123, I will print 321"
exit 1
fi
n=$1
rev=0
sd=0
while [ $n -gt 0 ]
do
sd=`expr $n % 10`
rev=`expr $rev \* 10 + $sd`
n=`expr $n / 10`
done
echo "Reverse number is $rev"
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
# Algo:
# 1) Input number n
# 2) Set sum=0, sd=0
# 3) Find single digit in sd as n % 10 it will give (left most digit)
# 4) Construct sum no as sum=sum+sd
# 5) Decrment n by 1
# 6) Is n is greater than zero, if yes goto step 3, otherwise next step
# 7) Print sum
#
if [ $# -ne 1 ]
then
echo "Usage: $0 number"
echo " I will find sum of all digit for given number"
echo " For eg. $0 123, I will print 6 as sum of all digit (1+2+3)"
exit 1
fi
n=$1
sum=0
sd=0
while [ $n -gt 0 ]
do
sd=`expr $n % 10`
sum=`expr $sum + $sd`
n=`expr $n / 10`
done
echo "Sum of digit for numner is $sum"
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
# Q10
#
a=5.66
b=8.67
c=`echo $a + $b | bc`
echo "$a + $b = $c"
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
# Q11
if [ $# -ne 1 ]
then
echo "Usage - $0 file-name"
exit 1
fi
if [ -f $1 ]
then
echo "$1 file exist"
else
echo "Sorry, $1 file does not exist"
fi
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
# Q12
# Script to check whether "/*" is included, in $1 or not
#
if [ $? -eq 1 ]
then
echo "Required i.e. $1/*"
else
echo "Symbol is Not required"
fi
rm -f /tmp/file.$$
rm -f /tmp/file0.$$
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
# Q13
#
# Shell script to print contains of file from given line no to next
# given numberlines
#
#
# Print error / diagnostic for user if no arg's given
#
if [ $# -eq 0 ]
then
echo "$0:Error command arguments missing!"
echo "Usage: $0 start_line uptoline filename"
echo "Where start_line is line number from which you would like to print file"
echo "uptoline is line number upto which would like to print"
echo "For eg. $0 5 5 myfile"
echo "Here from myfile total 5 lines printed starting from line no. 5 to"
echo "line no 10."
exit 1
fi
#
# Look for sufficent arg's
#
if [ $# -eq 3 ]; then
if [ -e $3 ]; then
tail +$1 $3 | head -n$2
else
echo "$0: Error opening file $3"
exit 2
fi
else
echo "Missing arguments!"
fi
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
# Q14
# -c clear
# -d dir
# -m mc
# -e vi { editor }
#
#
# Function to clear the screen
#
cls()
{
clear
echo "Clear screen, press a key . . ."
read
return
}
#
# Function to show files in current directory
#
show_ls()
{
ls
echo "list files, press a key . . ."
read
return
}
#
# Function to start mc
#
start_mc()
{
if which mc > /dev/null ; then
mc
echo "Midnight commander, Press a key . . ."
read
else
echo "Error: Midnight commander not installed, Press a key . . ."
read
fi
return
}
#
# Function to start editor
#
start_ed()
{
ced=$1
if which $ced > /dev/null ; then
$ced
#
# Function to print help
#
print_help_uu()
{
echo "Usage: $0 -c -d -m -v {editor name}";
echo "Where -c clear the screen";
echo " -d show dir";
echo " -m start midnight commander shell";
echo " -e {editor}, start {editor} of your choice";
return
}
#
# Main procedure start here
#
# Check for sufficent args
#
if [ $# -eq 0 ] ; then
print_help_uu
exit 1
fi
#
# Now parse command line arguments
#
while getopts cdme: opt
do
case "$opt" in
c) cls;;
d) show_ls;;
m) start_mc;;
e) thised="$OPTARG"; start_ed $thised ;;
\?) print_help_uu; exit 1;;
esac
done
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
# Q15
#
if [ $temph -lt 12 ]
then
mess="Good Morning $LOGNAME, Have nice day!"
fi
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
# Q16
# echo command with escape sequance to give differnt effects
#
# Syntax: echo -e "escape-code your message, var1, var2 etc"
# For eg. echo -e "\033[1m Hello World"
# | |
# | |
# Escape code Message
#
clear
echo -e "\033[1m Hello World"
# bold effect
echo -e "\033[5m Blink"
# blink effect
echo -e "\033[0m Hello World"
# back to noraml
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
# Q17
# To run type at $ promot as
# $ q17 &
#
echo
echo "Digital Clock for Linux"
echo "To stop this clock use command kill pid, see above for pid"
echo "Press a key to continue. . ."
while :
do
ti=`date +"%r"`
echo -e -n "\033[7s" #save current screen postion & attributes
#
# Show the clock
#
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
show_datetime()
{
dialog --backtitle "Linux Shell Tutorial" --title "System date and Time" --infobox
"Date is `date`" 3 40
read
return
}
show_cal()
{
cal > menuchoice.temp.$$
dialog --backtitle "Linux Shell Tutorial" --title "Calender" --infobox "`cat
menuchoice.temp.$$`" 9 25
read
rm -f menuchoice.temp.$$
return
}
delete_file()
{
dialog --backtitle "Linux Shell Tutorial" --title "Delete file"\
--inputbox "Enter directory path (Enter for Current Directory)"\
10 40 2>/tmp/dirip.$$
rtval=$?
case $rtval in
1) rm -f /tmp/dirip.$$ ; return ;;
255) rm -f /tmp/dirip.$$ ; return ;;
esac
mfile=`cat /tmp/dirip.$$`
if [ -z $mfile ]
then
mfile=`pwd`/*
else
grep "*" /tmp/dirip.$$
if [ $? -eq 1 ]
then
mfile=$mfile/*
fi
fi
for i in $mfile
do
if [ -f $i ]
then
echo "$i Delete?" >> /tmp/finallist.$$
fi
done
rtval=$?
file2erase=`cat /tmp/file2delete.tmp.$$`
case $rtval in
0) dialog --backtitle "Linux Shell Tutorial" --title "Are you shur"\
--yesno "\n\nDo you want to delete : $file2erase " 10 60
if [ $? -eq 0 ] ; then
rm -f $file2erase
if [ $? -eq 0 ] ; then
dialog --backtitle "Linux Shell Tutorial"\
--title "Information: Delete Command" --infobox "File: $file2erase is
Sucessfully deleted,Press a key" 5 60
read
else
dialog --backtitle "Linux Shell Tutorial"\
--title "Error: Delete Command" --infobox "Error deleting File: $file2erase,
Press a key" 5 60
read
fi
else
dialog --backtitle "Linux Shell Tutorial"\
--title "Information: Delete Command" --infobox "File: $file2erase is not
deleted, Action is canceled, Press a key" 5 60
read
fi
;;
1) rm -f /tmp/dirip.$$ ; rm -f /tmp/finallist.$$ ;
rm -f /tmp/file2delete.tmp.$$; return;;
255) rm -f /tmp/dirip.$$ ; rm -f /tmp/finallist.$$ ;
rm -f /tmp/file2delete.tmp.$$; return;;
esac
rm -f /tmp/dirip.$$
rm -f /tmp/finallist.$$
rm -f /tmp/file2delete.tmp.$$
return
}
while true
do
dialog --clear --title "Main Menu" \
--menu "To move [UP/DOWN] arrow keys \n\
[Enter] to Select\n\
Choose the Service you like:" 20 51 4 \
"Date/time" "To see System Date & Time" \
"Calender" "To see Calaender"\
"Delete" "To remove file"\
"Exit" "To exit this Program" 2> menuchoice.temp.$$
retopt=$?
choice=`cat menuchoice.temp.$$`
rm -f menuchoice.temp.$$
case $retopt in
0)
case $choice in
Date/time) show_datetime ;;
Calender) show_cal ;;
Delete) delete_file ;;
Exit) exit 0;;
esac
;;
1) exit ;;
255) exit ;;
esac
done
clear
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
# Q19
#
nouser=`who | wc -l`
echo -e "User name: $USER (Login name: $LOGNAME)" >> /tmp/info.tmp.01.$$$
echo -e "Current Shell: $SHELL" >> /tmp/info.tmp.01.$$$
echo -e "Home Directory: $HOME" >> /tmp/info.tmp.01.$$$
echo -e "Your O/s Type: $OSTYPE" >> /tmp/info.tmp.01.$$$
echo -e "PATH: $PATH" >> /tmp/info.tmp.01.$$$
echo -e "Current directory: `pwd`" >> /tmp/info.tmp.01.$$$
echo -e "Currently Logged: $nouser user(s)" >> /tmp/info.tmp.01.$$$
if [ -f /etc/redhat-release ]
then
echo -e "OS: `cat /etc/redhat-release`" >> /tmp/info.tmp.01.$$$
fi
if [ -f /etc/shells ]
then
echo -e "Available Shells: " >> /tmp/info.tmp.01.$$$
echo -e "`cat /etc/shells`" >> /tmp/info.tmp.01.$$$
fi
if [ -f /etc/sysconfig/mouse ]
then
echo -e "--------------------------------------------------------------------" >>
/tmp/info.tmp.01.$$$
echo -e "Computer Mouse Information: " >> /tmp/info.tmp.01.$$$
echo -e "--------------------------------------------------------------------" >>
/tmp/info.tmp.01.$$$
echo -e "`cat /etc/sysconfig/mouse`" >> /tmp/info.tmp.01.$$$
fi
echo -e "--------------------------------------------------------------------" >>
/tmp/info.tmp.01.$$$
echo -e "Computer CPU Information:" >> /tmp/info.tmp.01.$$$
echo -e "--------------------------------------------------------------------" >>
/tmp/info.tmp.01.$$$
cat /proc/cpuinfo >> /tmp/info.tmp.01.$$$
if [ -d /proc/ide/hda ]
then
echo -e "--------------------------------------------------------------------" >>
/tmp/info.tmp.01.$$$
echo -e "Hard disk information:" >> /tmp/info.tmp.01.$$$
echo -e "--------------------------------------------------------------------" >>
/tmp/info.tmp.01.$$$
rm -f /tmp/info.tmp.01.$$$
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
echo "Stars"
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
echo "Stars"
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
clear
if [ $i -eq 3 ]; then
echo -n "______"
echo -n -e ">> Powerd Server.\n"
else
echo "~~~~~"
fi
done
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
MAX_NO=0
clear
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# Linux Shell Scripting Tutorial 1.05r3, Summer-2002
#
# Written by Vivek G. Gite <[email protected]>
#
# Latest version can be found at http://www.nixcraft.com/
#
MAX_NO=0
clear
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#
# main logic is here
#
{
isdir1 = "[ -d " $1 " ] "
isdir2 = "[ -d " $2 " ] "
scriptname = "up2low"
awkscriptname = "rename.awk"
sfile = $1
dfile = $2
#
# we are not suppose to rename dirs in source or destination
#
#
# make sure we are renaming our self if in same dir
#
if ( sfile == scriptname || sfile == awkscriptname )
next
else if( ( system(isdir1) ) == 0 || system((isdir2)) == 0 )
{
printf "%s or %s is directory can't rename it to lower case\n",sfile,dfile
next # continue with next recored
}
else if ( sfile == dfile )
{
printf "Skiping, \"%s\" is alrady in lowercase\n",sfile
next
}
else # everythink is okay rename it to lowercase
{
mvcmd = "mv " sfile " " dfile
printf "Renaming %s to %s\n",sfile,dfile
system(mvcmd)
}
}
#
# End action, if any, e.g. clean ups
#
END{
}
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#!/bin/bash
#
# up2low : script to convert upercase filename to lowercase in current
# working dir
# Author : Vivek G. Gite <[email protected]>
#
#Copy this file to your bin directory i.e. $HOME/bin as cp rename.awk $HOME/bin
#
AWK_SCRIPT="rename.awk"
#
# change your location here
#
awkspath=$HOME/bin/$AWK_SCRIPT
ls -1 > /tmp/file1.$$
rm -f /tmp/file1.$$
rm -f /tmp/file2.$$
#
# Make sure awk script exist
#
if [ -f $awkspath ]; then
awk -f $awkspath /tmp/tmpdb.$$
else
echo -e "\n$0: Fatal error - $awkspath not found"
echo -e "\nMake sure \$awkspath is set correctly in $0 script\n"
fi
rm -f /tmp/tmpdb.$$
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
Note: This file is part of Linux Shell Scripting Tutorial, and contains many Linux/Unix definition,
miscellaneous concepts and answer to many shell scripts exercise section.
Free
Linux is free.
First ,It's available free of cost (You don't have to pay to use this OS, other OSes like MS-Windows or
Commercial version of Unix may cost you money)
Second free means freedom to use Linux, i.e. when you get Linux you will also get source code of Linux,
so you can modify OS (Yes OS! Linux OS!!) according to your taste.
It also offers many Free Software applications, programming languages, and development tools etc. Most
of the Program/Software/OS are under GNU General Public License (GPL).
Unix Like
Unix is almost 35 year old Os.
In 1964 OS called MULTICS (Multiplexed Information and Computing System) was developed by Bell
Labs, MIT & General Electric. But this OS was not the successful one.
Then Ken Thompson (System programmer of Bell Labs) thinks he could do better (In 1991, Linus
Torvalds felt he could do better than Minix - History repeats itself.). So Ken Thompson wrote OS on
PDP - 7 Computer, assembler and few utilities, this is know as Unix (1969). But this version of Unix is
not portable. Then Unix was rewrote in C. Because Unix written in 'C', it is portable. It means Unix can
run on verity of Hardware platform (1970-71).
At the same time Unix was started to be distribute to Universities. There students and professor started
more experiments on Unix. Because of this Unix gain more popularity, also several new features are
added to Unix. Then US govt. & military used Unix for there inter-network (now it is know as
INTERNET).
So Unix is Multi-user, Multitasking, Internet-aware Network OS. Linux almost had same Unix Like
feature for e.g.
● Like Unix, Linux is also written in C.
❍ Macintosh PC's
❍ Cyrix processor
❍ AMD processor
❍ Sun Microsystems Sparc processor
❍ Alpha Processor (Compaq)
Open Source
Linux is developed under the GNU Public License. This is sometimes referred to as a "copyleft", to
distinguish it from a copyright.
Under GPL the source code is available to anyone who wants it, and can be freely modified, developed,
and so forth. There are only a few restrictions on the use of the code. If you make changes to the
programs , you have to make those changes available to everyone. This basically means you can't take
the Linux source code, make a few changes, and then sell your modified version without making the
source code available. For more details, please visit the open-source home page.
Now every time you have to give all this detailed as you work in other directory, this take time and you
have to remember complete path.
There is another way, if you notice that all of our programs (in form of executable files) are marked as
executable and can be directly executed from prompt from any directory. (To see executables of our
normal program give command $ ls -l /bin ) By typing commands like
$ bc
$ cc myprg.c
$ cal
etc, How its possible? All our executables files are installed in directory called /bin and /bin directory is
set in your PATH setting, Now when you type name of any command at $ prompt, what shell do is it first
look that command in its internal part (called as internal command, which is part of Shell itself, and
always available to execute), if found as internal command shell will execute it, If not found It will look
for current directory, if found shell will execute command from current directory, if not found, then Shell
will Look PATH setting, and try to find our requested commands executable file in all of the directories
mentioned in PATH settings, if found it will execute it, otherwise it will give message "bash: xxxx
:command not found", Still there is one question remain can I run my shell script same as these
executables?, Yes you can, for this purpose create bin directory in your home directory and then copy
your tested version of shell script to this bin directory. After this you can run you script as executable file
without using command like
$ /bin/sh /home/vivek/first
Command to create you own bin directory.
$ cd
$ mkdir bin
$ cp first ~/bin
$ first
Q.4.How to define two variable x=20, y=5 and then to print division of x and y (i.e. x/y)
For Ans. Click here
$x=20
$ y=5
$ expr x / y
Parameter substitution.
Now consider following command
$($ echo 'expr 6 + 3')
The command ($ echo 'expr 6 + 3') is know as Parameter substitution. When a command is enclosed
in backquotes, the command get executed and we will get output. Mostly this is used in conjunction with
other commands. For e.g.
$pwd
$cp /mnt/cdrom/lsoft/samba*.rmp `pwd`
Now suppose we are working in directory called "/home/vivek/soft/artical/linux/lsst" and I want to copy
some samba files from "/mnt/cdrom/lsoft" to my current working directory, then my command will be
something like
$cp /mnt/cdrom/lsoft/samba*.rmp /home/vivek/soft/artical/linux/lsst
Instead of giving above command I can give command as follows
$cp /mnt/cdrom/lsoft/samba*.rmp `pwd`
Here file is copied to your working directory. See the last Parameter substitution of `pwd` command,
expand it self to /home/vivek/soft/artical/linux/lsst. This will save my time.
$cp /mnt/cdrom/lsoft/samba*.rmp `pwd`
AND
$cp /mnt/cdrom/lsoft/samba*.rmp .
Answer to if command.
A) There is file called foo, on your disk and you give command, $ ./trmfi foo what will be output.
Ans.: foo file will be deleted, and message "foo file deleted" on screen will be printed.
B) If bar file not present on your disk and you give command, $ ./trmfi bar what will be output.
Ans.: Message "rm: cannot remove `bar': No such file or directory" will be printed because bar file does
not exist on disk and we have called rm command, so error from rm commad
C) And if you type $ ./trmfi, What will be output.
Ans.: Following message will be shown by rm command, because rm is called from script without any
parameters.
rm: too few arguments
Try `rm --help' for more information.
Above echo statement uses ANSI escape sequence (\033[34m), above entire string ( i.e. "\033[34m
Hello Colorful World!" ) is process as follows
1) First \033, is escape character, which causes to take some action
2) Here it set screen foreground color to Blue using [34m escape code.
3) Then it prints our normal message Hello Colorful World! in blue color.
Note that ANSI escape sequence begins with \033 (Octal value) which is represented as ^[ in termcap
and terminfo files of terminals and documentation.
You can use echo statement to print message, to use ANSI escape sequence you must use -e option
This is just quick introduction about Linux Console and what you can do using this Escape sequence.
Above table does not contains entire CSI sequences. My up-coming tutorial series on C Programming
Language will defiantly have entire story with S-Lang and curses (?). What ever knowledge you gain
here will defiantly first step towards the serious programming using c. This much knowledge is sufficient
for Shell Programming, now try the following exercise :-) I am Hungry give me More Programming
Exercise & challenges! :-)
1) Write function box(), that will draw box on screen (In shell Script)
box (left, top, height, width)
For e.g. box (20,5,7,40)
For e.g.
$ echo -e "\033[5;10H Hello"
$ echo -e "\033[6;10f Hi"
In Above example prints Hello message at row 5 and column 6 and Hi at 6th row and 10th Column.
dialog --title "Linux Dialog Utility Infobox" --backtitle "Linux Shell Script\
Tutorial" --infobox "This is dialog box called infobox, which is used \
to show some information on screen, Thanks to Savio Lam and\
Stuart Herbert to give us this utility. Press any key. . . " 7 50 ; read
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
dialog --title "Linux Dialog Utility Msgbox" --backtitle "Linux Shell Script\
Tutorial" --msgbox "This is dialog box called msgbox, which is used \
to show some information on screen which has also Ok button, Thanks to Savio Lam\
and Stuart Herbert to give us this utility. Press any key. . . " 9 50
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
dialog --title "Inputbox - To take input from you" --backtitle "Linux Shell\
Script Tutorial" --inputbox "Enter your name please" 8 60 2>/tmp/input.$$
sel=$?
na=`cat /tmp/input.$$`
case $sel in
0) echo "Hello $na" ;;
1) echo "Cancel is Press" ;;
255) echo "[ESCAPE] key pressed" ;;
esac
rm -f /tmp/input.$$
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
#
#How to create small menu using dialog
#
dialog --backtitle "Linux Shell Script Tutorial " --title "Main \
Menu" --menu "Move using [UP] [DOWN],[Enter] to \
Select " 15 50 3 \
Date/time "Shows Date and Time" \
Calendar "To see calendar " \
Editor "To start vi editor " 2>/tmp/menuitem.$$
menuitem=`cat /tmp/menuitem.$$`
opt=$?
case $menuitem in
Date/time) date;;
Calendar) cal;;
Editor) vi;;
esac
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
11 Vivek
12 Renuka
13 Prakash
14 Ashish
15 Rani
11 67
12 55
13 96
14 36
15 67
egg order 4
cacke good 10
cheese okay 4
pen good 12
Floppy good 5
Hello I am vivek
12333
12333
welcome
to
sai computer academy, a'bad.
what still I remeber that name.
oaky! how are u luser?
what still I remeber that name.
hello world!
cartoons are good
especially toon like tom (cat)
what
the number one song
12221
they love us
I too
Hello World.
This is vivek from Poona.
I love linux.
It is different from all other Os
Do you know?
. (DOT) is special command of linux.
1. Pen 5 20.00
2. Pencil 10 2.00
3. Rubber 3 3.50
4. Cock 2 45.50
{
print $1 " + " $2 " = " $1 + $2
print $1 " - " $2 " = " $1 - $2
print $1 " / " $2 " = " $1 / $2
print $1 " x " $2 " = " $1 * $2
print $1 " mod " $2 " = " $1 % $2
}
{
no1 = $1
no2 = $2
ans = $1 + $2
print no1 " + " no2 " = " ans
}
{
total = $3 * $4
recno = $1
item = $2
print recno item " Rs." total
}
BEGIN {
print "---------------------------"
print "Bill for the 4-March-2001. "
print "By Vivek G Gite. "
print "---------------------------"
}
{
total = $3 * $4
recno = $1
item = $2
gtotal += total
print recno item " Rs." total
}
END {
print "---------------------------"
print "Total Rs." gtotal
print "==========================="
}
BEGIN {
printf "Bill for the 4-March-2001.\n"
printf "By Vivek G Gite.\n"
printf "---------------------------\n"
}
{
total = $3 * $4
recno = $1
item = $2
gtotal += total
printf "%d %s Rs.%f\n", recno, item, total
#printf "%2d %-10s Rs.%7.2f\n", recno, item, total
}
END {
printf "---------------------------\n"
printf "Total Rs. %f\n" ,gtotal
#printf "\tTotal Rs. %7.2f\n" ,gtotal
printf "===========================\n"
}
BEGIN {
printf "Bill for the 4-March-2001.\n"
printf "By Vivek G Gite.\n"
printf "---------------------------\n"
}
{
total = $3 * $4
recno = $1
item = $2
gtotal += total
printf "%2d %-10s Rs.%7.2f\n", recno, item, total
}
END {
printf "---------------------------\n"
printf "\tTotal Rs. %6.2f\n" ,gtotal
printf "===========================\n"
}
BEGIN {
myprompt = "(To Stop press CTRL+D) > "
printf "Welcome to MyAddtion calculation awk program v0.1\n"
printf "%s" ,myprompt
}
{
no1 = $1
op = $2
no2 = $3
ans = 0
if ( op == "+" )
{
ans = $1 + $3
printf "%d %c %d = %d\n" ,no1,op,no2,ans
printf "%s" ,myprompt
}
else
{
printf "Opps!Error I only know how to add.\nSyntax: number1 + number2\n"
printf "%s" ,myprompt
}
}
END {
printf "\nGoodbuy %s\n" , ENVIRON["USER"]
}
BEGIN{
printf "Press ENTER to continue with for loop example from LSST v1.05r3\n"
}
{
sum = 0
i = 1
for (i=1; i<=10; i++)
{
sum += i; # sum = sum + i
}
printf "Sum for 1 to 10 numbers = %d \nGoodbuy!\n\n", sum
exit 1
}
/home/vivek/awks/temp/file1 /home/vivek/final
/home/vivek/awks/temp/file2 /home/vivek/final
/home/vivek/awks/temp/file3 /home/vivek/final
/home/vivek/awks/temp/file4 /home/vivek/final
{
dcmd = "rm " $1
if ( system(dcmd) != 0 )
printf "rm command not successful\n"
else
printf "rm command is successful and %s file is removed \n", $1
}
BEGIN {
printf "Your name please:"
getline na < "-"
printf "%s your age please:",na
getline age < "-"
print "Hello " na, ", next year you will be " age + 1
}
BEGIN{
"date" | getline
print $0
}
BEGIN{
"date" | getline today
print today
}
#
#temp2final1.awk: Version 2
#Linux Shell Scripting Tutorial v1.05, March 2001
#
#Author: Vivek G Gite
#
#
#This version checks for source and destination file first
#then copy the file. If file alrady exist it will ask confirmation.
#
#
#
BEGIN{
}
#
# main logic is here
#
{
sfile = $1
dfile = $2
issexist = "[ -e " $1 " ]"
isdexist = "[ -e " $2 " ]"
cpcmd = "cp " $1 " " $2
printf "Coping %s to %s\n",sfile,dfile
if( ( system(issexist) ) != 0 )
{
printf "Skipking \"%s\", does not exist\n",sfile
next # read next record
}
if ( ( system(isdexist) ) == 0)
{
printf "\"%s\", exist overwrite(y/N)?", sfile
getline ans < "-"
if( ans == "y" || ans == "Y")
system(cpcmd)
}
else
system(cpcmd)
}
#
# End action, if any, e.g. clean ups
#
END{
}
#
# ./ch.sh: vivek-tech.com to nixcraft.com referance converted using this tool
# See the tool at http://www.nixcraft.com/uniqlinuxfeatures/tools/
#
Hello World.
This is vivek from Poona.
I love linux.
It is different from all other Os
Do you know?
. (DOT) is special command of linux.
1i\
Price of all items changes from 1st-April-2001
/Pen/s/20.00/19.5/
/Pencil/s/2.00/2.60/
/Rubber/s/3.50/4.25/
/Cock/s/45.50/51.00/
/^\*\{2,3\}$/,/^\*\{2,3\}$/{
/^$/d
s/Linux/Linux-Unix/
}
-----------------------------------------------------------------------
Name of Friend DOB Hobby Phone #
-----------------------------------------------------------------------
V.K. Rajopadhey 5/12/73 Food, Music 98220-5678
5/22,Stree 4,
A'bad,MH, INDIA.