Computer Networks

Chapter 07
(version June 13, 2007)

Maarten van Steen

Vrije Universiteit Amsterdam, Faculty of Sciences
Dept. Computer Science
Room R4.20. Tel: (020) 598 7784
E-mail: [email protected], URL: www.cs.vu.nl/∼steen/

01 Introduction
02 Physical Layer
03 Data Link Layer
04 MAC Sublayer
05 Network Layer
06 Transport Layer
07 Application Layer
08 Network Security

00 – 1 /

Application Layer

• Domain Name System

• Electronic Mail

• World Wide Web

• Multimedia

07 – 1 Application Layer/
 The Domain Name System
Basic idea: Every host has a worldwide unique name
that is bound to an IP address. DNS provides name-
lookup facilities: when given a hostname, it returns
that host’s IP address.

Generic Countries

int com edu gov mil org net jp us nl ...

sun yale acm ieee ac co oce vu

eng cs eng jack jill keio nec cs

ai linda cs csl flits fluit

robot pc24

A domain name is a path from a leaf node up to

the root. A domain is a subtree in the domain name
space.

Each domain can have a set of resource records

which are stored (in a file) at name servers.
07 – 2 Application Layer/7.1 Domain Name System

DNS Name Servers

Basic idea: Divide the name space into a collection
of non-overlapping zones, and let each zone be taken
care of by one or more name servers:

Generic Countries

int com edu gov mil org net jp us nl ...

sun yale acm ieee ac co oce vu

eng cs eng jack jill keio nec cs

ai linda cs csl flits fluit

robot pc24

Note: There can be several servers per zone. Most of

the time, secondary masters pull in their information
from a primary master. The latter gets its info from
domain administrators.

A resolver is capable of sending DNS queries to a

name server. A resolver is often just a collection of
library routines that can be linked to an application.
07 – 3 Application Layer/7.1 Domain Name System
 Resource Records
Type Associated
Description
entity
SOA Zone Holds information on the repre-
sented zone
A Host Contains an IP address of the host
this node represents
MX Domain Refers to a mail server to handle
mail addressed to this node
SRV Domain Refers to a server handling a spe-
cific service
NS Zone Refers to a name server that imple-
ments the represented zone
CNAME Node Symbolic link with the primary
name of the represented node
PTR Host Contains the canonical name of a
host
HINFO Host Holds information on the host this
node represents
TXT Any kind Contains any entity-specific infor-
mation considered useful

07 – 4 Application Layer/7.1 Domain Name System

DNS Iterative Name Resolution

1. <nl,vu,cs,ftp>
Root
2. #<nl>, <vu,cs,ftp> name server
nl
3. <vu,cs,ftp> Name server
nl node
Client's 4. #<vu>, <cs,ftp>
name vu
resolver 5. <cs,ftp> Name server
vu node
6. #<cs>, <ftp>
cs
7. <ftp> Name server
8. #<ftp> cs node

ftp
<nl,vu,cs,ftp> #<nl,vu,cs,ftp>
Nodes are
managed by
the same server

Note: Name resolution can be iterative, in which the

client repeatedly asks name servers to resolve part of
a name.

07 – 5 Application Layer/7.1 Domain Name System

 DNS Recursive Name Resolution
1. <nl,vu,cs,ftp>
Root
8. #<nl,vu,cs,ftp> name server 2. <vu,cs,ftp>

7. #<vu,cs,ftp> Name server

nl node 3. <cs,ftp>
Client's
name
resolver 6. #<cs,ftp> Name server
vu node 4. <ftp>

5. #<ftp> Name server

cs node

<nl,vu,cs,ftp> #<nl,vu,cs,ftp>

Note: With recursive resolution, a higher level server

passes the query to a lower one instead of passing it
back to the querying server.

Question: What is the main drawback of recursion?

Important: The main reason why DNS works is that it

assumes that name–to–address bindings hardly change.
This means that we can effectively cache bindings lo-
cally, saving the trouble of having to go to the actual
name server.
07 – 6 Application Layer/7.1 Domain Name System

DNS Address Resolution

Guess what: You can also find the name of a host

when given its address:

% host 192.31.231.80
% 80.231.31.192.in-addr.arpa domain name pointer veldersschuit.cs.vu.nl.

Solution: IP addresses are stored in the special in-

addr.arpa domain:

arpa

in-addr

0 192 255

0 31 255

0 231 255

0 80 255

07 – 7 Application Layer/7.1 Domain Name System

 Electronic Mail

Main issue: Mail is really not that interesting: you

just send mail to a mail server who takes care about
delivery:

User agent mbox

User agent mbox

User agent mbox

Message
transfer
agent

To/from other message

transfer agents

07 – 8 Application Layer/7.2 Electronic Mail

Email: Message Transfer

Basic idea: The message transfer agent extracts the
destination host from the message, and queries DNS
to obtain the destination address. DNS keeps track of
mailers in MX records:

cs.vu.nl mail is handled (pri=10) by zephyr.cs.vu.nl

cs.vu.nl mail is handled (pri=10) by tornado.cs.vu.nl
cs.vu.nl mail is handled (pri=20) by top.cs.vu.nl
cs.vu.nl mail is handled (pri=30) by solo.cs.vu.nl

Example: mail for [email protected] is first sent to the

message transfer agent on zephyr.cs.vu.nl, then tor-
nado, etc. Of course, zephyr is looked up as well.

The message transfer agent extracts the user and makes

an attempt to deposit the incoming message into the
user’s mailbox. The user may then be notified.

Note: We’re assuming that the user’s mailbox is ac-

cessible for the agent, not necessarily the user. Pro-
tocols exist that allow a user to remotely access the
mailbox.
07 – 9 Application Layer/7.2 Electronic Mail
 Email: Message Format (1/2)

Basic idea: Don’t prescribe anything concerning the

content of a message, but specify only the header:

To: e-mail address(es) main destination

Cc: e-mail address(es) to send copies
Bcc: e-mail address(es) to send blind copies
From: name of sender(s)
Sender: e-mail address sender
Received: line added by each intermediate transfer agent
Return-path: return address

Note: The From: field is often the same as Sender:,

so that the latter can be left out.

07 – 10 Application Layer/7.2 Electronic Mail

Email: Message Format (2/2)

Problem: Too many e-mail messages have specific
content that requires special applications to process.
We therefore need information on content (meta-data).

Solution: Extend header info with MIME fields (Multi-

purpose Internet Mail Extensions).
Text Plain unformatted
Richtext formatted RTF
Image Gif GIF still
Jpeg JPEG still
Audio Basic
Video Mpeg MPEG video
Application Octet-stream binaries
Postscript printable doc
Message RFC822 Embedded rfc822 msg
Partial more to follow
External-body provide URL
Multipart Mixed independent parts
Alternative same in diff. formats
Parallel view all at once
Digest set of rfc822s
07 – 11 Application Layer/7.2 Electronic Mail
 Email: Message Transfer
SMTP: (Simple Mail Transfer Protocol) Really simple:
(1) set up TCP/IP connection between client and server;
(2) client requests server to accept its messages; (3) server
responds, so that client can send.

Note: Client is often a message transfer agent, but

could also be the user agent.

User agent mbox

User agent mbox

User agent mbox

Message
transfer
agent

To/from other message

transfer agents

Question: What’s the drawback of letting the user

agent contact a remote mail server?
07 – 12 Application Layer/7.2 Electronic Mail

POP3 (1/2)

Problem: a user’s mailbox may be stored on a differ-

ent machine than the user agent. We need remote
access to incoming (and actually also outgoing) mes-
sages ⇒ Post Office Protocol:

SMTP Internet Message User

transfer agent
agent

(a) Sending Permanent Mailbox Receiving

host connection host

SMTP Internet Message POP3 User

POP3
transfer agent
server
agent

(b) Sending Mailbox ISP's Dial-up User's

host machine connection PC

07 – 13 Application Layer/7.2 Electronic Mail

 POP3 (2/2)
Client Server
+OK POP3 server ready
USER carolyn
+OK
PASS vegetables
+OK login successful
LIST
1 2505
2 14302
3 8122
.
RETR 1
(sends message 1)
DELE 1
RETR 2
(sends message 2)
DELE 2
RETR 3
(sends message 3)
DELE 3
QUIT
+OK POP3 server disconnecting

07 – 14 Application Layer/7.2 Electronic Mail

IMAP

Observation: POP3 (implicitly) assumes that retrieved

mail is deleted at the server. Not a good idea for peo-
ple wanting to access mail from different computers.
The Internet Message Access Protocol solves this
problem.

Feature POP3 IMAP

Where is e-mail stored User’s PC Server
Where is e-mail read Off-line On-line
Connect time required Little Much
Use of server resources Minimal Extensive
Multiple mailboxes No Yes
Who backs up mailboxes User ISP
Good for mobile users No Yes
User control over downloading Little Great
Partial message downloads No Yes
Are disk quotas a problem No Could be in time
Simple to implement Yes No
Widespread support Yes Growing

07 – 15 Application Layer/7.2 Electronic Mail

 World Wide Web
Basic model: Users and organizations maintain pages
of information that contain references to each other as
hyperlinks. Selecting a link has the effect of pulling
in the referenced page.

• The client has a Web browser that can display

Web pages. Web pages are formatted in a spe-
cial markup language which is interpreted by the
browser. This allows for fancy typefonts and the
like.
• A hyperlink identifies a (remote) Web server that
has access to the referred Web page. When se-
lecting a link, the browser establishes a TCP con-
nection to the server, and the page is transferred
to the user.
• A Web server listens for connection requests, ac-
cepts one request, returns the page over the con-
nection, and closes it again. A connected client
and server speak HTTP (HyperText Transfer Pro-
tocol).

07 – 16 Application Layer/7.3 WWW

WWW – Client/Server Interaction

Server Server
Client abcd.com xyz.com
Current page
displayed by
browser

Hyperlink
to abcd.com
Hyperlink
Browser to xyz.com
program

Disk Web Disk Web

Server Server

TCP connection

The Internet

Note: When a client receives a new Web page, it can

access other servers through the links contained in
that new page.

Note: Each special feature in a page (i.e. in-line im-

ages) is transferred separately after the page has been
copied to the client. This also means establishing and
releasing several connections to the original server.
Alternative solutions also exist.
07 – 17 Application Layer/7.3 WWW
 Web Servers
Issue: Most servers need to process many incom-
ing requests. An often applied design is to use multi-
threaded servers, and sometimes even server farms:

Web server machine

Cache
Processing
module
(thread)

Front end

Incoming Outgoing
request reply

Router Processing node Thread

(separate computer) pipeline

LAN
Front end

07 – 18 Application Layer/7.3 WWW

URL – Uniform Resource Locators

Essence: A URL contains three informative parts:

(1) the name of a page, (2) the name of its location,
(3) the access protocol:

Name Usage Example

http Hypertext http://www.cs.vu.nl/~steen/cn/
ftp File transfer ftp://ftp.cs.vu.nl/pub/minix/README
file Local file file:/home/steen/www/cn/index.html
news News group news:comp.os.minix
news News article news:[email protected]
gopher Gopher gopher://gopher.tc.umn.edu/11/Libs
mailto Sending email mailto:[email protected]
telnet Remote login telnet://www.w3.org:80

Disadvantage: URLs contain location information: they

refer to the location where a page is found. This makes
it much harder to move pages around and to replicate
them. In both cases, you don’t care where the page
is, but just that it has a worldwide unique name.

07 – 19 Application Layer/7.3 WWW

 Cookies

Issue: The Web is stateless: servers do not keep

track of their clients. However, this may be (mis)useful
in many cases. Solution: drop a cookie at the client
side containing server state relevant for that client.
Domain Content
toms-casino.com CustomerID=497793521
joes-store.com Cart=1-00501;1-07031;2-13721
aportal.com Prefs=Stk;SUNW+ORCL;Spt:Jets
sneaky.com UserID=3627239101

Note: There is also an Expires field; The Secure field

indicates that a cookie may be returned only to a se-
cure server.

Basic idea: When a browser contacts a server, a re-

lated cookie is sent to the server, after which a page
can be displayed relevant to that cookie/client.

07 – 20 Application Layer/7.3 WWW

Dynamic Web Pages

Essence: Instead of storing and returning statically

defined Web pages, servers often generate pages on-
the-fly:

1. User fills in form

Data 2. Form sent back
CGI base 3. Handed to CGI
Browser Server script on disk 4. CGI queries DB
User
5. Record found
1 2 3 4
6. CGI builds page
8 7 6 5 7. Page returned
8. Page displayed

Common Gateway Interface: CGI essentially allows

you to identify a program and its parameters in a URL.
The server will start a process to execute that pro-
gram, which, in turn, will return its results (if any) as a
regular Web page.

07 – 21 Application Layer/7.3 WWW

 Scripting and Web Pages

Alternative approach: Let Web pages incorporate

interepretable code; when a page is being processed,
the embedded script is simply executed. Distinguish
server-side and client-side solutions:

Browser Server Browser Server

User User
1 2 1

4 3 2

(a) PHP module JavaScript (b)

07 – 22 Application Layer/7.3 WWW

HTTP (1/2)

Essence: Communication in the Web is generally based

on the HyperText Transfer Protocol; a relatively sim-
ple client-server transfer protocol having the following
request messages:
Operation
Description
Head Request to return the header of a document
Get Request to return a document to the client
Put Request to store a document
Post Provide data that are to be added to a docu-
ment (collection)
Delete Request to delete a document

07 – 23 Application Layer/7.3 WWW

 HTTP (2/2)
C/S
Header Contents
Accept C The type of documents the client can handle
Accept-Charset C The character sets are acceptable for the client
Accept- C The document encodings the client can handle
Encoding
Accept- C The natural language the client can handle
Language
Authorization C A list of the client’s credentials
Date C+S Date and time the message was sent
ETag S The tags associated with the returned document
Expires S The time for how long the response remains valid
From C The client’s e-mail address
Host C The server’s DNS name
If-Match C The tags the document should have
If-None-Match C The tags the document should not have
If-Modified- C Tells the server to return a document only if it has
Since been modified since the specified time
If-Unmodified- C Tells the server to return a document only if it has
Since not been modified since the specified time
Last-Modified S The time the returned document was last modified
Location S A document reference to which the client should
redirect its request
Referer C Refers to client’s most recently requested document
Upgrade C+S The application protocol sender wants to switch to
Warning C+S Information about status of the data in the message

07 – 24 Application Layer/7.3 WWW

WWW – Proxy Servers

Original idea: It is also possible to transfer informa-

tion referenced by a different transfer protocol (notably
FTP). If the browser does not speak that protocol, a
proxy was used.

Now: Proxies are mainly used to enhance Web per-

formance by caching responses. The proxy cache
simply keeps previously requested pages and returns
them on the next request.

Proxy Internet Proxy

Client Client-side ISP

machine LAN LAN

07 – 25 Application Layer/7.3 WWW

 Content Delivery Networks

Basic idea: Install a bunch of servers across the In-

ternet and simply replicate Web pages on those servers.
Be sure to redirect clients to the nearest replica server.

1. Look up www.furryvideo.com
DNS server 2. Furry's IP address returned
3. Request HTML page from Furry
1 2 5 6 4. HTML page returned
5. After click, look up cdn-server.com
6. IP address of cdn-server returned
www.furry- 3 7 cdn-server
Client 7. Ask cdn-server for bears.mpg
video.com (fake HTTP)
4 8 8. Client told to redirect to CDN-0420.com
9. Request bears.mpg
9 10
Cache on disk 10. Cached file bears.mpg returned

Proxy

CDN-0420.com

Example: looking up www.furry-video.com which is a

page containing references to replicated web pages
(identified as http://cdn-server.com/...).

07 – 26 Application Layer/7.3 WWW

Multimedia

Issue: The Internet is by-and-large turning partly into

an infrastructure for broadcasting multimedia streams.
Streams consist of packets containing samples of au-
dio and video, possibly augmented with data (such as
used for subtitles or meta-information).

Streaming audio: The simplest way to handle this

type of streaming:

Client machine Server machine 1. Establish TCP connection

2. Send HTTP GET request
1, 2 3. Server gets file from disk
Media Web
Browser 4. File sent back
player server
4 5. Browser writes file to disk
6 5 3 6. Media player fetches file
block by block and plays it
Disk Disk

Problem: There’s no real streaming; instead a (po-

tentially very large) file is sent to the client for play-
back.
07 – 27 Application Layer/7.4 Multimedia
 Real Time Streaming Protocol

Better solution: Let the browser start an media player

application that sets up a connection to the server,
which in turn starts streaming packets to the player.
Note: we are using RTP on top of UDP. To reduce
jitter, buffers are used:

Client machine Server machine

Buffer
Media Media
player server

Low- High-
water water
mark mark

Command Description
DESCRIBE List media parameters
SETUP Establish channel
PLAY Start sending data to client
RECORD Start accepting data from client
PAUSE Temporarily stop sending data
TEARDOWN Release channel

07 – 28 Application Layer/7.4 Multimedia

Voice over IP
Essence: Instead of using traditional circuit-switching
technology, it may pay off to send digitized voice over
a packet-switching network. Two groups defined a
standard. ITU (the telcos) invented H.323. It’s big,
as all other ITU protocols are. The IETF invented SIP.
It’s simpler, like most IETF protocols.

Session Initiation Protocol: It deals only with setup,

management, and termination of sessions. The data
transport should use other protocols like RTP.

Method Description
INVITE Request initiation of a session
ACK Confirm initiation of session
BYE Request termination of session
OPTIONS Query a host about capabilities
CANCEL Cancel a pending request
REGISTER Inform redirection server about current location

SIP is text-based and runs on UDP as well as TCP.

Users are addressed through, for example, telephone
URLs.
07 – 29 Application Layer/7.4 Multimedia
 SIP in Practical Use

Location server

2 LOOKUP

3 REPLY
Proxy
Caller Callee

1 INVITE 4 INVITE
6 OK 5 OK
7 ACK 8 ACK

9 Data

07 – 30 Application Layer/7.4 Multimedia

Video-on-Demand (1/2)

Two models: (1) The user can request any video, and
stop the incoming stream at any time. (2) The provider
broadcasts popular videos, but starts several at short
intervals (near video on demand).

Video Switch
server Customer's
house

Fiber
Local
spooling
ATM or SONET server
backbone network

Audio Local distribution

server network

07 – 31 Application Layer/7.4 Multimedia

 Video-on-Demand (2/2)
Note: The video server can be pretty hot stuff: it re-
quires a lot of storage, which will include tape archives,
optical disks (as in a juke box), and arrays of magnetic
disks (RAIDs).

Note: The client will have a set-top box, which is just

a simple computer that does the (MPEG) decoding,
has an interface to the network, and controls the TV
set (monitor & remote control).

Big problem: How are we ever going to get the band-

width to our homes (the local loop problem).

Really big problem: There are so many possible so-

lutions, and all of them cost a lot. What we’ll need is
a convergence of solutions to standards. This means
a lot of experimentation in the coming years, much of
which is already going on (ADSL, Fiber-to-the-house,
etc.)
07 – 32 Application Layer/7.4 Multimedia