Semantic Web and Ontology Engineering: ITKS544
Semantic Web and Ontology Engineering: ITKS544
former names:
TIES429 , TLI364 – Semantic Web and Web Services
TLI372 – Intelligent Information Integration in Mobile Environment
Course Introduction
Vagan Terziyan
Department of Mathematical Information Technology, University of Jyvaskyla
[email protected], URL:http://www.cs.jyu.fi/ai/vagan
+358 14 260-4618
Package of courses
Java programming (desirable),
AI basics
Fall Spring
Design of distributed, self-descriptive, autonomous,
proactive, self-managed, interoperable, intelligent
systems, Web-applications and services
2
TIES-433 – Design of Agent-Based Systems
4
Course Introduction:
Semantic Web - new Possibilities for
Intelligent Web Applications
5
Three alternative trends of Web development
Machines, Applications,
Human
devices, services, agents
Communities
Facilitates
computers Machine-to-
Facilitates
Machine
Software-to-
interaction
Software
Facilitates interaction
Human-to-
Human
interaction
6
Internet of Things (we knew much earlier)
7
New integral trend of Web development
Web of intelligent entities
Facilitates
(intelligence services),
Intelligence-to-
browseable, searchable, Intelligence
composable, configurable, interaction
reusable, dynamic, mobile
…
If by “intelligence” we
mean also more general
various formal
(mathematical) models
then we are talking about
such version of future
Web, which can be called
“Web of Abstractions” [MIT]
8
“Semantic Wave” (Web X.0)
10
http://www.youtube.com/watch?v=BywCMkbG-Jg
Motivation for Semantic Web
Web Limitations
Semantic Web
Average WWW searches examine Doubles in size
only about 25% of potentially
relevant sites and return a lot of
every six months The Semantic Web is a
unwanted information vision: the idea of having
data on the Web defined and
linked in a way that it can be
World Wide Web
used by machines not just for
display purposes, but for
automation, integration and
reuse of data across various
Information on web is not suitable applications.
for software agents
4
S e m a n tic
O n to lo g ie s L o g ic al S u p p o rt
A n n o tatio ns
S e m a n tic
W eb
T o o ls A p p lica tio n s /
L a n g u ag e s
S e rv ice s
W W W C re a to rs U se rs
WWW C re a to rs U se rs
an d and
B eyon d W e b c o n te n t
B eyond W e b c o n te n t
11
7 8
Semantic Web Content: New “Users”
C
re
ato
rs U
se
rs
S
eman
tic
We
b a
nd S
ema
nticW e
b applications
B
eyo
nd conten
t
agents
Se
m a
n tic
O
nto
lo
gie
s L
og
ic
alS
upp
ort
A
nno
tations
S
eman
tic
We
b
T
oo
ls A
pp
lic
a tio
ns/
L
an
gua
ges
S
ervic e
s
WW W C
re
ato
rs U
se
rs
a
nd
Be
yon
d W
ebc
onte
nt
12
Some Professions around Semantic Web
Content creators AI Professionals
Web designers
Ontologies
Agents Annotations
Ontology engineers
Software engineers 13
Semantic Web: Resource Integration
Semantic
annotation
Shared
ontology
Web resources / 14
services / DBs / etc.
ψ-Projection of the Future ICT Research
psi-Projection:
Proactivity (agent technologies, Distributed AI, MAS, …)
Semantics (Semantic Web, ontologies, reasoning, trust, …)
Intelligence (machine learning, data mining, knowledge
discovery, pattern recognition, NLP, …)
15
Semantic Web vs. Web 2.0 (Ora Lassila)
16
Web 2.0 vs. Semantic Web
Human Machines,
Communities devices,
software, etc
17
Web 2.0 to Semantic Web
Human Machines,
Communities devices,
software, etc
18
Semantic Web to Web 2.0
Human Machines,
Communities devices,
software, etc
19
Sample of Wiki Web page
Collaborative
editing window
20
Wikipedia
21
Semantic MediaWiki
22
Web 2.0: Mashups
Mashup is a term that's become popular to describe Web 2.0-ish sites that combine the
features or functions of one website with another. Website mashups, created by clever
programmers typically feature a high level of interactivity, user input, social
networking, and sometimes even encourage people to use them as the basis for
derivative works. The most common mashups involve maps, but there are also video
mashups, photo mashups, search and shopping mashups, and news mashups. Website
developers can use data feeds and application programming interfaces (APIs) provided
by established sites such as Google, Yahoo, Microsoft, Amazon, Ebay and others,
which are created specifically to encourage mashups.
23
Web 2.0: Blogs
A blog (web log) is a website where entries are written in chronological order and
commonly displayed in reverse chronological order. Many blogs provide commentary
or news on a particular subject; others function as more personal online diaries. A
typical blog combines text, images, and links to other blogs, web pages, and other
media related to its topic. The ability for readers to leave comments in an interactive
format is an important part of many blogs. Most blogs are primarily textual, although
some focus on art (artlog), photographs (photoblog), sketchblog, videos (vlog), music
(MP3 blog), audio (podcasting) and are part of a wider network of social media. Micro-
blogging is another type of blogging which consists of blogs with very short posts. As
of September 2007, blog search engine Technorati was tracking more than 106 million
24
blogs.
Semantic Mash-Ups
Semantic blog — Enhance web journal Semantic desktop and webtop — Use natural
with machine interpretable annotations language understanding, ontologies, data space
and models & personal ontologies to concepts, and semantic processing to manage every
harvest, link, and search information of piece of information a person encounters.
interest by concepts and relationships.
Semantic bookmarking & tag clouds — Associate links Semantic social networks — Web of
to web resources with concepts represented in an external people, content, sites, and profiles that
ontology. Use semantic auto-tagging to Map folksonomy + machines help build, interrelate,
semantic relationships between tags, users, and site resources. communicate with, and enjoy.
Semantic Collaboration — Collaboration Semantic wikis — Read-write web site that includes an
tools enable groups to read, write, edit, and present underlying model of the knowledge described in its pages.
information, coordinate their activities, share Features include concept- rather than language-based
information and manage knowledge together. searching; richly structured content navigation (multiple
Semantic collaboration adds a layer of knowledge views, perspectives, levels of abstraction); context-specific
representation and meanings that enrich the visualization and presentation; mining of relationships;
collaborative experience and utility of its results. 26
linking with external repositories, feeds, and systems.
Semantic Web: which resources to annotate ?
This is just a small part of
Technological
Semantic Web concern !!! External world
and business
processes resources
Web resources /
services / DBs / etc.
Semantic
annotation
Shared
ontology Multimedia
resources
Web users
(profiles,
preferences)
GUN
=
Global Environment
+
Global Understanding
=
Proactive Self-Managed
Semantic Web of Things
= (we believe) =
“Killer Application” for
Semantic Web Technology
28
GUN and Ubiquitous Society
GUN can be considered as
a kind of Ubiquitous Eco-
System for Ubiquitous
Society – the world in
which people and other
intelligent entities
(ubiquitous devices,
agents, etc) “live” together
and have equal
opportunities (specified by
policies) in mutual
understanding, mutual
service provisioning and
mutual usability.
Human-to-Human
Human-to-Machine
Agent-to-Agent
Machine-to-Human
Machine-to-Machine 29
Positive feedback from top US expert
(Semantic Wave father)
From: Mills Davis <[email protected]>
To: Vagan Terziyan <[email protected]>
Subject: Design of Agent-Based Systems
Date: Sat, 15 Nov 2008 12:50:06 -0500
“Vagan,
Just came across your course presentation on design of agent-based systems. I very much
enjoyed your presentation of GUN concepts.”
Mills Davis
Mills Davis is Founder and Managing Director of Project10X — a research consultancy
specializing in next wave semantic technologies, solutions, and business models. The firm’s
clients include technology manufacturers, global 2000 corporations, government agencies, and
next-generation web start-ups. Mills serves as principal investigator for the Semantic Wave
2008 research program. A noted consultant and industry analyst, he has authored more than
100 reports, white papers, articles, and industry studies. Mills is active in both government and
industry-wide technology initiatives that are advancing semantic technologies. He co-chairs
SemanticCommunity.net, which carries on the mission the Federal Semantic Interoperability
Community of Practice (SICoP) in supporting Communities of Interest in both government and
private industry. Mills is a founding member of the AIIM interoperable enterprise content
management (iECM) working group, and a founding member of the National Center for
Ontology Research (NCOR). Also, he serves on the advisory board of several new ventures in
the semantic space.
“Over the next decade, the semantic wave will spawn multi-billion
dollar technology markets that will drive trillion dollar global
economic expansions to transform industries as well as our 30
experience of the internet.” [Mills Davis]
Web 3.0
From: http://www.javajazzup.com/issue3/JavaJazzUp.pdf
31
Web 3.0 components
From: http://www.javajazzup.com/issue3/JavaJazzUp.pdf
32
Candidate Web 3.0 technologies
From: http://www.javajazzup.com/issue3/JavaJazzUp.pdf
33
Word-Wide Correlated Activities
Semantic Web Agentcities is a global, collaborative effort
to construct an open network of on-line systems
hosting diverse agent based services.
Semantic Web is an extension of the current
web in which information is given well-defined
meaning, better enabling computers and people
to work in cooperation
Agentcities
Grid Computing
Wide-area distributed computing, or "grid” technologies,
provide the foundation to a number of large-scale efforts
utilizing the global Internet to build distributed computing
and communications infrastructures.
FIPA
FIPA is a non-profit organisation aimed
Web Services at producing standards for the interoperation
of heterogeneous software agents.
35
Impact of Semantic Technology
36
Contrasting Semantic and Other Technologies:
Models and their Role
Traditional OO analysis Programming
Program
Requirements Object
Code
Model
Model-Driven Architecture
modeling translation translation
Program
Requirements Analysis Design
Code
Model Model
Knowledge/Rules Engineering
modeling translation
Domain Rules &
Knowledge
Knowledge Knowledge
Model
Semantic Engineering Base
Integration
Rules & Design Semantic
Knowledge Model Application
37
Base
Distributed Intelligence – a new wave of
innovation
38
Semantic Technology Market Forecasting
Semantic solution, services & software markets
will grow rapidly, topping $60B by 2010.
39
Analysts and Media Coverage
“[...] Semantics-based integration tools are destined to become increasingly powerful and
capable, combined with web services applications, the technology could doom
middleware as it is currently known.”
From, CIO Magazine, August 2002. 40
What’s the big deal?
In U.S. Web Services Market Analysis, 2002 IDC predicts that
Web services will become the dominant distributed computing
architecture in the next 10 years. Web services will drive
software, services and hardware sales of $21 billion in the U.S.
by 2007 and will reach $27 billion in 2010.
“Semantic Web Services promise easy access to remote content
and application functionality, independently of the provider's
platform, the location, the service implementation, or the data
format.”
Kuassi Mensah, Oracle
41
Semantic Web Services: Promised
Challenge
“When Semantic Web becomes widespread, the ability to
deploy, discover and use online processing resources and
devices, in a significantly automated fashion, will likely be
viewed as a major transformation of the Web.
SWWS
“Semantic Web and Web Services”, EU 5th Framework project
http://swws.semanticweb.org
• researching for scalable mediation between different and heterogeneous services based on semantic-driven descriptions and business logic;
SWAP
“Semantic Web and Peer-to-Peer”, EU 5th Framework project
http://swap.semanticweb.org
• provides a comprehensive study of the potential of Semantic Web and Peer-to-Peer for knowledge management and plan to provide an appropriate integrated software environment;
ASG
“Adaptive Services Grid”, EU 6th Framework project
http://asg-platform.org
43
Samples of Conferences
2004
SiCOP – Semantic Interoperability Community of Practice
Delphi Group On-Demand Enterprises (2004)
COFES-2004: Conference on Future of Engineering Software
SD-Forum 2004 on the West Coast
Enterprise Architecture 2004
DAMA Conference (2004)
Software Development West 2004
KM World and Intranet 2004
2nd Annual Semantic Technology for eGovernment –Sep 8th and 9th
2005 (main event)
Semantic Technology Conference 2005, March 7-10, 2005, Stanford
Court Hotel, Nob Hill, San Francisco, CA
• The first conference focused on the application of Semantic Technologies to
Enterprise Systems and the Web
46
Practical Information
Credits: 5-10 ECTS
Lectures: 24 hours
Vagan Terziyan Michal Nagy
8 lectures by Vagan Terziyan – theory;
4 lectures by Michal Nagy – theory and practice;
Mondays: 25 January - 1 March, 14:15-16:00, aud. Ag C231;
Wednesdays: 27 January - 3 March, 10:15-12:00, aud. Ag C231
Slides available online (links from Introductory Lecture)
http://www.cs.jyu.fi/ai/vagan/SWWS_Introduction.ppt
Exercises: min 1 exercise on basic course (5 ECTS)
+ max +1 group exercise (+ 1-5 ECTS)
Will be announced during the lectures
Monday lectures: 14:15 – 15:55; Break: 15:00 – 15:10; Place: Agora C 231
48
Wednesday lectures: 10:15 – 11:55; Break: 11:00 – 11:10; Place: Agora C 231
Lectures
49
Lecture 1: This Lecture - SWWS Introduction
Course Introduction
Vagan Terziyan
Department of Mathematical Information Technology, University of Jyvaskyla
[email protected], URL:http://www.cs.jyu.fi/ai/vagan
+358 14 260-4618
http://www.cs.jyu.fi/ai/vagan/SWWS_Introduction.ppt
50
Lecture 2: Metamodels for Managing Knowledge
C
D
r
i
e
f
f
a
e
t
i
r
e
n
n
ga
n
tL
d
e
ve
M
l
a
so
na
fP
g
i
o
n
s
s
g
i
b
Kn
l
e
o
C
w
o
l
e
n
d
te
g
e
x
Ac
c
t-a
r
o
e
r
d
a
i
m
n
o
g
n
g
t
o Metamodels for Managing
t
he bas
ica
bi
lit
iesofani
n t
ell
ige
n ta
gen
t Knowledge
M
et
aco
nt
ext
s
M
et
a-me
ta
kno
wle
dge
C
on
te
xts
M
et
akn
owl
edg
e
Vagan Terziyan
D
at
a University of Jyvaskyla, Finland
e-mail: [email protected]
K
no
wle
dge 2 http://www.cs.jyu.fi/ai/vagan/index.html 1
http://www.cs.jyu.fi/ai/vagan/Metamodels.ppt
51
Lecture 3: Semantic Web Basics
http://www.cs.jyu.fi/ai/OntoGroup/pres/SW_Tutorial_2004_Part_1.ppt
http://www.cs.jyu.fi/ai/vagan/Semantic_Web.ppt 52
Lecture 4: Semantic Web Applications
Semantic
3
Search Semantic
7
Games
http://www.cs.jyu.fi/ai/OntoGroup/pres/SW_Tutorial_2004_Part_2.ppt
53
Lecture 5: RDF and RDF Schema
D escriptionofSem anticPropertiesofthe
W ebR esourcesandSem anticRelationships
betw eenthemisExtrem elyIm portant forthe
Intelligent W ebA pplications
John’s
homepage
T obea
Director
http://www.cs.jyu.fi/ai/vagan/RDF.ppt
54
Lecture 6: Ontologies in Semantic Web
The More or Less Global Agreement about
Standard Terminology and Conceptual Hierarchy
for a Domain Description is Necessary for the
Interoperability in the Intelligent Web
w
ww.o
ntok
nowle
dge
.or
g/o
il
O
nt
o lo
gie
s
inSe
m a
nticWe
b
Basedontu
toria lsa
ndpre
se n
tatio
ns:
2 D
.Le
e,F.H
arme
len
,M .Aru
m u ga m,C.Goble
,I.H orrock
s,N.F.N o
y,1
D.L.Mc
G u
inn
ess
,J.Bro
ek stra,M.Kle
in,S.D eck e
r,D.F
e n
sel
http://www.cs.jyu.fi/ai/vagan/Ontologies_1.ppt
http://www.cs.jyu.fi/ai/vagan/Ontologies_2.ppt 55
Lectures 7-8: Tutorial: Designing Ontologies
with Protégé
Protégé is an ontology editor and a knowledge-base
editor (download from http://protege.stanford.edu ).
Protégé is also an open-source, Java tool that
provides an extensible architecture for the creation
of customized knowledge-based applications.
Protégé's OWL Plug-in now provides support for
editing Semantic Web ontologies.
http://www.cs.man.ac.uk/~horrocks/Teaching/cs646/
http://www.co-ode.org/resources/tutorials/ProtegeOWLTutorial.pdf
56
Lecture 9: Storing and Querying RDF data
http://users.jyu.fi/~akataso/itks544/Lecture1.pdf 57
Lecture 10: Reasoning and Rules
http://users.jyu.fi/~akataso/itks544/Lecture2.pdf
58
Lecture 11: Semantic Web Services
http://users.jyu.fi/~akataso/itks544/Lecture3.pdf
59
Lecture 12: Semantic Programming of
Agent-Based Systems
http://users.jyu.fi/~akataso/itks544/Lecture4.pdf 60
Additional Material for Self-Study
153 Video Lectures on Semantic Web
http://videolectures.net/Top/Computer_Science/Semantic_Web/
62
Introduction to XML
Tools
Intelligent Web Applications
Data (XML)
Web
Services
Introduction to XML
Based on tutorials of B. Cormia, D. Suciu, H. Boley, S.
Decker, M. Sintek, E. R. Harold and others
http://www.cs.jyu.fi/ai/vagan/XML.ppt
63
Markup Techniques
Namespaces
UniversalStorag e /In terchan geForm ats DTDs CSS
aream ongth eB a s icR equirementsfor DAML Stylesheets
XSLT
theIn
tero perabilityinth eW eb Ontobroker Agents Transformations
XQL
HornML
Rules
XML
RuleML Queries XQuery
SHOE XML-QL
Frames RDF[S] Acquisition
TopicMaps
Protégé
Markup Techniques
Based on Tutorials :
H. Boley, S. Decker, M. Sintek, E. R. Harold
http://www.cs.jyu.fi/ai/vagan/Markup_Techniques.ppt
64
Knowledge Management
K n o w le d g e M a n a g e m e n t
B a s e d o n tu to r ia ls a n d p r e s e n ta tio n s : R . B e r g m a n n , M .M . R ic h t e r , D .J . S k y r m e ,
B e lla n e t In t’l, S U R F - A S , R . L . H e r t in g , R . S m it h , F . J . K u r f e s s , R . D ie n g a t a l., M .
S in te k , A . A b e c k e r , A . B e r n a r d i, D . K a r a g ia n n is , R . T e le s k o , L . K e r s c h b e r g
“ G iv e a m a n a fis h - f e e d h im f o r a d a y ;
t e a c h h im h o w t o fis h - fe e d h im fo r a life tim e ”
C h in e s e p r o v e r b
http://www.cs.jyu.fi/ai/vagan/Knowledge_Management.ppt
65
Web Content Management Architectures
21W
21 eb Content Management
Architectures
Vagan Terziyan
MITDepartment, University of Jyvaskyla,
AI Department, Kharkov National University of Radioelectronics
[email protected]; http://www.cs.jyu.fi/ai/vagan/index.html
http://www.cs.jyu.fi/ai/vagan/Architectures.ppt
66
Web Mining
Dis
cov
eri
n gKn
ow l
edgefroman
d aboutW WW-
i
soneoftheba
si
c abi
lit
ieso
fani
n t
ell
ige
nta
ge
nt
W
WW
K
no
wl
e d
ge
W
e
bMi
ni
ng
B
a
se
do
nt
ut
ori
al
san
dp
re
s
en
ta
t
io
ns
:
J
.Ha
n,D.J
in
g,W .
Y a
n, Z
.
X ua
n,M.Mo
r
zy
,M.Ch
en,M.B
robb
ey,N.
S o
ma
se
tt
y,N.Ni
u,
2 P
.Su
ndar
am,S.
Saj
ja,
S .T
hot
a,H.Ah
on
e
n-
Myk
a,R.
C o
ole
y,B.
M o
bashe
r
,J
.Sr
iv
ast
ava
http://www.cs.jyu.fi/ai/vagan/Web_Mining.ppt
67
Semantic Web Services
ManagingTransactionswithDistributedE-Services
andprovidingIntegra tedSe rvicetoaU se r- are
amongth eb asicabilitiesofanIn telligentAg ent
[email protected]
http://www.cs.jyu.fi/ai/vagan
+358 14 260-2347
http://www.cs.jyu.fi/ai/vagan/Transactions_Services.ppt
http://www.cs.jyu.fi/ai/OntoGroup/pres/SW_Tutorial_2004_Part_3.ppt
68
Why Semantic Web Services ?
Semantic Web Services Basis
Why Semantic Web Services ?
New Opportunity for the Semantic Technology
The question we should answer today:
“Why these are necessary ?”
Software Technologies
http://www.cs.jyu.fi/ai/vagan/Why_SWS.ppt
69
Semantics in Agent-Based Systems (UBIWARE)
http://www.cs.jyu.fi/ai/UBIWARE.ppt 70
Semantic Web Tools
http://www.cs.jyu.fi/ai/vagan/SW_Tools.ppt 71
S-APL and Design of Semantic Applications
MATES, Leipzig
24-26 September, 2007
http://www.cs.jyu.fi/ai/MATES-2007.ppt 72
Course Exercise 1 (5 ECTS)
73
Task for the Exercise (I part of the course, 5 ECTS)
75
Lecture Notes and Textbook
Follow link:
http://www.cs.jyu.fi/ai/vagan/courses
Useful textbook
76
Additional Reading
Johan Hjelm, “Creating the Dieter Fensel: “Ontologies: A Silver
Semantic Web with RDF”, Bullet for Knowledge Management
John Wiley, 2001 and Electronic Commerce”, Springer
Verlag, 2001
John Davies, Dieter Fensel & Dieter Fensel, Wolfgang Wahlster,
Frank van Harmelen:, “Towards Henry Lieberman, James Hendler
the Semantic WEB – Ontology
(Eds.): “Spinning the Semantic Web:
Driven Knowledge Management”,
John Wiley, 2002 Bringing the World Wide Web to Its
Full Potential”, MIT Press, 2002
Michael C. Daconta, Leo J. Obrst,
Thomas B. Passin, "Explorer's Kevin T. Smith: “The Semantic Web:
Guide to the Semantic Web", A Guide to the Future of XML, Web
ISBN 1932394206, June 2004 Services, and Knowledge
Management”, John Wiley, 2003
Jeff Pollock and Ralph Hodgson, M. Klein and B. Omelayenko (eds.),
"Adaptive Information: Improving “Knowledge Transformation for the
Business Through Semantic Semantic Web”, Vol. 95, Frontiers in
Interoperability, Grid Computing, Artificial Intelligence and
and Enterprise Integration“, Wiley Applications, IOS Press, 2003
Computer Publishing, September
77
2004
Where to find out more fresh: Web-Sites
Semantic Web
http://www.w3.org/standards/semanticweb/
http://www.semwebcentral.org/
Ontologies, OWL, OWL-2
http://www.w3.org/2004/OWL/
http://www.w3.org/2007/OWL/wiki/OWL_Working_Group
Semantic Web Services
http://www.w3.org/TR/sml/
http://www.daml.org/services/
78