Tutorial: Development of Interactive

Applications for Mobile Devices

7th International Conference on Human Computer Interaction
with Mobile Devices and Services
(Mobile HCI 2005)
Enrico Rukzio (Media Informatics Group, University of Munich )
Michael Rohs (Deutsche Telekom Laboratories)
Daniel Wagner (Graz University of Technology )
John Hamard (DoCoMo Communications Laboratories Europe)

Application development
with J2ME
Enrico Rukzio

1
 Enrico Rukzio
SLIDE 3/42 [email protected]

Outline

History / Java Universe

J2ME Basics
The J2ME Universe
J2ME: CLDC/MIDP
Midlets
Developing a user interface / storing data
Resources / Documents / Tools (IDEs)
Implementing “Hello World”
Experiences

Enrico Rukzio
SLIDE 4/42 [email protected]

Java on mobile devices: History [1,4,9]

1990: Java started as an internal project at Sun

Microsystems
1995: Initial release of JDK 1.0 (applets Æ
servlets)
1999: JavaOne conference
ƒ Subdivision of Java in
- Java 2 Enterprise Edition (J2EE)
- Java 2 Standard Edition (J2SE)
- Java 2 Micro Edition (J2ME) (successor of
Personal Java and Embedded Java)
2000/01 First mobile phones with support for
J2ME

2
 Enrico Rukzio
SLIDE 5/42 [email protected]

Java on mobile devices: History [1,4,9]

2002: Second version of Mobile Information

Device Profile (MIDP 2.0)
April 2004: 250 Million mobile phones support
J2ME [4]
June 2005: 700 Million mobile phones support
J2ME [10, 4] - more mobile phones with Java
support than desktop PCs with Java support
Now: most vendors of mobile phones (Motorola,
Nokia, Panasonic, Samsung, Sharp, Siemens,
Sony Ericsson, Toshiba, etc.) provide mobile
phones that support J2ME

Enrico Rukzio
SLIDE 6/42 [email protected]

The Java universe [3]

3
 Enrico Rukzio
SLIDE 7/42 [email protected]

J2ME: Basics

J2ME: Java 2 Platform, Micro Edition

ƒ “Java for small devices”
ƒ Divided in configurations, profiles and optional
APIs

Stack
ƒ Configuration + profile + optional APIs

Configuration: for a specific kind of devices

ƒ Specifies a Java Virtual Machine (JVM)
ƒ Subset of J2SE (Standard Edition)
ƒ Additional APIs

Enrico Rukzio
SLIDE 8/42 [email protected]

J2ME: Basics
Profile: more specific than configuration
ƒ based on a configuration
ƒ adds APIs for user interface, persistent storage,
etc.

Optional APIs: additional functionality (Bluetooth,

Multimedia, Mobile 3D, etc.)

Everything is specified by a JSR (Java Specification

Requests)

4
 Enrico Rukzio
SLIDE 9/42 [email protected]

The J2ME universe [1,9]

Smaller Larger

Car
Mobile Internet Set-Top
Pagers PDAs Navigation
Phones Appliances Boxes
Systems

Personal Profile
MIDP PDAP
(Mobile (Personal
Personal Basis Profile
Information Digital Assistant
Device Profile) Profile)
Foundation Profile

CLDC CDC
(Connected, Limited Device (Connected Device
Configuration) Configuration)

J2ME
(Java 2, Micro Edition)

Enrico Rukzio
SLIDE 10/42 [email protected]

J2ME: CLDC [JSR 30, 139]

Connected, Limited Device Configuration

For small devices (e.g. mobile phone, pager, PDA)
with small screen size, limited memory, slow
network connection
For devices with 160 to 512KB (according to the
specification) of memory for Java Platform
JVM: KVM (“Kilobyte Virtual Machine”)
ƒ Not a full standard bytecode verifier
ƒ Adding native methods not allowed Æ not
possible to access platform-specific functionality
CLDC 1.0 / CLDC 1.1. (Floating point data types)

5
 Enrico Rukzio
SLIDE 11/42 [email protected]

J2ME: MIDP 2.0 (JSR 118, based on CLDC) [9]

Mobile Information Device Profile for mobile
phones and pagers
Device characteristics (according to the
specification):
ƒ Min. 128KB RAM (Java Runtime Heap)
ƒ 8KB for persistent data
ƒ Screen: > 94*54 pixel
ƒ Input capacity, Network connection
Advantages:
ƒ WORA (Write Once, Run Anywhere)
ƒ Security (Sandbox KVM)

Enrico Rukzio
SLIDE 12/42 [email protected]

J2ME: APIs in CLDC 1.1 + MIDP 2.0

MIDP 2.0
javax.microedition.lcdui
javax.microedition.lcdui.game
javax.microedition.media
javax.microedition.media.control
javax.microedition.midlet
javax.microedition.pki
javax.microedition.rms

CLDC 1.1
java.lang APIs are restricted
java.lang.ref when compared with
java.io J2SE
java.util
java.microedition.io

6
 Enrico Rukzio
SLIDE 13/42 [email protected]

Device configurations: some examples

Type Nokia 6600 Nokia 6630 Nokia N91
(June 2003) (June 2004) (End 2005)
Configuration CLDC 1.0 CLDC 1.1 CLDC 1.1
Profile MIDP 2.0 MIDP 2.0 MIDP 2.0
Optional APIs Nokia UI, Wireless APIs of 6600 + APIs of 6630 + Web Services,
Messaging, Mobile FileConnection Security and Trust, Location,
Media, Bluetooth and PIM, Mobile SIP, Scalable 2D Vector
3D Graphics Graphics, Advanced
Multimedia Supplements,
JTWI
Heap Size 3 MByte Unlimited Unlimited

Shared 6 MByte (the only 10 MByte 29 MByte

Memory for limitation is the
Storage amount of free
memory)
JAR size Unlimited Unlimited Unlimited

Enrico Rukzio
SLIDE 14/42 [email protected]

J2ME: Compatibility [1, 9]

7
 Enrico Rukzio
SLIDE 15/42 [email protected]

MIDlet

MIDP applications are called MIDlets

Every MIDlet is instance of
javax.microedition.midlet.MIDlet
ƒ No argument constructor
ƒ Implements lifecycle methods
Conceptually similar to Applets
ƒ Can be downloaded
ƒ Executed in host environment

Enrico Rukzio
SLIDE 16/42 [email protected]

MIDlet (MIDP Application): Life Cycle

8
 Enrico Rukzio
SLIDE 17/42 [email protected]

MIDlet (MIDP Application): Life Cycle

Application Manager: controls the installation and

execution of MIDlets
Start of a MIDlet: constructor + startApp (done by
Application Manager)
MIDlet
ƒ place itself in Paused state (notifyPaused())
ƒ destroy itself (notifyDestroyed())

Enrico Rukzio
SLIDE 18/42 [email protected]

MIDlet (MIDP Application): Life Cycle

Application Manager
ƒ pauseApp() and destroyApp() could be triggered
by Application Manager
‘active’ Paused state
ƒ resumeRequest() – MIDlet wants to become
Active
Methods for every state transition

9
 Enrico Rukzio
SLIDE 19/42 [email protected]

MIDlet Build Cycle

- Edit source code
- Compile
- (Application) Package, MIDlet Suite
ƒ MIDlets + Classes + Ressources + Manifest Information =>
Java Archive (JAR)
ƒ Manifest: describes content of archive (versions of CLDC
and MIDP, name, version, vendor)
ƒ Application Descriptor (*.jad)
- same information like manifest (+ MIDlet-Jar-Size, MIDlet-
Jar-URL), but a external file
- Sometime used for installation
- Test or Deploy

Enrico Rukzio
SLIDE 20/42 [email protected]

Anatomy of a MIDlet suite

MidletSuite.jad

Contents of MidletSuite.jar

MidletSuite.jar

MANIFEST.MF

10
 Enrico Rukzio
SLIDE 21/42 [email protected]

MIDP: User Interface

Goal: Write Once, Run Anywhere

Anywhere?
ƒ different screen sizes
ƒ resolution of screen
ƒ color or grayscale screen
ƒ different input capabilities (numeric keypad,
alphabetical keyboards, soft keys, touch
screens, etc.)

Enrico Rukzio
SLIDE 22/42 [email protected]

User Interface: Methodology

Abstraction (Æ Preferred Method)

ƒ specifying a user interface abstract terms
ƒ (Not:) “Display the word ‘Next’ on the screen
above the soft button.”
ƒ Rather: “Give me a Next command somewhere
in this interface”
Discovery (Æ Games)
ƒ Application learns about the device + tailors the
user interface programmatically
ƒ Screen size Æ Scaling

11
 Enrico Rukzio
SLIDE 23/42 [email protected]

User Interface: View from the Top

User-interface classes javax.microedition.lcdui

Device display represent by
Display (getDisplay())
Displayable

Display: easel
Displayable: canvas Screen Canvas
on easel
Canvas: Discovery
Screen: Abstraction Alert Textbox

List Form

Enrico Rukzio
SLIDE 24/42 [email protected]

User Interface: View from the Top

Changes the contents of the display: passing

Displayable instances to Display’s setCurrent()
Typical Sequence
ƒ Show a Displayable
ƒ Wait for input
ƒ Decide what Displayable should next
ƒ Repeat

12
 Enrico Rukzio
SLIDE 25/42 [email protected]

User Interface: Simple Example

public class Commander extends MIDlet {
public void startApp() {
Displayable d = new TextBox("TextBox", "Commander", 20, TextField.ANY);
Command c = new Command("Exit", Command.EXIT, 0);
d.addCommand(c);
d.setCommandListener(new CommandListener() {
public void commandAction(Command c, Displayable s) {
notifyDestroyed();
}
});

Display.getDisplay(this).setCurrent(d);
}

public void pauseApp() {}

public void destroyApp(boolean unconditional) {}

}

Enrico Rukzio
SLIDE 26/42 [email protected]

MIDP: Persistent Storage [8]

Goal: Write Once, Run Anywhere

Anywhere?
ƒ Device with Flash ROM
ƒ Battery-backed RAM
ƒ Small Hard Disk
Abstraction is needed
Record stores (small databases)
Min. 8KByte (Nokia 6600: ‘the only limitation is the
amount of free memory’)

13
 Enrico Rukzio
SLIDE 27/42 [email protected]

Persistent Storage: Records

Record store
ƒ contains records (pieces of data)
ƒ instance of javax.microedition.rms.RecordStore
MIDlet Suite MIDlet Suite MIDlet Suite
Every MIDlet in a MIDlet MIDlet MIDlet MIDlet
Suite can access every MIDlet MIDlet
Record Store MIDlet MIDlet
Since MIDP 2.0: Access
RecordStore RecordStore RecordStore
across suite boarders
RecordStore RecordStore
possible !!!
RecordStore

Device Persistent Storage

Enrico Rukzio
SLIDE 28/42 [email protected]

Connecting to the World

- Generic Connection Framework
- Extremely flexible API for network connections
- Contained in javax.microedition.io
- Classes based on connection interface
HttpConnection (Get / Post) / HttpsConnection
SocketConnection
ServerSocketConnection (Responding to incoming
connections)
SecureConnection (TLS or SSL socket)
CommConnection (SerialPort)
DatagramConnection (UDP DatagramConnection)

14
 Enrico Rukzio
SLIDE 29/42 [email protected]

MMAPI (Sound, Music, Video)

- Mobile Media API
- General API for multimedia rendering and recording
- ABB (Audio Building Block) – play simple tones (MIDI –
note, duration, volume) and sampled audio (wav, mp3)
- Player lifecycle
UNREALIZED Manager
REALIZED (generates players)

PREFETCHED
STARED DataSource
CLOSED (MIME-Type)
Player

Control (Volume,
Tone)

Enrico Rukzio
SLIDE 30/42 [email protected]

Further APIs
Wireless Messaging API (JSR-120)
Mobile Media API (JSR-135)
Bluetooth API (JSR-82 no OBEX)
FileConnection and PIM API (JSR-75)
Mobile 3D Graphics API (JSR-184)
Location API (JSR-179)
Web Services API (JSR-172)
Advanced Multimedia Supplements (JSR-234)

Further APIs (not JSRs): kXML, kSOAP, Parsing of

GPS data, etc.

15
 Enrico Rukzio
SLIDE 31/42 [email protected]

Material
Jonathan B. Knudsen, Sing Li. Beginning J2ME: From Novice to
Professional. ISBN: 1590594797. 2005.
Java.Sun.Com (Documentation, Code samples & Articles, FAQs,
white papers, technical articles, etc.)
http://java.sun.com/products/cldc/
Forum.nokia.com (Documents, Code & examples, tools, forum)
http://www.forum.nokia.com
Links to documentations and tutorials at hcilab.org
http://www.hcilab.org/documents/tutorials/DocuTuto/index.
html
Sun Wireless Toolkit: JavaDoc

Enrico Rukzio
SLIDE 32/42 [email protected]

Tool Support / Development Kits

Sun’s MIDP reference Implementation

Sun J2ME Wireless Toolkit (Javadoc)
IDE
ƒ Netbeans 4.1 + Mobility Pack
ƒ Eclipse (with Plug-In EclipseME)
ƒ Borland JBuilder MobileSet
ƒ IBM WebSphere Studio Device Developer
ƒ Metrowerks Code Warrior Wireless Studio
ƒ Sun ONE Studio, Mobile Edition
Vendor Specific Toolkits & Documentation

16
 Enrico Rukzio
SLIDE 33/42 [email protected]

Netbeans 4.1

Cross-platform Java IDE

Available for free for non-commercial use.
Download and install Netbeans 4.1 (requires a
J2SE JDK, version 1.4.2 or higher + Sun’s
Wireless Toolkit) + Mobility Pack at
www.netbeans.org

Enrico Rukzio
SLIDE 34/42 [email protected]

New Project

17
 Enrico Rukzio
SLIDE 35/42 [email protected]

New Project: Name and Location

Enrico Rukzio
SLIDE 36/42 [email protected]

New Project: Platform Selection

18
 Enrico Rukzio
SLIDE 37/42 [email protected]

IDE

Enrico Rukzio
SLIDE 38/42 [email protected]

IDE: Source

19
 Enrico Rukzio
SLIDE 39/42 [email protected]

IDE: Run Project

Enrico Rukzio
SLIDE 40/42 [email protected]

Install MIDlet on Mobile Phone

20
 Enrico Rukzio
SLIDE 41/42 [email protected]

Experiences

CLDC/MIDP is a powerful platform for building

novel application on mobile devices
Everything (phones, APIs, tools, books,
documentation, etc) is getting better in a very
fast way
Programming with J2ME It is still a novelty for
most people.
New APIs (Mobile Media, Bluetooth, etc.) have new
bugs. “Old” APIs (storage, UI) are already in a
matured state.

Enrico Rukzio
SLIDE 42/42 [email protected]

Experiences

Different mobile devices have different KVMs (with

different bugs)
Testing of applications on the mobile phone (!!!) is
very important.
Big differences between the emulators and the
real phone.
Lack of memory and processing power is still a
problem.
Debugging on the mobile phone is a big problem.
(No meaningful error messages.)

21
 Enrico Rukzio
SLIDE 43/42 [email protected]

Experiences

Implementation on an abstract level. Not so much

possibilities like in Symbian.

Enrico Rukzio
SLIDE 44/42 [email protected]

Wishes for the next CLDC/MIPD Generation

New security model for J2ME

ƒ Accessing data (record stores)
ƒ Accessing the camera, microphone, network, Bluetooth

Quality of service
ƒ Uncertain behavior when recording (quality, encoding)
and playing (Which player?) media

22
 Enrico Rukzio
SLIDE 45/42 [email protected]

Market

Mobile devices
ƒ are an exploding market
ƒ because of increasing processing power,
available memory and internet connectivity Æ
attractive platform

Most supported platform on mobile devices: J2ME

ƒ Write once – run everywhere
ƒ Safety features for downloadable code

Enrico Rukzio
SLIDE 46/42 [email protected]

References
[1] Jonathan B. Knudsen. Wireless Java: Developing with J2ME. Second Edition. ISBN: 1590590775.
[2] Stephen Neal. Overview of J2ME and Nokia
APIs. Sun Tech Days.
http://www.nokia.co.jp/forum/publish/documents/Tech_Days_Yokohama_Workshop_Session.pdf
[3] J2ME datasheet
http://java.sun.com/j2me/j2me-ds.pdf
[4] Heise Newsticker
http://www.heise.de/newsticker/
[5] CDC Data Sheet.
http://java.sun.com/j2me/docs/j2me_cdc.pdf
[6] What's in MIDP 2.0: A Guide for Java Developers
http://www.forum.nokia.com/ndsCookieBuilder?fileParamID=3632
[7] MIDP 2.0: An Introduction
http://www.forum.nokia.com/ndsCookieBuilder?fileParamID=3231
[8] Understanding the Record Management System
http://developers.sun.com/techtopics/mobility/midp/articles/databaserms/
[9] Jonathan B. Knudsen, Sing Li. Beginning J2ME: From Novice to Professional. ISBN: 1590594797.
[10] Sun Takes Java App Server Open Source- http://www.itjungle.com/tlb/tlb062805-story04.html

23
 Enrico Rukzio
SLIDE 47/42 [email protected]

Deleted Slides

Enrico Rukzio
SLIDE 48/42 [email protected]

J2ME: CDC (JSR 36, 218) [5, 9]

CDC: Connected Device Configuration
For set-top boxes, car navigation systems, smart
communicators, high end PDAs, etc.
ƒ 32bit microprocessor
ƒ 256 KB RAM and 512 KB ROM for Java Runtime
Environment
Full Java Virtual Machine
ƒ CDC 1.01 (JSR 36) based on J2SE 1.3.1
ƒ CDC 1.1 (JSR 218) based on J2SE 1.4
Supports three profiles: Foundation Profile,
Personal Basis Profile, Personal Profile
Outdated Personal Java is still used

24