9 Development Process for Multimedia Projects

9.1 9.2 9.3 9.4 Classical models of the software development process Special aspects of multimedia development projects Example: The SMART process Iterative development of multimedia projects

Literature: Ian Sommervile: Software Engineering, 8. Auage. Pearson 2007 K. Osswald: Konzeptmanagement.Interaktive Medien interdisziplinre Projekte, Springer 2003

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 1

Models of the Development Process

Which workows and activities take place?
In which order?

What are the results (artefacts) produced in the activities?

Which are the dependencies between activities?

Related issues:
Project management How to plan a project How to control a project Quality assurance How to ensure that goals are met

Process models:
Often rather informal sketches Sometimes formal documents used as input to development support tools
Ludwig-Maximilians-Universitt Mnchen Prof. Humann Multimedia-Programmierung 9 - 2

The Waterfall Model - Textbook Version

Analysis
Requirements Specification

Winston Royce, Managing the Development of Large Software Systems, 1970

Design Specification

Design

Implementation

Code

Test, Integration

Tested Code

Change Requests
Ludwig-Maximilians-Universitt Mnchen Prof. Humann

Maintenance

Multimedia-Programmierung 9 - 3

Waterfall Feedback Loop #1: Quality Control

Analysis
Requirements Specification

Local feedback loops are mentioned already in the original paper from 1970!
Design Specification

Design

Implementation

Code

Test, Integration

Tested Code

Change Requests
Ludwig-Maximilians-Universitt Mnchen Prof. Humann

Maintenance

Multimedia-Programmierung 9 - 4

Waterfall Feedback Loop #2: Prototyping

System Requirements Software Requirements Preliminary Program Design Analysis Scope Analysis Design Coding Testing Usage
Ludwig-Maximilians-Universitt Mnchen Prof. Humann

This is how the original waterfall model by Royce looked like!

Prototype

Program Design Coding Testing Operations

Multimedia-Programmierung 9 - 5

A Modern Iterative/Incremental Process: Rational Unied Process

Source: IBM
Ludwig-Maximilians-Universitt Mnchen Prof. Humann Multimedia-Programmierung 9 - 6

Current Practice in Multimedia Industry?

K. Osswald, 2001: Systematic interviews with companies from the German multimedia (interactive media) sector
Out of a basis of 3000 enterprises, 30 were selected and asked (the most successful enterprises according to rankings) 22 enterprises took part in the study

Results regarding the development process:

More than 80% of the companies apply the waterfall model In almost all cases, there is a large overlap between neighbouring project phases Frequently used technique: Prototyping More than 80% of the interviewed specialists complain that customers demand changes at a very late point in project time, regarding information architecture and concrete content 18% of the companies are working on the introduction of an iterative incremental process model (similar to the Rational Unied Process) None had completed the transition by 2001
Ludwig-Maximilians-Universitt Mnchen Prof. Humann Multimedia-Programmierung 9 - 7

Waterfall Model as Used in Multimedia Industry

Roy Strauss: Managing Multimedia Projects, Focal Press 1997 Waterfall model adapted to multimedia projects
Highly consistent with the result of the interviews with German companies

Analysis and Planning Design Implementation Testing Maintenance & Support

Ludwig-Maximilians-Universitt Mnchen Prof. Humann Multimedia-Programmierung 9 - 8

9 Development Process for Multimedia Projects

9.1 9.2 9.3 9.4 Classical models of the software development process Special aspects of multimedia development projects Example: The SMART process Iterative Development of multimedia projects

Literature:
R. Malaka, A. Butz, H. Humann: Medieninformatik, Pearson, erscheint im Herbst 2009 (Kapitel 12) P. A. Henning, Taschenbuch Multimedia, Fachbuchverlag Leipzig, 2001, Kap. 9 E. England, A. Finney: Project Management for Interactive Media (2nd edition), Addison-Wesley 1998

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 9

Multimedia Development
Scope: Interactive multimedia applications, including distributed applications Typically carried out by multimedia agencies (Multimedia-Agenturen)
Main target distribution media: CD/DVD-ROM Web presentations (HTML technology, Flash technology) Movie clips distributed via TV, cinema, Web

Position in the value chain: Distribution Platform Provision

Content Production

Application Production

Media industry Multimedia agencies Telcos Traditional industry System integrators ISPs (Internet Service (e-commerce) Provider)
Ludwig-Maximilians-Universitt Mnchen Prof. Humann Multimedia-Programmierung 9 - 10

Multimedia Development Team

Executive Producer Producer Production assistant Creative director Interactive designer Instructional designer Industrial designer Project manager Copywriter/editor Content specialist Researcher Artistic Director Graphic designers Sound engineer TV crew Photographer File-transfer/network manager Programmer

A mixture of roles known from movie production & roles known from software projects
Prof. Humann Multimedia-Programmierung 9 - 11

Ludwig-Maximilians-Universitt Mnchen

The Design Dilemma

There are at least three different kinds of design involved in a multimedia project:

Media Design

Media Design Software Visual Design (still image & video), Interaction Audio Design Design Design Extremely complex, specialists available Software Design Software architecture, standard frameworks, design patterns Extremely complex, specialists available Intersection with media design specialists: almost zero Interaction Design Man-machine interaction, usability, accessibility Complex, but only a few specialists available Intersection mostly either with Media Design or with Software Design specialists

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 12

Three-Way Parallel Waterfall

Idealized view Emphasis on similarities among activities In practice, different running times of parallel activities within one phase Waterfall model is not necessarily applied in all three activities

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 13

Content
Auch im deutschsprachigen Raum als Fremdwort benutzt!
Inhalt im Sinne eines zu bermittelnden Guts

Content in media delivery chains:

Usually content has its own important market value (music, movie) Often associated with products of commercial value (Product description in ecommerce) Value chains within content production can be rather complex in themselves

Content Provider:
Separate organisation specialized in delivering (and possibly also producing) content

Content Research:
Finding sources for appropriate content, clarifying copyright issues

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 14

Topics in Multimedia Project Management

Topics from England/Finney 1998 (outline): Contract issues Agreeing the content Choosing the platform Selecting the media and techniques (video, audio, graphics) Interface design Audio asset production Video asset production Graphics asset production Rights, copyright, intellectual property Integration Testing Team management

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 15

Multimedia Assets and Products

Adopted from Henning 2001 (Four-Phase Multimedia Design Process) Process for a relatively detailed (micro) level, higher levels see later Multimedia Asset
Informational unit that occupies one or more perception channels of the human being E.g. text object, picture, audio sequence, video clip, VR object Usually produced in separate specialized workows Using specialized tools

Multimedia Product
Combined and integrated set of multimedia assets Creates an interactive stream of information using several perception channels of a human being Process of combining and integrating media objects: media integration, composing Using integration platforms/tools (e.g. Flash, SMIL etc.)

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 16

Four-Phase Multimedia Design Process: Overview

Phase 1: Integration Planning image text audio Phase 2: MM Asset Production VR Phase 3: Integration Edit - Compile - Test animation/video

Phase 4: Rendering

(Only in cases where complex graphics, e.g. 3D animation, is involved)

Henning 2001
Ludwig-Maximilians-Universitt Mnchen Prof. Humann Multimedia-Programmierung 9 - 17

Multimedia Design Process Phase 1

Integration Planning Planning for the co-ordinated effect of the multimedia assets to be used High Level:
What is the desired effect on the end user? Which role is played by multimedia technology? Which media assets do we need / can we afford? When to show what? What are the possibilities of the user to intervene? Interaction design

Low Level:
Development of story board Synchronisation planning Planning of error handling

Henning 2001
Ludwig-Maximilians-Universitt Mnchen Prof. Humann Multimedia-Programmierung 9 - 18

Modeling the End User

Age: what is the average age or age-range of anticipated users? Background, interests Skills: background skills and level of knowledge of users Media sophistication: background skills in multimedia and the use of computers? Special Needs Where is the resource to be used: home, classroom, workplace, public space? Contact Time: What is the expected contact time with the resource? Learning context: Is there to be only one type of end-user or will there be several? How will the system be used: by one user or by several users simultaneously? Is the resource to be used as a presentation device by a teacher/trainer, as an aid to group discussion, in single-user standalone mode, or across a network? Diagnostics: is diagnostic feedback about user performance desirable? Password protection, condentiality, monitoring, data protection Distribution Medium Support Materials Will the needs of each user-type change over time, either as a result of interacting with the system or independently of the system?
Prof. Humann Multimedia-Programmierung 9 - 19

Ludwig-Maximilians-Universitt Mnchen

Storyboarding
A storyboard is an expression of everything that will be contained in the program
what menu screens will look like what pictures (still and moving) will be seen when and for how long what audio and text will accompany the images, either synchronously or hyperlinked.

Important tool for communication among client, interactive programmer, graphic designer
Central point of orientation for team Saves time in writing other documentation A storyboard pad

Usually hand-written/drawn
From little booklets up to large wall-charts

Storyboarding tools
Easier transition into development work Loss of air
Ludwig-Maximilians-Universitt Mnchen Prof. Humann Multimedia-Programmierung 9 - 20

Multimedia Design Process Phase 2

Asset Production Production of required media content Generation of a media library to be used in later steps New material:
Film production, music production, ...

Legacy material:
Dealing with old formats Dealing with copyright problems

Adaptation of material:
Digital image/audio/video processing E.g. (images): Format conversion Geometric, colour transformations Filtering (e.g. sharpness)

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 21

Multimedia Design Process Phase 3

Integration, Composing Media assets are not modied anymore
Virtual composition (e.g. movie clips in video editing software)

Creation of a common context for individual media assets Integration of navigation, control and information entry elements
Buttons, rulers, text elds, ...

Paradigms for media asset integration (tools):

Timeline-based (e.g. Flash) Frame-based (e.g. ToolBook, also in Flash) Flowchart-based (e.g. in AuthorWare - discontinued) Object-based (e.g. in recent versions of Flash, Flex) High emphasis on textual code/script

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 22

9 Development Process for Multimedia Projects

9.1 9.2 9.3 9.4 Classical models of the software development process Special aspects of multimedia development projects Example: The SMART process Iterative Development for multimedia projects

Literature:
K. Osswald: Konzeptmanagement. Interaktive Medien interdisziplinre Projekte, Springer 2003

(Since this source is in German, the following slides are in German language as well.)

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 23

Schlsselbegriff: Konzept
Konzept: 1. [stichwortartiger] Entwurf, erste Fassung einer Rede oder einer Schrift. 2. Plan, Programm (Duden-Fremdwrterbuch, 1994) Begriff aus der Literaturwissenschaft, bertragen auf die Medien- und Werbebranche Konzeption = Erstellen eines Konzepts:
Aufbauend auf nur wenigen Grundinformationen Kernaspekte einer konkreten Anwendung festlegen und veranschaulichen Beschreibung aller Komponenten, die fr die Realisierung notwendig sind

Formalisierung:
Konzept kann in den Kpfen der beteiligten Mitarbeiter existieren Konzept kann detailliert, z.B. als Antwort auf eine Ausschreibung, ausgearbeitet sein

Erfolgreiche Konzeption ist nur im Zusammenspiel der verschiedenen Design-Arten mglich!

Ludwig-Maximilians-Universitt Mnchen Prof. Humann Multimedia-Programmierung 9 - 24

Nicht-technische Ttigkeitsfelder in Multimedia-Projekten

Konzeption
Hoch kreative Ttigkeit Grobkonzept entwickeln und Umsetzung in Feinkonzept betreuen Typische Aufgabe fr ein interdisziplinres Team

(Medien-)Design
Gestalterische Umsetzung der Anwendung in Bild und Ton Durch moderne Interaktionstechnologien Grenze zum Interaktions- und Softwaredesign verschwimmend

Redaktion
Verfassen und Zusammenstellen von Content-Bestandteilen Content-Akquisition, Lizensierung

Information Broking
Recherche von spezischen Fragestellungen in Datenbanken und Bibliotheken

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 25

Technische Ttigkeitsfelder in Multimedia-Projekten

Projektmanagement
Koordination und Abwicklung einer Produktion Management und Controlling Schnittstelle zwischen Kunde und Produktionsteam Hug auch intensiv an der Konzeption beteiligt

Programmierung
Umsetzung der Konzepte in Programmiersprachen und Autorensystemen Klassischer (und eher fr Grounternehmen geeigneter) Ansatz: Technische Spezialisten erst in spten Projektphasen beteiligt Trend: Technische und grasche Sichtweisen mglichst frh in die Konzeptarbeit integrieren (Osswald S. 29)

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 26

SMART-Modell
Rahmenwerk zur Vorgehensplanung bei Multimedia-Projekten (Kerstin Osswald 2003) Skalierbar Multimedia Aufgabenplanung Ressourcenplanung Tool

Iterative Entwicklungsmethode, am Rational Unied Process orientiert

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 27

SMART: Phasen
Idee der Trennung von Grob- und Feinentwurf wegen laufender nderungswnsche nicht realisierbar Bessere Trennung: Ziele, kreative Idee, Erarbeitung von Inhalten Strategie:
Abstraktion, Zerkleinerung Denition des (ber die Projektlaufzeit stabilen!) Problems Strukturierung, Hypothesenbildung

Kreation:
Produktion mglichst vieler verwertbarer Ideen (unabhngig vom Kunden!) Entwicklung einer interdisziplinren Vision fr den Projektverlauf

Konzeption:
Kritische Prfung entstandener Ideen Disziplinbergreifende Ausarbeitung von ausgewhlten Ideen

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 28

SMART: Workows
Anforderungsmanagement Strategieentwicklung Ideenndung auf Metaebene Denition der Funktionalitten Redaktion Informationsarchitektur Grasches Konzept Technisches Konzept Zeit- und Kostenmanagement Qualittsmanagement

(prinzipiell anpassbar an spezische Gegebenheiten)

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 29

SMART: Zuordnung von Workows zu Phasen

Phase 1: Phase 2: Strategie Kreation Iteration Anforderungsmanagement Strategieentwicklung Ideenndung auf Metaebene Denition der Funktionalitten Redaktion Informationsarchitektur Grasches Konzept Technisches Konzept Zeit- und Kostenmanagement Qualittsmanagement Beispielhaft, aber typisch!
Ludwig-Maximilians-Universitt Mnchen Prof. Humann Multimedia-Programmierung 9 - 30

Phase 3: Konzeption 3 4 5

SMART: Typische Rollen (Auswahl)

Art Director:
berwacht Konzeption und Gestaltung, erstellt Interaktionskonzepte Arbeitet eng zusammen mit Screendesigner, Konzepter, Softwareentw.

Creative Director:
berwacht die Stimmigkeit aller Konzepte und hinterfragt Entscheidungen Inhaltliche Verantwortung fr kreative Arbeit, sorgt fr innovativen Input

Screendesigner:
Entwickelt Masterscreen-Beschreibung und Look and Feel Erstellt visuelle Konzepte und grasche Content-Elemente Setzt Corporate Design des Kunden um

Frontend/Backend Programmierer:
Frontend: Clientseitige Programmierung, meist Dialogdummies Backend: Anwendungslogik, Datenbankanbindung, Middleware

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 31

SMART: Artefakte (1)

Angebot Anwendungsfallprotokoll Anwendungsfallbersicht Benchmark-Analyse Benutzerprol Brand Bible Change Request Containerprol Content Management Plan Contentogramm Content Writing Styleguide Creative Brief Datenbankarchitektur Designvorschlag Modulprol Moodboard/Komposition/Skizze Navigationskonzept Phasenplan Production Board Prototyp Programmierspezikation Rebrieng/Strategic Brief Risikoanalyse Screenverzeichnis Seitengrundraster Seitentypdenition Site Map Storyboard/Drehbuch Dialogdummy Dienstleistermotivation
Multimedia-Programmierung 9 - 32

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

SMART: Artefakte (2)

Erfolgsmatrix Feasibility-Analyse Flussdiagramm Funktionsspezikation Geschftszieltabelle Graphical Strategic Brief Interactive Media Storyboard Investitionsempfehlung Iterationsplan Kostenvoranschlag Mission Statement Mitarbeitermotivation Szenario Technical Strategic Brief Technischer berblick Technische Spezikation Usability-Analyse Vision Visual Design Styleguide Zieldenition

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 33

SMART-Konguration
Fr eine Organisation bzw. ein Projekt werden festgelegt: Welche Artefakte werden bentigt?
Abhngig von Anwendungsgebiet und Komplexitt in den verschiedenen Aspekten Beispiele von Projektcharakteristika: Statisch/Dynamisch/Prozesse/Bewegtbild

Welche Rollen werden bentigt?

Jedes Artefakt ist (fest deniert) mit bestimmten Qualikationen zu seiner Herstellung verknpft.

Denition der Zuordnung von Workows zu Phasen

Anpassung des beispielhaften Basis-Modells (siehe oben) Bercksichtigung der zu erstellenden Artefakte

... Fr Details siehe Osswald 2003!

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 34

Practical Conclusion: A Simple Multimedia Development Process

Phase 1: Phase 2: Strategy Creation Iteration Development of Global Goals Finding Creative Ideas Graphical Conception Technical Conception Interaction Conception Time und Quality Management 1 2 3 Phase 3: Conception 4 5

Overall Planning: Goals, Team, Size...

Brainstorming

First Prototyping

Continuous feedback on achievements, readjustment of goals/ideas, enhancement of prototypes

Multimedia-Programmierung 9 - 35

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Integration with Four-Phase Development Process

Phase 1: Phase 2: Strategy Creation Iteration Development of Global Goals Finding Creative Ideas Graphical Conception Technical Conception Interaction Conception Time und Quality Management 1 2 3 Phase 3: Conception 4 5

Integr. planning
Ludwig-Maximilians-Universitt Mnchen

Asset Rendering Integration production

Prof. Humann Multimedia-Programmierung 9 - 36

9 Development Process for Multimedia Projects

9.1 9.2 9.3 9.4 Classical models of the software development process Special aspects of multimedia development projects Example: The SMART process Iterative Development of multimedia projects

Literature:
R. Malaka, A. Butz, H. Humann: Medieninformatik, Pearson, erscheint im Herbst 2009 (Kapitel 12)

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 37

Changing Requirements
Key problem in software development
Requirements change during course of project Requirements snapshot

Inconsistency !

Real life

Requirement changes

Development process
Analysis, Design Implementation

Specic drivers for requirement changes in multimedia projects:

New technologies & devices, new (corporate) design rules, new services, Feedback from non-technical reviewers (designers, customers)
Ludwig-Maximilians-Universitt Mnchen Prof. Humann Multimedia-Programmierung 9 - 38

Planning for Change

Fred Brooks, 1975: Plan to throw one away; you will anyhow. David Lamb, 1988: Software engineering is planning for change Berry Boehm, 1988: Spiral model of development Lessons learnt from traditional software engineering at this point:
Iteration is a key principle in all variants of the development process (from waterfall to modern process denitions) Continuous feedback is important Incremental development is suitable for small projects with volatile requirements

Extreme continuation of the idea of iterative development: Agile Development/Extreme Programming

Mainly suitable for volatile requirements and small projects Of which kind is the majority of projects?

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 39

Iteration in Three Parallel Activities

Creation

Conception

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 40

Problems in Iterative Multimedia Development (1)

Change of general requirements Examples (functional):
Introduction of new use cases Introduction of new user types

Examples (non-functional):
Change of platform New security requirements

Changes of most functional and some non-functional requirements may be dealt with by agile development:
Radical deviation from waterfall idea Continuous update of integrated and executable prototype

Details see Praktikum Multimediaprogrammierung

Ludwig-Maximilians-Universitt Mnchen Prof. Humann Multimedia-Programmierung 9 - 41

Problems in Iterative Multimedia Development (2)

Updates in media assets (audio, video, photography, external graphical work) Examples:
Introduction of new corporate design Change to different location in scenes Change to different language Change of device brand

Already produced media assets are difcult to change or cannot be changed at all Only way out:
Delay media asset production until requirements are stable (waterfall!)

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 42

Problems in Iterative Multimedia Development (3)

Testing of multimedia interaction (animations, interactive controls, visual/auditive feedback) Examples:
Testing an interactive game Testing sound feedback (sound mix)

Testing involves using interface channels (graphics card, sound card, operating system) Testing involves human activity Fully automatic testing is difcult to achieve Research area: Using image/sound analysis techniques

Ludwig-Maximilians-Universitt Mnchen

Prof. Humann

Multimedia-Programmierung 9 - 43