N Putra Sastra, Wirawan, G.

Hendrantoro
Institut Teknologi Sepuluh November Surabaya

SITIA 2010
 Introduction
 Hardware
 Software: Embedded Linux OS
 Implementation Image Capture
 Result
 Conclusion

2
 The need for multimedia application in wireless communication
and energy saving,
 Intel mote2 radio sensorboard with processor platform XSCALE
PXA270 Intel 32-bit is such a device. This sensor is designed as
wireless sensor network embedded system on TinyOS [1].
 Because of the capabilities, open source community have
developed an embedded Linux based operating system[3].
 With this Linux embedded, the development of applications
becomes easier.
 some technical criterias required: need the capability of process
and storage in capturing and storing video or images.
 We design node that capable in multimedia application based on
intel mote2 platform and Linux as embedded operating system.
 How to build a sensor network node that able to capture images
in Portable Pixmap (PPM) format.

http://staff.unud.ac.id/~putra/ 3
 Intel Mote 2 Platform
◦ Intel® Mote is a modular, stackable design
◦ Main board (ARM* core, SRAM, FLASH, BT
radio)
◦ Power supply board (battery, AC, solar, …)
◦ Sensor board(s)
◦ Other boards (alternate radio, debug,
actuator, …
Jtag cable

Interface board
Imote2 radio board

Imote2 battery

Figure 1. stackable intel mote 2 plat form

4
Intel mote 2 Radio Board

Figure 2. intel mote 2 radio board

5
• Color Image and Video Camera Chip
• (OmniVision OV7670) Audio Capture and
Playback CODEC (Wolfson WM8940)
• On Board Miniature Speaker and Line
Output
• On Board Microphone and Line Input
• PIR Motion Sensor (Panasonic)
• Status LED
CIF I2C

Camer
Alarm PIR LED GPIO
a

Micropho Audio Speak

ne codec er

I2S I2C
Figure 3. intel mote Multimediaboard 6
 We select Linux as OS with some considerations, i.e. such a vast
Linux developers that we can get required driver on building
application easier.
 We can use various compilers to develop an application. And
specific modules addition on Linux OS does not require re-
flashing.
 On Linux OS, to images or video capture we use video4linux that
provided by its kernel. Interfacing video camera card needs some
drivers : I2C driver to read serial data, I2C-GPIO driver, and
camera driver with soc-ov7670 chipset.
 To use Linux as OS, we need to compile linux kernel to make a
boot loader, kernel and, file system from linux kernel source
 Flashing process to upload bootloader, kernel, and root file
system to radioboard using jtag cable[8] and interface board,
IIB400.
 Add one pull up resistor in IMB400 bus data line GPIO I2C so the
driver of pxa-camera I2C-GPIO and ov7670-soc work .

7
Including Video4Linux Design image capture function
#include <bits/types.h> open_device ();
#include <videodev2.h> init_device (colour);
start_capturing ();
Define image size and format mainloop (colour);
typdef enum {} stop_capturing ();
uninit_device ();
struct buffer {}
close_device ();
static char * dev_name = NULL;
static io_method io=IO_METHOD_MMAP;
static int fd = -1; Image Capture test
struct buffer * buffers = NULL; Int main(int argc, char
static unsigned int n_buffers = 0; **argv){
dev_name = "/dev/video0";
define YUV2RGB {} enum v4l2_colorspace
init YUV422_to_RGB8{} colour =
static void process_image{} V4L2_PIX_FMT_YUYV;
for (;;) {
static int read_frame{} int index;
static void init_mmap (void){} int c;
static void init_user{} c = getopt_long
(argc, argv,
}
} exit (EXIT_SUCCESS);
8
 To use Linux as OS, we need to bulid boot loader, kernel, and file
system from kernel source, flashing process to upload
bootloader, kernel, and root file system to radioboard using jtag
cable[8] and interface board, IIB400.
 From this work, one main finding is that we need an addition of
one pull up 1K8 resistor placed in IMB400 bus data line GPIO I2C
so the driver of pxa-camera I2C-GPIO and ov7670-soc work.
Without this resistor, visual sensor chip unable to read any data.
This would be the main different from implementation on
TinyOs, that does not need any pull up resistor.
 The proposed platform differs from previously TinyOs based
implemented on intel mote2. The significant difference is that by
using Linux OS, we no longer need to flash and compile a whole
system to make it work on intel mote2, but only application that
runs on this Linux platform.
 Output images from this application are images of size 640 x
480 pixels ppm format, with size of 901 KB (complete meta data
is shown in Table 1)

9
Filename image001.ppm image012.ppm
FileModDate 12-Apr-2010 13:20:37 12-Apr-2010 03:02:22

FileSize 921615 921615

Format PPM PPM
FormatVersion P6 P6
Width 640 640
Height 480 480 a
BitDepth 24 24
ColorType Truecolor Truecolor
FormatSignature P6 P6
Encoding Rawbits Rawbits
MaxValue 255 255
ImageDataOffset 15 15

b
Figure 4. a) image001.ppm b) image012.ppm 10
 This paper introduce a scheme to capture image
using sensorboard intel mote2 on platform
embedded Linux OS.
 Resulting images from camera is raw bit images,
portable pixmap (ppm). The aim of using this
format is to reduce processor load. Output
images are images with dimension of 640 x 480
pixels and size of 900 KB.
 Further research that will be carried out is on
development of wireless network topology,
processing and compressing images on
radioboard, video streaming application, and
camera selection application in capturing scenary
or specific object

11
12