Presentation

on
“Graph Generator for Remote Virtual
Machine”
By,
Kulkarni Shrirang Vilas
Exam Seat No.- 1550
T.Y.M.C.A. (Engg)
NDMVP Samaj’s KBTCOE

Guided by,
Prof. R. S. Junagade
Company Profile
• Persistent is a global company specializing in software product
and technology innovation.
• For more than two decades, Persistent have partnered closely
with pioneering start-ups, innovative enterprises and the
world’s largest technology brands.
• Persistent have utilized their fine-tuned product engineering
processes to develop best-in-class solutions for consumers in
technology, telecommunication, life science, healthcare,
banking, and consumer products sectors across North America,
Europe, and Asia.
Introduction
• Graph Generator for Remote Virtual Machine is a standalone
application for graph creation and analyzing the stats
• It is used to monitor any Linux based system
• It focuses on “vmstat” and “iostat” of a machine
• Built on a problem definition given by the Company
• Includes Real-time depiction of the stats
Agenda
• Available monitoring systems
• Need of System
• Detail overview of “Graph Generator for Remote Virtual
Machine”
• Performance overview of the application
• Conclusion
Available monitoring tools
• Various monitoring tools available
– kSar
– Ganglia
– NMON (Nigel's performance Monitor for Linux)
– VisualVM
Need of the system
• “Ganglia” and “kSar” are capable doing the analysis once the
log file or text file of statistics is loaded to it.
• Generates static graph
• No peculiar tool available for vmstat and iostat
• Limited types of graph created (in most cases, line chart)
• No analysis is done in these tools
• These tools generate graphs for entire log file, no record
specific graphs
• Dumping of graph to local drive is available in kSar only
Detail overview of the system
Points to be covered
- What is vmstat and iostat?
- Proposed system
- Workflows included
- Technologies used
- External Libraries used
- Operating environment
- Methodology
- Screen shots & results
- Performance analysis
vmstat and iostat
• vmstat (Virtual Machine Stats)
‘vmstat’ (virtual memory statistics) is a computer system monitoring tool that
collects and displays summary information about operating system memory,
processes, interrupts, paging and block I/O.
-procs
-memory
-swap
-io
-system
-cpu
vmstat screen
• iostat (Input Output Stats)
It is used to collect and show operating system storage input and output
statistics
- CPU Utilization
%user
%nice
%system
%iowait
%steal
%idle
- Device Utilization
tps
Blk_read/s (kb_read/s or mb_read/s)
Blk_write/s (kb_write/s or mb_write/s)
Blk_read (kb_read/s or mb_read/s)
Blk_write (kb_read/s or mb_read/s)
iostat screen
Proposed System
• Remote Machine Graph Generator is an Application Tool built for
generating graphs out of various attributes of VMStat and IOStat log files.
This application serves following major purposes.

(i) It can generate graphs from log files.

(ii) It can connect to Remote Machine and run respective commands

to fetch data at real time and store it into Excel sheet and generate
graphs from the fetched data.

(iii) It can connect to Remote Machine and provide the real-time

Time-Series chart.
Proposed System (contd.)
• Entirely built on Java Platform
• Standalone application
• Extendable
• Uses open source libraries
• Consumes less memory
• Negligible overhead on the system
Workflows
1. Generating graphs from stored log files

VMStat
Log
Files Formatted
Extracti
User Application Output
ng Data
(Graphs)
IOStat
Log Files
2. Connecting to Remote Machine, fetching stat values and
storing them in Excel Sheet
3. Connecting to Remote Machine and displaying real-time Time-
Series chart

VMStat
User
Enters Real-time
Applica Connect Select
Choice Time-Series
tion to Remote Attribute
chart
Machine
IOStat
Technologies used
• Java (Java Development Kit 7)
• Microsoft Office 2013
• WindowBuilder 10
External Libraries
Library Name Version Released by

JFreeChart 1.0.19 JFree.org

JCommon 1.0.23 JFree.org

Apache POI 3.10 Apache Software Foundation

JSch 0.1.51 JCraft

dom4j 1.6.1 dom4j

Log4j - Apache Software Foundation

Operating Environment
Windows

Minimum Recommended
RAM 512 MB 1 GB
Storage Space 20 MB 50 MB
Processor Pentium 2 266 MHz processor -
Operating System  Windows Server 2012 (64-bit) -
Operating Environment (contd.)
• Mac OS
Intel-based Mac running Mac OS X 10.8.3+, 10.9+
• Linux
Oracle Linux 5.5+1
Oracle Linux 6.x (32-bit), 6.x (64-bit)
Oracle Linux 7.x (64-bit)
Red Hat Enterprise Linux 5.5+1, 6.x (32-bit), 6.x 64-bit)
Ubuntu Linux 12.04 LTS, 13.x
Suse Linux Enterprise Server 10 SP2+, 11
Software Requirements
• Java:
Java SE Runtime Environment (6 and above)

• Microsoft Office:
Microsoft Office containing Microsoft Excel (2007 and
above)

• Virtual Machine:
For ‘iostat’: Install “sysstat” on your virtual machine
 UML Diagrams

Use Case Diagram

Class Diagram
Activity Diagram
Sequence Diagram
Component Diagram
Entity
Relationship
Diagram
Screen shots
Excel Sheet Generator
Bar Chart
Line Chart
Scatter plot
Histogram
Excel sheet (iostat : Device Utilization)
Chart sheet (iostat : Device Utilization)
Excel sheet (iostat : CPU Utilization)
Chart sheet (iostat : Device Utilization)
Excel sheet (vmstat)
Chart sheet (vmstat : CPU)
Real-Time graph : vmstat
Real-Time graph : iostat (zoomed in)
Performance Analysis

VisualVM screen for tool

 Conclusion
• The application which was developed in this process
would definitely serve the presented problem statement.
• It has added few more functions that were not present in
the ongoing system.
• For example, real time graphs were not present in most
of the monitoring tools available in the market.
• As it was made with the open source libraries, it has not
cost other than put man-hours.
Advantages
• Being a standalone application, it reduces dependencies.
• Highly extendable.
• Built from open source libraries hence developing cost is negligible.
• Gives real time statistics.
• Can work on any system having Java environments set.
• Connects to any remote machine at real time and monitors performance.
• Can generate entries in excel sheet for analysis.

Disadvantages
• May face lagging if remote machine is having high CPU utilization.
• Use of open source libraries may reduce neatness of results.
• Focus is only on vmstat and iostat.
Future Enhancements
• Providing a custom logger option in the application
• Including “mpstat” and “sar” facility.
• Saving the details of most commonly used Remote Machine Details.
• Providing space for including custom macros in the Excel sheet.
Bibliography
Books
[1] Andre Bondi- Foundations of Performance and System Engineering
Published by Addison Wesley, Publication Date: 08/08/2014
[2] Ryan Baclit , Chivas Sicam , Peter Membrey , John Newbigin-
Foundations of CentOS Linux: Enterprise Linux on the Cheap
Published by Apress, Publication Year: 2009

Websites
[1] www.poi.apache.org
[2] www.stackoverflow.com
[3] www.jfree.org
[4] www.sourceforge.net: kSar project
[5] www.oracle.org
[6] www.jcraft.org
[7] www.mkyong.com
Thank You!