IBM Software Group

WebSphere MQ
(MQSeries)
Introduction
Ken Kunkel
Business Integration
Technical Specialist
[email protected]
216-370-5038

WebSphere Business Integration © Copyright IBM Corporation 2004

 IBM Software Group

Agenda

 Basics
 Advanced topics

WebSphere Business Integration 2 © Copyright IBM Corporation 2004

 IBM Software Group

Agenda

 Basics
 Definition
 Queue Manager and
its objects
 API
 Platforms & Protocols
 Roles & Education
 Benefits
 Resources

WebSphere Business Integration 3 © Copyright IBM Corporation 2004

 IBM Software Group

Common Communication Infrastructure

App App App App App

Middleware

Network

Eliminates RPC/Sockets/communication code

Eliminates FTP processing
Eliminates data storage requirements
Handles network protocols
Enables portability between platforms

WebSphere Business Integration 4 © Copyright IBM Corporation 2004

 IBM Software Group

Enterprise Service Bus – Concept of Enterprise Communication

Portal Service

SOAP
Service Request
(e.g. .NET)

B2B
Interactions
Service
Flow

Data

Existing
Applications

New
Service Logic

WebSphere Business Integration 5 © Copyright IBM Corporation 2004

 IBM Software Group

WebSphere MQ (MQSeries)

...transport mechanism between platforms

and applications

M = Message
An object containing a string of data
Created and read by applications

Q = Queuing
A container for messages

Message-oriented middleware
WebSphere Business Integration 6 © Copyright IBM Corporation 2004
 IBM Software Group

WebSphere MQ (MQSeries) - Features

Assured,
Assured,exactly
exactlyonce
oncedelivery
delivery
Single
SingleAPI
APIacross
across35+
35+platforms
platforms
Network
Networkintegration
integrationacross
acrossvarious
various
network
networkprotocols
protocols
Transactional control
Transactional control
Triggering
Triggeringofofjobs/programs
jobs/programs
Content
Contentindependence
independence
Single
Singlemessage
message>>100MB
100MB
Asynchronous
Asynchronousdesign
design(application
(application
&&platform independent
platform independent
Parallel
Parallelprocessing
processing
Robust,
Robust,commercial
commercialmiddleware
middleware
Shields
Shieldsdevelopers
developersfrom
from
network
networkcomplexities
complexities

WebSphere Business Integration 7 © Copyright IBM Corporation 2004

 IBM Software Group

Agenda

 Basics
 Definition
 Queue Manager and
its objects
 API
 Platforms & Protocols
 Roles & Education
 Benefits
 Resources

WebSphere Business Integration 8 © Copyright IBM Corporation 2004

 IBM Software Group

Queue Manager

Windows XP
• Container for the MQ Objects
• Manages and controls the MQ Objects
• Talks to programs via its API
• Communicates with other queue managers
• Usually only one per machine
• Must have an unique name within the network
• Usually named after the machine name
• Logging of configuration and messages
• Security

Queue Mgr Queue Mgr

1 2

MQSeries Software

WebSphere Business Integration 9 © Copyright IBM Corporation 2004

 IBM Software Group

Queues

QM1 Windows XP

• Container for messages

• Opened by a program either for input or output
• Arrival of message can trigger job or program
• Several types:
• Local
• Remote
• Transmission
• Alias
• Dynamic
• Model
• Dead Letter
• System

WebSphere Business Integration 10 © Copyright IBM Corporation 2004

 IBM Software Group

Messages

Header User Data

• Two parts: header and user data

• Header contains identification and parameters for processing (both system
and user supplied)
• Header size is ~400 bytes
• User data can contain anything
• Size can be up to 4GB (segmented internally into 100MB messages)
• Persistence

WebSphere Business Integration 11 © Copyright IBM Corporation 2004

 IBM Software Group

Channels

• Logical connection between two queue managers

• Sends the messages to the other queue manager
• Handles multiple types of protocols
• TCP/IP QM1
• SNA
• NetBIOS
• SPX/IPX
• Uni-directional
• Types:
• Sender
• Receiver
• Server
• Requestor QM2
• etc.

WebSphere Business Integration 12 © Copyright IBM Corporation 2004

 IBM Software Group

Agenda

 Basics
 Definition
 Queue Manager and
its objects
 API
 Platforms & Protocols
 Roles & Education
 Benefits
 Resources

WebSphere Business Integration 13 © Copyright IBM Corporation 2004

 IBM Software Group

API

Similar to accessing a database or file system:

MQCONN Connect to a queue manager

MQOPEN Open a queue (either for input or output)
MQPUT Put a message to a queue
MQGET Get a message from a queue
MQCLOSE Close a queue
MQDISC Disconnect from a queue manager

MQPUT1 Perform an open, put and close to a queue

MQCMIT Commit a set of messages
MQBACK Rollback a set of messages
MQBEGIN Begin a unit of work as part of a commit
MQINQ Inquire on attributes of objects
MQSET Change attributes of objects

WebSphere Business Integration 14 © Copyright IBM Corporation 2004

 IBM Software Group

Agenda

 Basics
 Definition
 Queue Manager and
its objects
 API
 Platforms & Protocols
 Roles & Education
 Benefits
 Resources

WebSphere Business Integration 15 © Copyright IBM Corporation 2004

 IBM Software Group

Platforms

Servers:
Clients only:
OS/390,zOS SCO: Openserver, UnixWare
AIX IRIX DG/UX
Windows NT, 2000, XP DC/OSx Apple MacOS
Solaris: Intel & SPARC NUMA-Q MPE/iX
HP-UX Sinix Java
OS/400 Linux (Intel, zSeries) Windows: 3.1,95,98
OS/2 PalmOS (MQe) DOS
Compaq Open VMS EPOC (MQe) VM
Compaq NSK Java (MQe) Stratus VOS
Compaq Tru64 UNIX Unisys 2000 4690
VSE/ESA Hitachi Unisys A
Digital UNIX
SunOS
Dynix/ptx
NCR
TPF

WebSphere Business Integration 16 © Copyright IBM Corporation 2004

 IBM Software Group

Protocols and Languages

TCP/IP Java
SNA C
NetBios C++
SPX/IPX COBOL
PL/1
RPG
Visual Basic
.NET
...

WebSphere Business Integration 17 © Copyright IBM Corporation 2004

 IBM Software Group

Agenda

 Basics
 Definition
 Queue Manager and
its objects
 API
 Platforms & Protocols
 Roles & Education
 Benefits
 Resources

WebSphere Business Integration 18 © Copyright IBM Corporation 2004

 IBM Software Group

Roles

Developers
Design applications that use MQ
Write applications using MQI
Test applications

Administrators
Assist in designing applications
Design MQ network
Build objects within MQ
Monitor and troubleshoot MQ network
Develop standards

WebSphere Business Integration 19 © Copyright IBM Corporation 2004

 IBM Software Group

Education - Administrators

MQ01 - A Technical Introduction to MQSeries - 1 day

MQ15/20 - MQSeries System Administration - 3 days

Later...
MQ30 - MQSeries Advanced System Administration - 3
days

WebSphere Business Integration 20 © Copyright IBM Corporation 2004

 IBM Software Group

Education - Developers

MQ01 - A Technical Introduction to MQSeries - 1 day

MQ05 - MQSeries Application Programming - 3 days

MQ70 - MQSeries Application Design - 2.5 days

WebSphere Business Integration 21 © Copyright IBM Corporation 2004

 IBM Software Group

Agenda

 Basics
 Definition
 Queue Manager and
its objects
 API
 Platforms & Protocols
 Roles & Education
 Benefits
 Resources

WebSphere Business Integration 22 © Copyright IBM Corporation 2004

 IBM Software Group

Benefits

Higher developer productivity by eliminating communication

coding
Reliability by providing assured delivery of messages
(knowing that your message will arrive at the destination)
Provides business continuity and better customer service
because, in the event of infrastructure failure, the messages
are retained for processing for when the environment is
restored
Network optimization by transmitting a single message into
your network and not multiple
Scaleability of large volume-handling applications because
transactions(messages) are kept and processed outside of
the application (State Street Bank hit a peak of 250 million
messages per day)
Flexibility in infrastructure (machines, network protocols,
application residences) and higher developer productivity
because changes in infrastructure do not affect the
application internals
WebSphere Business Integration 23 © Copyright IBM Corporation 2004
 IBM Software Group

Benefits

Flexibility in system design by providing an asynchronous

paradigm to allow parallel processing
Operational enhancement by changing applications to
real-time access due to ability to trigger programs and jobs
Sub-second response time since MQ is a resource manager
and handles the majority of requests and objects in memory
Transactional processing capability since it has the ability to
commit or rollback messages
Ease of use with minimal number of verbs and tools to allow
central administration of the MQ environment
Higher developer flexibility because MQSeries is
database-independent and content independent
More developer flexibility and productivity with ability to
access the same API through multiple languages
De-facto standard in messaging allows flexibility in software
package purchases
WebSphere Business Integration 24 © Copyright IBM Corporation 2004
 IBM Software Group

Business Success

Usage
>7000 customer sites All Industries with any of
>350 of IBM's top 500 customers key data characteristics
>66%of NA and European banks
In heavy production usage, e.g. State Street Bank - High volume
peaked at 375M messages per day, average 144M per
- High performance
day
- High value
Business real-time usage, e.g. Chicago Mercantile
Exchange, Sydney Olympics, Wimbledon, Delta - Integrated value chains
Airlines
Achievement
> 75+% WW market share Finance, Manufacturing,
> 4000+ certified specialists (1000 companies) Retail, Telco, Travel,
> 500+ ISVs offer services & products Insurance, Healthcare,
> 60+ significant formal IBM announcements since Utilities, Govt, Sports
Jan 96
Recognition
7 major industry awards
Strong analyst interest in
loosely-coupled environments 7 industry
Seen as de-facto standard by many analsts awards

WebSphere Business Integration 25 © Copyright IBM Corporation 2004

 IBM Software Group

Agenda

 Basics
 Definition
 Queue Manager and
its objects
 API
 Platforms & Protocols
 Roles & Education
 Benefits
 Resources

WebSphere Business Integration 26 © Copyright IBM Corporation 2004

 IBM Software Group

Resources – Software Support Team

Post Sales
Pre/Post Sales Pre-Sales Technical
Technical

Client Executive

Software Account
Manager

Sales Specialist Technical Specialist Telephone Support

Advanced
Technical Support

Product Development

WebSphere Business Integration 27 © Copyright IBM Corporation 2004

 IBM Software Group

Resources – User Groups

Cleveland WebSphere MQ User Group

Pittsburgh WebSphere MQ User Group

Spring and Fall Meetings

Free Membership
Expert Speakers
Participation Open To Everyone

www.websphere.org

WebSphere Business Integration 28 © Copyright IBM Corporation 2004

 IBM Software Group

Resources - Web

www.ibm.com/software/integration/mqfamily
• Announcement letters
• Brochures
• Downloads
• Extensions
• Manuals
• Samples
• Support Pacs
• White papers
• etc.

WebSphere Business Integration 29 © Copyright IBM Corporation 2004

 IBM Software Group

WebSphere Business Integration 30 © Copyright IBM Corporation 2004

 IBM Software Group

Agenda

 Advanced topics
 Connectivity
 Messages
 API
 Triggering
 Transactional
 Messaging Paradigms
 Clustering
 Monitoring
 Architecture

WebSphere Business Integration 31 © Copyright IBM Corporation 2004

 IBM Software Group

Connectivity
MQSERIES CONNECTIVITY DIAGRAM

S U N S O L A R I S QM1 OS/390 QM2

RQD Name: FRED Listener

Remote Queue Name: BOB
Remote Queue Manager Name: QM2
Transmission Queue Name: XMITQ1

QM1.QM2
RQD S R
Queue Name: XMITQ1 Queue Name: BOB
Usage: XMITQ Usage: NORMAL

QM2.QM1
R S RQD

Queue Name: JIM Queue Name: XMITQ2

Usage: NORMAL Usage: XMITQ
RQD Name: DAN
Remote Queue Name: JIM
Remote Queue Manager Name: QM1
Transmission Queue Name: XMITQ2

Listener

WebSphere Business Integration 32 © Copyright IBM Corporation 2004

 IBM Software Group

Agenda

 Advanced topics
 Connectivity
 Messages
 API
 Triggering
 Transactional
 Messaging Paradigms
 Clustering
 Monitoring
 Architecture

WebSphere Business Integration 33 © Copyright IBM Corporation 2004

 IBM Software Group

Messages - Header Information

Header User Data

• Structure Identifier • Backout Count • Offset

• Structure Version Number • Reply to Queue Name • Message Flags
• Report Options • Reply to Queue Manager Name • Original Length
• Message Type • User Identifier
• Expiration Time • Accounting Token
• Feedback/Reason Code • Application Identity Data
• Encoding • Put Application Type
• Coded Character Set Id • Put Application Name
• Format • Put Date
• Priority • Put Time
• Persistence • Application Origin Data
• Message Identifier • Group ID
• Correlation Identifier • Message Sequence Number

WebSphere Business Integration 34 © Copyright IBM Corporation 2004

 IBM Software Group

Messages – Report Options

• Confirm on arrival (COA)

• Confirm on delivery (COD)
• Expiration
• Exception

All with or without the first 100 bytes of data

WebSphere Business Integration 35 © Copyright IBM Corporation 2004

 IBM Software Group

Agenda

 Advanced topics
 Connectivity
 Messages
 API
 Triggering
 Transactional
 Messaging Paradigms
 Clustering
 Monitoring
 Architecture

WebSphere Business Integration 36 © Copyright IBM Corporation 2004

 IBM Software Group

API – Major Verbs

MQCONN/MQCONNX - Connect to Queue Manager

MQCONN (QMName, Hconn, CompCode, Reason)

name = name of queue manager to connect with

Hconn = queue manager handle returned by the MQCONN call
CompCode = completion code; OK, WARNING or FAILED
Reason = reason code describing CompCode; NONE or reason
descriptions

WebSphere Business Integration 37 © Copyright IBM Corporation 2004

 IBM Software Group

API – Major Verbs

WebSphere Business Integration 38 © Copyright IBM Corporation 2004

 IBM Software Group

API – Major Verbs

WebSphere Business Integration 39 © Copyright IBM Corporation 2004

 IBM Software Group

API – Major Verbs

WebSphere Business Integration 40 © Copyright IBM Corporation 2004

 IBM Software Group

API – Major Verbs

WebSphere Business Integration 41 © Copyright IBM Corporation 2004

 IBM Software Group

API – Major Verbs

WebSphere Business Integration 42 © Copyright IBM Corporation 2004

 IBM Software Group

API – Minor Verbs

WebSphere Business Integration 43 © Copyright IBM Corporation 2004

 IBM Software Group

API – Minor Verbs

MQBEGIN - Syncpoint begin unit of work

MQBEGIN (Hconn, CompCode, Reason)

Hconn = queue manager handle returned by MQCONN call

CompCode = completion code; OK or FAILED

Reason = reason code describing CompCode; NONE or reason

descriptions

WebSphere Business Integration 44 © Copyright IBM Corporation 2004

 IBM Software Group

API – Minor Verbs

MQCMIT - Syncpoint commit

MQCMIT (Hconn, CompCode, Reason)

Hconn = queue manager handle returned by MQCONN call

CompCode = completion code; OK or FAILED

Reason = reason code describing CompCode; NONE or reason

descriptions

WebSphere Business Integration 45 © Copyright IBM Corporation 2004

 IBM Software Group

API – Minor Verbs

MQBACK - Syncpoint rollback

MQBACK (Hconn, CompCode, Reason)

Hconn = queue manager handle returned by MQCONN call

CompCode = completion code; OK or FAILED

Reason = reason code describing CompCode; NONE or reason

descriptions

WebSphere Business Integration 46 © Copyright IBM Corporation 2004

 IBM Software Group

API – Minor Verbs

MQINQ - Inquire about object attributes

WebSphere Business Integration 47 © Copyright IBM Corporation 2004

 IBM Software Group

API – Minor Verbs

MQSET - Change object attributes

WebSphere Business Integration 48 © Copyright IBM Corporation 2004

 IBM Software Group

Agenda

 Advanced topics
 Connectivity
 Messages
 API
 Triggering
 Transactional
 Messaging Paradigms
 Clustering
 Monitoring
 Architecture

WebSphere Business Integration 49 © Copyright IBM Corporation 2004

 IBM Software Group

Triggering - Types

• First
• Every
• Depth
• Priority

WebSphere Business Integration 50 © Copyright IBM Corporation 2004

 IBM Software Group

Triggering - Mechanism

3. Trigger Monitor program Trigger

reads message from Initiation Monitor
Queue and starts the Job Program
/Program.

2. MQ reads Process
Definition identified in Initiation Queue
Application Queue Application
Application queue and
creates a message in Job / Program
the Initiation Queue with
Application Job/Program
4. Application
1. Message arrives information stored
Job/Program reads
on Application Queue therein.
message off of
Process Application Queue
Process
Definition
Definition

Contains name of
application job or program

WebSphere Business Integration 51 © Copyright IBM Corporation 2004

 IBM Software Group

Agenda

 Advanced topics
 Connectivity
 Messages
 API
 Triggering
 Transactional
 Messaging Paradigms
 Clustering
 Monitoring
 Architecture

WebSphere Business Integration 52 © Copyright IBM Corporation 2004

 IBM Software Group

Transactional - Syncpoint

WebSphere Business Integration 53 © Copyright IBM Corporation 2004

 IBM Software Group

Agenda

 Advanced topics
 Connectivity
 Messages
 API
 Triggering
 Transactional
 Messaging Paradigms
 Clustering
 Monitoring
 Architecture

WebSphere Business Integration 54 © Copyright IBM Corporation 2004

 IBM Software Group

Messaging Paradigms

Fire & Forget

Program Program
A B

Request/Reply
Program Program
A B

WebSphere Business Integration 55 © Copyright IBM Corporation 2004

 IBM Software Group

Messaging Paradigms

Publish/Subscribe Program
B

Program
C

Program
Broker
A
Program
D

Program
E

WebSphere Business Integration 56 © Copyright IBM Corporation 2004

 IBM Software Group

Messaging Paradigms

Chain

Program Program Program

A B C

Loop
Program Program
A B

Program
C

WebSphere Business Integration 57 © Copyright IBM Corporation 2004

 IBM Software Group

Agenda

 Advanced topics
 Connectivity
 Messages
 API
 Triggering
 Transactional
 Messaging Paradigms
 Clustering
 Monitoring
 Architecture

WebSphere Business Integration 58 © Copyright IBM Corporation 2004

 IBM Software Group

Clustering

Q Mgr 1
Program
• Failover
B
• Workload balancing
• Default: Round-robin Queue 1
• User replaceable exit
Q Mgr 2
Program
B

Q Mgr A Queue 1
Program
A Q Mgr 3
Program
B
• Reduced administration
Queue 1
• Automatic creation of:
• Remote queues
• Channels Q Mgr 4
Program
• Scalability B
• New queue managers
can join cluster at any time Queue 1

WebSphere Business Integration 59 © Copyright IBM Corporation 2004

 IBM Software Group

Agenda

 Advanced topics
 Connectivity
 Messages
 API
 Triggering
 Transactional
 Messaging Paradigms
 Clustering
 Monitoring
 Architecture

WebSphere Business Integration 60 © Copyright IBM Corporation 2004

 IBM Software Group

Monitoring

Monitoring for Business Integration

PATROL® for WebSphere MQ

QACenter for WebSphere

MQ

…and others

WebSphere Business Integration 61 © Copyright IBM Corporation 2004

 IBM Software Group

Agenda

 Advanced topics
 Connectivity
 Messages
 API
 Triggering
 Transactional
 Messaging Paradigms
 Clustering
 Monitoring
 Architecture

WebSphere Business Integration 62 © Copyright IBM Corporation 2004

 IBM Software Group

Internal Architecture

Applications
Utilities
Command Server
Listener
Channel Initiator
Trigger Monitor
PUT GET MQ Explorer
LOG

Operating System
Timers
Operating Semaphores
Messaging ECB's
System& Memory
& Queuing
Storage ...

Communications

WebSphere Business Integration 63 © Copyright IBM Corporation 2004

 IBM Software Group

WebSphere Business Integration 64 © Copyright IBM Corporation 2004