IMS Connect Session with Ellis-9405 FINALv2

IMS Connect:

Proving It’s Worth for Web Services

Ellis Holman, IBM System z Client Architect

Nancy Stein, IBM Consulting IT Specialist

August 8, 2011

Session Number 9405

U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule

Contract with IBM Corp.

THE INFORMATION CONTAINED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL PURPOSES

ONLY. WHILE EFFORTS WERE MADE TO VERIFY THE COMPLETENESS AND ACCURACY OF THE

INFORMATION CONTAINED IN THIS PRESENTATION, IT IS PROVIDED “AS IS” WITHOUT WARRANTY OF

ANY KIND, EXPRESS OR IMPLIED. IN ADDITION, THIS INFORMATION IS BASED ON IBM’S CURRENT

PRODUCT PLANS AND STRATEGY, WHICH ARE SUBJECT TO CHANGE BY IBM WITHOUT NOTICE. IBM

SHALL NOT BE RESPONSIBLE FOR ANY DAMAGES ARISING OUT OF THE USE OF, OR OTHERWISE

RELATED TO, THIS PRESENTATION OR ANY OTHER DOCUMENTATION. NOTHING CONTAINED IN THIS

PRESENTATION IS INTENDED TO, NOR SHALL HAVE THE EFFECT OF, CREATING ANY WARRANTIES OR

REPRESENTATIONS FROM IBM (OR ITS SUPPLIERS OR LICENSORS), OR ALTERING THE TERMS AND

CONDITIONS OF ANY AGREEMENT OR LICENSE GOVERNING THE USE OF IBM PRODUCTS AND/OR

SOFTWARE.

IBM, the IBM logo, ibm.com, z/OS, IMS, DB2, WebSphere, WMQ, Rational, RAD, RADz, and zLINUX are trademarks or

registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these

and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™),

these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published.

Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is

available on the Web at “Copyright and trademark information” at www.ibm.com/legal/copytrade.shtml

Other company, product, or service names may be trademarks or service marks of others.

Disclaimer

Purpose and Agenda

• Proof of Concept Purpose

• Determine if a combination of IMS 11 and IMS Connect

can replace the existing WMQ interface to IMS

applications, simplify the environment and continue to

meet business SLAs

• Agenda

• Introduction

• IMS Connect PoC

• Findings

• Potential Benefits

• References

• Appendix

Introduction – Background

• In the beginning … an onsite System z Infrastructure

Architecture Workshop (zIAW) was executed with

customer and IBM SMEs

• Developed and outlined an IMS Connect PoC

• Subject Applications

• Online Inquiry System portal integration with mainframe

application

• Online Update System portal integration with mainframe

application

• Outbound Pricing Service

• Established IMS Connect PoC sandbox environment

for learning and discovery of IMS SOA capabilities

Introduction – Key Participants

• Customer

• Enterprise Architects

• Application Developers

• System Programmers & DBAs

• Performance & Tuning / Capacity Planning

• Application Developers

• Management

• Ellis Holman, IBM System z Client Architect

• Nancy Stein, IBM Consulting IT Specialist

• Haley Fung, IBM IMS Connect Lead Developer

Introduction – Additional Team Members

• Linda Warfield, IBM Project Manager

• Subra Narayanaswamy, IBM Global Services

• Thomas Garrett, IBM Global Services

• Gerald Waterman, IBM

IMS Connect POC – Customer’s Goals

Create a simple sandbox environment to exercise IMS Connect for:

1) inbound calls to an existing IMS application

2) outbound calls from IMS applications to existing web services

This environment is going to be used for discovery and learning relative

to the IMS Connect product. We hope to learn how we can leverage

IMS Connect in the environment.

• Inbound Transaction Use Case Evaluation

• Port an existing client application to the mainframe running under a z/Linux LPAR

• Existing WMQ calls will be modified to utilize the IMS TM Resource Adapter

running in Websphere on z and IMS Connect to call existing IMS transactions

• The modified application will eliminate the need for WMQ

• Outbound Transaction Use Case Evaluation

• Use an existing CLAIM application to leverage the new IMS DLI call, ICAL, to

invoke an existing web service via the IMS SOAP Gateway

IMS Connect POC – What Was Done ?

• On-Site IBM System z Infrastructure Architecture Workshop

• September 2009

• Studied two selected Business Use Cases

• Setup Sandbox Environment for PoC

• Application Portals Modifications

• Migrated from mid-tier AIX platform to Linux on System z platform

• Replaced WMQ calls with IMS TM Resource Adapter / IMS Connect API

• Inbound Transaction Use Case Evaluation

• IMS TM Resource Adapter (J2C 1.5 Architecture)

• IMS Connect API

• IMS DB Resource Adapter

• IMS JDBC Universal Drivers

• Outbound Transaction Use Case Evaluation

• IMS Transactions as web service consumers

• IMS SOAP Gateway

A project plan was drawn up and teams

assembled to provide support for the effort

IMS Connect POC– Sandbox Environment

• Hardware:

• 1 new LPAR

• 1 IFL

• 10 Gb Memory

• Software:

• z/OS LPAR

• z/VM LPAR

• IMS 11 Control Region and IMS Connect

• IMS SOA Integration Suite

• Rational Application Developer Version 7.5.5

• Rational Application Developer for System z Version 7.6

• Websphere Application Server – ND Version 7

• Redhat Enterprise Linux for z/OS Version 5

System z Hardware

Service Machines

(similar to daemons)

WAS Linux Guests

LPAR

z/OS

IMS DB

“Inside the box”

virtual networking

CP1 CP2 CP3

IFL4

IMS Connect POC– Architecture

IMS

IMS Connect

LPAR

z/VM Control Program

IMS Inbound Service Requests

IMS

IMS Connect – IMS’s TCP/IP Gateway

TCP/IP

WebSphere

IMS TMRA

DataPower

Appliance

IMS SOAP

Gateway

IMS Univ

DB Adapters

IMS Connect

API Clients

IMS

DBs

z/OS

OBDM

IMS

Connect

EXIT

MGR

Operations

Manager

SCI

XCF

DEP RGN

Application

IMS Control

Center

ISV

Solutions

IMS

Connect

Extensions

IMS PA & IMS PI Tooling

DRA

ODBA

Roll Your

Own Solution

TCP/IP

IMS TM

Resource

Adapter

(J2C)

Business

Services EJBs

IMS

Connect

z/OS

WebSphere Application Server

zVM LINUX GUEST

IMS

SVC

HTTP(S)

IMS Connect PoC

Use Case #1: Inbound Call to IMS

WEB CLIENTS

1. User issues inquiry or update request from Web Browser via HTTP(S)

2. Business Service EJB receives and processes request

3. Business Service EJB invokes IMS TM Resource Adapter

4. IMS TM Resource Adapter sends request to IMS Connect via TCP/IP (uses Hipersocket connection)

5. IMS Connect passes I/P message to OTMA via XCF; OTMA places transaction on IMS Message Queue

6. IMS schedules and processes transaction in dependent region,

7. O/P response message is returned to Business Services EJB

IMS

SVC

IMS

SVC

XCF

Appl. TRAN

scheduled and

response

message is

ISRT to IOPCB

Findings – Inbound Applications

• Positives …

• Improved performance of inbound IMS transaction

• application response time reduced by 25%

• Improved performance of Portals under Linux on System z

• average 30% improvement in the overall performance

• Standard and flexible IMS interfaces vs. proprietary WMQ calls

• JEE, TMRA, JCA 1.5, JDBC and direct API calls

• Standard, supported IMS SOA vs. proprietary black box solutions of EIS

and BSI application frameworks

• Flexibility of switching backend IMS subsystems via WAS Admin Console

• no coding changes required when using WAS and IMS TMRA

• Paradigm shift to a two-tier architecture model

• resulted in code that is cleaner and easier to maintain

• IMS 11 supports inbound services calls after enabling IMS Connect

• Narrowed the knowledge gap between M/F and Distributed personnel

Findings – Inbound Transactions

• Things to be aware of …

• Not a full JDBC 3.0 implementation

• No impact on this PoC, but does not support JDBC Batch

accessing databases directly in DLI mode

• Little Endian and Big Endian conversion between platforms

• When the client application was migrated to Linux on System

z , the order in which bytes were stored in memory required

specific parsing of the IMS message returned

• Need to handle mainframe transaction ABENDs properly

OBIS Transactions

0.5

1.5

2.5

1 2 3 4 5 6

Usecase

Average Response Time(s)

WebSphere MQ

IMS Connect

IMS TM RA

Inbound Transactions

Stress Test Observations

View of performance results for use cases accessing IMS transactions to fetch data

Snap shot of stress test results for use cases - WMQ, IMS Connect API & IMS TMRA

Stress Test Observations

Average 30% improvement

using IMS Connect vs WMQ

IMS Outbound Service Requests

TCP/IP

IMS

SOAP

Gateway

IMS

Connect

z/OS

zVM LINUX GUEST or z/OS

HTTP(S)

IMS Connect PoC

Use Case #2: IMS Outbound to Web Service

1. IMS application transaction issues an “ICAL” request with a SENDRECV to an OTMA Descriptor

2. OTMA passes the request message directly to IMS Connect bypassing the IMS Message Queue

3. IMS Connect converts message into XML and sends it to SOAP Gateway via TCP/IP (uses Hipersocket)

4. SOAP Gateway wraps SOAP envelope around the XML and sends request to the Web Service via HTTP(S)

5. Web Service receives and processes the request from IMS application transaction

6. Web Service sends response back to waiting IMS application transaction via a reverse path

XCF

WEB

SERVICE

PROVIDER

IMS

Appl. TRAN ->

“ICAL” with

SEDNRECV

sub-function

SOAP

XML

Converter

Byte String

llzzTRCDdata

Findings – Outbound Pricing Service

• Simple http enabled service was successful

• The following configuration issues were resolved

• Tpipe connectivity issue

• Analysis to determine why the tpipe which connects IMS

Soap Gateway and IMS Connect to OTMA is not processing

IMS call to request the simple http enabled service

• Resolved by putting adhoc security in place and applying an

APAR

• RAD/z was needed to create the WSDL used by IMS Connect

• Issues uncovered working with RAD/z:

• The mapping code generated is rejecting the request

• Looking at the Cobol versioning level

• Worked with IBM Labs in Germany and in SVL

Findings – Outbound Pricing Service

• Call failed in the timeframe of the PoC

• Artifact creation issues within the IBM® Rational® Developer for

System z® caused a change in direction to create a simple http

enabled service to continue with the PoC

• WSDL RPC support

• Not all standard WSDL levels were supported

• IBM confirmed that in the next release this issue would be

addressed

• Three enhancement requests were opened to make the tool

useful in a production deployment environment

• ODC

• multiple mapping

• embedded logic

• Connection issues to the mainframe demon listeners using

IBM® Rational® Developer for System z® (RAD/z)

• Fixed with security

Findings - Non-Technical

• From the Customer

• IBM as a Technical Partner

• “IBM supported business associates and addressed the

issues quickly and listened to our findings and proposed

solutions or integrated our findings into future releases of

the software.”

• “Infrastructure support is strongly exploring skipping IMS

10 and migrating directly to IMS 11 and IMS Enterprise

Suite Version 11, then deploying the IMS Connect and

IMS SOAP Gateway address spaces.”

• “An additional PoC is being proposed by Enterprise

Architecture staff to use the IMS 11 sandbox to determine

if the technology can be applied to current BSI

Frameworks”

Findings – PoC Success

• Proof of Concept Purpose

• Determine if a combination of IMS 11 and IMS Connect

can replace the existing WMQ interface to IMS

applications, simplify the environment and continue to

meet business SLAs

• IMS V11 and IMS Connect …

• Can replace the WMQ interface to IMS applications

• Simplifies the integration environment significantly

• Able to achieve better results than the business SLAs

Potential Benefits

• IMS Connect and IMS SOA Integration Suite

• Performance, reliabiilty and scalability improvements

• Reduced configuration and maintenance vs. WMQ setup and

maintenance – simplification of interface

• Assumed significant reduction in production MIPs

• It was determined that an average Claim took 60 - 100 ms of

overhead when going through the WMQ calls

• Eliminates 32kb payload restriction using “ICAL” / IMS Connect /

IMS SOAP Gateway

• Allowed for request and response payloads of 16mb

• Eliminates the multiple points of failure inherent in WMQ hops

• Allows a point to point connection to all web enabled/SOAP/html

services from within IMS

• Brings the IMS environment inline with SOA standards

Potential Benefits

• Server Virtualization Using Linux on System z

• Dynamic computing resource allocations

• Decreased complexity to improve manageability of systems

• Automate routine tasks

• Reduces overall management costs through efficiency

• Possible Software License cost saving

• Improves return on infrastructure investment through better

utilization of resources

• Savings on energy and floor space

Potential Benefits

• Lean Development Process

• On demand computing environment and model to test,

assemble, retest & deploy applications and maximize

hardware utilization

• Automatically configure OS & software stacks

• Provides developer self service capabilities

• Simplifies ongoing operations and reduces technical

support burden

• 11 Servers will be sunset during solution implementation

Post-PoC Steps

• Total Cost Ownership (TCO) Analysis by IBM

• Hardware cost saving model through Linux on System z

virtualization

• License cost saving

• Maintenance and administration labor cost saving

• Process efficiency analysis

• Production Implementation (based on TCO analysis)

• IMS 11 and IMS Connect, IMS SOA Integration Suite and

z/Linux

• Application Portal z/Linux Migration

• consolidate 11 physical boxes

• software license and administration cost saving

• DB2 Gateway migration

• consolidate 2 boxes

Post-PoC Steps

• Identify Additional Applications Within Scope

• Begin reengineering of another IMS application

• Frameworks integration using DataPower

• PoC completed in 2010

• Phase II PoC

• Centralize Benefit Services running on Websphere 7 / z/OS

• DataPower integration

References for PoC

• IMS SOA Integration Suite

http://www-01.ibm.com/software/data/ims/soa-integration-suite/

• IMS Enterprise Suite

http://www-01.ibm.com/software/data/ims/soa-integration-suite/enterprise-suite/

• IBM Websphere Application Server

IBM - WebSphere Application Server - Software

• Programming with the IMS Universal JDBC drivers

http://publib.boulder.ibm.com/infocenter/dzichelp/v2r2/topic/com.ibm.ims11.doc.apr/ims_odbjavareference.htm

References for PoC

• Bringing IMS and SOA Together With IMS Connect

Bringing IMS and SOA Together With IMS Connect | Mainframe | IBM

Systems Magazine

• IBM IMS TM Resource Adapter

• http://www-01.ibm.com/software/data/ims/ims/components/tm-resource-adapter.html

• IBM Enterprise Modernization Sandbox - Demos

http://www.ibm.com/developerworks/downloads/emsandbox_systemz/index.html

Information and Analytics Communities

• On-line communities, User Groups, Technical

Forums, Blogs, Social networks, and more

• Find a community that interests you …

• ibm.com/software/data/community

• Information Champions

• Recognizing individuals who have made the most

outstanding contributions to Information Management

communities

• ibm.com/software/data/champion

IMS Information and Education

• “An Introduction to IMS” book

• Update coming for IMS 11

• IMS Redbook

• IMS Version 11 Technical Overview

• IMS Family Website: www.ibm.com/ims

• Presentations, papers, newsletters, fact

sheets, announce letters, Redbooks

• Schedule of seminars, webcasts and

conferences

• IMS education schedule

• Information Center - enables search across

IMS, DB2 and Tools documentation

• Migration, skills transfer, customized

offerings at [email protected]

• IMS 11 Announcement Letter 208-258

www.ibm.com/common/ssi/index.wss

• IMS 11 Fact Sheet - GC19-2451

http://publib.boulder.ibm.com/infocenter/dzichelp/v2r2/index.jsp?topic=/com.ibm.ims11.doc.fact/factsheet_v11.htm

• IMS 11 Release Planning - GC19-2442

http://publib.boulder.ibm.com/infocenter/dzichelp/v2r2/topic/com.ibm.ims11.doc.rpg/rpg.htm

• IMS 11 Publications

• All of the IMS 11 publications are available from the Information

Management Software for z/OS® Solutions Information Center

http://publib.boulder.ibm.com/infocenter/dzichelp/v2r2/topic/com.ibm.ims11.doc/imshome_v11.htm

• IMS Version 11 Technical Overview – Redbook SG24-7807-00

http://www.redbooks.ibm.com/abstracts/sg247807.html?Open

• IMS 11 Open Database – Redbook SG24-7856-00

http://publib-b.boulder.ibm.com/abstracts/sg247856.html?Open/

IMS 11 Information

Data Management Communities for IMS

• Data Management Community – share and interact on all Data

Management topics with peers around the world

• www.ibm.com/software/data/management/community.html

• IMS Community – share and interact with IMS peers around the world

• http://www-01.ibm.com/software/data/ims/community/

• IMS Regional User Groups – find a meeting near you

• www.ibm.com/software/data/ims/usergroups.html

• IMS Application Development Forum

• www.ibm.com/developerworks/forums/forum.jspa?forumID=1632

• Information Champions – recognized individuals who have made the most

outstanding contributions to the Information Management community

• www.ibm.com/software/data/champion

• Rational Cafes – for host application programming languages

• www.ibm.com/software/rational/cafe/index.jspa

• COBOL Cafe – IMS Hub for application programmers

• www.ibm.com/software/rational/cafe/community/cobol/ims?view=overview

twitter.com/IBM_IMS

Twitter, Facebook, YouTube, LinkedIn, SlideShare, Tumblr and their respective logos may be trademarks or registered trademarks of Twitter Inc., Facebook Inc., Google Inc., LinkedIn Corp., SlideShare Inc. & Tumblr Inc., respectively.

imsmadesimple.tumblr.com

www.ibm.com/developerworks/mydeveloperworks/blogs/IMS

www.youtube.com/user/ReThinkIMS

www.slideshare.net/ibmims

www.ims-ug.org

facebook.com/IMSFans

imslistserv.bmc.com

ibm.com/vrm/newsletter/11069

linkedin.com/groups?mostPopular=&gid=1949922

www.ibm.com/software/rational/cafe/community/cobol/ims?view=overview

Thank You!

Your Feedback is Important to Us

Ellis Holman, IBM System z Client Architect – eaho[email protected]om

Nancy Stein, IBM ATS Specialist / IMS – ngstein@us.ibm.com