Integration Patterns

IBM Redbooks Solution Guide

Note: This is publication is now archived. For reference only.

Published 30 April 2014

View online

More options

Rate and comment

(based on 3 reviews)

Tell us what you think

Authors: Coble Deana, Margaret Ticknor

Abstract

Throughout the history of the IT industry, integration has been an important part of most projects. Integration of transactions, integration of data, or integration of processes have their own challenges and associated patterns and anti-patterns. In an age of mobile, social, and cloud, integration is more important than ever, but the scope of the challenge that is facing IT projects has changed. Partner application programming interfaces (APIs), social networks, physical sensors and devices, and many others are important sources of capability or insight. No longer is it sufficient to integrate resources under the control of the enterprise; many important resources live in the ecosystem beyond the enterprise boundaries. This IBM® Redbooks® Solution Guide focuses on using IBM products together as a "hybrid" integration solution to achieve total company integration.

Contents

Today’s customers expect you to be relevant to their life. Relevancy is not generic; it is specific to the customer in the moment. To remain relevant, enterprises must expand and engage with the customer and with third parties (developers) to support the customer. It is time for innovative solutions (see Figure 1).

Application programming interface (API) management delivers the business centricity and business model that many service-oriented architecture (SOA) initiatives historically have lacked, and SOA delivers the experience and engineering discipline that drives good API design and provides robust integration to systems of record. API management and classical SOA governance are highly synergistic. API management refocuses on the business aspects of human and software interactions. The advent of APIs allows you to separate the business concerns of making an API a successful product from the IT concerns of providing the service that implements the API. The journey from IT-centric web services to business-centric API management is necessary for enterprises that build systems of interaction spanning beyond their enterprise walls. API management solutions provide can define an API and project that API into an ecosystem that the enterprise cannot effectively reach through its own user solutions.

Opportunities for businesses to innovate
Figure 1. Opportunities for businesses to innovate


Did you know?

Mobile users are intrinsically impatient and always on the move; in fact, the average mobile user spends around 60 seconds in a mobile app before moving to something else. This means that mobile interactions must be personal to be relevant. They must be in the here and now. The modern user expects you to know who they are and what they need now. These characteristics represent an opportunity for enterprises that understand how to embrace them and provide a differentiating customer experience.


Business value

What is called the Nexus of Forces (http://www.gartner.com/technology/research/nexus-of-forces/) by Gartner is the confluence of mobile, social, cloud, and big data analytics. The Nexus of Forces implies an experience where context is key and important interactions might not be directly related to business transactions but rather focused on building social relationships and ecosystems. Social interactions of interest to the business can and will happen between two third parties (such as viral content).

Many interactions are mobile and happen in a real-time context. You can access information, accounts, or contact a friend dynamically. The growth of social media created a consumer who expects their opinion to matter and chooses the mobile device as the way the consumer interacts with the world. These characteristics change the scope of what is considered business relevant.

For businesses that are ready to grow beyond the enterprise, the Nexus of Forces raises some key questions and challenges around defining a business model and engineering the business solutions that support it:

  • Where do transactions happen? Anywhere and anytime; this is the essence of mobile and cloud.
  • Who can influence your business? Anyone that publishes an opinion, positive or negative; this is the essence of social.
  • Who can access your information? Anyone that you can legally provide it to, whether in exchange for money, influence, or improved relationships. Applying big data analytics to vast amounts of available information sources lets you provide unique value and insight (particularly in the context of the Internet of Things).
  • What is an application? Any piece of software that provides value (including mobile apps, software that is embedded in appliances or cars, cloud services, and so on).
  • Who is your developer? Anyone that builds business solutions by using your information or services. In an open ecosystem, it is often someone who is not employed within your own enterprise.

More engaging applications and processes intelligently use the context of a business interaction to optimize the experience. Context is crucial to optimizing the offers that are made to a particular customer, and context is a necessity for making that customer feel like they are being treated as a person rather than just a general business opportunity (see Figure 2). Human society is accustomed to people taking into account everything they know about us as a factor in how they choose to interact.

Engaging applications and processes
Figure 2. Engaging applications and processes

You generally do not interact in the same way with a person who is bald by style, a person who is a soldier, and a person who is a survivor. Just knowing their physical appearance is not sufficient; you must know who they really are to make the optimal choice of how to interact. In the world of software and processes, the Nexus of Forces changes the way that your business operates by allowing you to apply the same type of contextual reasoning that you apply in the physical world.


Solution overview

To be an engaging enterprise requires embracing an open ecosystem, using sound SOA principles while delivering APIs as part of a business product, carefully promoting and managing your external business persona, and creating a fundamental topology that aids in understanding the different roles and purposes of integration middleware products. The separation of capabilities (into messaging, integration, and gateway) forms that fundamental topology.

Classical SOA middleware focuses on creating and managing software services. The other three middleware ingredients of the API and service economy (Figure 3) are centered around the following concepts:
  • Designing and optimizing a business persona through the definition and management of easy to consume APIs.
  • Providing developer portals and participating marketplaces to make potential consumers aware of your APIs and the support of onboarding and self-service in a controlled fashion.
  • Making the consumption of APIs as easy as possible, including supporting uniform hybrid composition across a multitude of providers, environments, and technologies.

API and service economy
Figure 3. API and service economy

Many of these capabilities are known in isolation but must be integrated in new ways. Other elements require fundamental innovation and a different approach to delivery. IBM® has a recipe for more engaging and innovative business processes (see Figure 4).

Business process innovation
Figure 4. Business process innovation

To cover the four ingredients in the recipe, consider them from a retail perspective:
  • Detect: A customer is detected walking down the street close to one of your stores.
  • Enrich: Deepen the understanding of the situation through knowledge about that customer's previous buying behavior.
  • Perceive: This particular customer tweeted last night about going on a beach vacation soon.
  • Act: Send an SMS with a promotion on swim wear.

In only a few seconds, you created a unique and personalized experience. This more personal experience for the customer improved the chance of generating business, and might have strengthened the long-term relationship with the customer.


Solution architecture

Systems of interaction drive more engaging applications and processes by seamlessly and intelligently integrating systems of engagement with systems of record. This is an integration that crosses the boundary between the controlled enterprise environment and the uncontrollable Internet of Things (see Figure 5). This integration reaches from the mobile device to the corporate back end. Direct connections across this boundary are inappropriate and dangerous. Personal information typically is involved, which requires a secure and managed connection, and the traffic originating outside the boundary is internet scale in terms of both volume and spikes. So, traffic must be controlled and optimized to prevent bringing down the enterprise IT infrastructure.

Interaction and the changing world
Figure 5. Interaction and the changing world

In the context of integration throughout and beyond the enterprise, this situation implies an important distinction between the fundamental parts of your topology:
  • Messaging: Moving information payloads from A to B in a reliable fashion. At the heart of messaging is the ability to move an information payload from origin to destination in a controlled and reliable fashion.
  • Integration Bus: Creating structured assets and services that are based on existing data and functionality. At the heart of an Integration Bus is the ability to create reusable assets. The Integration Bus is the topology component that is closest to the classical notion of an enterprise service bus (ESB). The ESB is a general pattern embodying the SOA concept of consumers and providers that is mediated in a loosely coupled fashion. An Integration Bus is a particular embodiment of the ESB pattern that is centered around integrating resources within a zone of control. Although an Integration Bus provides mediation and composition of any conceivable type of resource, it does not provide the advanced security and traffic controls that are necessary for a gateway.
  • Gateway: Exposing APIs and services across a boundary in a controlled and optimized fashion. The concept of a gateway represents the topology component sitting on the boundary between systems of engagement and systems of record, or any other boundary of interest. Even though a gateway, by its nature, does support some amount of mediation, it is different from an Integration Bus. The difference stems from the fact that the gateway architecture is optimized towards control and throughput rather than towards aggregation of data and functionality (which is the focus of an Integration Bus). Gateways have advanced security and traffic control (a smart and efficient pipe), but no composition and limited mediation. Gateways typically are limited to a few standard protocols, such as SOAP and REST.

The Nexus of Forces drives new business agendas and information needs. However, what drives the design to support such business innovation? SOA design principles are a key ingredient in building systems of interaction that are flexible, robust, and extensible.

Three fundamental aspects (Figure 6) are part and parcel of SOA:
  • Service: A repeatable business task (such as checking customer credit or opening an account)
  • Service orientation: A way of thinking about your business through linked services and the outcomes they provide
  • Service-oriented architecture (SOA): A business-centric architectural approach that is based on service-oriented principles


Figure 6. Service-oriented architecture

A service as an abstract representation is important; it allows the service to be projected and accessed beyond the boundary of a physically controlled environment. A service as a representation of a business task is important for designing collaborative business systems beyond pure software integration. Finally, mediation, which is an intrinsic part of the enterprise service bus pattern and a fundamental building block of SOA, supports intelligent pairing of consumers and providers of services. This mediation functions whether those consumers and providers are software or people (see Figure 7).

SOA between consumers and providers
Figure 7. SOA between consumers and providers

The design principles that aid building such collaborative systems must be broader than the criteria for what constitutes a good service. IBM believes that the following SOA design principles are also fundamental to building systems of interaction:
  • Service orientation at the core: Thinking about business solutions in terms of interacting processes and services.
  • Process integration at an internet scale: Ensuring integrity of interactions and information across time and location.
  • Integration with enterprise capabilities and back-end systems: Providing a unified experience across channels and systems, which maximizes existing capabilities to drive new innovative processes.
  • A basis in industry standards: No single player or vendor can dictate protocols or information standards.
  • Providing the platform for a growing ecosystem: As the business ecosystem grows beyond the walls of the enterprise, so does the ecosystem that delivers and manages business solutions.

The last bullet is what the excitement around web APIs is about: growing the development ecosystem beyond the enterprise as a means for extended business outreach.


Usage scenarios

An online store and a social networking service, although adopting different business models, are both examples of early adopters of a computing model that is open by design and where the product is based on APIs and services that are projected into an extended ecosystem. Without its open merchant platform, the online store cannot be the one-stop shop for various goods and might not have become one of the dominant internet retail portals. Without the open interface to its communication servers, the social networking service cannot rely on a myriad of smart clients being provided for, at no cost, by various open source communities, and might not have achieved the popularity that it enjoys today. These are just two examples of a trend across all industries where solutions are first designed for an open ecosystem, whether those solutions are deployed internally, externally, or in a hybrid fashion. It is no coincidence that "mobile first" and "cloud first" are some of the mantras of this new age of computing. This new age is marked by designing for a different experience and environment yet allowing solutions, where appropriate, to still run within the enterprise or using traditional channels.


Integration

IBM has a sophisticated set of products that simplify integration and quickly solve a wide range of problems:
  • IBM WebSphere® Cast Iron® and IBM WebSphere DataPower® XH40: Connecting to applications in the public cloud enables enterprises to use a new cloud economy.
  • IBM Workload Deployer and IBM PureApplication® System: Enterprises looking to achieve more with less by better managing IT resources as collectives.
  • Integration Bus (IBM WebSphere Message Broker): The enterprise service bus integrates apps, data, services, and partners while controlling and optimizing connections.
  • IBM WebSphere eXtreme Scale (WXS) and IBM WebSphere DataPower XC10: Cache grids improve scale and performance of applications and services.
  • IBM Mobile Foundation Worklight®: A mobile utility that can deal with the scale and ubiquity of mobile and sensor rich environments that have changed requirements of enterprises.
  • IBM WebSphere DataPower XG45: Secure appliances enable controlled access to enterprise resources.
  • IBM WebSphere MQ: A messaging backbone in the data center that extends to external clients that are connected through the internet.
  • Sterling Commerce, IBM WebSphere DataPower XB62, and IBM WebSphere Cast Iron Live: These business-to-business partners open channels and collaboration where a new genre, “App Developer Partner”, is emerging.

For more information, see Integration Throughout and Beyond the Enterprise, SG24-8188-00, which can be found at the following website:

https://www.redbooks.ibm.com/Redbooks.nsf/RedpieceAbstracts/sg248188.html?Open


Supported platforms

For detailed system requirements, a list of supported operating systems, prerequisites, and optional supported software, with component-level details and operating system restrictions, go to the following websites:


Ordering information

Table 1 shows ordering information for the products of this solution.

Table 1. Ordering information
Program namePID numberCharge unit description
IBM Worklight5725-I43Client device installation application
IBM WebSphere DataPower Service Gateway XG457198-32X Per appliance
IBM WebSphere DataPower B2B Appliance XB625725-K54Per appliance
IBM WebSphere DataPower Integration Appliance XI527199-42XPer appliance
IBM WebSphere DataPower Cast Iron Appliance XH407198-8FXPer appliance
IBM WebSphere MQ for Multiplatform5724-H72 Per Processor Value Unit (PVU) for Linux on IBM System z®
Per PVU
PROCESSOR-Day
IBM Integration Bus5724-J05PVU: Available through IBM Passport Advantage® only


Related information

Others who read this publication also read



Special Notices

This material has not been submitted to any formal IBM test and is published AS IS. It has not been the subject of rigorous review. IBM assumes no responsibility for its accuracy or completeness. The use of this information or the implementation of any of these techniques is a client responsibility and depends upon the client's ability to evaluate and integrate them into the client's operational environment.

Follow IBM Redbooks

Follow IBM Redbooks

LinkedIn RSS