Microsoft BizTalk Enterprise Service Bus Toolkit March 26, 2014 - - PowerPoint PPT Presentation

▶
microsoft biztalk enterprise service bus
SMART_READER_LITE
LIVE PREVIEW

Microsoft BizTalk Enterprise Service Bus Toolkit March 26, 2014 - - PowerPoint PPT Presentation

Sep 29, 2023 426 likes •730 views

Microsoft BizTalk Enterprise Service Bus Toolkit March 26, 2014 Author : Mallesh Bonla Agenda Application Integration Challenges ESB Toolkit Frameworks and Architecture Components Drilldown Itinerary Terminology Orchestration

slide-1
SLIDE 1

Author : Mallesh Bonla

Microsoft BizTalk Enterprise Service Bus Toolkit

March 26, 2014

slide-2
SLIDE 2

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

 Application Integration Challenges  ESB Toolkit Frameworks and Architecture  Components Drilldown

  • Itinerary Terminology
  • Orchestration
  • Itinerary On-Ramp / Off-Ramp
  • Pipelines
  • Messaging
  • Resolver
  • Adapter Provider

 Itineraries Deployment  Patterns & Extensibility  BizTalk ESB Toolkit Benefits  Summary

Agenda

2

slide-3
SLIDE 3

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

3

Connecting Application in BizTalk with out Service

JD Edwards Service SAP Service Java Appl. Service .Net Appl. Service CICS Service AS/400 Service MS CRM Service Oracle Service

  • Point-to-Point
  • Complex Interface
  • Redundant Logic
  • Doesn’t Scale
  • Lacks Visibility
  • Business Impact
  • Delays Response to changing

business needs

slide-4
SLIDE 4

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

4

Agility thru Service Composition

Service Consumer Service Consumer Service Consumer Service Provider Service Provider Service Provider

Invocation & Orchestration Transport Protocol Conversion Data Format Transformation Location & Version Transparency Message Interactions Support

Enterprise Service Bus

Error Handling & Repair

slide-5
SLIDE 5

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

5

ESB Toolkit - New Abstraction Layer on Top of BizTalk

Declarative, Meta-data, Policy and Configuration –Driven.

Transform Service Routing Process Orchestration Protocol Adaptation End Point Resolution Pub/Sub Service Service Consumers Service Providers

  • 1. Transform my message
  • 2. Determine which endpoint I need
  • 3. Route my message
  • 4. Route the response to a second

service

  • 5. Return the final result to me

On Ramp Off Ramp

Transform my message Resolve a service end point address for me

slide-6
SLIDE 6

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

6

BizTalk ESB Toolkit Components

Adapters Dynamic Ports Pub Sub Engine Transformation Engine Business Rules Engine Host Environment Itinerary Services Resolvers

BizTalk Components

On/Off-Ramps Management Portal Orchestration Engine Adapter Providers Core Web Services UDDI 3.0 Exception Management BAM

ESB Toolkit

slide-7
SLIDE 7

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

7

BizTalk ESB Toolkit Architecture

Core Web Services

Resolver Web Service Transformation Web Service UDDI Web Service Exception Web Service Operations Web Service

BizTalk Send Ports Off-Ramps BizTalk Receive Ports On-Ramps

Exception Management Store

ESB Management Portal

Provisioning Framework Reports Alerts

ESB Toolkit Core

Itinerary Services Exception Management Framework

Exception Logger Exception Handler Fault Processor

Resolver-Adapter Provider Framework

Resolvers (…) Adapter Providers(…)

UDDI 3.0 BAM

Generic SOAP Send Generic WCF Send Generic JMS Send Custom Send

Pipeline Pipeline Pipeline Custom Pipeline Itinerary Store

Generic SOAP Receive Generic WCF Receive Generic JMS Receive Custom Receive

Pipeline Pipeline Pipeline Custom Pipeline Route Service Custom Service Transform Service

Transformation Engine Business Rules Engine Orchestration Engine BizTalk Pub/Sub Engine

slide-8
SLIDE 8

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

8

The Core ESB Toolkit Components

Itinerary Services:

Message Processor

Resolvers:

Context Finder

Adapter Providers:

Adapter Properties

Itinerary Policy

slide-9
SLIDE 9

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

9

Itinerary Terminology

  • Term

Definition Itinerary

  • Processing instructions expressed as XML
  • Defines the message processing steps and order
  • Enables the message to control its own order of execution

Itinerary Service

  • Individual processing "step" represented in the itinerary
  • Each step can be orchestration-based or messaging-based
  • Resolvers are used to determine where to route messages
  • Adapter Providers promote properties required for delivery

Itinerary On-Ramp

  • Receive Port that uses specialized ESB pipelines
  • ESB Toolkit includes on-ramps, or you can create your own

Itinerary Off-Ramp

  • Dynamic Send Port that automatically determines its configuration

using ESB-specific promoted properties

  • Uses specialized ESB pipelines to send messages
  • One-way and two-way off-ramps are provided, or create your own
slide-10
SLIDE 10

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

10

Itinerary Services: Orchestration

BizTalk Pub/Sub Engine

Invoked via orchestration subscription

Service Resolver Adapter Provider Orchestration Service Message + Routing slip Message + Routing slip

  • Executed by BizTalk runtime via orchestration subscriptions
slide-11
SLIDE 11

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

11

Reviewing Itinerary Message Flow

Two-Way ESB On-Ramp

Request Response Itinerary Store Pipeline resolves itinerary and retrieves it from the repository

MessageBox Two-Way ESB Off-Ramp

Pipeline caches the itinerary to reattach it to the response Request Response Pipeline reattaches the cached itinerary to the response Itinerary Cache Pipeline removes itinerary before sending final response message

1 2 3 9 4 5 6 7 8

Cont…

slide-12
SLIDE 12

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

12

Message flow through an ESB-based application

The message is send from a service consumer into BizTalk through a two-way on-ramp. The receive pipeline uses the itinerary resolver component to retrieve the appropriate itinerary from the itinerary store database and then attaches the itinerary to the message The message is published to the MessageBox database where the itinerary is evaluated against the available services, in this case a two-way off-ramp subscribes. The send pipeline in the two-way off-ramp removes the itinerary from the message and places it in the itinerary cache Service request is made using the message Response is received from the service, the receive pipeline of the two-way off-ramp retrieves the itinerary from the itinerary cache and reattaches it to the message The message is published to the MessageBox database where the itinerary is evaluated against the available services, in this case the original two-way on-ramp subscribes to the message. The send pipeline remove the itinerary. Message is sent as response to the original requestor 1 2 3 4 5 6 7 8 9

slide-13
SLIDE 13

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

13

Exploring Itinerary (Logical On-Ramp Concept)

Processed message and itinerary is published

Itinerary On-Ramp

MessageBox

Receive Pipeline

WCF Client

Select Itinerary Based on Descriptor

WCF Adapter

Process Messaging-Based Services SOAP header contains Itinerary Descriptor

ESBItineraryDb

slide-14
SLIDE 14

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

14

Exploring Itinerary(Logical Off-Ramp Concept)

Dynamic Send PortA Dynamic Send PortA

Response Pipeline

Process any messaging-based itinerary services Resolve itinerary from Cache

MessageBox

WCF Adapter WCF Service WCF Adapter

Cache

Request Pipeline

Process any messaging-based itinerary services Cache itinerary (for request-response)

1 2 3 4 5 6 7

Cont…

slide-15
SLIDE 15

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

15

The processing of a two-way off-ramp will follow the list below

Message is routed from the MessageBox to the two-way dynamic send port. The request (send) pipeline processes any messaging-based itinerary services and then caches the itinerary so it can be reattached to the response message. The message is sent to the external service using an adapter. The external service does its thing. The response is received back into BizTalk via the adapter. The response (receive) pipeline resolves the itinerary from the itinerary cache and reattaches it to the message, then executes any messaging-based itinerary services. The message is published to the MessageBox.

1 2 3 4 5 6 7

slide-16
SLIDE 16

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

16

The Role of ESB Pipelines

General ESB Pipeline Concepts

  • The Toolkit includes components to support the ESB pattern

 Ships with several pipelines built from these components  Duplicate and augment standard BizTalk processing functionality

  • Receive pipelines attach itineraries, and optionally process services
  • Send pipelines are responsible for caching itineraries before sending, and optionally process

services

 For request-response, itinerary is cached and matched to response.

Core ESB Pipeline Components

  • Components Implementing the Routing Slip Pattern

 Itinerary Component  Itinerary Selector Component  Itinerary Cache Component  Dispatcher Component  Dispatcher Disassemble Component  Forwarder Component  Identifying Bonus ESB Pipeline Components  The Namespace Components

slide-17
SLIDE 17

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

17

Pipelines Included with the ESB Toolkit

Pipeline Name Included Components

ItineraryReceive

  • ESB Itinerary
  • XML Disassembler
  • ESB Dispatcher

ItineraryReceiveXml

  • ESB Itinerary
  • ESB Dispatcher

Disassemble ItineraryReceivePassthrough

  • ESB Itinerary
  • ESB Dispatcher

ItinerarySelectReceive

  • ESB Itinerary Selector
  • XML Disassembler
  • ESB Dispatcher

ItinerarySelectReceiveXml

  • XML Disassembler
  • ESB Itinerary Selector
  • ESB Dispatcher

ItinerarySelectReceivePassthrough

  • ESB Itinerary Selector
  • ESB Dispatcher

Pipeline Name

  • Included Components

ItinerarySend

  • ESB Dispatcher
  • XML Assembler
  • ESB Itinerary Cache

ItinerarySendPassthrough

  • ESB Dispatcher
  • ESB Itinerary Cache

ESB Receive Pipelines ESB Send Pipelines

  • Pipeline Name
  • Included Components
  • ItinerarySendReceive
  • ItinerarySelectSendR

eceive

  • Same functionality as the

ItineraryReceive and ItinerarySelectReceive, but adding the Itinerary Cache component in the Decode stage

  • ItineraryForwarderSe

ndReceive

  • ESB Itinerary Cache
  • XML Disassembler
  • ESB Dispatcher
  • Forwarder
  • ItineraryForwarderSe

ndReceiveXml

  • ESB Itinerary Cache
  • ESB Dispatcher Disassemble
  • Forwarder

ESB Response Pipelines

slide-18
SLIDE 18

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

18

Itinerary Services: Messaging

Invoked as by ESB interceptor pipeline component

Resolver Adapter Provider Message + Routing slip Message + Routing slip Messaging Service

  • Messaging Services
  • Loaded using dependency injection
  • Can produce multiple messages if invoked from ESB

disassembler

slide-19
SLIDE 19

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

19

ESB Toolkit Resolver

  • ESB Resolver

– Endpoint Resolution

  • UDDI 2.0/3.0
  • XPATH
  • Static
  • Business Rules Engine (BRE)

– Artifact Resolution

  • Itinerary (BRE)
  • Itinerary Static
slide-20
SLIDE 20

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

20

ESB Adapter Provider

  • FTP
  • WebSphere MQ
  • File
  • Custom
  • WCF-BasicHTTP
  • WCF-WsHTTP
  • WCF-Custom

 WCF-SQL

  • SMTP
slide-21
SLIDE 21

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

21

Itineraries Deployment

Design Time

XML File

Itinerary Store Test/Run Time

Itinerary

OnRamp Itinerary Selector ESB Processing

Itinerary & Message Message

Itinerary Store

BizTalk Deployment Tools

slide-22
SLIDE 22

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

22

Itinerary Modeling

Models and designer extensions Itinerary DSL model Designer Extenders Itinerary Runtime Model (XML) Itinerary Services Configuration Adapter Manifests

Service Definition Technology Definition Runtime Definition Custom Extender Service Definition

slide-23
SLIDE 23

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

23

Three Ways to Assign Itineraries

Itinerary is resolved on the server’s ESB On-Ramp receiving port via configurable resolver

 Service Proxy

Client resolves itinerary via resolver service and then sends it in a WCF/SOAP Header request

Adaptive Service Client

Client sends an itinerary in a WCF/SOAP Header request

Advanced Service Client

slide-24
SLIDE 24

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

24

ESB Design Patterns

The ESB Toolkit promotes pattern-based development

  • Message Routing Patterns

– Message Router – Content-Based Router – Routing Slip – Scatter-Gather – Recipient List – Splitter

  • Message Transformation Patterns

– Message Translator – Normalizer – Content Enricher

  • Service Mediation Patterns

– VETO/VETRO – Request-Response

  • Service Management Patterns

– Repair and Resubmit

slide-25
SLIDE 25

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

25

BizTalk ESB Toolkit Extensibility

Extensibility Point Description Adapter Provider Create new Adapter Provider component, manifest file Orchestration Service Implement orchestration, update configuration Messaging Service Implement service and designer extender Resolver Implement resolver component Composite Resolver Define Unity container, fact providers, fact translators Cache Manager Support Enterprise Library 4.1 API Itinerary Exporter Implement custom exporter component

slide-26
SLIDE 26

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

26

BizTalk ESB Toolkit provides Service Composition Challenges:

  • Location & Version Changes
  • Sequencing Changes
  • Data Semantics Mismatch
  • Transport Protocol Mismatch
  • Interaction Model Mismatch
  • Quality of protection
  • Error Recovery
  • Monitoring & Visibility
  • Quality of service

BizTalk ESB Solutions:

  • Dynamic Endpoint Resolution
  • Itinerary-based Routing
  • Dynamic Transformation
  • Protocol Mediation
  • Itineraries-based Processing
  • BizTalk Security Model & SSO
  • Exception Framework & Portal
  • BAM Integration
  • Exception Management Portal
slide-27
SLIDE 27

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

27

BizTalk ESB Toolkit Benefits

Higher levels of service re-use Lower operational costs Faster adaptation to business changes Visibility business and exception metrics

Provides the right benefits to cope with complex and rapidly changing integration challenges

Highly extensible to introduce new functionality or encapsulate patterns

slide-28
SLIDE 28

Microsoft BizTalk Enterprise Service Bus Toolkit Mallesh Bonla

28

Summary