IBM Rational Proof of Technology

IBM Rational Proof of Technology Discovering the Value of IBM Rational’s Web Services Testing Solution

Agenda • Overview of Quality Management of SOA Applications • Challenges of Testing SOA Applications • Overview of IBM SOA Quality Management Solution • Key SOA Concepts and Terminology • Functional Testing of Services • Performance Testing of Services • Management and Monitoring of Services

IBM Rational softwareA strategic partner in business innovation & transformation Business imperatives Business innovation& transformation • Global capability Governing the businessprocess of software& systems delivery • Alignment • Control • Efficiency • Business flexibility Governance & lifecycle management • Time to value • Risk & compliance management Decades of proven processexpertise & customer success

Service Development and Delivery Management Infrastructure and Management In Support of SOA SOA Governance Method What is IBM SOA Quality Management? An Integral Part of SOA Governance & Service Lifecycle Management Service Development & Delivery Management Apr ‘06 Oct ‘06 March ‘07 Dec ‘06

SOA Quality Management is the process to assure services meet business requirements by validating service functionality and operations throughout the SOA Lifecycle What is SOA Quality Management? SOA Lifecycle SOA Quality Management is continuous and takes place within each phase of the SOA Lifecycle

The SOA Testing Strategy • The only way to effectively test SOA projects is to…. • start from the ground up. • test the inputs and outputs of individual modules. • assemble sections of logic together and test smaller sections of the integration flow. • Assemble those smaller sections into a finished SOA project and perform an end-to-end test on the fully assembled project. • Key tenants • Focus on the business processes in requirements and testing • Create test plans that account for assembly of services • Create an automated and repeatable testing process • Plan for typical SOA testing hurdles (e.g. security access, unavailable systems) Test early, test often is more important now than ever (due to the domino affect a bug in a service may have on a given business process and the possibility of that service being in many business processes)

SOA adoption increases modularity & changeBringing quality to the forefront Business impact • Service and application SLAs will be impacted by more frequent updates • Cross-organization Business/IT organizations will have increased complexity Pain of modularity • Lower level of functionality & performance both at individual service level & composite application • Increased risk and need to manage distributed assets • Increased management of a larger number of services including custom, outsourced & packaged Decentralization, modularity and increased risk drives need for a structured approach of integrated requirements, architecture & lifecycle quality management

Ensuring system fulfils requirements Validating system functionality Validating system performance Validating component web services Tracking test cases and defects Quality Management of Service Oriented ApplicationsExamining the fundamental challenge… Challenges of testing Service Oriented Architecture Applications

Validating component web services Quality Management of Service Oriented ApplicationsA new twist on an old problem… Challenges of testing Service Oriented Architecture Applications

Traditional user centric requirement, test and defect management New Web Service Quality functionality to address building blocks of SOA Apps Post Deployment monitoring of service oriented architecture applications Quality Management of Service Oriented ApplicationsThe IBM Rational Solution. Quality Management of Service Oriented Architecture Applications The IBM Rational Solution is a three pronged approach

“There’s too much to test. Where do we begin ?” “I have requirements, I have tests and I have defects…but nothing ties them together” “Everyone uses different tools – there’s no way to share data between the team.” Challenge: The Cost - Time - Quality TradeoffGovernance of the software delivery process Your job is to deliver quality applications.On Time. On Budget. You need to coordinate teams, data, schedules, requirements, models, code, tests, results and reports. Are you ready?

“How can we leverage our Business Process analysis in our services testing efforts?” “We don’t want to pull Programmers off their projects to write complex test harnesses.” Challenge: Validating SOA component functionality & performanceEnsuring functionality of composite application units Web Services are the building blocks of SOA applications. A single service is a stand-alone component but may be used in dozens of systems. Some of those services will be yours, some not.How do you test a service without the rest of the system? Does it work? All the time? Under load? Are you sure? “The Web Service is ready for testing, but there is no user interface to exercise it.”

“How can I communicate problems found in the field back to development?” Challenge: Post Deployment Monitoring of ServicesCreating a feedback loop from operations to development Congratulations you’ve gone live. How are things going out there? Do you know? What happens when you need to make a change? And what if operations found a problem – how would it get back to development? Do these groups communicate? “How can I monitor web services running on many different platforms against thousands of users?” “How do I change policies and ensure those changes don’t break the implementations?”

IBM Rational Quality Management Solutions Process and products to ensure quality throughout the delivery lifecycle and deployment Implement Increasecode quality Define & AnalyzeEnable requirements based testing Build & Deploy Automate & trace the quality process Assessbusinessanalytics Test & ProductionEnsure functionality, system performance & compliance

Create service update plan • Create/modify the service to meet the business requirements • Assess service against governance policies • Approve assembly completion • Validate the business requirements • Discover and assess against current services • Model service requirements • Manage & monitor the service throughout its lifecycle • Track the service in the registry • Report on the service against SLAs IBM Rational Quality Management SolutionsProcess and products to ensure quality throughout the delivery lifecycle and deployment SOA Lifecycle • Quality assure the services • Function testing • Performance testing • Compliance testing • Approve service deployment

Create, document and prioritize business requirements • Rational RequisitePro • WebSphere Business Modeler • Define, approve & monitor • Rational Portfolio Manager • Rational ClearCase • Design, code, build • Rational Application Developer • Rational Build Forge Publish Govern Manage Enrich Find • Evaluate & execute functional & performance test cases • Rational Tester for SOA Quality and Performance Tester Extension for SOA Quality • Rational ClearQuest Deploy, build & monitor in production environment • Tivoli CompositeApplication Manager • Tivoli Provisioning Manager WebSphere Service Registry and Repository IBM Toolset • What does thetoolset provide? • Automate business processes to achieve improved business flexibility • Proactive response to quality issues earlier in the lifecycle • Collaborative process automation & enforcement • Extensible framework and registry/repository SOA Lifecycle

Track requirements, test cases, change requests and defects from a single interface Consolidated reporting for full lifecycle process governance Global test project coordination unifies distributed teams on a centralized data infrastructure Configurable, enforceable processes ensures the tool adapts to your process Test Management with ClearQuestThe Hub for Life-Cycle development

Service Quality Management Functional and Performance Testing of Web Services from a common interface Rational Tester for SOA Quality Automated regression and functional testing for GUI-less Web services Rational Performance Tester Extension for SOA Quality Performance Testing for Web Service based applications

Service (in the context of SOA) • A self contained business function in which consumers interact through a well defined interface (contract). • The consumer does not know (or care) "how" the service implements the requested business action - only that the service performs "what" is defined by its published interface (contract). A service in the context of an SOA An abstracted view of SOA concepts

WSDL – Web Service Description Language • An XML-based service description on how to communicate using web services. • Defines services as collections of network endpoints, or ports. • Specification provides an XML format. • The abstract definition of ports and messages is separated from their concrete use or instance, allowing the reuse of these definitions. • WSDL is often used in combination with SOAP and XML Schema to provide web services over the Internet.

Functional & Regression Testing Strategy • Quickly test Web Services and setup desired regression Test Cases. • Ease-of-use in setting up these tests will help promote testers to test their Web Services early and often. • Easy Test Case Management and Setup is vital to a productive establishment and maintenance of functional & regression tests. • Setup an environment where the impact of requirement and business process changes can be quickly analyzed and realized

IBM Rational Tester for SOA QualityCode free test development • Simplify testing of GUI-less service • Automated generation of web service test client • No programming knowledge is necessary to create, comprehend, modify, and execute a functional or performance test • Support a wide variety of users • Automated data correlation and data driven testing through a code-free test environment • Simplify service integration testing • Automated test creation from WebSphere Business Process Execution Language resources • Create, comprehend, modify, and execute a functional or performance test • Graphical test editor enables both high-level and deeper detail views • Support Web services standards (e.g. SOAP, HTTP(S), JMS, WS-Security, UDDI) Code FreeTest Editor

Performance Testing Strategy • QA Testers & Network Engineers should test the scalability and robustness of web services and determine performance and endurance characteristics of their WSDL operations. • Performance Tests should determine: • response times • latency • throughput profiles • endurance • robustness • scalability

IBM Rational Performance Tester Extension for SOA QualityPerformance testing for Web applications Web Service Response Time • Validate system scalability • Automated generation of web service performance tests • Real-time reporting of server response time and throughput • Eliminate need for costly development of test code • Automated generation of web service test client • Get real time feedback on SOA efficiency • Broad platform monitoring support for deployed web services User action throughput

Agenda • Overview of Quality Management of SOA Applications • Challenges of Testing SOA Applications • Overview of IBM SOA Quality Management Solution • Key SOA Concepts and Terminology • Functional Testing of Services • Performance Testing of Services • Manage and Monitoring of Services

Analyze SOA Service Quality Deploy with confidence with Tivoli Provisioning Manager Increased service modularity within SOA will require additional and regular dependency and integrity checking • Dependency Checking • Analyzing the environment to ensure the change will be successful • Integrity Checking • Analyzing relationships and the impact the change will have on them

Monitor Deployed Services and Service QualityTivoli Composite Application Management (ITCAM) • Health Monitoring of SOA components • NEW! Application Management dashboards for IT and business reporting supports Web Services, ESB and Process Server • Performance Monitoring and Transaction Management • Populate WSRR with live service performance data • NEW! Response Time dashboards • Change and Configuration management • DataPower configuration support • Reroute services by making changes and upgrades while staying in full production mode • Auto-discover services for populating WSRR with services information ITCAM supports production and development needs with a unified console! “Show me the flow details in my service development tool!”

Import ITCAM and ITM data to your development environment to discover bottlenecks in hardware and code Feed back operations data to development to provide insight into live deployed application response Monitor both resource data such as CPU, Network and RAM as well as code performance data Response Time BreakdownMapping imported operations monitoring data to code Export operations alert data for analysis by development

Next Steps – Learn and Explore • Rational Tester for SOA Quality • http://www-306.ibm.com/software/awdtools/tester/soa/index.html • IBM Rational Tester for SOA Quality test execution and performance reports • http://www-128.ibm.com/developerworks/rational/library/07/0327_kelly2/index.html?ca=drs- • IBM SOA • http://www-306.ibm.com/software/solutions/soa/ • Tutorials on developerWorks • http://www-128.ibm.com/developerworks/views/rational/libraryview.jsp?search_by=Design+SOA+services+with+Rational+Software+Architect,+Part/

Quality Management of Service Oriented ApplicationsA complete solution Enable quality managementthroughout the lifecycle Ensure businessflexibility Enhanceorganizational efficiencies Continuous, comprehensive, and collaborative quality management throughout the lifecycle reduces costs and improves credibility Functional and performance testing of business services helps ensure compliance and improve customer satisfaction Automating workflows across business processes by streamlining and eliminating redundancies to improve return on investment IBM Rational software quality management: Connecting software results to business objectives

IBM Rational Proof of Technology