Netcentric Serviceoriented Enterprises Bina Ramamurthy Chapter 1 of

Net-centric Service-oriented Enterprises Bina Ramamurthy Chapter 1 of The Semantic Web book 9/2/2021 IE 565 Spring 2009 1

Introduction n Werservices Mashups Service-oriented architectures What next? q q q q n Web is still a set of static and dynamically generated web pages linked together. Usually coded in html and meant for human consumption. Web information need to be used not only display purposes but also for interoperability and integration between systems and applications: XML is a solution that partially addresses this need. In order to enable machine-machine exchange and automated processing we need to provide information in such a way that machines can understand. New standards and languages are being investigated and developed to give meaning to web information. Examples: RDF (Resource Description framework), OWL (Web Ontology Language) Improve expressiveness of the web, allow automatic and semiautomatic processing of web resources and web pages. Answer to “What next? ”: Semantic Web Services for a given business/industrial domain 9/2/2021 IE 565 Spring 2009 2

About the textbook n n It is one in a series of textbook in this area. Though it approaches service-enabling from semantic web point of view the industries discussed are quite diverse and very relevant to what we are working on. q q q n Financial: data and information management Government: access to municipal services Healthcare: biomedical research and medical records management Education: Course management systems Business: data integration and business process collaboration Enterprise management: knowledge management in steel industry Technologies such as OWL (Web Ontology Language), RQL, RDQL, SOARQL, and SWRL 9/2/2021 IE 565 Spring 2009 Page 3

What did we do in CSE 507? n n Text book: Enterprise SOA: Service-oriented Architecture Best Practices, D. Krafzig, K. Banke and D. Slama, Prentice-Hall Inc. , 2007. WS and SOA 9/2/2021 IE 565 Spring 2009 Page 4

SOA and WS n n 9/2/2021 A Service-Oriented Architecture (SOA) is a design model for linking computational resources, data and applications to perform services and deliver results to service consumers. Web Service (WS) standard provides a platform-independent method for messaging-based interaction of applications. IE 565 Spring 2009 Page 5

Web Services n n n n n Web Services is a technology that allows for applications to communicate with each other in a standard format. A Web Service exposes an interface that can be accessed through messaging. Deployable unit. A Web service uses protocol to describe an operation and the data exchange with another web service. Ex: SOAP Platform independent, say, through WSDL. Publishable, discoverable, searchable, queryable Scalability issues: A group of web services collaborating accomplish the tasks of a large-scale application. Web services can be used to realize the “services” in an SOA. Your task in the first week is to review WS concepts, Try a simplementation of a WS and get familiarized with WS framework (XML, SOAP, REST, WSDL etc. ), if you have not done so. 9/2/2021 IE 565 Spring 2009 Page 6

Amazon. com and SOA n n n “SOA creates order out of chaos @ Amazon” by Rich Seely (June 23, 2006) based on Werner Vogels’ talk “Order in the Chaos: Building the Amazon. com Platform. " 1995: Started out with a single web service on a single server. Today amazon has about 150 web services on its homepage alone. 1 million merchant partners; 60 million customers One server of customers and inventory grew into two servers; more database servers were added as the business expanded 1999: A mistep during this exponential growth period was moving to mainframe from distributed server. Failed to meet scalability, reliability and performance; it was scratched in 2000. 9/2/2021 IE 565 Spring 2009 Page 7

Amazon (contd. ) n n n 9/2/2021 Robustness: Shopping cart is tested for 20000 items by a single customer, for example! Amazon’s secret sauce is “operating relaibly at scale”. After “the denial of service” debacle in 1999, they decided to use Web services to insulate the databases from being overwhelmed by direct interaction with online applications. Each web service is the responsibility of a team of developers: q “And they are not just responsible for writing the service and then tossing it over the wall for testing and eventual entry into production where some poor maintenance geek has to look after it. q The Amazon CTO tells his Web services team members: "You build it. You own it. " q That means the team is responsible for its Web service's on-going operation. If a Web service stops working in the middle of the night, team members are called to fix it. ” Web services are kept simple: complexity is the notorious enemy of reliability No attachment to one technology or standard: what ever customer wants, give it. (Ex: REST and SOAP) IE 565 Spring 2009 Page 8

Topics for Discussion n n n Creating and using semantic information Ontologies: Cornerstone of Semantic Web Services and service-oriented enterprises Characteristics of a new world Challenges for service-based applications Importance of semantics for organizations Semantic Service Oriented Architecture q 9/2/2021 Ontologies + Ontology management system IE 565 Spring 2009 9

Semantic information n n Discover, acquire, and create metadata for unstructured, semi-structured, and structured information Reason, interpret, infer and answer using semantics Represent, organize, integrate resources, content and knowledge using semantics provision, present, communicate and act using semantics Provide machine-machine semantic interface, human-semantics semantic interface 9/2/2021 IE 565 Spring 2009 10

WS and SOA and Semantics (Web) HTML W XML WS SOA SWS SW OWL 9/2/2021 IE 565 Spring 2009 11

Ontologies in Business n n Provide formal support for communication between agents and exchange of knowledge. In the context of human communications, it aims at reducing and eliminating terminological and conceptual confusion. q 9/2/2021 Unifying framework enabling cooperation amongst people in reaching better inter-enterprise organization. IE 565 Spring 2009 12

Examples of successful Ontologies n n n Healthcare hierarchical and controlled vocabulary for human disease representation Food and agriculture organizations of the United Nations FAO Data management and interchange between enterprises: Open EDI for business transactions Scientific Computing Knowledge representation ontologies. 9/2/2021 IE 565 Spring 2009 13

Characteristics of a new world n n Information and knowledge are key enablers of business and economic performance and sustainable development. Globalization: creation and consumption of knowledge and information are made in the global context. q q q 9/2/2021 Exploitation of synergies and capacities beyond boundaries Realization of new opportunities Understanding of threats Human and social networks New levels of performance IE 565 Spring 2009 14

Characteristics: Business networking n Business and economic activities as well as competition, require new models of business networking. q q q 9/2/2021 Advanced documentation of skills and competencies Newer business models: Example: IF. com’s banking product Context-based collaboration define new demands for advanced business networking at global level IE 565 Spring 2009 15

Characteristics: Shared Models n A global consensus toward peace, development, health and prosperity needs to be based on shared conceptual models that addresses issues on global scale. Examples: q q n Global warming Mars exploration Financial and manufacturing sectors Global AIDS initiatives Global information landscape shared models are required for interoperability, exploitation of collective intelligence. 9/2/2021 IE 565 Spring 2009 16

Characteristics: Collective intelligence n n n Apply collective intelligent filters or collaborative filtering in the context of global information world. These may challenge the traditional models of business performance, marketing and profitability. Example: Financial domain: once again revisit IF. com 9/2/2021 IE 565 Spring 2009 17

Characteristics: Open Paradigm n Open paradigm relates with several complimentary movements: q q q n n Open source software Open content Open access Open knowledge Open research Open culture Result: amazing capacity to support new business models and several application models. Example: amazon EC 2, cloud computing, map reduce 9/2/2021 IE 565 Spring 2009 18

Challenges for Semantic Web Services-based Systems: Summary n Definition of new modes of human, knowledge and business networking beyond local boundaries: well defined conceptual models that match information sources and human services. q q n With ontologies and social networks as anchors Process and service-oriented infrastructure Globalizing information and definition of new contexts for value exploitation: q q 9/2/2021 Design of multiple reference levels to the same set of information and knowledge delivers a new level for dynamic, and personalized systems. Internationalization IE 565 Spring 2009 19

Challenges… n n Delivering and integrating quality to information: q Enormous explosion of content while quality is very subjective concept q We need infrastructure that deliver assessment models of information quality. Integration of isolated information assets: build more meaningful services. SOA can help in this aspect. Lets discuss how? Support of business value and co-located distributed business models: crucial aspect is to translate web semantic ontologies to business models. SOA can help bridge this gap. How? Promotion of a critical shift in human understanding and interacting with digital world: Web needs to respond to human demand for richer modes of meaningful, useful and productive interaction. Combination of semantics and SOA can help here. 9/2/2021 IE 565 Spring 2009 20

Importance of semantics and services (SOA) to organizations n n n Integration is the top priority for many worldwide enterprises. Inter, intra and human interface integration. Cross-organization cooperation in small and medium enterprises (SME). Semantics and service combination can facilitate discovery of heterogeneous components, data integration and communication. Semantics SOA is most suitable for business interaction and in integration of e-business value chains. Ex: amazon. com market place, yahoo. com 9/2/2021 IE 565 Spring 2009 21

Ontology Management System (OMS) n n Supports entire lifecycle of inter-enterprise ontologies, including creation, storage, search, query, reuse, maintenance, and integration. An OMS needs to address a wide range of problems: ontology models, ontology base design, query languages, programming interfaces, query processes and optimization, federation of knowledge sources, caching and indexing, transaction support, distributed system support, and security support. 9/2/2021 IE 565 Spring 2009 22

Overall Challenge n High volume and wealth of data and information generated by the numerous web applications that needs to be analyzed and processed to provide useful and timely knowledge for decision makers. q 9/2/2021 Arcelor Mittal: 330000 employees, 60 countries, flat steel products. How to extract knowledge from the information generated? IE 565 Spring 2009 23

Contributions of the text chapters n n Important industries (vertical domains) covered: semantic enterprises, finance, government, healthcare and life sciences, education, business and customer management, enterprise management and security. Highlights in the context of actual industry, the full range of business and technological issues that must be addressed. Provides a comprehensive discussion of the required integration of semantic web services (SOA) and business strategies. Sets a context for critical thinking. 9/2/2021 IE 565 Spring 2009 24

Project ideas n n Read the text Choose a vertical domain that appeals to you and that is familiar to you. Form your project group of two. More directions will be given in Assignment#1 9/2/2021 IE 565 Spring 2009 25

Chapter 2: Semantic Enterprises n n n For a concept to be widely adopted it needs to reach a level of maturity. Semantic web is a new concept that still has some distance to go before it reaches a point of this widespread adoption. Lets examine how semantic web (tools and technologies) can help address some of the challenges that companies are facing today. 9/2/2021 IE 565 Spring 2009 26

Topics for Discussion n n The Business context Tools and Technologies for representing semantics Software for semantic services Use cases for semantic representation of information: q q q q 9/2/2021 Recruitment services Agile manufacturing Patterns and insights in data Integration of scientific data Enterprise search and navigation Compliance and regulation SOA metadata IE 565 Spring 2009 27

Business and Technology Drivers: The Context n n n n n Read Section 2 of Ch. 2 Commercial organizations are always under pressure to perform financially. Growing interest in being able to integrate all data related to the core components that drive their success. Integrate not only structured data but also huge volume of unstructured data collected and generated. Ex: explosive email Many industries are moving towards collaborative business models. Ex: drug discovery and clinical trials Companies conduct businesses in many countries. Integrating data across department also comes with its challenges. Ability to respond rapidly to change. Data is the most important asset and access to it should be controlled. Provide API for access and build revenue models around it. Effective use of business data and change/adapt as needed. 9/2/2021 IE 565 Spring 2009 28

Tools and Technologies: RDF n n Resource Description Framework (RDF) is a core semantic web recommendation from W 3 C. Represents data using triplet: subjectpredicate-object 9/2/2021 IE 565 Spring 2009 29

Tools and Technologies: OWL n n OWL (Web Ontology Language) is a more expressive language once a a standard from W 3 C. It provides ways to define classes and instances and relationship for modeling real-world objects. <owl: Class rdf: ID="Potable. Liquid"> <rdfs: sub. Class. Of rdf: resource="#Consumable. Thing" />. . . </owl: Class> SPARQL is a query language for RDF and OWL. 9/2/2021 IE 565 Spring 2009 30

Software n n n Databases, middleware and applications must be enhanced to work with RDF, OWL and SPARQL. Remember most of today’s data is in relational databases and in XML formats. So we need converters or interfaces to bridge this gap. Pages 21 -22 has a excellent collection of software initiatives in this direction. Bottom line is that we need to pay attention to data representation in order to build an efficient SOA. On to use cases. . 9/2/2021 IE 565 Spring 2009 31

Recruitment Services hireme. com Geo: 4930956 hireme: candidate 101 hireme: candidate 102 Job 2 hireme: candidate 102 Job 3 RDF. . 9/2/2021 IE 565 Spring 2009 32

Recruitment Services n n n To enable querying across multiple recruiter databases, the hiring company would encourage all its recruitment agencies to make a subset of their data available in RDF. Common vocabulary, SPARQL endpoint OWL could also be used Conversion to legacy relational info into OWL or RDF Expose recruitment companies services too. 9/2/2021 IE 565 Spring 2009 33

Agile Manufacturing n Business drivers: q q n n n Reuse machines Use ingredients in multiple products Follow trends and latest food craze FDA labeling regulations Enterprise resource planning: incorporate ontologies Scheduling supported by food ontologies. Services and semantics will make it easier to incorporate new data that is deemed relevant and help in decision making. 9/2/2021 IE 565 Spring 2009 34

Identifying of Patterns and Insights in data n Business drivers: q q q n n n Non-structured data : reports, email Need to mine this data Use natural language to extract triplets and store as RDF which can then be queried. Association of semantics and services will make the querying this RDF or OWL database very efficient. Oracle database supports RDF and OWL. Java APIs are available for querying patterns. 9/2/2021 IE 565 Spring 2009 35

Integration of Scientific Data n Business driver: q Drug discovery and development is very expensive and time consuming process n q q q 9/2/2021 For a drug to get from bench to market takes 5000 screened compounds, 15 years and nearly $1 billion. Desire to eliminate late stage attrition: identifying and eliminating drugs that do not have the desirable safety profiles. Need to be aware of competitive offerings or patents to access market potential Solution: semantic data integration of heterogeneous databases and services for semantic queries IE 565 Spring 2009 36

Integration of scientific data (contd. ) n n Data types include: chemical structures, biological sequences, images, biological pathways, clinical observations and scientific papers. Data warehouse is NOT a solution. We need a unified view with no ambiguity in terms. . GSK protein needs to different than GSK the company name. . This would allow biological mashups for discovery and decision making. 9/2/2021 IE 565 Spring 2009 37

Enterprise Search and Navigation n OTN (The Oracle Technology Network) is the main source of technical information for oracle developer community. Web site provides access to product documentation, product releases, software downloads, etc. Richness, complexity and dynamism of the information made it challenging for traditional search. Oracle worked with Siderean and created a semantic web: http: //otnsemanticweb. oracle. com 9/2/2021 IE 565 Spring 2009 38

Compliance and Regulation n Increasing complex set of regulations by such congressional acts such as SARBOX and HIPPA. Policies can be implemented using semantic web. Semantics and services can keep trace and verify compliance. 9/2/2021 IE 565 Spring 2009 39

SOA Metadata n n Semantics can be used to assign metadata that will help in true dynamic discovery, invocation and composition. Thus semantics can improve inherent flexibility of SOA infrastructure. 9/2/2021 IE 565 Spring 2009 40

Summary n n We understand that incorporating semantics into the services infrastructure can help advance SOA goals. Future designs should consider both semantic web concepts and SOA concepts. 9/2/2021 IE 565 Spring 2009 41