Federated Search True Enterprise Search Abe Lederman President

Federated Search: True Enterprise Search Abe Lederman, President and CTO Deep Web Technologies Search Engine Meeting – April 28 -29, 2008

Who We Are… Founded in 2002 l Headquartered in Santa Fe, New Mexico l 20 Employees l Over $2 million in R&D through DOE SBIR program l DWT is focused on providing state-of-the-art federated search products and solutions which search, retrieve, aggregate and analyze content from web-based databases.

Enterprise Search l l l Crawl and index internal content into a master index Searching of this index is intended for internal users Some searchers think that all of a companies’ information is available through a corporate portal.

Federated Search Two Meanings 1. 2. Real-time search of multiple disparate data sources Batch indexing of information from multiple Web Service information sources into a single master index. Read: What’s in a name: Federated Search August 2007 Newsletter http: //www. ideaeng. com Managed Service or Customer-Hosted

An Enterprise’s Information Universe Firewall Vendor and Partner Sources R&D s base Data il Ema ries sito o p e R Competitor Web Sites Corpo rat Intran e et Federated Search Manufacturing Databases Subscription Content Sales Marke & Docu ting ments Government Databases

Limitations of Enterprise Search l l Scalability – Not feasible to index all desired content into a master index. Cost – Too expensive to create a master index of all content. Ownership of content – Internal content owners and licensors of subscription content won’t permit their content to be indexed. Security – Difficult to enforce content security and privacy requirements.

True Federated Search Solves These Limitations l Easy and inexpensive to create a portal that searches hundreds of information sources at the same time. l Current information is available at all times without costly duplication l Authentication and security requirements of content can be enforced in real-time.

True Federated Search Solves These Limitations (cont. ) l Creation and update of content is left to experts. l Federated search can integrate well with content accessible through one or more Enterprise Search portals.

Enterprise-Level Federated Search. . . (not the same as Federated Search for Libraries) l l l Enterprise federated search authentication needs are more complex. Search requirements are more demanding. Information Sources are much more heterogeneous in Enterprise Search.

Federated Search. Not the answer to all. . . l l Indexed content is easier to relevance rank. Hard to implement taxonomies in Federated Search Advanced search syntax such as proximity searching, case sensitive searching and thesaurus-based searching may not be implemented by Federated Search is unable to search highly custom databases such as a parts database.