260 likes | 401 Views
Intelligent Software Agent Technology. Dr. Thomas E. Potok Collaborative Technologies Group Leader Computer Science and Mathematics Division Oak Ridge National Laboratory Research Team Mark Elmore, Joel Reed, Nagiza Samatova, Jim Treadwell. Oak Ridge National Laboratory.
E N D
Intelligent Software Agent Technology Dr. Thomas E. Potok Collaborative Technologies Group Leader Computer Science and Mathematics Division Oak Ridge National Laboratory Research Team Mark Elmore, Joel Reed, Nagiza Samatova, Jim Treadwell
Oak Ridge National Laboratory • Established in 1943 for the World War II Manhattan Project. • ORNL today pioneers the development of new energy sources, technologies, and materials and the advancement of knowledge in the biological, chemical, computational, engineering, environmental, physical, and social sciences. • Budget: $870 million, 80% Department of Energy, 20% work for others. • 3800 employees, 1500 scientists and engineers
AGENTS Internet Telephone Face to Face Agent Technology Trend Information to Knowledge “The Semantic Web… will open up the knowledge and workings of humankind to meaningful analysis by software agents, providing a new class of tools by which we can live, work and learn together” Tim Berners-Lee, James Hendler, Ora Lassila “The Semantic Web” Scientific American 5/2001
Neural Nets for Recovery Boiler Control Neural Nets for Bankruptcy Prediction Neural Nets for Spring-back Prediction Collaborative Design System Neural Nets for Resistance. Spot Welding Neural Nets for Material Mix Optimization Genetic Algorithms for Chemical Synthesis Knowledge-based Systems - Manufacturing Advisors Knowledge-based Systems for Constructability Design and Analysis of Computer Experiments Knowledge-based Computer Systems Calibration Successful Projects • We have extensive expertise in agent development • Began working with agent technologies in 1980s Scientific Data Management VIPAR Knowledge Discovery Supply Chain Management Agent System Manufacturing Emulation Agent System Collaborative Management Environment • Over 10 successful projects within the last 5 years • Collaborations with leading agent experts 1985 1990 1995 2000
Collaborative Management Environment Managing heterogeneous information Original Document XML tagged Document Field level query Financial Summary
Portfolio Management Environment • Dr. Ernest Moniz, Under Secretary of Energy, approves • Portfolio Management Environment (PME) • Based on the ORNL Collaborative Management Environment (CME) project • Estimated 5-year implementation cost • $17 million total investment • Producing approximately $39 million annual productivity gains for DOE
SDM center Agents in Scientific Data Management Probe Parallel Agent Distributed Clustering Astrophysics Climate Genomic Simulations Scientific Analysis And Discovery HPSS DOE Labs: Argonne, Berkeley, Livermore, Oak Ridge Universities: Georgia Tech, NC State, Northwestern, SDSC 3 year $9M Center to manage massive scientific data
Client Server Messaging Behavior State What are Agents? ...Software entities that assist people and act on their behalf - IBM Traditional Software Agents Peer to Peer Messaging Reactive Model Knowledge Model Social Model
Client Server Messaging Behavior State What are Agents? ...Software entities that assist people and act on their behalf - IBM Traditional Software Agents Peer to Peer Messaging Reactive Model Knowledge Model Social Model
Simple Agent Example Agent, find me the book “War and Peace,” and I need it tomorrow Dedicated Agents Amazon 2 Days $18.50 Barnes and Nobel 1 Day $21.75 B. Dalton 1 Day $20.25 Does the agent understand buying books? Form a plan to buy the book
Simple Agent Example Agent, find me the book “War and Peace,” and I need it tomorrow Dedicated Agents Amazon 2 Days $18.50 Barnes and Nobel 1 Day $21.75 B. Dalton 1 Day $20.25 Agent Communities Library 1 Day Free Does the agent understand buying books? Form a plan to buy the book eBay 1 Day $12.50 Execute the plan On-Line www.online-literature.com Now Free
USPACOM Command Virtual Information Center • Only 10% of available newspapers scanned • Entirely manual operation Manually gather Information from 20–30 newspapers Manually Organize Information Manually Analyze And Summarize Information Inside China CINC Summary Russia Today Summary Jakarta Post Analysts Unorganized Newspaper Articles
CINC Summary New Intelligent Agent Approach • Capable of organizing 10,000 article per day • Requires only a desktop computer Automatically Gather, Organize, andSummarize Thousands of articles Manually Analyze And Summarize Information Inside China Russia Today Jakarta Post Summary Analysts Article Retrieval Agents Organize and summarize Articles
VIPAR Architecture Overview Information Agents Whiteboard Agent Text Analysis Agent Internet Information Agents Database … Cluster Agent Information Agents Agent Communities Agent Communities Multi-agent ORMAC Framework RDF Ontologies Java Java RMI FIPA ACL
D1 D2 D3 Clustering: A Simple Example 1. Original and Parsed Documents 2. Terms Dictionary 3. Vector Space Model 4. Document Similarity 5. Euclidean Distance 7. Phylips tree representation 6. Agglomerative Hierarchical Clustering 8 1 2 3 4 6 7
VIPAR “Nuclear Weapons” Search - 9/21/00 How are these articles organized? • Wen Ho Lee Spends First Day Savoring Home Delights • Lee Case Points up Scientists' Attitude on Security • India and Pakistan: Troubled relations • U.S. China Trade Vote Milestone on Rocky Road • Troops die in Kashmir clashes • Clinton Concerned Over Lee Case - Reno On Defensive • IAEA Supports Putin Nuclear Power Initiative • China Rejects Moves to Tighten Regulation of Nuclear Materials • Clinton Calls For Review Of Lee Secrets Case • Asian-Americans Demand White House Action on Lee
Manual Organization“Business as Usual” • Wen Ho Lee • Wen Ho Lee Spends First Day Savoring Home Delights • Clinton Calls For Review Of Lee Secrets Case • Clinton Concerned Over Lee Case - Reno On Defensive • Asian-Americans Demand White House Action on Lee • Lee Case Points up Scientists' Attitude on Security • India and Pakistan • India and Pakistan: Troubled relations • Troops die in Kashmir clashes • IAEA Meeting • IAEA Supports Putin Nuclear Power Initiative • China Rejects Moves to Tighten Regulation of Nuclear Materials • U.S. China Trade • U.S. China Trade Vote Milestone on Rocky Road
VIPAR Automatic OrganizationSame as manual 3 2 • Wen Ho Lee • Wen Ho Lee Spends First Day Savoring Home Delights • Clinton Calls For Review Of Lee Secrets Case • Clinton Concerned Over Lee Case - Reno On Defensive • Asian-Americans Demand White House Action on Lee • Lee Case Points up Scientists' Attitude on Security • India and Pakistan • India and Pakistan: Troubled relations • Troops die in Kashmir clashes • IAEA Meeting • IAEA Supports Putin Nuclear Power Initiative • China Rejects Moves to Tighten Regulation of Nuclear Materials • U.S. China Trade • U.S. China Trade Vote Milestone on Rocky Road 4 1 Wen Ho Lee 5 US China Trade India/Pakistan 6 IAEA Meeting 10 7 9 8
Endorsements • US Pacific Command’s CINC Admiral Blair • “A tremendously successful project” • “Software agents … lead to substantially improved analytical products.” • Science and Technology Advisor • “a grand slam home run!” • “first time we've seen information discovery and knowledge management software working at HQ USCINCPAC operationally.”
Enhanced VIPAR Performance • The Phylips Tree representation of the clustering of 1015 articles • Required almost 360 second (6 minutes) and 241 MB of memory to compute
Battelle Funded VIPAR Upgrades • Memory • Evaluated caching of document title and collection • Optimized internal data structures • Experimented with clustering partial articles. • Applied Porter’s Stemming Algorithm • Clustering Performance • Clustering algorithm “Clusters in place” • Hybrid clustering approach to large article sets
Result • The Phylips Tree representation of the clustering of 9461 articles • Required 2.5 minutes (137 seconds) and 495 MB of memory to compute
Summary • Intelligent agents are a significant future technology direction • We have a significant progression of deployed agent systems and research to our credit • We have ringing endorsements regarding the success of our systems and research • We look forward to the next step…
Contact Information Tom Potok PotokTE@ornl.gov 865-574-0834 Mark Elmore ElmoreMT@ornl.gov 865-241-6372 Jim Treadwell JZT@ornl.gov 865-574-3350