Distributed Systems and Algorithms DSA from A to

Distributed Systems and Algorithms (DSA from A to Z) Carey Williamson i. CORE Professor and NSERC IRC Department of Computer Science University of Calgary November 2005

Computer Science (CPSC) Distributed Systems & Algorithms Evolutionary Quantum Visual & Software Computing & Interactive Engineering Cryptography Computing You are here! November 2005 Copyright © 2005 Department of Computer Science 2

Computer Science (CPSC) Distributed Systems & Algorithms Evolutionary Quantum Visual & Software Computing & Interactive Engineering Cryptography Computing Databases Distributed - Alhajj Algorithms/ - Barbosa Reliability - Barker - Hammad - Higham Multi-agent/ Biological Systems Networks - Denzinger - Jacob November 2005 Copyright © 2005 Department of Computer Science - Li - Mahanti - Williamson Simulation/ Grid/HPC - Simmonds - Unger 3

ADSA: Yesterday to Today Ø Bio-Informatics and Bio-Computing Ø Cache Invalidation Schemes for Mobile Databases Ø Keyword Search in Structured Databases Ø Knowledge Discovery and Data Mining Ø Multi-agent Systems Ø Partitioning Ø Replication in Grid Environment Ø Web Databases Ø XML and Data Reengineering November 2005 Copyright © 2005 Department of Computer Science 4

ADSA: Today to Tomorrow Ø Bio-Informatics and Bio-Computing Ø Data Mining Ø Distributed Systems Ø Database Security Ø Autonomic Systems DBA Ø Systems Integration Ø XML Data Systems/Repositories Ø Sensor Systems Ø Stream Mining November 2005 Copyright © 2005 Department of Computer Science 5

Computer Science (CPSC) Distributed Systems & Algorithms Evolutionary Quantum Visual & Software Computing & Interactive Engineering Cryptography Computing Databases Distributed - Alhajj Algorithms/ - Barbosa Reliability - Barker - Hammad - Higham Multi-agent/ Biological Systems Networks - Denzinger - Jacob November 2005 Copyright © 2005 Department of Computer Science - Li - Mahanti - Williamson Simulation/ Grid/HPC - Simmonds - Unger 6

Distributed Algorithms (Higham) • Did you know that. . . – – many commercial multi-processors don’t work correctly? Herlihy’s hierarchy collapses for hard real-time apps? self-stabilizing algorithms matter in real-life? sensor networks are the next big thing? • Lisa Higham studies theoretical side of distributed computation, including fault-tolerance, parallel algorithms, memory consistency models, wait-free computation, and sensor networks November 2005 Copyright © 2005 Department of Computer Science 7

Computer Science (CPSC) Distributed Systems & Algorithms Evolutionary Quantum Visual & Software Computing & Interactive Engineering Cryptography Computing Databases Distributed - Alhajj Algorithms/ - Barbosa Reliability - Barker - Hammad - Higham Multi-agent/ Biological Systems Networks - Denzinger - Jacob November 2005 Copyright © 2005 Department of Computer Science - Li - Mahanti - Williamson Simulation/ Grid/HPC - Simmonds - Unger 8

Multi-Agent Systems (Denzinger) • Application of advanced artificial intelligence (AI) techniques to problems requiring learning, cooperation, coordination, and negotiation between and among multiple (software) agents • Examples: – Internet search – software agent negotiation – finding good/bad strategies in gaming applications • See poster for details! November 2005 Copyright © 2005 Department of Computer Science 9

Biological Computation (Jacob) • One ant: dumb • Lots of ants: smart • Swarm intelligence!! • The world of biology offers fascinating insights into computational models, showing the power of evolutionary algorithms and swarm intelligence • See poster for details! November 2005 Copyright © 2005 Department of Computer Science 10

Computer Science (CPSC) Distributed Systems & Algorithms Evolutionary Quantum Visual & Software Computing & Interactive Engineering Cryptography Computing Databases Distributed - Alhajj Algorithms/ - Barbosa Reliability - Barker - Hammad - Higham Multi-agent/ Biological Systems Networks - Denzinger - Jacob November 2005 Copyright © 2005 Department of Computer Science - Li - Mahanti - Williamson Simulation/ Grid/HPC - Simmonds - Unger 11

Networks and Systems Multiple Choice Quiz • Which of the following statements is NOT true? (a) Over 60% of U of C Internet traffic is P 2 P (b) Microsoft IE browser violates TCP FIN rules (c) In WLANs, “one bad apple spoils the batch” (d) Web traffic workloads exhibit heavy tails (e) Internet media streaming quality is often poor (f) Network coding achieves optimal throughput (g) There is $100 taped underneath your chair Answer: (g) November 2005 Copyright © 2005 Department of Computer Science 12

Network Coding Theory (Li) Bit. Torrent: The Next Generation? November 2005 Copyright © 2005

Content Distribution Systems (Mahanti) • • • Multimedia streaming on wired networks Multimedia streaming on wireless networks Quality adaptation for streaming media Scalable multicast streaming protocols Internet traffic classification and modeling Peer-to-peer (P 2 P) systems • See poster for details! November 2005 Copyright © 2005 Department of Computer Science 14

Network Performance (Williamson) • “Make the Internet go faster” • Research area? – Wireless/cellular networks, Internet protocols, computer systems performance evaluation • Approach? – Experimental, simulation, analytical • Key challenges? – Citius, Altius, Fortius! – Performance, scalability, robustness November 2005 Copyright © 2005 Department of Computer Science 15

Computer Science (CPSC) Distributed Systems & Algorithms Evolutionary Quantum Visual & Software Computing & Interactive Engineering Cryptography Computing Databases Distributed - Alhajj Algorithms/ - Barbosa Reliability - Barker - Hammad - Higham Multi-agent/ Biological Systems Networks - Denzinger - Jacob November 2005 Copyright © 2005 Department of Computer Science - Li - Mahanti - Williamson Simulation/ Grid/HPC - Simmonds - Unger 16

Grid Computing (Simmonds, Unger) • What? – High performance computing for big science apps – Service based architecture with user-level authentication and credential delegation – Enables creation of federated computing environments spanning administrative domains • How? – Standard interfaces to HPC systems – High performance data transfer tools (> 900 Mbps!!) – Additional tools build on top of these services • Where? – U of C (and U of A, U of L, UBC, SFU, …) November 2005 Copyright © 2005 Department of Computer Science 17

West. Grid November 2005 Copyright © 2005 Department of Computer Science 18

Grid Research Activities • Grid Monitoring • Data Management • Data Analysis • http:

Computer Science (CPSC) Distributed Systems & Algorithms Evolutionary Quantum Visual & Software Computing & Interactive Engineering Cryptography Computing Databases Distributed - Alhajj Algorithms/ - Barbosa Reliability - Barker - Hammad - Higham Multi-agent/ Biological Systems Networks - Denzinger - Jacob November 2005 Copyright © 2005 Department of Computer Science - Li - Mahanti - Williamson Simulation/ Grid/HPC - Simmonds - Unger 20

DSA Posters on Display Today • Multi-Objective Optimization to Produce the Most Natural Clustering (Alhajj/Barker) • VIREX: A Visual Tool for Querying Relational DBs to Produce XML Documents (Alhajj/Barker) • Managing Complex Data (Barbosa) • System Testing by Learning Behavior (Denzinger) • Evolutionary and Swarm Design (Jacob) • Non-Traditional Data Management (Hammad) • Content Distribution Systems (Mahanti) November 2005 Copyright © 2005 Department of Computer Science 21

Summary: DSA Members • • • Reda Alhajj (Databases) Denilson Barbosa (Databases) Ken Barker (Databases) Jörg Denzinger (Multi-Agent Systems) Moustafa Hammad (Databases) Lisa Higham (Distributed Algorithms) Christian Jacob (Biological Computation) Zongpeng Li (Network Coding Theory) Anirban Mahanti (Content Distribution Systems) Rob Simmonds (Grid Computing) Brian Unger (Grid Computing) Carey Williamson (Network Performance) Questions? November 2005 Copyright © 2005 Department of Computer Science 22