Education as a Peer to Peer Grid Service

Education as a Peer to Peer Grid Service PTLIU Laboratory for Community Grids Geoffrey Fox Computer Science, Informatics, Physics Indiana University Bloomington IN 47404 gcf@indiana. edu 9/21/2021 gecdistedaug 01 1

Some Technology Trends l l l l Increasing performance of Internet backbone and last mile (access) Hand-held devices and wireless Pervasive Access Peer to peer technologies enable new ways of collaborating and blurs distinction between clients and servers Client-Server Multi-tier Architectures XML Schema and tools All data defined as objects Separation of client, system and persistent storage models for information Development of (application) service model imply to capture New Technologies common (maybe centralized) capabilities New Opportunities requiring typically Business models Semantic Web, Grid or … “Next New Generation Web” 9/21/2021 For gecdistedaug 01 Education and Training 2

What is a Grid Service? l l The Grid is distributed system allowing communities to access seamlessly heterogeneous resources from heterogeneous clients – Resources are web-pages, instruments, Object repositories, Simulation codes running on supercomputers …. A Service is a generic application or capability respecting standards (general web and application specific) allowing multiple providers to compete on a given service Portal is customizable User interface Middle Tier Broker Back end Capability Resource 9/21/2021 gecdistedaug 01 3

Some General Grid Services l Business is developing “web service” concept to support areas like e-commerce where one composes atomic services like – – Security Payment Catalog Goods supply Each of these services could allow Multiple choices of provider In a given session Payment Credit Card Security WSDL is new standard for web services 9/21/2021 gecdistedaug 01 Catalog Warehouse shipping 4

Architecture of Grid: Commodity Science l Commerce, Entertainment, Healthcare, Science, Computing, Education …. will be Grid Services C o n v e n i e n c e Next Generation Consumer Web Twenty-First Century University and laboratory Community Portals Science Portals & Workbenches Commerce Grid Education Grid Research Grid Computational Grid Business Services Education Services Research Services & Technology Computational Services Grid Services (resource independent) Grid Fabric (resource dependent) P e r f o r m a n c e Networking, Devices and Systems 9/21/2021 gecdistedaug 01 5

Why use Service Idea? l l l Well a major lesson for me of HPCC effort was the importance of sustainable hardware and software Software like MPI is sustainable because it is simple Software like HPF and POOMA (Do. E) illustrate the difficulties of either commercial or academic entities – Much more powerful than MPI but difficult to advise users to adopt as such “heroic (software development) efforts” can be halted for a variety of reasons l l l So we need to build great software where possible on simple sustainable bases So use the Web where ever possible and try to address its obvious difficulties (performance) Try to abstract capabilities so can build hierarchically to support range of users 9/21/2021 gecdistedaug 01 6

Simple Minded View of Services l l So we are building a “component” model of software systems Components are “just web applications” or more precisely support the web standards – You can access them from portals for Graphical User Interface – You can link to them and discover them like web applications l So Grid Services concept is a sustainable “framework” for developing parallel and distributed systems – Parallel version implies low latency / high bandwidth communications in both hardware and software – So Grid services must be implementable with high functionality (SOAP) or high performance protocols (RMI, threads) l They are subroutine library model for the Grid 9/21/2021 gecdistedaug 01 7

Why use Distance Education and Training? l New and rapidly changing Curriculum suggest the use of distance education as it will allow a few experts to deliver instruction to more students and this addresses both – The shortage of trained faculty – Offering classes with small enrollments at one university – cost of developing new curriculum QUICKLY requires many students (say around 5 -10 times traditional class) to amortize cost l l l Distance Education is technically sound based on web curricula-both synchronously and asynchronously -- today with very robust clear implementations available over next few years Both delivery mechanism and identification of knowledge nuggets that are smaller than or different in content from a traditional degree suggests different approaches to certification – Courses are given, graded etc. by multiple organizations -- University integrate degrees? Similar arguments for distance training with relative importance of synchronous and asynchronous learning differing by customer group 9/21/2021 gecdistedaug 01 8

The Virtual University l l l Motivated either by decreased cost or increased quality of learning environment Will succeed due to market pressures (it will offer the best product) Assume that as with text books, only a few pedagogically excellent teachers will produce lectures; only a few charismatic souls deliver them “Centers of Excellence” (“Hermits Cave Virtual University”) are natural entities to produce and deliver classes supported by good technology and wonderful graphics University acts as an integrator putting together a set of classes where it may only teach some 20% but acts as a mentor to all 9/21/2021 gecdistedaug 01 9

Capabilities of the Education Grid Service l l l Curriculum or “Learning Objects” – Web Pages becoming more sophisticated (Flash) Audio-Video Conferencing, Chat rooms, white boards to support student, teacher, mentor interactions Shared Documents for synchronous collaboration Learning Management Systems – Student registration, Quizzes, Grading, Security – Database Storage (persistent Learning Objects) IMS and ADL standards for interoperability Asynchronous self paced access 9/21/2021 gecdistedaug 01 10

Some Education Grid Services l l l l l Registration Performance (grading) Authoring of Curriculum Online laboratories for real and virtual instruments Homework submission Quizzes of various types (multiple choice, random parameters) Assessment data access and analysis Synchronous Delivery of Curricula Scheduling of courses and mentoring sessions Asynchronous access, data-mining and knowledge discovery 9/21/2021 gecdistedaug 01 11

Portal for Education Service l l The User Model is that of a Portal familiar from Yahoo and the growing effort in Enterprise Information Portals (Lotus Notes implemented with Web or Object Grid technology) Education service must use generic Portal service 9/21/2021 gecdistedaug 01 12

3 -Tier Architecture for Education Portal l l Everything is an Object: Curriculum, Users, grades, computers – all are defined in XML very important in online education as objects quite small, are naturally decentralized and have rich important metadata Object There are several important Object Repository Models: COM, CORBA, Java, Excel Web, flat file, Oracle Database …… But model doesn’t matter!! XML Request Or Export/Import Information Middle Tier “Business Logic” dissociates User and Back End 9/21/2021 File System (Web Site) gecdistedaug 01 Database 13

ADL Learning Management Model Learnin Content External systems: “Learning g Management Server(s) HR, E-Commerce, ERP. . . Server System” LMS Migration Adapter Course Interchange: Course Structure Format (CSF), Metadata Services or Adapter Learning Server Adapter Server Side Common Grid Services & Objects Runtime Good but … Environment: Launch, API, Client-Server Data not Model. Multi-tier Not built in terms of services Client Side Client Browser API Adapter Application HTML+ www. adlnet. org ADL is Advanced Distributed Learning – Do. D Initiative gecdistedaug 01 9/21/2021 14

Some General Grid Services Portals Computing Interface customization Workflow Registration (security) People Collaboration (Access Grid -- Desktop Support flow of information Audio Video) (approval) through some process Resource Collaboration (P 2 P, Document secure authentication of this flow Sharing) News groups Authoring Channels Multi-fragment pages Instant Messenger Charts White board Multimedia Anonymity Payment -- Digital Cash Video on Demand Catalog Support Tenure evaluation support Comments as in Amazon Generate CV Surveys Refereeing Decision Making Authoritarian Universal Access Consensus from PDA/Phone to disabilities Group Mediation caching Advertising Akamai Search/Knowledge Discovery (Digital Library Service) Scaling My. Google performance Need for structured (Directory in Google, Indexed Databases etc. ) trouble shooting grid Unstructured Data (basic Google) gecdistedaug 01 9/21/2021 15

Science as a Grid Service I l l l l Science Generic Services building on previous Grid services Storage Rendering and Authoring of Mathematics Other specialized authoring and rendering Scientific Whiteboard n. D (n=2 3) Support GIS Virtual worlds Integration of different sciences – – – optimization (NEOS) image processing "SCALAPACK" etc. (NETSOLVE) – Matlab as a Grid Service l l l Authoring Curriculum specification and associated services specification: – prerequisites – completion requirements l l l l Grading Homework Submission Quiz Setting including individualized questions Quiz Taking Office Hours Mentoring Delivery Assessment including – – l l 9/21/2021 Education as a Grid service gecdistedaug 01 evaluation of material evaluation of student interaction with material Self paced learning Particular learning models from K -12 to Lifelong 16

Science as a Grid Service II General Science Research -- Theory/Discussion Computing Interface Scientific Notebook/Whiteboard Job Control/Submission Brainstorming Seminars Scheduling Theorem proving Visualization Programming Research -- Experimental Parameter Specification Virtual Control Room from accelerator to Legacy Code support (wrapping) satellite Data Analysis Application Integration Virtual Instrument Software version control Sensors Monitoring. . . Satellites to Field work to wireless in the Amazon Scientific Data services to Video cameras recording earthquake High Performance damage Special Formats to LED in rack of accelerator control Virtual data as in. Note Gryphyn Outreach Sharesmodule manyinstruments services(Telemedicine with Research medical Grid Fastlane/ Report submission Service) but some components are at a “less detailed” level Science Library Publication Outreach Multi-cultural customization Comparison of Theory/Expt Multi-level presentations evaluation 9/21/2021 gecdistedaug 01 17

Why use Distance Education and Training? l New and rapidly changing Curriculum suggest the use of distance education as it will allow a few experts to deliver instruction to more students and this addresses both – The shortage of trained faculty – Offering classes with small enrollments at one university – cost of developing new curriculum QUICKLY requires many students (say around 5 -10 times traditional class) to amortize cost l l l Distance Education is technically sound based on web curricula-both synchronously and asynchronously -- today with very robust clear implementations available over next few years Both delivery mechanism and identification of knowledge nuggets that are smaller than or different in content from a traditional degree suggests different approaches to certification – Courses are given, graded etc. by multiple organizations -- University integrate degrees? Similar arguments for distance training with relative importance of synchronous and asynchronous learning differing by customer group 9/21/2021 gecdistedaug 01 18

Courses at Jackson State l Taught using Tango since fall 97 over Internet and defense high performance network DREN twice a week from Syracuse – Course material based on Syracuse Senior Undergraduate class CPS 406(Web Technologies) and graduate classes CPS 615/616/640(Base Computational science/Internetics) – Curricula, Homework, Grading, Facilities done by Syracuse – Students get JSU NOT Syracuse Credit l l Jackson State major HBC University with many computer science graduates Do not compete with base courses but offer addon courses with “leading edge” material (Web Technology, modern scientific computing) which give JSU (under)graduates skills that are important in their career Fall 99 Semester CPS 640 offered to 40 students in 5 distant places and separately 40 at Syracuse Fall 2001 restart with “latest technology” (Access Grid, Hear. Me, Garnet) 9/21/2021 gecdistedaug 01 19

Architecture of Tango Distance Education JSU Web (Proxy)Server Student’s View of Curriculum Page HTTP Java Tango Server Share URL’s Audio Video Conferencing Chat Rooms White Boards etc. NPAC Web Server Address at JSU of Curriculum Page Teacher’s View of Curriculum Page ……. Java Sockets Java ……. Control Clients Teacher/Lecturer at NPAC Participants at JSU All Curricula placed on the Web 9/21/2021 gecdistedaug 01 20

What is Web-based Collaboration? l l Collaboration means sharing objects (Web Page very important object) Web-based Collaboration implies use of Web to share distributed objects accessible through the Web – Shared Web Pages; Resources accessed through Web Servers or Brokers; Client-side applications with programmatic interfaces such as Java Physics Simulations Web Site Specify Page Web Page 9/21/2021 Receive Identical Page Web Page gecdistedaug 01 Shared Page Shared Pointer 21

> Two Shared Physics Simulations – SHO and Vector cross product > Chat Room > Audio video conferencing 9/21/2021 gecdistedaug 01 22

What did this lead to? l l l Jackson State students got access to curricula that was not otherwise available to them Developed quite good Information Technology and computational science curricula Jackson State faculty acted as mentors in course and now teach some of material in their own courses and to other HBCU colleges – Make rapidly changing and important curricula available to an HBCU network -- could dramatically improve curricula opportunities for HBCU students – JSU has institutional commitment to area Used in High School Java, Do. D wide training and Winter 00 semester as part of ERDC Graduate Institute Supports migrant teachers -- I have delivered course spring 00 semester from Syracuse, FSU and ERDC, Vicksburg 9/21/2021 gecdistedaug 01 23

Saturday Java Academy http: //old-npac. csit. fsu. edu/projects/k 12 javaspring 99/ 9/21/2021 gecdistedaug 01 24

Hierarchical Delivery Model l l One could teach to 1000 different students – each at a separate workstation but … No real opportunity for questions so better to use broadcast technology – not conferencing Further could better deliver to 40 classrooms – each with an average of 25 students Each classroom has central high quality A/V conferencing, displays and – A Mentor monitoring and helping students – Each student could have wireless laptop or PDA l So synchronous systems must support simultaneously disparate clients – high end display to PC to PDA 9/21/2021 gecdistedaug 01 25

Authoring of Curriculum l l l Market pressures push to high end authoring Authoring approaches for the Web can include – Basic HTML – Macromedia/Adobe/etc. packages like Fireworks, Dreamweaver, Illustrator – Power. Point and Word exported Also can include Real. Networks or Microsoft or. . Format Multimedia – Note Streaming multimedia formats have larger buffers than A/V conferencing formats Certainly use XML to specify content and render this into attractive portal SVG and SMIL are important 2 D vector graphics and multimedia standards – HTML does not give reproducible pages – Flash can be thought of as “proprietary SVG” 9/21/2021 gecdistedaug 01 26

Current Status and Futures l l l Commercial Systems such as Centra, Web. Ex, Anabas and Placeware offer similar functionality to our old system Tango for synchronous collaboration – Shared applications, chatroom, whiteboard, A/V conferencing Blackboard, Web. CT, Lotus offer learning management systems – Can they switch to IMS, ADL standards; high-end authoring and XML based object technology (not databases or files) Access Grid (community e. g. classroom) and Hear. Me (desktop) are new internet audio-video systems which are be used with shared object systems I develop research system Garnet for education portals – Features hand-held and desktop clients, integrated collaboration and some “technical advances” – major use of XML, shared SVG Peer to Peer Grids suggest decentralized architecture (http: //www. jxta. org) 9/21/2021 gecdistedaug 01 27

Commercial Collaboration Systems Centra Anabas Web. Ex 9/21/2021 gecdistedaug 01 Place. Ware 28

Batik Viewer on PC Power. Point can be converted to SVG via Illustrator or Web export 9/21/2021 SVG Sharing PC to PDA gecdistedaug 01 29

Access Grid (Argonne, NCSA) and Hear. Me Access Grid: Community Hear. Me: desktop integrates phones and Internet Audio Presenter camera Presenter mic Ambient mic (tabletop) Audience camera 9/21/2021 gecdistedaug 01 30

Garnet Heritage/Assumptions l l Support Education, Training and if possible Computing as Grid(Web) Services Use best practice commercial and academic capabilities – Access Grid, Hear. Me, Anabas, (JMS, WSDL, EJB, Castor, Oracle etc. ) – Worry about Centra, Web. Ex, Placeware, Blackboard, Web. CT, Saba, Groove, Docent etc. – Respect IMS/ADL Learning Object standards (http: //www. adlnet. org) and GGF Computing Objects l l Integrate Synchronous and Asynchronous ( “learning management system”) collaboration Support hand held and desktop clients (universal access) 9/21/2021 gecdistedaug 01 31

Garnet Technology l Uniform XML event (message) based architecture – Linked with a publish-subscribe paradigm l XML Schema GXOS supports hierarchical data structures (compatible with Do. D ADL SCORM for learning objects) – XML for all metadata (Users, documents, computers) and object changes -- from text chats to display changes etc. ) l l Java Middleware using Enterprise Javabeans Production system uses JMS (Java Message Service) to implement publish-subscribe – JMS does Synchronous and Asynchronous Messaging l My. Xo. S manages XML information nuggets 9/21/2021 gecdistedaug 01 32

Important Capabilities in Initial Garnet l l l Standard stuff: built in shared display, whiteboard, Hear. Me Audio control, quizzes, annotations, chat/IM (Jabber. org) – Desktop video will be special case of shared display Record and replay all features of session (SMIL) – A/V, Presentation, Annotations, Text Chat Several Specialized Collaborative Shared Export Viewers: JSP, ( later HTML, Acrobat. . ) Initial SVG (Scalable Vector Graphics) Shared Batik Viewer – 2 D Scientific Visualization/Whiteboard – Macromedia (Flash~SVG) and Adobe (already “all” to SVG) Initial source of SVG: Convert Power. Point VML/WMF to SVG – Gives shared export model for Power. Point with each client able to scale independently at high resolution 9/21/2021 gecdistedaug 01 33

JMS (Java Message Service) Structure in Garnet Basic primitive is a topic/property labeled queue = JXTA Pipes are collections of either messages or other pipes and just “nodes” in information hierarchy labeled by a URI JMS Global (distributed) Event Receptor (Queue) Subscribe Publish HHMS Convert Events to JMS Java. Script 9/21/2021 Java C++ …. . gecdistedaug 01 HHMS (Hand Held Message Service) Optimized for Performance. 34

Performance of Commercial JMS I One millisecond latency is fine for Synchronous Collaboration and fine for Grid Implementation Non-persistent as We do database backup outside JMS 9/21/2021 gecdistedaug 01 35

Peer to Peer P 2 P Networks l l Publish/Subscribe is mechanism we use to establish who gets what information for Collaboration and P 2 P and may be ALL Grid and ALL Web Services? Gnutella and JXTA are different implementations Message (or of event) underlie P 2 P Grids (from JMS) P 2 P services information propagation – GMS can be built on top of JXTA or JMS architecture l JXTA like My. Xo. S identifies the implicit distributed operating (control messages/metadata) system – – Both have message queues as primitives Both have Shell Both use XML based messages JXTA Advertisements are similar to GXOS metadata for objects 9/21/2021 gecdistedaug 01 36

Classic Grid Architecture Resources Database Composition Neos Netsolve Security Portal Middle Tier Brokers Service Providers Portal Typically separate Clients Servers Resources 9/21/2021 Clients gecdistedaug 01 Users and Devices 37

Peers Peer to Peer Network User Service Resource Routing Peers are Jacks of all Trades linked to “all” peers in community Typically Integrated Clients Servers and Resources User Service Resource Routing 9/21/2021 User Service Resource Routing gecdistedaug 01 User Service Resource Routing 38

Peer to Peer Grid User Service Resource Routing GMS Routing Services GMS or GES is Grid Message/Event Service User Service Resource Routing 9/21/2021 Dynamic Message or Event Routing from Peers or Servers User Service Resource Routing gecdistedaug 01 39

Single Server P 2 P Illusion Data base JMS/GMS Server Traditional Collaboration Architecture e. g. commercial Web. Ex and old Syracuse system Tango 9/21/2021 gecdistedaug 01 40

P 2 P Grid Event Service – a better JMS l l l Dynamic Collection of some billion computers each of which can either generate, route or consume events Publisher labels events by an (XML) object which is at simplest a URI but in general a collection of tag-values or instance of XML Schema Subscribers issue some sort of XML Query e. g. deliver all gxos: //garnet/Education/Graduate/Computer. Science/ Indiana/Spring 2001/CPS 616/Lecture 3/* Need Secure, High Performance, Efficient (don’t propagate events further than they need), Fault Tolerant delivery service Shrideep Pallickara Ph. D June 1 2001 Current version Java RMI based – could be SOAP 9/21/2021 gecdistedaug 01 41

Proposed GMS Model for Messages l All message publication labels and subscription profiles are defined in XML Subscribes to all events to get Database persistence Subscriber Profile Objects Specify Query to Event Label Message Queue Labeled by (XML) Topic Object Subscribers Publishers 9/21/2021 gecdistedaug 01 42

Multiple Server P 2 P Illusion Data base JMS Server Generate “Automatically” JMS moving. Server from We are client – server – resource model with Clearly defined responsibilities to a Heterogeneous Dynamic Grid of service providers and Service consumers which are not necessarily distinct 9/21/2021 gecdistedaug 01 43

Some Results – 22 Servers are logically but not necessarily physically distinct from clients 9/21/2021 gecdistedaug 01 44

Match Rates of 10% 9/21/2021 & Server Hop to client = 1 gecdistedaug 01 45

Event-based Garnet Architecture l l All Objects are defined in XML (metadata)– this XML view could be “virtual” but can be used to discover, edit (etc. ) objects – labeled by a URI GXOS manages meta data defining all Objects -- it doesn’t really want to manage Objects, just information required to find, access, store, render and share it – MUST have a good object management system to build collaboration service – Rendering includes Palm devices as well as PC’s – Entities are people, cuuricula, grades, computers etc. All actions including object changes are events – all events are GXOS objects – Instant Messenger access, Framebuffer changes etc. are all GXOS events uniformly routed/archived etc. There is a Shell My. Xo. S with basic Services (copy, create, collaborate etc. ) – similar in concept to JXTA Shell gecdistedaug 01 9/21/2021 46

Overall Structure of GXOS for a Mega. Meeting Capabilities Users Event Archive Global Root Devices Documents Mega. Meeting Admin Multimedia Have a hierarchy of Mega. Meetings (any collection of meetings) Course, Degree. . Are Mega. Meetings Any level (except lowest) can be a pipe Meeting gxos: //Education/University/Indiana/CS/Ph. D/Course/Lecture 9/21/2021 gecdistedaug 01 47

Interface of XML and Java I l l How will we teach computing? – K-4: Internet Access – Middle School: (Simple) XML Schema interfaced to some scripting language – High School: Java as the programming model with Java classes (for external data) generated Probably don’t want to specify objects twice – Start in Java; generate Schema Or Start with Schema and generate Java Need a natural API of computer code to real or virtual XML – Current mechanisms seem quaint (JDBC), inefficient (parsers), or non standard (Castor) 9/21/2021 gecdistedaug 01 48

Interface of XML and Java II l l Suppose we have a quadrillion (1015) Database XML objects as say produced by a physics accelerator per year (Enterprise GXOS) Need to combine: (Virtual) XML View – Search Interface to select nodes of XML Tree l Specify URI l JDBC or Google like Interfaces – Castor like Interface to map XML into Java but need to control depth of conversion from XML into Java Choose And Convert Middleware(EJB) 9/21/2021 gecdistedaug 01 49

Current GXOS API Architecture l Initially implement “Personal GXOS” – Information Repository small enough that we can afford to read all possibly relevant information into memory and refine this – E. g. Support course data for individual faculty l File. xml XML Object Java Object and vice versa – Use Castor to automate XML Schema to Java Object l Primitives Supported Initially – Get a “leaf Object” – Get a Collection (Internal Node) – “handle” and self. xml (the GXOS properties associated with this node) – List Contents of a collection (recursively) – Get Contents of a collection (recursively) 9/21/2021 gecdistedaug 01 50