TCS i ON Digital Assessment Redefining the Future









































- Slides: 41
TCS i. ON Digital Assessment Redefining the Future of Assessments Jan 2020 TCS Confidential Copyright © 2016 Tata Consultancy Services Limited Copyright © 2018 Tata Consultancy Services Limited
TCS i. ON Digital Assessment - Agenda 2 1 Experience in Assessments 2 Infrastructure 3 Manpower 4 Solution 5 Process 6 Content 7 Exam Governance 8 Customer Speak TCS Confidential
Click to edit Master title style TCS i. ON Digital Assessment – Experience in Assessments
Conducting effortless, paperless and errorless assessments with A Secured Platform that Hosts World’s Largest Single Shift Assessment 4 TCS Confidential
We service > 80% of the high stake exams in India 4 out of 5 Top Medical Entrance Exams Top Engineering Entrance Exams Top B-School Entrance Exams 5 TCS Confidential
We service > 80% of the high stake exams in India State Departments and Recruitment Bodies 9 out of 22 PSCs Education Boards and Universities 6 TCS Confidential
Digital Assessment Secured, Scalable Center and Nodes Items Stakeholders 3, 222 Exams 6, 542 Unique Exam Centers 201 Mn Candidates 5 Shifts Exam max in a day 3, 59, 816* Computers 645 Exam Venue Cities 377 Subjects Unique 442 Customers 4, 348*Center Heads 272 TCS Digital Sites 4* Shifts Exams in a Day 28* States 9* Union Territories, 6* International State 18. 9 Mn Candidates Largest Exams 2, 36, 931 Candidates Largest Single Shift Customers 7 Question Papers 13, 78, 678 Unique Items 16 Languages 7, 893* IT Managers 992 Subject Experts 234 International Assessment Venues National Testing Agency Educational Consultants Institute of Banking. TCS Confidential India Limited Personnel Selection All India Institute of Medical Sciences Common Admission Test by IIM Staff Selection Commission *Data from 1 st to 311 st Dec 2019 Candidates and Exam
Digital Assessment Secured, Scalable TCS i. ON Internet Based Assessment 17. 79 Mn 27. 37 Mn Total Candidates registered Attempts taken by candidates 138 1, 31, 217 Organizations leveraging 8 Assessments created TCS Confidential
Click to edit Master title style TCS i. ON Digital Assessment – Infrastructure
TCS i. ON Digital Assessment – TCS i. ON Digital Zones Standardized TCS i. ON Digital Zones Spread across 159 cities in India 249 TCS i. ON Digital Zones currently operational and more to be added Physically Challenged Candidate Friendly Test Centers Categorization of Exam Centers 10 TCS Confidential
Self Contained Inventory in every Test Center INVENTORY AVAILABILITY Servers 5, 548 Network Kits Data Cards 2, 155 Switches 1, 668 Web Cams 7, 530 Scanners 945 Partitions 3, 40, 959 Biometric Devices 11 AVAILABILITY Data as on April 1, 2018 7, 596 TCS Confidential 1, 582
Click to edit Master title style TCS i. ON Digital Assessment – Manpower
Adequate availability of Certified Local Manpower Head – Assessment Operations Certified Manpower Program Director Project Manager TCS Staff Zonal Head <Zone> Local Infrastructure Service Provider Staff Regional Ops Mgrs. <State> City Head <City> o IT Managers o 1: 250 Candidates o Registration Managers o 1: 30 Candidates o Invigilators o Center Heads o 1: 1 Exam Center o City Heads o 1: 1 Exam City o Management Oversight i. ON Academy Identificati. ON Center Head <Center> Test Center Administrator Volunteers 13 Act LAN Managers IT Manager Guards RATIOS Invigilators Support Staff Certificati. ON Feedback, Internal Tests Check Codificati. ON Disseminati. ON Trained & Certified Manpower available in over 450+ cities in India TCS Confidential Plan Do
TCS i. ON Digital Assessment – Rigorous Invigilation Management Identified larger pool of invigilators in every city Building a database of Ex-Servicemen, Ex-Bank Officials, Ex-Academicians etc Background Checks mandatory for all Invigilators Invigilator Certification post Training Random allocation of Invigilators across labs/test centers Pre-Exam, declaration from invigilators that close relations are not taking the exam Post Exam, declaration in attendance sheet on fair invigilation along with mobile number Post Exam, invigilator address proof also shared with customer Restricted mobile usage for Invigilators 14 TCS Confidential
Click to edit Master title style TCS i. ON Digital Assessment – Process
TCS i. ON Digital Assessment – Granular Rigor in Exam Processes 16 1 Detailed Standard Operating Procedures - Pre-Exam, Exam & Post Exam Activities 2 Strengthening Test Center Management - 360 Degree view of Test Centers 3 Digitization of Processes – Project Tracker, Centralized test Center Booking 4 Candidate Responses & Results shared with customers in less than 24 hours 5 Post exam data and feedback analysis leading to having Test Centers on Hold / RCA TCS Confidential
TCS i. ON Digital Assessment – Redundancy at all levels Candidate Systems Assessment Servers Internet access for Primary Server Data Center 17 § 10% Buffer Systems in all Test Centers § Buffer Test Center in every Test City § Backup Server configured for every Primary Assessment Server § Direct Internet access § Tested Data cards § 2 Data Centers in different seismic zones TCS Confidential
Click to edit Master title style TCS i. ON Digital Assessment – Solution
End to End Platform for any Assessment Pre-Exam 1 Application Management 2 Allocation Management During Exam Distributed [LAN) Assessment Post Exam 3 Key Based Analytics Internet Based Assessment Online Marking Exam Management QP & Response Hosting OMR Based Assessment Item/QP Management Pen/Paper Based Assessment Exam Portal TCS i. ON PAPER Audio/Video Based Assessment Digital Scoring Result Hosting Marking Assessment Monitoring (Any Device; Any Where Command Center) 19 TCS Confidential Merit List
TCS i. ON Digital Assessment – Wide support to Question Types 20 1 Multiple Choice Question (MCQ) 9 Audio 2 Multiple Select Question (MSQ) 10 Video 3 Short Answer (Numerical) 11 Programming 4 Short Answer (Alpha Numeric) 12 Typing 5 Comprehension 13 Stenography 6 Linked Answer Question 14 Multiple Choice Meta Question 7 Subjective 15 Multiple Select Meta Question 8 Fill in the blanks 16 Match the following TCS Confidential
TCS i. ON Digital Assessment – Wide support to Question Types 21 17 Memory- Multiple Types 25 Mechanical Comprehension 18 Picture Number Association 26 Intelligence 19 Following Direction 27 Information Ordering 20 Depth Perception 28 Personality 21 Number Matching 29 Attention 22 Observation 30 Spatial Scanning 23 Finding a number 31 Attention 24 Perceptual Speed 32 Form Board TCS Confidential
TCS i. ON Digital Assessment – Security embedded in all levels Digital Exams Examination Server Candidate System Machine Assessment § Center Management § Planning § Resource Allocation § Multi-lingual § 256 bit encryption for QP § Registration and Audit § Standard Operating Environment(SOE) § Exam Scheduling Data Item Marking § 128 bit encryption for Results § Digital and Secured Trail Bank § Whitelisting§ of. Question Servers Security § Using Keys (Objective) § Mocks QP Distribution § Cryptographic Hash Function (MD 5) § Question § Time hardening of servers § Using Teachers / § Registration Desk § Secured Printing Paper § Result sharing in encrypted format Evaluators (Subjective) § Friendly to Differently § Paper § OMR Auto-Scoring Abled Template (Objective) § Unique login credentials § Rule Engine § Question § Allocation Net. Boot - Custom Linux based OS § Audit Log Results § Node Management. Types Publishing § § i. ON Launcher E-Admit Cards § Verification of§ Admit Card Photo User § Analysis Infrastructure Audit § § Port Blocking § Verification of Original ID Proof § Merit List § Dashboard Security § Audit Trail § § Dynamic Internet checking Candidate Scheduling § Biometric capture before / during /after § Rank List § § § Drive Commencement Drive Start Detection of Virtualized Environment Detection of Additional Hardware Application § Online Form Randomization of seats § § § § Data Consolidation Payment Options Dashboard Print Friendly Services § § System Access Password (SAP) Drive Credentials (DC) QP Bundle Access Password (QAP) Drive Commencement Password (DCP) Data Entry Scanning Support Help. Content Desk Security exam for verification § Results Hosting Photo capture, display of application and § Objection Managements exam day photo for verification § Response Sheet Hosting Email of Candidate § § Candidate to System Binding § Response Sheet § Exam Duty Staff Verification § § i. ON Content Authoring Engine (CAE) QP creation in customer Premises Multiple Authentication 256 bit encrypted QP Bundle ISO 27001, 20, 000 & 9001 Certified & Cert-In Certified Data Center 22 TCS Confidential
TCS i. ON Digital Assessment - Command Centre Pre-Exam During Exam • Lanscaped Systems • Drive Configuration Status • Attendance Generation Status • Candidate Details Download Status • • Content Delivery Status • Staff Registration Status • Expected/Registered/Present/ Absent/ Delayed / Added / PWD Candidates Number of Netboot/Windows/ Linux Systems • Proxy/Internet Detected Incidents • Lock/Unlock Incidents • Expected Exam Completion Time Post Exam • Result /Audit / Biometrics Upload • IT Manager/IR Feedback • Drive End Status • Document Upload Status • Candidate Verification Status Transparency re-defined with real-time monitoring of exam process 23 TCS Confidential
Click to edit Master title style TCS i. ON Digital Assessment – Content
TCS i. ON Digital Assessment – Access to Credible SMEs 377 Subjects 992 13, 78, 678 Authors Unique Items Network of renowned authors use our secured Content Authoring Engine to deliver Question Paper 25 Data as on April 1, 2018 TCS Confidential
Click to edit Master title style TCS i. ON Digital Assessment – Exam Governance
Smart Practices to deal with Impersonation Photo & Biometric capture - Strict enforcing of guidelines System based check to identify unregistered candidates Option to choose which finger’s impression is being captured Biometric Verification - Display of score (with appropriate color coding) during verification* Biometric Verification - Verification Report Printout Photograph Verification – Photograph displayed on candidate console * 0 -2147 Green | 2148 -10, 000 Amber | >10, 000 Red 27 TCS Confidential
TCS i. ON Digital Assessment – Controls to Curb Malpractice Dynamic Internet Check 28 2 Strict Invigilation Process Candidate Seat Randomization 5 3 1 Net Boot for online exams - TCS owned operating system Frisking of Candidate and Baggage 4 TCS Confidential Node binding with the Candidate 7 6 Results Encryption
TCS i. ON Digital Assessment – Insightful Analytics Identify Analyze 29 § Scheduling Data Personal Data Candidate Registration Data Exam Day Data § Test Center Data § Hardware Data @ Test Center § LAN level Data § Exam Data Candidate Result Data § § § § Geographic Analysis Schedule Analysis Machine Analysis Candidate Analysis Registration Analysis Malpractice Attempts Incident Analysis Test Center Analysis Asset Analysis Point-in-time Analysis Response Behavior Analysis Time Analysis Feedback Analysis § § Collect from Infer TCS Confidential Application Form Test Center Management Hall Ticket Module Past History of Assets Logs – Server/IT Manager/Incident/Locks Network Analysis Seating Arrangement Command Center Raw Responses § § § Complete Analysis Inferences on the dimensions § Exam Type § Exam Shift § Test City § Test Center § Candidate
TCS i. ON Digital Assessment – Strong Support to RTI Participant Report Get candidate’s exam roll no. , test center name, subject and question paper details Data Report Details of each question in the order they have appeared to the candidate Question-wise Report Analysis of questions attempted by the candidate including marks allotted & negative marking Audit Log Click by click reproduction of the entire assessment of a candidate 30 TCS Confidential
TCS i. ON Digital Assessment – Patents Application Title EPO Customized Question Paper Generation 31 India 2811/MUM/2011 Examination Management 12170891. 1 353/MUM/2012 Method and System for conducting audit for an assessment platform 17199524. 4 201721011543 Secured computer based assessment (i. DEA) 13194236. 9 3711/MUM/2012 System And Method For Computer Based assessment distribution and printing 17 153 172. 6 201621041143 TCS Confidential
TCS i. ON Digital Assessment – i. LEON High Secured Fair & Uniform Foolproof Scalable Affordable • Bluetooth, wifi signal detection • RF detector to detect 2 G/3 G/4 G signals • Pre-installed i. LEON OS • Customized & Uniform • Lock Down hardware connection • Embedded camera & Bio-metric sensors • Dual boot for multi-purpose • Logistically movable • Affordable price range • Battery operated device Conduct secured and scalable assessments with standardized experience 32 TCS Confidential
Click to edit Master title style TCS i. ON Digital Assessment – Customer Speak
TCS i. ON Digital Assessment – Candidate Experience Software 99. 14% Communication 99. 14% Process and Support 98. 62% *Based on a high stake exam conducted with over 2, 000 candidates 34 TCS Confidential Average Candidate Satisfaction Index of 98. 97%*
Case Study 1 : Railway Recruitment Board CHALLENGES • Cumbersome and manpower intensive process of offline assessments • Error-prone manual allocation of test centers • Time and effort intensive Question Paper (QP) creation and risk of leakage • Effort intensive result processing SOLUTION • Digitization of exam process • Question Creation Wizard and Question Paper Wizard to frame question papers unique to each candidate with the same level of difficulty • Enhanced security features with 128 -bit encryption for information sharing IMPACT • Saving of time and efforts in question paper creation • Elimination of logistics and security risks • Got real time status of examination and faster result declaration without logistic hassles ENGAGEMENT • 351+ cities covered to assess over 9. 12 Million candidates • Assessment exam taken place for 1127+ exam centers with 15 languages • 0. 19 Million candidates was a largest single shift assessment for RRB NTPC 35 TCS Confidential
Case Study 2 : All India Institute of Medical Sciences CHALLENGES • • Irregularity in candidate mapping process Security risk in manual and paper-pen examination SOLUTION • Conducted MBBS examination online with total of 1, 94, 311 students appeared Covering 153 cities across 398 centers Biometric registration minimizing candidate impersonation • • IMPACT • • ENGAGEMENT 36 • • Ability to quickly de-map and re-map a candidate whenever needed Better center management in terms of invigilation and readiness of the staff at the local center Candidate mapping process has been flawless Continuous improvement in examination security process TCS Confidential
Case Study 3 : Central Board of Secondary Education • • • CHALLENGES • • • SOLUTION Real time data where shared during the conduct of exams Customized reports with respect to attendance, response and results Increased test center capacity up to 20% from the existing capacity in many remote areas • • IMPACT • ENGAGEMENT • • 37 Difficulty in monitoring exam status Non availability of real time reports Increased administrative effort Command center to give real time reports of exam progress Assessment conducted in 279 cities including 7 international cities SMS + email notification to candidates pre-post examination Admin rights were provided to the customer to access various data eliminating dependency on i. ON team Dedicated project management team was deputed during the examination process at their location TCS Confidential
Case Study 4 Madhya Pradesh Council of Vocational Education and Training CHALLENGES • Long exam planning cycle time of 6 -8 months • Malpractice attempts and QP leakage • Huge overhead costs in the offline mode of exam IMPACT • Marking cycle time reduction by 30% • Lesser post-results queries • 100% elimination of totaling errors • Transparency in marking process ENGAGEMENT • First Indian state to conduct online ITI SCVT exams • Over 452 K candidates were digitally assessed during SCVT and NCVT exams • Assessments at 125+ exam centers across MP SOLUTION • Computer based assessment covering end-to-end examination • Digitized student application and automated allocation process • Encrypted and secured question paper creation • Automated evaluation and faster result processing 38 TCS Confidential
TCS i. ON Digital Assessment – Value Proposition Candidate • Easy access to test centers in the vicinity • Enhanced candidate experience through real-time test progress pallet • On-time and defect-free access to results Controller / Head of Exam • 100% elimination of security risk throughout the exam life cycle • 100% elimination of logistics of QP and response sheets • 100% error-free result processing Exam Body • Reduction in exam cycle time from 8 months to 1 month • Real time monitoring of examination progress • On-demand RTI query response within 1 day 39 TCS Confidential
Click to editeffortless, Master title style Conduct paperless and errorless assessment with TCS i. ON Digital Assessment
THANK YOU