Time Ca T Time Capture Tool Time Ca

Time. Ca. T Time Capture Tool (Time. Ca. T): Development of a Comprehensive Application to Support Data Capture for Time Motion Studies. Marcelo A. Lopetegui, M. D. Postdoctoral Researcher Department of Biomedical Informatics Improving People’s Lives through innovations in personalized health care

Time. Ca. T Background Time Capture Tool Clinical Workflow Understand Hospital Management Measure Clinical Research

Time. Ca. T Background Time Capture Tool Clinical Workflow Understand Patient Safety, detecting interruptions and medication errors Quality of care, assessing timeliness of treatments and procedures Measure Productivity and efficiency Clinicians workload and time allocation

Time. Ca. T Background Time Capture Tool Time Motion Studies The observation and analysis of tasks within an activity with an emphasis on the amount of time required to perform the task.

Position Tracking Device Multimedia Recording External Observer Passive Tracking Work Sampling Self Reports Continuous Observation Self Work Sampling Active Tracking Time. Ca. T Background Time Capture Tool Time Motion Studies Computerized Systems

Time. Ca. T Background Time Capture Tool Continuous Observation TMS Task one Task two Task three Observer Id task time 1 Begin 09: 30: 20 2 Task 1 09: 30: 22 3 Task 2 09: 31: 54 4 Task 3 09: 35: 01 5 End 09: 36: 35 Subject

Time. Ca. T Background Time Capture Tool Task one Task two Task three WORKFLOW 2 INTERVENTION WORKFLOW 1 Task one Task four Task three

Time. Ca. T Background Time Capture Tool + + + Results H 1 Results H 2 Results H 3

Time. Ca. T Background Time Capture Tool Results

Time. Ca. T Background Time Capture Tool Continuous observation time motion studies could enhance clinical workflow studies by providing rich quantitative data required for in-depth workflow analyses. However, methodological inconsistencies have been reported in continuous observation TMS, potentially reducing the validity of TMS’ data and limiting their contribution to the general state of knowledge.

Time. Ca. T Background Time Capture Tool We aim to standardize clinical workflow time motion studies by developing methods and tools that ensure their reproducibility.

Time. Ca. T Background Time Capture Tool n/r 16% Time Capture Tool Both 2% Electronic 40% Stopwatch+paper 42% Electronic Stopwatch+paper Both n/e

Time. Ca. T Time Capture Tool Methods

Time. Ca. T Background Time Capture Tool Comprehensive Dynamic Accessible Scalable

Time. Ca. T Background Time Capture Tool THE TIMECAT ROADMAP Aim: Identify critical areas requiring normalization and gain awareness of the state of the art in TMS. 1 Aim: Make a time capture tool available to TMS researchers, and use it as means of testing, distributing proposed methods, and collect user’s feedback. 2 Aim: Propose standards regarding human observers’ training, develop a realistic and appropriate inter-observer reliability assessment score, unify approaches for multitasking scenarios and capturing interruptions. 3 Aim: Facilitate results aggregation across sites, workflow comparisons and knowledge discovery by solving definitions inconsistencies. 4 5 Task 1 Task 2 Task 3 Aim: To move forward in the analysis of TMS produced data: from a simple average time on tasks, to a comprehensive quantitative workflow analysis driven by TMS data.

Time. Ca. T Background Time Capture Tool Validation Dissemination Methods Incorporation Push New Version Tool Development Methods Development Evaluation Collect Feedback and Analyze Data

Time. Ca. T Time Capture Tool v 3. 9 [BETA] Time. Ca. T Time Capture Tool

Time. Ca. T Tool Time Capture Tool notebook 5% Ultra Mobile PC 26% PDA 47% tablet pc 21%

Time. Ca. T Tool Time Capture Tool Cross-Platform (Device and Operative System agnostic)

Time. Ca. T Time Capture Tool Responsive and touch-enabled Tool

Time. Ca. T Tool Time Capture Tool Foundation The most advanced front-end framework in the world

Time. Ca. T Time Capture Tool

Time. Ca. T Time Capture Tool Data Capture 23

Time. Ca. T Methods Time Capture Tool Start Time Observation Task A Task B Task C Observer Subject End Time Task A Task B Task C

Time. Ca. T Methods Time Capture Tool 08: 16: 13 08: 15: 22 -Task B A 08: 16: 05 C Task A Task B Task C Notes: DELETE RENAME FIX TIME

Time. Ca. T Methods Time Capture Tool STOP 08: 16: 13 08: 17: 25 -Task -Other. B 08: 16: 05 -Task C Task A 08: 15: 22 -Task A Task B Task C Notes:

Time. Ca. T Methods Time Capture Tool 08: 16: 13 -Task B Task A 08: 16: 05 -Task C 08: 15: 22 -Task A Task B Task C Interruption Notes:

Time. Ca. T Methods Time Capture Tool 08: 17: 01 -Task C 08: 16: 13 -Task B Task A 08: 16: 05 -Task C 08: 15: 22 -Task A Task B Task C Notes:

Time. Ca. T Methods Time Capture Tool Current time Duration of Observation Duration Task A Notes: 08: 17: 01 -Task C Notes: 08: 16: 13 -Task B Notes: 08: 16: 05 -Task C Notes: 08: 15: 22 -Task A Task B Task C Notes:

Time. Ca. T Time Capture Tool Data Schemas 30

Time. Ca. T Methods Time Capture Tool Start Time Observation Task A Task B Task C Observer Subject End Time Task A Task B Task C

Time. Ca. T Methods Time Capture Tool Task 1 Task 2 Task 3 Task 4 Observer Subject Task 5

Time. Ca. T Methods Time Capture Tool Task A Start Time Task C Task D Task E Task F Task G Observation Task B Task H Task I Task J End Time

Time. Ca. T Methods Time Capture Tool Hallway Prepare Social Chat medication TMS 1 TMS 2 Travel room Nurse Chart station Patient TMS 3 TMS 4 TMS 5 Admin Log in system medication TMS 6 Explains Phone in/out procedure TMS… TMSn Po-Yin Yen, RN, Ph. D Research Assistant Professor Department of Biomedical Informatics COAUTHOR

Time. Ca. T Methods Time Capture Tool COMMUNICATION Explains procedure Phone in/out Social Chat TASK (hands on) LOCATIONS Prepare medication Chart Nurse station Travel Log in system Admin medication Hallway Patient room

Time. Ca. T Time Capture Tool Duration of Observation Location Task Communication Current time Notes:

Time. Ca. T Methods Time Capture Tool Start Time Social Explain Procedure Patient Room Prepare Med. Observation Phone-in Hallway Phone-in Social Prepares Medication Prepare Med. Explain Procedure Admin Medication Chart Admin Med. Social Hallway Nurse Station Chart Hallway Patient Room Nurse Station Communication Task Location End Time

Time. Ca. T Time Capture Tool Study Types 38

Time. Ca. T Time Capture Tool Study Types Time. Ca. T One dimension Time Capture Tool Linear (sequential) time Three dimensions Multitasking “n” dimensions Multi-Actor 39

Time. Ca. T Time Capture Tool Tasks Taxonomy 40

Time. Ca. T Time Capture Tool Open flexible task list Dimension 2 Dimension 1 Task A Task B Task C Task A Task D

Time. Ca. T Time Capture Tool Open flexible task list Name: Definition: Start milestone: Task A End milestone: TRAINING PUBLISHING

Time. Ca. T Time Capture Tool 4 Aim: Facilitate results aggregation across sites, workflow comparisons and knowledge discovery by solving definitions inconsistencies.

Time. Ca. T Time Capture Tool Time Engine 44

Time. Ca. T Time Capture Tool Task Name -> Duration Task Name -> Start Timestamp Task Name -> Duration 45

Time. Ca. T Time Capture Tool 1 2 3 Online Server 4 Unique Time Stamp Synchronized 5

Time. Ca. T Time Capture Tool UNIX Timestamp 1329497834 UNIX Epoch [00: 00 UTC on 1 January 1970]. 2012 -02 -17 T 16: 57: 14 Z ISO 8601 Friday, 17 th February 2012 11: 57 am 1329497834 11: 57: 10 am 1329793983 02: 12: 04 pm 793983 02 hours 14 min 02 sec

Time. Ca. T Time Capture Tool Main Hospital in L. A. => Pacific Time Small Clinic in L. A. => Pacific Time Main Hospital in Boston=> Eastern Time

Time. Ca. T Time Capture Tool Observation UNIX Timestamp Time. Ca. T Time Capture Tool Task A task_id observation_id im >T = d _i site Task A at 08: 20: 15 am local time in L. A. Client _id p k s ta stam d=> i e _ n m i o T vati r e obs Server ne o z e

Time. Ca. T Time Capture Tool

Time. Ca. T Time Capture Tool Training & Reliability 51

Time. Ca. T Time Capture Tool Real Observation Training Session Inter-Observer Reliability Assessment (I. O. R. A. )

Time. Ca. T Time Capture Tool Time Intervention Observer A Observer B Subject One Data X Data Y

Time. Ca. T Standardization Efforts: Inter-observer reliability Time Capture Tool Kappa Intra-Class Correlation Coefficient Bland Altman limits of agreement Pearson product-moment correlation Results

Time. Ca. T Time Capture Tool Standardization Efforts: Inter-observer reliability Results

Time. Ca. T Time Capture Tool Study Management 56

Time. Ca. T Time Capture Tool Healthcare describes a circadian and seasonal activity pattern Representativeness across the day and the week

Time. Ca. T Time Capture Tool Time. Ca. T Number of patients per day during March 2009 and March 2010 Time Capture Tool March 2009 Consuls per day March 2010 Consuls per day

Time. Ca. T Time Capture Tool Data Visualization & Reports 59

Time. Ca. T Results Time Capture Tool Time. Ca. T Principal Investigator Site 1 Site 2 Observer Subject

Time. Ca. T Time Capture Tool Tag 2, Tag 3 Tag 2, Tag 4 Tag 1, Tag 2 Free task name Testing Schedule

Time. Ca. T Time Capture Tool

Time. Ca. T Time Capture Tool

Time. Ca. T Time Capture Tool Roles and Privileges 64

Time. Ca. T Time Capture Tool Administrator Observer

Time. Ca. T Time Capture Tool Live Demo 66

Time. Ca. T Time Capture Tool Future Work 67

Time. Ca. T Time Capture Tool Inter Observer Reliability Assessment In-depth quantitative workflow analyses

Time. Ca. T Time Capture Tool Results http: //www. timecat. org

Time. Ca. T Acknowledgements Time Capture Tool CO-INVESTIGATOR Po-Yin Yen, RN, Ph. D Albert M. Lai, Ph. D Research Assistant Professor Department of Biomedical Informatics CO-INVESTIGATOR Peter J. Embi, MD, MS Associate Professor Vice-Chair Department of Biomedical Informatics PRINCIPAL INVESTIGATOR Philip R. O. Payne, Ph. D Associate Professor Chair Department of Biomedical Informatics Funding: Department of Biomedical Informatics

Time. Ca. T Time Capture Tool v 3. 9 [BETA] Time. Ca. T Time Capture Tool

Time. Ca. T Time Capture Tool Methods

Time. Ca. T Time Capture Tool