Root cause Time consuming Tedious Manual Symptom of

Root cause Time consuming Tedious Manual Symptom of bug

Today and Tomorrow + Visual Studio Intellitrace. TM Ask experts Trace in a debugger Check bug database Reproduce bug + Visual Studio Test Elements + Visual Studio Test Impact Analysis How else can we help diagnose failures? Check version history

Use large test suites to diagnose failures Use a previous, stable version of an application to diagnose failures Mines software repositories for information related to a bug

Where testing meets debugging > >

Automated/Manual Visual Studio unit tests Visual Studio Test Elements Statistical analysis Holmes path coverage Historical debugging

demo

announcing http: //research. microsoft. com/holmes

Automated/manual Visual Studio unit tests Visual Studio Test Elements

> > number of successful test cases in which p is covered number of failing test cases in which p is covered number of successful tests in which the context of p was covered number of failing tests in which the context of p was covered

>>FUTURE > http: //research. microsoft. com/holmes > > > >

> > Root cause

> > Old version New version > Root cause > >

New Old if (src[*i] == ESCAPE) { if (src[*i - 1] == ESCAPE) { escjunk = esc(src, i); junk = addsrt(escjunk, dest, j, maxset); } Failing test case Passing test case generated by Darwin

>>FUTURE > > > http: //research. microsoft. com/darwin

Has this or similar bug been looked at or fixed before? What do we know about this kind of bugs? Who should I ask for help? Where should I start looking?

The customer experiences some deadlocks on a server. The problem is random and may occur from several times a week to once a month. The system looks hung because the global resource 'Obp. Init. Kill. Mutant' is help by a thread which tries to close a file forever. So all the processes having a thread waiting on 'Obp. Init. Kill. Mutant' stop working fine. Drivers such as TCP/IP continue to respond normally but it's impossible to connect to any share. 0: kd> !thread 82807020 Child. EBP Ret. Addr Args to Child 80 c 7 a 028 00000000 ntkrnlmp!Iop. Acquire. File. Object. Lock+0 x 58 82 a 6 d 7 a 0 80 c 7 a 028 00120089 ntkrnlmp!Iop. Close. File+0 x 79 82 a 6 d 7 a 0 80 c 7 a 010 80 f 6 da 40 ntkrnlmp!Obp. Decrement. Handle. Count+0 x 112 00000324 7 ffdef 01 0000 ntkrnlmp!Nt. Close+0 x 170 00000324 7 ffdef 01 0000 ntkrnlmp!Ki. System. Service+0 xc 9 00000324 80159796 000000 c 9 ntkrnlmp!Zw. Close+0 xb 000000 c 9 e 185 f 648 0000 ntkrnlmp!Ob. Destroy. Handle. Procedure+0 xd 809 e 3008 801388 e 4 82 a 6 d 926 ntkrnlmp!Ex. Destroy. Handle. Table+0 x 48 00000001 82 a 6 d 7 a 0 7 ffde 000 ntkrnlmp!Ob. Kill. Process+0 x 44 00000001 82 a 6 d 7 a 0 82 a 6 d 7 f 0 ntkrnlmp!Psp. Exit. Process+0 x 54 0000 f 0941 f 04 0012 fa 70 ntkrnlmp!Psp. Exit. Thread+0 x 447 ffff 00002 a 60 ntkrnlmp!Nt. Terminate. Process+0 x 13 c ffff 00002 a 60 ntkrnlmp!Ki. System. Service+0 xc 9 00000000 NTDLL!Nt. Terminate. Process+0 xb REGISTERS: eax=00000005 ebx=e 3185488 ecx=0000083 c edx=e 2 dddc 68

Query engine Stack trace Code snippets Emails Version control Bug repository Debug logs Stack trace parser Register information parser

> > Unsolicited feedback 129 users, 628 queries Solicited feedback 20 bugs 25% 23% 75% 77% Useful Not useful

>>FUTURE > >

Code Visualization, UML, and DSLs Cameron Skinner Extending the Microsoft Visual Studio 2010 Gabriel Torok & Code Editor to Visualize Runtime Intelligence Bill Leach A Lap Around Microsoft Visual Studio and Cameron Skinner & Team Foundation Server 2010 Mario Rodriguez Microsoft Visual Studio Lab Management to the Build Setup Rescue Vinod Malhotra Tuesday 4: 30 PM Wednesday 4: 30 PM Thursday 10: 00 AM Scrum in the Enterprise and Process Customization with Microsoft Visual Studio Simon Bennett & Stuart 2010 Preston Thursday Advanced Diagnostics, Intelli. Trace™ and Test Automation Habib Heydarian Thursday Kapil Vaswani & Sandeep Karanth Power Tools for Debugging Thursday Automating "Done" in the Team Workflows with Microsoft Visual Studio Jamie Cool & Ultimate and Team Foundation Server 2010 Brian Randell Thursday 1: 45 PM 3: 00 PM

> > > > http: //research. microsoft. com/holmes http: //blogs. msdn. com/holmes Trishul Chilimbi, Ben Liblit, Krishna Mehra, Aditya Nori and Kapil Vaswani, ICSE 2009 Dawei Qi, Abhik Roychoudhury, Zengkai Liang and Kapil Vaswani, FSE 2009 B. Ashok, Joseph Joy, Hongkang Liang, Sriram Rajamani, Gopal Srinivasa, and Vipindeep Vangala, FSE 2009

YOUR FEEDBACK IS IMPORTANT TO US! Please fill out session evaluation forms online at Microsoft. PDC. com

> > channel 9. msdn. com/learn Built by Developers for Developers….

© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U. S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.