Wdk driver Test Manager Outline hct and the history of driver testing

WDK Driver Test Manager

Outline

• HCT and the history of driver testing

• Problems to solve

• Goals of the WDK Driver Test Manager (DTM)

• Automated Deployment Tools

• Packager

• Changes to the Windows Logo Program

The HCT Today

• Hardware Compatibility Test (HCT)

• Can only run logo tests provided by Microsoft
• Used for DFW/logo program
• Content
• ~1600 Test Cases (400+ binaries)
• Test Manager (shell)
• Logo Docs and Test Specs

• Testing for Driver quality

• Some partners develop their own tests and infrastructure
• Some partners use only the logo tests for quality testing

What You Told Us

• HCT is not scalable

• Adding new technologies is problematic
• Can’t run non-logo tests
• Can’t run on more than one machine
• Can’t run partner tests

• Partners must maintain Logo-only infrastructure

• Dedicated hardware
• Dedicated headcount

Goals of Driver Test Manager (DTM)

• Improve the end user Windows experience

• Reduce blue-screens
• Increase performance
• Improve driver quality

• Improve the partner experience

• Provide MS quality tests
• Allow partner tests
• Provide infrastructure to push testing earlier in development cycle
• Reduce submission complexity

Key Concepts

• Test Management

• Studio
• Device Selection and Scheduling
• Controller
• Jobs database
• Client
• Packager
• Collaboration tool
• Tests and content delivery
• Automated Software Installer (ASI)

DTM Scenario

Driver Test Manager (DTM)

• Jobs

• A collection of 1 or more tasks
• Tasks are executables, like “LogoTest.exe”
• Task dependencies can be created
• Setup, Regular, Cleanup
• Created, edited and scheduled in Studio
• Sharable
• Constrainable
• Dimensions
• Parameters

Driver Test Manager (DTM)

• Scheduler

• Matches constraints and test machines (clients)
• Manages job distribution to Machine pool

• Job Monitor

• Presents status of machines in machine pool (clients)
• Presents status of jobs in scheduler
• Presents status of tasks in jobs

• Results Explorer

• Results roll-up view
• Results collection
• Log viewer

• Device Selection

• Provides for “Device Based Job Selection” paradigm
• Adds HCT functionality to the DTM
• Necessary for Logo Programs

Automated Deployment Tools

• Ximage and ASI

Ximage and ASI

• Ximage

• A command line interface to the imaging technology used by Windows codenamed “Longhorn” setup
• Will create file based image and restore it

• Automated Software Installer (ASI)

• Automate the install of any Windows OS
• From disk images
• From Windows CDs
• Optimized for testing environments

• Benefits

• Increased productivity
• Eliminate multi-boot and disk-swapping scenarios
• Manage images and builds for the entire organization in one location

Ximage

• System Imaging Tool

Ximage Architecture

Automated Software Installer

• Windows Deployment Tool

ASI Functionality

ASI Client Configuration

Using ASI in the Driver Test Manager

ASI Server Deployment

Ximage and ASI: Which One Should I Use?

• Ximage

• A disk imaging tool

• Use if you want to restore a test system to exactly the same state multiple times

• Use if the bits don’t change regularly

What About Ghost?

• The DTM will automate any tool with a command line interface

• Virtually everyone is using Ghost images in their testing

• Keep using your existing images

• Consider moving to Ximage and ASI over time

• Realize the benefits of tools optimized for a test environment

• Ximage and ASI are included in the WDK

• Some jobs Microsoft provides may require these tools

Packager

Packager Architecture

Benefits of Packager

• Move jobs or test data between controllers

• Share jobs with another organization

• Share test results with other organizations

• Make a logo submission

• Simplified reproduction of failures

• Update mechanism for the WDK

Packager Functionality

Packager Scenarios

Scenario Create Logo Package

Scenario Investigate a Failure

Scenario Export Tests

Scenario Package logs and results

Windows XP and Windows Server 2003 Logo Program Support

Windows XP and Windows Server 2003 Logo Program Support

• Program simplification

• Reduce the number of HCT tests to about 30
• One “kit” for all Windows XP and Windows Server 2003 devices
• One “kit” for all Windows XP and Windows Server 2003 systems, excluding datacenter and cluster

• Windows XP and Windows Server 2003 kits will be in the DTM

• HCT and DCT will reach end-of-life when the DTM ships

Call To Action

• Start preparing for the WDK now

• Sign up for the WDK Beta and actively participate

• Visit the Windows Driver Kit Page – http://www.microsoft.com/whdc/driver/wdk/default.mspx

• Engage with the WDK Team - provide feedback through Microsoft aliases

Additional Resources

• Web Resources:

• Windows Driver and Hardware Central – http://www.microsoft.com/whdc/default.mspx
• Windows Driver Kit Page – http://www.microsoft.com/whdc/driver/wdk/default.mspx

• Email: WDKFB @ microsoft.com for feedback and questions on the WDK