The Economic Payback of 3D Mice for CAD Design Engineers Research Findings
Abstract
Technology Assessment Group (TAG), an independent product consulting firm specializing in product evaluation and productivity measurement, conducted this research to assess the economic impact of 3D mouse use by CAD design engineers.
User interface research by GE, IBM, and the University of Toronto suggests that substantial productivity gains should result from using well-integrated 6-degree-of-freedom (6DoF) devices for complex 3D applications such as 3D CAD.
This resulting report incorporates market data and independent research to provide a framework in which companies can estimate their economic results.
Key Findings - More than 84% of CAD design engineers report a noticeable or significant improvement in their product designs and their ability to detect design problems as a result of using 3D mice. - The average productivity gain reported by CAD users while using 3D mice is 21%. - The payback period for 3D mice is very short, typically less than one month.
The Economic Payback - 1 - Technology Assessment Group of 3D Mice for CAD Design Engineers 2008 1. INTRODUCTION Delivering high-quality, defect-free products to the marketplace faster than the competition is central to any companys success. Both factorsquality and time to marketare critical. Companies can quickly riseand fallbased on their perform- ance. Examples of this abound in the business news. For instance: Automobile companies are racing to deliver next-generation fuel-efficient cars in response to changed customer economy requirements and government emissions regulations. - Reuters reports that as the race to bring a mass-market, rechargeable electric vehicle to the market heats up, GM executives have said the Volt is crucial to the largest U.S. automakers efforts to snag the environmental technology crown from Japanese rival Toyota Motor Corp. Cell phone companies are scrambling to deliver new offerings to lure customers. - Motorola, the category leader in 2006 with its hot Razr product, failed to deliver compelling encores and has slipped to third place in 2008. Airplane manufacturers are pushing to deliver new airplanes that will constitute a substantial percentage of their future revenues. Getting to market a few months faster than the compe- tition can make the difference between winning or losing billion-dollar orders. In the product development chain, one key element to delivering high-quality, defect-free products quickly to the market is the performance of CAD design engineers. If they can improve their product designs, catch problem areas earlier, and do all this in less time, they can contribute to improving their companies market performance. Fundamental user interface research by GE Research, IBM, the University of Toronto, and others has documented the performance improvements resulting from user interface devices that enable the CAD design engineer to navigate 3D objects intuitively and to work with both hands simultaneously. 3D mice are user interface devices that provide both intuitive navigation of 3D models and the ability to work with two hands simultaneously. CAD design engineers and companies who have adopted 3D mice for their product design work have reported impressive performance gains. But no careful quantitative research has been done to determine just how much difference these 3D mice make. And because 3D mice represent a company investment, its important to understand the economic results, which companies can use to assess the appropriateness for their organization. Technology Assessment Group (TAG) designed the following research to help answer these questions: A 14-question survey was created to collect responses from 190 existing 3D mice users. This survey was fielded by MarketLab, an independent market research group, in May 2008. The survey asked users about their experience with 3D mice with regard to: - Perceived improvements in product design and early defect detection - Productivity gains (how much faster they were in performing their work) - Length of time it took them to become comfortable and productive with 3D mice - Amount of time they spent using their 3D CAD applications This report presents the results from this research, as well as the underlying user interface research that explains the reasons for the results. The report then addresses these fundamental management questions: What is the economic payback of investing in 3D mice for CAD design engineers? How can we determine the economic payback for our company?
The Economic Payback - 2 - Technology Assessment Group of 3D Mice for CAD Design Engineers 2008 2. USERFINDINGS One hundred and ninety CAD design engineers who use 3Dconnexion 3D mice were surveyed in the U.S. They worked in companies with fewer than 10 CAD design engineers up to companies with more than 500 CAD design engineers. These design engineers most commonly used familiar 3D CAD applications such as CATIA, Inventor, NX, Pro/ENGINEER, and SolidWorks. They represent the full range of 3D mice experience, from less than three months to more than two years. Of these design engineers, 53% used their 3D mouse for less than one year, and 88% used it for less than two years, with the breakout as shown below.
Note that for the sake of brevity in this report, percentages are presented with no decimal part. As a result, presented percentages will sometimes vary 1% due to rounding.
2.1 JobCharacteristics CAD design engineers are different from casual computer users in that they use job-specific CAD applications many hours a day to perform their work functions. Accordingly, 74% reported that they spend at least three hours a day using their CAD applications. Fully 41% spend at least seven hours a day. The following diagrams show the distribution of usage by group and cumulatively.
2.2 CADApplicationsand3DMice As stated earlier, corporate and academic research has shown that two key 3D mouse factors signifi- cantly improve the performance of people using intensive 3D applications: 6DoF devices for quickly orienting 3D objects or views Devices that enable working with both hands simultaneously (for example, a 3D mouse in one hand and a traditional 2D mouse in the other hand) The survey wanted to determine whether 3D mouse users experienced these two factors in their work and whether they thought these factors enabled them to produce higher-quality designs, detect errors better, and create designs faster. Of these users, 83% reported (on a five-point scale) that the 3D mouses 6DoF navigation was very useful or extremely useful, and nearly half (49%) found it extremely useful. Virtually all users (95%) found this feature useful or better. The detailed response percentages are shown below.
The Economic Payback - 3 - Technology Assessment Group of 3D Mice for CAD Design Engineers 2008
Concerning working simultaneously with both hands, 75% found the 3D mouses enabling of two-handedness very useful or extremely useful, and again, nearly half (49%) found it extremely useful. Virtually all (93%) found this feature useful or better. The detailed response percentages are shown below.
How then did these factors affect the product design process? The Introduction described high- quality, defect-free products as being key to a companys success; can 3D mice actually improve design quality and reduce errors? According to the surveyed users, a 3D mouse enabled them to much more easily rotate, inspect, and explore their designs. As a result: 85% saw a noticeable or significant improvement in their product designs 84% thought that they could noticeably or significantly improve their detection of errors
These are very high percentages, indicating that companies adopting 3D mice for their CAD design engineers should confidently expect similar results. And what about design speedthe time it takes design engineers to create their design? Are they faster (more productive) using a 3D mouse? Improving CAD designer productivity will directly contribute to faster time to market, which can have an enormous impact on a products success in the marketplace. CAD designers reported that they were, on average, 21% more productive using 3D mouse than they were without a 3D mouse. More than 86% of the users reported productivity increases, ranging from under 10% to over 50%. The following chart details the responses.
What about the learning curve for using 3D mice? If it takes three months to become comfortable with a 3D mouse and another three months to become productive, are these productivity gains worth the learning curve? In order for users to embrace a new way of work- ing, its critical that they can quickly become comfortable with the new style. If they find the new approach awkward or cumbersome, theyll abandon it, even if it might pay dividends down- stream.
The Economic Payback - 4 - Technology Assessment Group of 3D Mice for CAD Design Engineers 2008 With 3D mice, more than half the users (58%) were comfortable within the first four hours, and the vast majority (80%) were comfortable within two days.
Next, how long does it take for users of 3D mice to feel not only comfortable but proficient? According to the survey, 3D mouse users move quickly from feeling comfortable to feeling proficient: 66% felt proficient within the first week, and 78% within two weeks.
How quickly does a 3D mouse user become more productive? This is the ultimate goal of any changed work style. Users reported that nearly half (45%) were more productive within two days, and 68% were more productive within the first week of using a 3D mouse.
3. UNDERLYINGUSERINTERFACERESEARCH It is important to understand the fundamental user interface concepts that underlie these productivity improvements. This provides an understanding both for CAD design engineers who experience these improvements as well as non-CAD professionals who might wonder why 3D mice would make such a difference. This section first explains how a CAD design engineers computer use varies from casual computer user. It then addresses the unique user interface demands presented by 3D CAD applications. The user interface bandwidth concept is introduced along with two major UI bandwidth accelerators. References for the research cited in this section can be found in the References section at the end of this report.
3.1 CADDesignEngineersvs.CasualComputer Users CAD design engineers commonly: Work at a core job function that depends heavily on job-specific, complex CAD applications - The most frequently used 3D CAD applications are CATIA, Inventor, NX, Pro/ENGINEER, and SolidWorks. Often spend more than half of their day using their CAD applications Require very high-performance computers in order to increase job productivity Spend between 1000 and 50,000 on application software More than one million 3D CAD users worldwide share this profile. In contrast, casual computer users: Work at a core job function that may involve using general-purpose applications (e-mail, Web access, word processing, spreadsheet, and so on) but that typically does not depend on job-specific applications Spend, on average, less than half of their day on a computer Have less need for high-performance com- puters Spend less than 1000 on application software
The Economic Payback - 5 - Technology Assessment Group of 3D Mice for CAD Design Engineers 2008
The table below summarizes the core differences between these two classes of computer users. 3D CAD User Casual User Applications Complex, jobspecific General- purpose Computer Use 48 hours/day 04 hours/day Computer Performance High performance Medium performance Application Purchases 1000 50,000 < 1000
These differences provide a context for examining the characteristics of 3D CAD applications and their unique user interface challenges.
3.2 Characteristicsof3DCADApplications 3D CAD users have substantially more demanding computer working styles than casual users. Their job-specific applications typically require them to work in the following unique ways: More frequent navigation of the work (models, views) More complex (degrees-of-freedom) navigation (panning, zooming and rotating much more common) Dramatically more commands/minute and navigations/minute than a casual computer user Much greater number of frequently used commands To illustrate, imagine a casual user reading e-mail, the most frequently used application. The user would start reading an e-mail message and perhaps scroll down vertically to finish reading it. Then they might reply or forward the message, and then select the next email to read. In this typical scenario: The navigation (vertical scrolling) is typically limited to one degree-of-freedom (1DoF), as is the selection of the next e-mail message to read. The number of commands actually used is fairly limited. The user input bandwidth requirement is quite low, for both navigation and commands. If you were to watch this users hands from above, the pace would be measured and slow. In contrast, the 3D CAD users hands appear like those of a concert pianist racing through a fast passage, the right hand rapidly moving the mouse and mouse wheel while the left hand repeatedly selects keys (often Ctrl, Shift, Alt, and Esc) on the keyboard. Based on observation of and interviews with 3D CAD users, TAG estimates that 3D CAD users issue 5 to 10 times more navigations/minute and commands/minute than casual users. This demand to push a large number of navigations and commands per minute is the core requirement of high-bandwidth user interfaces, as discussed in the next section.
3.3 UserInterfaceBandwidth 3D CAD applications performance can be throttled by three distinct bandwidth channels: Computer bandwidth Graphics bandwidth User Interface bandwidth To illustrate, lets take the example of a mechanical engineer designing a new faucet using 3D CAD software such as Pro/ENGINEER or SolidWorks. The computation bottleneck is the ability of the software/computer to keep a 3D model up- to-date. As products become more complex, the computation requirements increase rapidly. The display bottleneck is the ability of the software/graphics card to render the 3D model accurately in real time. The user interface bottleneck is the ability of the user to directly move the object to the desired position and then issue various com- mands, with the least number of interruptions and context shifts, in the shortest amount of time. Whereas computer bandwidth and graphics band- width have increased at a Moores Law pace, 3D CAD user interfaces have not kept up. As a result, user interface bandwidth has emerged as one of the
The Economic Payback - 6 - Technology Assessment Group of 3D Mice for CAD Design Engineers 2008 principal bandwidth throttles for 3D CAD applications today. A conceptual framework developed by academic researchers provides a useful visual representation for understanding user interface bandwidth. Navigation Command Time Navigation Command Command Switch Time Switch Time Switch Time Left Hand Right Hand
User Interface Bandwidth Framework (Source: Buxton, W., Billinghurst, M., Guiard, Y., Sellen, A., and Zhai, S. 2002) This framework illustrates that user interfaces (today and in the near future) are driven by the activity of the right and left hands, generating both navigation and commands. User interface bandwidth is simply the time it takes to execute a series of navigations and commands to perform a particular application function. 3.4 InputStreams The first user interface bandwidth limitation in 3D CAD applications has to do with input streams. As just discussed, all user input is driven through the right and left hands; in reality, however, the left hand is typically doing very little except periodic- ally invoking a mode key press (for example, Ctrl, Shift, or Alt). From the user interface band- width framework shown below, we see that the right hand (assuming a right-handed user) is doing almost all the work, essentially constituting a single input stream. Navigation Command Time Navigation Command Command Switch Time Switch Time Switch Time Left Hand Right Hand
Single-Stream User Input As summarized aptly in Zhai, Smith, and Selker (1997): One basic feature of the existing mainstream user interfaces is that the user communicates with the computer system via a single stream of spatial input, physically driven by a 2 degree of freedom input device, typically a mouse, and graphically displayed as a cursor. The universal cursor travels around the entire interface, switching its functions from pointing, to selection, to drawing, to scrolling, to opening and to jumping, according to what virtual devices (widgets), such as the main document/window, a menu, a scrolling bar, an icon or a hyperlink, has been acquired and engaged. Such a single stream operation, needless to say, has offered the users many advantages such as the ease of understanding and learning the interaction mechanism. The disadvantage, however, is the limited communication bandwidth (Buxton 1986) and the costs in time and cognitive effort of acquiring widgets and control points (Buxton and Myers 1986, Leganchuk, Zhai and Buxton 1996). In observing both 3D CAD and casual computer users, TAG estimates that the 3D CAD user issues 5 to 10 times more navigations/minute and commands/minute than the casual user. When these have to proceed largely through a single stream (albeit with some use of the keyboard for buttons or modifiers), the bandwidth is severely restricted. The first opportunity for improving user interface bandwidth is thus to increase the number of streams through which the user can drive the application.
3.5 Navigation The second user interface bandwidth limitation is navigation. Navigation involves getting to the place of interest to perform a task. This could be scrolling to read an e-mail message, panning to a location in Photoshop, or rotating a model to view the back side of a part in CATIA. Although navigation is a frequent activity in most applications, the nature of the navigation varies dramatically depending on the application type. The following table provides a description of common navigation operations, together with the number of degrees of freedom (DoF) they require and some example applications.
The Economic Payback - 7 - Technology Assessment Group of 3D Mice for CAD Design Engineers 2008
# DoF Description Common Applications Scrolling (Vertical) 1 Moving a document up/down E-mail, Web, Word Scrolling (Horizontal) 1 Moving a document left/right Excel Panning 2 Moving a drawing simultaneously horizontally and vertically AutoCAD, Photoshop Zooming 1 Moving a document/model in or out AutoCAD, Photoshop Rotating 3 Moving a model simultaneously around any of three rotational axes 3ds Max, CATIA, Pro/ENGINEER, Maya, SolidWorks DoF Requirements for Different Types of Navigation
These DoF numbers are additive. For example, to pan and zoom you need 2 (pan) + 1 (zoom) = 3DoF. To pan, zoom, and rotate you need 2 (pan) + 1 (zoom) + 3 (rotate around three axes) = 6DoF. Different applications vary dramatically in their use of these various types of navigations, as shown in the following table. A p p l i c a t i o n
S c r o l l i n g
( V e r t i c a l )
S c r o l l i n g
( H o r i z o n t a l )
P a n n i n g
Z o o m i n g
R o t a t i n g
E-mail ***** Word ***** * * Excel **** *** ** Photoshop * * *** **** CATIA and 3D CAD applications *** ***** ***** Navigation Frequency by Application (* = low; ***** = high) The salient fact is that most 3D CAD applications frequently navigate using pan and zoom (3DoF) or pan, zoom, and rotate (6DoF). Accordingly, this presents another important user interface band- width opportunity.
BeingintheFlow Before turning to research regarding high- bandwidth opportunities, its worth noting that the three bandwidth limitations break an inherently creative process called being in the flow. Being in the flow is a term used by artists, athletes and designers to describe activities where they are fully engaged and in control. Another phrase used to describe this state is being in the zone. All of these activities involve substantial concentration and outlay of mental and/or physical energy. For 3D CAD computer users working with complex and cognitively demanding applications, being in the flow translates to higher quality and faster performance. Often, however, theyre distracted from their flow by user interfaces that siphon off cognitive bandwidth and require the user to slow down in order to drive tedious aspects of the user interface (Bederson 2002). Significantly, one of the most common interrup- tions to being in the flow is a low-bandwidth user interface in which users cannot engage in their tasks as quickly as they can think. In contrast, high-bandwidth user interfaces allow 3D CAD users to stay in the flow; well turn now to these bandwidth opportunities.
3.6 HighBandwidthUserInterfaceOpportunities In the previous section, two significant user interface throttles were identified: Limited input streams Limited navigation For both of these throttles, research provides approaches that can significantly increase the bandwidth.
HigherBandwidthInputStreams We introduced the problem of the single stream of input when we observed that 3D CAD users are trying to push 5 to 10 times more commands per minute than a casual user. Whereas a casual user might not be as greatly affected by having a single stream, the 3D CAD user has much higher band- width requirements.
The Economic Payback - 8 - Technology Assessment Group of 3D Mice for CAD Design Engineers 2008 One very promising user interface approach takes advantage of humans ability to use both hands simultaneously in a cooperative fashion. As noted in Buxton (2002): A student turns a page of a book while taking notes. A driver changes gears while steering a car. A recording engineer fades out the drums while bringing in the strings. By equipping both hands with tools to drive the application (typically a 3D mouse in the left hand and a standard 2D mouse in the right hand), substantial bandwidth increases can be achieved. First, lets look again at how single-stream interfaces work today. Navigation Command Time Navigation Command Command Switch Time Switch Time Switch Time Left Hand Right Hand
Single-Stream User Input Note that the user incurs a switching time by going from one mode to another. The near-universal example of this is navigation and selection. The right hand first navigates to the point of interest, say on a model, using the mouse. Then the user switches modes, whereby the mouse now becomes a selection tool to issue a command. This process repeats itself endlessly. Also observe the lack of parallelism: the user is either navigating or selecting at one time, but not both. A bimanual stream would change the activity profile as illustrated below. Navigation Command Time Navigation Command Command Left Hand Right Hand
Bi-manual Input Streams Because each hand has a tool to perform tasks, the user doesnt need to switch the right hand from a navigation mode to command mode and back again. Removing the unnecessary switches essentially reduces the bandwidth requirement. In addition, the human physiology allows for parallel activities that can be synchronized with each other, providing additional bandwidth headroom. This parallelism is depicted in the preceding illustration by the partial overlap of navigation and commands: the user can start the command with the right hand while the left hand is completing the navigation. The resulting comparison of unimanual and bimanual performance is shown below. Navigation Command Time Navigation Command Command Left Hand Right Hand Navigation Command Time Navigation Command Command Switch Time Switch Time Switch Time Left Hand Right Hand Bandwidth Increase
Unimanual (top) vs. Bimanual (bottom) Bandwidth The conceptual framework illustrated above was validated in a study conducted by IBM (Zhai 1997), in which they found that a bimanual inter- face (in this case, a joystick in the nondominant hand and a mouse in the dominant hand) was 1.36 times faster than using the mouse alone, in tasks involving navigation and selection. Bi-Manual vs. Uni-Manual Performance 72 69 53 51 Test 1 Test 2 One Handed Two Handed
Unimanual vs. Bimanual Performance (Source: IBMZhai 1997) Furthermore, in a study conducted at the Univer- sity of Toronto (1997), as the tasks became more cognitively demanding (larger, more complex models) two-handed interfaces produced an even more significant performance gain than the Zhai research.
The Economic Payback - 9 - Technology Assessment Group of 3D Mice for CAD Design Engineers 2008 HigherBandwidthNavigation As described earlier, navigation in 3D CAD applications as compared to more traditional 2D applications is much more frequent and requires more DoFs for efficient performance. The following diagram shows how many simul- taneous DoFs are required by various types of navigation, from no rotation (scrolling) to pan and zoom and finally to pan, zoom, and rotate. P a n
&
Z o o m High Low High Low Rotation 6DoF 1DoF 3DoF
Application Navigation and DoF 3D CAD applications typically fall squarely in the 6DoF quadrant, as shown in the following diagram. P a n
&
Z o o m High Low High Low Rotation 3D CAD Animation 3D GIS Graphics Arts EDA 2D CAD Email Web WP Spreadsheets
Navigation by Application Type This introduces the potential for devices that offer more simultaneous DoFsup to 6DoF to address applications with high zoom and pan and high rotation, which are typically 3D applications. The following table lists common input devices and their characteristics, notably the number of simultaneous DoFs. D e v i c e
T y p e
S i m u l t a n e o u s
D o F s
R a t e
o r
P o s i t i o n a l
E x a m p l e
Two-button mouse 2 Positional Classic mouse Wheel mouse 2+1 Positional Microsoft IntelliMouse Graphics tablet 2+1+1+1 Positional Wacom Intuos Joystick 2+1 Rate Logitech Wingman 3D motion controller 6 Rate 3Dconnexion SpaceBall Device Types and Characteristics The conventional mouse offers 2DoF, being able to move along the plane of a desk. The mouse wheel separately offers 1DoF (typically for scrolling in text-based applications, and for zooming in 3D applications). Users typically do not move the mouse and spin the wheel at the same time, so a wheel mouse can be described as a 2+1DoF device. A 6DoF device allows the user to move in one fluid movement to zoom, pan, and rotate the object to any orientation. In contrast, the wheel mouses 2+1DoF intrinsic capabilities require a modal DoF mapping to achieve 6DoF navigation, typically involving pressing an additional key. A common approach is as follows: Mode A (Ctrl key depressed) + mouse movement pans the model Mode B (Alt key depressed) + mouse movement rotates the model Mode C (no keys depressed) + mouse wheel zooms the model Using the UI bandwidth framework, the following comparison shows the increased bandwidth resulting from using a 6DoF device for 3D navigation.
The Economic Payback - 10 - Technology Assessment Group of 3D Mice for CAD Design Engineers 2008 6DoF Navigation Time Left Hand Right Hand Pan Time Left Hand Right Hand Bandwidth Increase Zoom Rotate Pan Mode Switch Time Mode Switch Time Reset Mouse
Mouse (top) vs. 6DoF device (bottom) 3D Navigation One of the most common activities in 3D CAD applications is the frequent precise movement of a model from one orientation to another. In a GE study of seven users (Salazar and Marteau, 2004), users had to move from one of eight possible starting points to reach a precise (+/1) target 3D orientation, using a classic mouse and a 6DoF device. In the GE study, users could achieve the target 3D orientation almost twice as fast with a 6DoF device (in this case, a 3Dconnnexion 3D mouse) as compared to a standard 2D mouse, as noted in following graph. 3D Navigation Performance 12.0 22.5 18.0 14.0 12.5 13.0 12.0 6.0 10.0 9.5 7.0 8.0 8.0 6.5 #1 #2 #3 #4 #5 #6 #7 Subject Mouse 6DoF Device
3D Navigation Performance: Standard Mouse vs. 6DoF Device (Source: Salazar and Marteau 2004) When using the standard mouse, users took 89% longer to perform the required 3D orientation. Moreover, all users were substantially faster when using the 6DoF device, ranging from 1.56 to 2.25 times faster, suggesting that the results would apply broadly to all users.
Ratevs.PositionalDevicesforNavigation Another point worth noting is the distinction between rate devices and positional devices, and their respective strengths for navigation. The earlier table showing device types and character- istics indicates which devices are rate vs. positional. According to Zhai (1997): As shown in recent six degree of freedom input control studies (Zhai and Milgram 1993, Zhai, Milgram and Drascic 1993, Zhai 1995), position control is better conducted with isotonic, free moving devices, such as the mouse; and rate control is better conducted with isometric or elastic devices. The key factor to this compatibility issue is the self-centering effect in isometric or elastic devices. With self centering, rate control can be easily done. Without it, rate control requires conscious effort. Either position control or rate control can give users the ability to control all aspects of movement, including displacement, movement speed or higher order derivatives, but each mode corresponds to only one aspect directly: displacement or speed. A rate control technique that is compatible with isometric devices can be particularly suitable for navigation tasks where you need very precise movement and also very large movements (e.g. scrolling long documents, rotating a model, moving a camera) as no repetitive release-reengage problem exists as in the case of a mouse.
3.7 UserInterfaceResearchConclusions 3D CAD computer users require much a higher user interface bandwidth in order to stay in the flow of their work and perform at their optimum level. 3D CAD users issue 5 to 10 times more naviga- tions/minute and commands/minute than casual users. 6DoF navigations are common, further taxing user interface bandwidth. These points, coupled with the high percentage of time that 3D CAD users spend using their CAD applications, present significant opportunities for improving productivity by increasing user interface bandwidth.
The Economic Payback - 11 - Technology Assessment Group of 3D Mice for CAD Design Engineers 2008 Two user interface approaches present substantial potential for improving productivity: Bimanual interfaces, using a mouse in the dominant hand and a rate device in the nondominant hand (1.36 times fasterIBM research) A 6DoF device for the nondominant hand, particularly in 3D applications (1.89 times fasterGE research) Moreover, these approaches should have an additive impact, further increasing the user interface bandwidth for 3D CAD users. The survey of 3D mice CAD users and the time- measured test designed by a senior CATIA application engineer indicate that significant productivity gains can be realized by 3D CAD design engineers. Fundamental user interface research further explains the reasons for such gains. The productivity increases reported by CAD design engineers and the productivity time measurements of CATIA users are concrete manifestations of this underlying research. Given these impressive productivity increases, its now time to address the larger economic question: what is the economic payback of equipping CAD design engineers with 3D mice?
4. ECONOMICPAYBACKOF3DMICE Its difficult to precisely quantify the impacts of higher product quality, fewer defects, and faster time to market. But with the research results presented here, the economic return from a design engineers productivity gains can be calculated. Its paramount, however, to recognize that product quality, fewer defects, and faster time to market represent a much larger financial impact than simply the cost savings from having a more productive CAD design engineer. As Gavin Finn writes in Quality Digest: Very real costs are associated with inattention to design quality. If errors or omissions in the design data are not addressed early, more costly changes are required later in the product development process. This is depicted in Finns early detection diagram, below.
Thus, if an economic return can be demonstrated on the design engineers productivity gains alone, its reasonable to assume a much higher payback overall. Three principal factors will drive the ROI of investing in 3D mice for CAD design engineers: Cost of the 3D mouse Loaded salary of the CAD design engineer Productivity gains as a result of 3D mouse use Companies use two common metrics to evaluate such investments: payback period and annual ROI. Further metrics (NPV, IRR, and so on) will not be discussed in this report but could be easily derived from this data.
4.1 PaybackPeriodandROI The payback period determines how quickly the investment cost will be fully recovered. The calculation is as follows: PaybackPeriodinYears= 3DMouseCost/(AnnualCADDesignEngineer LoadedSalary*ProductivityGain) As shown in the following illustration, this calculation can be depicted visually in a payback calculator, in which the user can adjust the three sliders: CAD Design Engineer Loaded Salary 3D Mouse Cost Productivity Gain
The Economic Payback - 12 - Technology Assessment Group of 3D Mice for CAD Design Engineers 2008 The payback calculator would then compute and display the resulting payback period in months.
The ROI calculation measures the ongoing return on an investmenttypically on an annualized basis, which gives a more comprehensive financial evaluation. This calculation is: Annual ROI = (Annual CAD Design Engineer Loaded-Salary *Productivity Gain) 3D Mouse Cost ) / 3D Mouse Cost Two of these variables are reasonably straight- forward: the 3D mouse cost and the CAD design engineers loaded salary. The critical variable productivity gainis derived from the survey of 3D mouse users. These constitute the inputs into determining expected economic returns on investment in 3D mice for CAD design engineers.
4.2 3DMiceCosts 3Dconnexions professional 3D mice range from 69 to 275 in price. Many companies select the higher-end professional devices, SpaceExplorer (199) or SpacePilot (275), due to their richer feature set. For the purpose of this analysis, well use the 275 cost of the SpacePilot.
4.3 CADDesignEngineerSalariesandCosts Several websites summarize salaries for various job titles. ITJobsWatch reports the average salary for a CAD design engineer in 2008 as 37,500.
This will of course vary by all the usual factors, including years of experience, location, and industry. In general, 3D CAD design engineers will make more than 2D CAD design engineers. Employee benefits (vacation, health insurance, and so on) are estimated conservatively at 25% of base salary, resulting in an average benefit-loaded cost of 46,875 per CAD design engineer. Fully loaded costs (space, equipment, and so on) add another substantial cost multiple. In the absence of solid data, this factor will be ignored in the analysis.
4.4 3DMiceProductivityGains The productivity gains from using 3D mice are calculated by taking the average productivity gain reported in the survey and multiplying it by the average percentage of the day that design engineers spend using their 3D CAD applications. The average productivity gain reported by the 190 3D mouse users was 21%. The average time per day users reported that they used their CAD appli- cations was five hours; a conservative estimate of 50% of their day will be used. Multiplying these two figures together, we get an average productivity gain of 10.5%. Now, using the earlier payback period formula of PaybackPeriodinYears= 3DMouseCost/(AnnualCADDesignEngineer LoadedSalary*ProductivityGain)
we get the following calculation:
275/(46,875*10.5%)=.056years(20days) This means that an investment in a 3D mouse will, on average, pay for itself in less than one month.
The Economic Payback - 13 - Technology Assessment Group of 3D Mice for CAD Design Engineers 2008 By adjusting the three payback calculator sliders to these figures, we see the resulting 20-day (= 0.65 month) calculation.
5. CONCLUSIONS This report purported to evaluate the anecdotal claims that 3D mice can significantly improve CAD design engineer productivity. It further sought to evaluate the user interface research that also suggested impressive productivity gains. Based on a survey of 190 3D mice users, it appears that in fact substantial gains of more than 20% are being experienced by CAD design engineers while using 3D mice with their CAD applications. These users further corroborated the underlying user interface research observations that 6DoF navigation and simultaneous two-handedness were the key factors leading to their improvements. Finally, it was shown that an investment in 3D mice can have an unusually fast paybackless than a monthleading to the conclusion that companies would be well advised to proactively consider adopting 3D mice for their CAD design engineers.
The Economic Payback - 14 - Technology Assessment Group of 3D Mice for CAD Design Engineers 2008 6. REFERENCES Bederson, B.B. (2002) Interfaces for Staying in the Flow, Human-Computer Interaction Lab, University of Maryland. Buxton, W., Billinghurst, M., Guiard, Y., Sellen, A., and Zhai, S. (2002). Human Input to Computer Systems: Theories, Techniques and Technology. Buxton, W. (1986) Theres more to interaction than meets the eye: some issues in manual input. User Centered System Design, Lawrence Erlbaum Associ- ates, Norman, D.A. and Draper, S.W. (Eds.), 3 19337. Buxton, W. and Myers, B. (1986) A study of two- handed input. Proceedings of CHI 86: ACM Conference on Human Factors in Computing Systems, 321326. Callahan, J., Hopkins, D., Wiser, M., and Shneiderman, B. (1988) An Empirical Comparison of Pie vs. Linear Menus, Computer Science Department, University of Maryland. Fitts, P. (1954) The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 46, 199210. Guiard, Y. (1987) Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of Motor Behavior, 19(4) 486517. ISUR Project: Industry Usability Report (1999) NIST White Paper. Kabbash, P., Buxton, W., and Sellen, A. (1994) Two- handed input in a compound task. Proceedings of CHI 94: ACM Conference on Human Factors in Computing Systems, 417423. Leganchuk, A., Zhai, S., and Buxton, W. (1996) Manual and cognitive factors in two-handed input: an experi- mental study. Submitted for publication. MacKenzie, I.S., Sellen, A., and Buxton, W. (1991) A comparison of input devices in elemental pointing and dragging tasks (1991). Proceedings of CHI 91: ACM Conference on Human Factors in Computing Systems, New Orleans, Louisiana, 161166. Nielsen, J. (1994) Usability Engineering. Poulton, E.C. (1974) Tracking skill and manual control. New York, Academic Press. Rutledge. J. and Selker, T. (1990) Force-to-motion function for pointing. Proceedings of INTERACT 90: The IFIP Conference on Human Computer Interaction, 701705. Salazar, P. and Marteau, J-M. (2004) Designing a 3D Input Device for Interventional Radiology GE Health- care, Global Industrial Design Department. Smith, D.C., Irby, C., Kimball, R., Verplank, W., and Harslem, E. (1982) Designing the Star user interface. Byte, 7(4), 242282. Venolia, D. (1993) Facile 3D direct manipulation. Proceedings of INTERCHI 93: ACM Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands, 3 136. Zhai, S. (1995) Human Performance in Six Degree of Freedom Input Control, Ph.D. Thesis, University of Toronto. http://etclab.mie.utoronto.edu/people/shumin _dir/publications.html. Zhai, S. and Milgram, P. (1993) Human performance in evaluation of manipulation schemes in virtual environments. Proceedings of VRAIS 93: IEEE Virtual Reality Annual International Symposium, Seattle, Washington, 155161. Zhai, S., Milgram, P, and Drascic, D. (1993) An evaluation of four 6 degree-of-freedom input tech- niques. Adjunct Proceedings of INTERCHI 93: The IFIP Conference on Human-Computer Interaction, Amsterdam, The Netherlands, 155161. Zhai, S., Smith, B., and Selker, T. (1997) Improving Browsing Performance: A Study of Four Input Devices for Scrolling and Pointing Tasks. Proceedings of INTERACT 97.