Software Metrics "State of the Art"
Do you know the most effective measurements and metrics for software organizations such as yours? How do the metrics which your organization uses compare to your peers? We are conducting a study on measurements usage by software organizations. Your participation will take only a few minutes, and will entitle you to receive the results of the study - BEFORE they are published. Please take a moment to complete the following brief survey, and e-mail it back to me directly at pkulik@klci.com (do not post replies in this newsgroup). I will e-mail you the study results as soon as our report is complete. Thank you in advance. Peter Kulik KLCI, Inc. pkulik@klci.com http://www.klci.com/accelerate FAX 937-291-1944 (Note: your return e-mail address will not be sold, or subjected to spam as a result of your participation!) ----- 1. How important are measurements/metrics to your software development activities (please mark the appropriate line)? __ 0 - take no measurements __ 1 - minimal or no importance __ 2 __ 3 - average importance; one of several factors __ 4 __ 5 - extremely important; an integral part of development Comments (optional): 2. Which of the following quality measurements/metrics do you currently use (please mark all that apply)? __ Fault density (errors per lines of code or function pnts) __ Test coverage % __ Mean time to failure __ Fault arrival rate __ System operational availability __ Fault severity distribution __ Cumulative failure profile __ Other - Explain: 3. Which of the following other measurements/metrics do you currently use (please mark all that apply)? __ Lines of code __ Function points __ Cyclomatic complexity __ Software Science difficulty __ Scheduled tasks completed on time __ Scheduled tasks completed late __ Schedule contingency __ Overall project risk % __ Time to market __ Requirements completeness __ Requirements stability __ Planning completeness __ Resource adequacy (staffing, funding, etc.) __ Teaming effectiveness __ Schedule, quality, and cost tradeoffs __ Other - Explain: 4. Why did you choose the measurements/metrics selected in questions 2 and 3 (please mark all that apply)? __ Historical reasons __ Dictated by management or "corporate" processes __ Easy to implement __ Understood by software developers __ Understood by management __ Predictive of customer experience __ Provide insight into project activities __ Can be consistently measured across multiple projects __ Other - Explain: 5. What are the TOP THREE improvements would you be interested in making in the measurements/metrics you gather for software projects (please mark three items only)? __ Increase impact on project execution __ Better understand and manage software development process __ Cover more phases of project execution __ Make more achievable project commitments __ Measure "leading indicators" to project results __ Identify overall project strengths and risk areas __ Measure and track improvement project execution __ Provide "early warning" of problems __ Eliminate root causes of problems __ Measure teaming effectiveness and impact __ No interest in changing metrics __ Other - Explain: 6. What are your TOP THREE considerations when deciding to implement new measurements/metrics (please mark three items only)? __ Support of management __ Easy to implement __ Understood by software developers __ Understood by management __ Predictive of customer experience __ New, useful insight into key project activities __ Can be consistently measured across multiple projects __ Other - Explain: 7. Demographics Is your organization a (please mark the row which applies): __ Government agency __ Government contractor (develop for government agencies) __ Commercial (develop for other businesses or consumers) __ MIS/IT Group (develop for internal usage) How many software developers are in your organization (please mark the row which applies)? __ 1 to 5 __ 6 to 15 __ 16 to 30 __ 31 to 50 __ 51 to 100 __ 101 or more How many projects does your organization typically complete in one year (please mark the row which applies)? __ 0 to 1 __ 2 to 5 __ 6 to 10 __ 11 to 20 __ 21 to 40 __ 41 or more What type of software does your organization develop (please mark all which apply)? __ Mainframe __ Client-Server __ PC __ Internet/Intranet __ Other - explain: Where is your primary development site located (please mark the row which applies)? __ Australia __ Canada __ France __ Germany __ India __ Japan __ UK __ US __ Other - identify country: