Test Manager Sample Question Set 1

Test Manager Sample Question Set 1 

Q-1: Which of the following is an example of testing as part of the requirements specification phase of a project?

1. A requirements review meeting

2. A business analyst eliciting requirements

3. A database administrator designing a table

4. A test results report showing requirements coverage

Q-2: Assume you are a test manager working on a project to create a programmable thermostat for home use to control central heating, ventilation, and air conditioning (HVAC) systems. This project is following a sequential lifecycle model, specifically the V-model. Currently, the system architects have released a first draft design specification based on the approved requirements specification released previously.

Identify all of the following that are appropriate test tasks to execute at this time:

1. Design tests from the requirements specification

2. Analyze design-related risks

3. Execute unit test cases

4. Write the test summary report

5. Design tests from the design specification

Q:-3 You are the manager of a bank's quality assessment group, in charge of independent testing for banking applications. You are working on a project to implement an integrated system that will use three off-the-shelf systems to manage a bank's accounts-receivable system.

Identify all of the following that are test levels that you would expect to directly manage:

1. Component testing for each system

2. Component integration testing for each system

3. System testing for each system

4. Contract acceptance testing for each system

5. System integration testing

Q-4: Which of the following is generally applicable to demonstrating compliance to regulations for safety critical systems?

1. Test traceability

2. ISO 61508

3. Usability testing

4. Employee evaluations

Q-5: Which of the following is an accurate statement that captures a difference between a trend chart showing the total number of bugs discovered and resolved during test execution and a trend chart showing the total number of test cases passed and failed during test execution?

1. The bug trend chart will reveal test progress problems while the test case trend chart

will not.

2. The bug trend chart will show test coverage while the test case trend chart will not.

3. The test case trend chart will reveal test progress problems while the bug trend chart

will not.

4. The test case trend chart will show test coverage while the bug trend chart will not.

Q-6: Considering the typical objectives of testing that are identified in the Foundation syllabus, which of the following metrics can we use to measure the effectiveness of the test process in achieving one of those objectives?

1. Average days from defect discovery to resolution

2. Lines of code written per developer per day

3. Percentage of test effort spent on regression testing

4. Percentage of requirements coverage

Q-7: Assume you are a test manager working on a project to create a programmable thermostat for home use to control central heating, ventilation, and air conditioning (HVAC) systems. This project is following a sequential lifecycle model, specifically the V-model. Your test team is following a risk-based testing strategy augmented with a reactive testing strategy during test execution to ensure that key risks missed during risk analysis are caught.

Of the following statements, identify all that are true about the test plan.

1. The test plan should include risk analysis early in the process.

2. The test plan should list the requirements specification as an input to the risk analysis.

3. The test plan should assign specific bugs to specific developers.

4. The test plan should discuss the integration of reactive test techniques into test

execution.

5. The test plan should specify overall project team metrics used to determine bonuses

Q-8: Which of the following is a test document in which you would you expect to find the preconditions to start executing a level of testing?

1. Test plan

2. Test design specification

3. Incident report

4. Project plan

Q-9: Which of the following is the most likely reason a user might be included in test execution?

1. Their application domain knowledge

2. Their technical expertise

3. Their testing expertise

4. Their management expertise

Q-10: You are the manager of a bank's quality assessment group, in charge of independent testing for banking applications. You have just concluded a project to implement an integrated system that will use three off-the-shelf systems to manage a bank's accounts-receivable system. During the project, you found that one of the vendor's systems, while comprising approximately the same amount of functionality and of roughly the same complexity as the other two systems, had significantly more defects. Making no assumptions other than ones based on the information provided here, which of the following is a reasonable improvement to the test process for subsequent projects involving this vendor?

1. Impose retroactive financial penalties on this vendor for the number of bugs delivered

on this project.

2. Perform an acceptance test for all systems received, with particular rigor for this vendor.

3. Cancel the contract with this vendor and put it on an industry blacklist.

4. Require the vendor's developers to attend training to improve their ability to write

quality code.

Q-11: Which of the following is a project risk mitigation step that you might take as a test manager?

1. Testing for performance problems

2. Hiring a contractor after a key test analyst quits

3. Procuring extra test environments in case one fails during testing

4. Performing a project retrospective using test results

Q-12: You are planning the testing for an integrated system that will use three off-the-shelf components to manage a bank's accounts-receivable system. You are conducting an informal quality risk analysis session with project and system stakeholders to determine what test conditions should be tested and how much each test condition should be tested. Which of the following is a quality risk item that you might identify in this quality risk analysis session?

1. Failure of a component vendor to conduct adequate component testing

2. Calculation of excessive late-payment penalties for invoices

3. On-time payment of all invoices for international vendors

4. Calculation of risk priority using likelihood and impact

Q-13: During a formalized quality risk analysis session following the Failure Mode and Effect Analysis technique, you are calculating risk priorities. Which of the following are major factors in this calculation?

1. Severity and priority

2. Functionality, reliability, usability, efficiency, maintainability, and portability

3. Loss of a key contributor on the test team

4. Loss of a key contributor on the development team

Q-14: Assume you are a test manager in charge of integration testing, system testing, and acceptance testing for a bank. You are working on a project to upgrade an existing automated teller machine system to allow customers to obtain cash advances from supported credit cards. The system should allow cash advances from $20 to $500, inclusively, for all supported credit cards. The supported credit cards are American Express, Visa, Japan Credit Bank, Eurocard, and MasterCard.

Which of the following statements best associates a key stakeholder with the kind of input that stakeholder can provide during a quality risk analysis?

1. A tester can provide input on the likelihood of a risk item.

2. A developer can provide input on the impact of a risk item.

3. A business analyst can provide input on the likelihood of a risk item.

4. A help desk staffer can provide input on the impact of a risk item.

Q-15: Which of the following is a situation in which you would expect an iterative quality risk analysis to result in the largest number of new or changed risk items and risk levels?

1. You perform a risk analysis on the final requirements specification and subsequently

receive a draft design specification.

2. A tester leaves after test design is complete, and you hire a new tester to replace her.

3. The development manager hires two additional programmers after the quality risk

analysis is complete.

4. You perform a risk analysis on the final requirements specification and then that

document is placed under formal configuration management.

Q-16: Assume you are a test manager working on a project to create a programmable thermostat for home use to control central heating, ventilation, and air conditioning (HVAC) systems. In addition to the normal HVAC control functions, the thermostat also has the ability to download data to a browser-based application that runs on PCs for further analysis. During quality risk analysis, you identify compatibility problems between the browser-based application and the different PC configurations that can host that application as a quality risk item with a high level of likelihood. You plan to perform compatibility testing to address this risk.

Which of the following is a way in which you might monitor the effect of testing on the reduction of this risk during test execution?

1. Reduce the number of supported PC configurations.

2. Assign more testers to cover compatibility than testers to cover functionality.

3. Analyze the number of defects found that relate to this risk item.

4. Plan to test the most common PC configurations.

Q-17: Which of the following is an example of a project where failure mode and effect analysis would be a better choice for risk analysis?

1. It is the project team's first application of risk-based testing.

2. The system under test is both complex and safety critical.

3. The system under test is a financial system.

4. Minimizing the amount of documentation is a key concern.

Q-18: Assume you are a test manager in charge of integration testing, system testing, and acceptance testing for a bank. You are working on a project to upgrade an existing automated teller machine system to allow customers to obtain cash advances from supported credit cards. The system should allow cash advances from $20 to $500, inclusively, for all supported credit cards. The supported credit cards are American Express, Visa, Japan Credit Bank, Eurocard, and MasterCard.

In the master test plan, the Features to be Tested section lists the following:

1. All supported credit cards

2. Language localization

3. Valid and invalid advances

4. Usability

5. Response time

Relying only on the information given above, select the features to be tested for which

sufficient information is available to proceed with test design.

1. I

2. II

3. III

4. IV

5. V

Q-19: Continue with the scenario described in the previous question. Which of the following topics would you need to address in detail in the master test plan?

1. A strategy for regression testing

2. A list of advance amount boundary values

3. A description of intercase dependencies

4. A logical collection of test cases

Q-20: Assume you are a test manager working on a project to create a programmable thermostat for home use to control central heating, ventilation, and air conditioning (HVAC) systems. In addition to the normal HVAC control functions, the thermostat also has the ability to download data to a browser-based application that runs on PCs for further analysis.

The company test strategy calls for each test case to be run on all combinations of

configuration options. For this system, you identify the following factors and, for each factor, the following options:

 Supported PC/thermostat connections: USB and Bluetooth

 Supported operating systems: Windows 2000, Windows XP, Windows Vista, Mac X, Linux

 Supported browsers: Internet Explorer, Firefox, Opera

Because there are 10 test cases that involve downloading data, this would require running 300 test cases, each of which requires an hour to run.

With management approval, you decide to test five configurations, covering each option but not all the possible pairs and triples of options.

Which of the following statements describes the best option for documenting this deviation from the test strategy?

1. In the test design specifications, explain the alternate approach planned for this project

and how to set up the test configurations.

2. In the test procedure specifications, explain which test cases should be run against

which configurations.

3. In the master test plan, explain the alternate approach planned for this project and why

this approach is sufficient.

4. In the test item transmittal report, explain the alternate approach planned for this

project and which test items were tested against which configuration.

Q-21: Continue with the scenario described in the previous question. You are writing a master test plan to cover integration testing and system testing of the programmable thermostat. Select all of the following statements that are true.

1. The approach section should describe how to test the integration of the thermostat with

other parts of the HVAC system.

2. The schedule section should describe when integration testing should start and when

system testing should start.

3. The environmental needs section should address who is responsible for each level of

testing.

4. The test items section should describe the equipment required for each level of testing.

5. The test deliverables section should describe results reporting for each level of testing.

Q-22: 12. Continue with the scenario described in the previous questions, where you are a test manager working on a project to create a programmable thermostat for home use to control central heating, ventilation, and air conditioning (HVAC) systems. One critical quality risk identified for this system is the possibility of damage to the HVAC system caused by excessive cycling of the compressor (i.e., turning the unit on and off repeatedly in short intervals). Which of the following is a reasonable way to use an IEEE 829 test plan to direct appropriate testing for this risk?

1. Write a separate test plan for this level of testing.

2. List the feature that prevents excessive cycling as a feature to be tested.

3. Detail all of the requirements of the programmable thermostat in the introduction of the

test plan.

4. Include a fully functioning compressor as one of the test items.

Q-23: Continue with the scenario from the previous question.

Historically, on seven past projects, the test team has found approximately 12 bugs during system test for each person-month of development team effort. Five developers are assigned to work on a new project that is scheduled to last six months. Assume that the cumulative number of bugs found, as shown in your convergence chart, has flattened at 351 defects. Based on this information only, which of the following statements is most likely to be true?

1. You would expect to find exactly 20 more defects before the end of system test.

2. You have omitted tests for at least one critical quality risk category.

3. You needed a test team of at least three testers for optimum testing.

4. You have found roughly the number of defects you would expect to find during system

test.

Q-24: Continue with the scenario from the previous question.

Assume that this project is following an iterative lifecycle, while the previous projects for which you have bug metrics followed a sequential lifecycle. Assuming no other dissimilarities between this project and the previous projects exist, which of the following might be a reason to question the accuracy of the predicted number of defects?

1. People factors

2. Material factors

3. Process factors

4. Quality factors

Q-25: You are a test manager in charge of system testing on a project to update a cruise-control module for a new model of a car. The goal of the cruise-control software update is to make the car more fuel efficient.

You have written a first release of the system test plan based on the final requirements

specification. You receive an early draft of the design specification. Identify all of the following statements that are true.

1. Do not update the system test plan until the final version of the design specification is

available.

2. Produce a draft update of the system test plan based on this version of the design

specification.

3. Check this version of the design specification for inconsistencies with the requirements

specification.

4. Participate in the final review of the design specification but not any preliminary reviews

of the design specification.

5. Review the quality risk analysis to see if the design specification has identified additional

risk items.

Q-26: 16. Which of the following is the best example of a technique for controlling test progress in terms of the residual level of quality risk?

1. Counting the number of defects found and the number of defects resolved

2. Counting the number of test cases passed and the number of test cases failed

3. Counting the number of requirements that work properly and the number of

requirements with known defects

4. Counting the number of tested risk items without known defects and the number of

tested risk items with known defects

Q-27: You are a test manager in charge of system testing on a project to update a cruise-control module for a new model of a car. The goal of the cruise-control software update is to make the car more fuel efficient.

Halfway through test execution, you find that the test results do not conclusively determine whether fuel efficiency has improved. Identify all of the following actions that you might direct the test analysts to take to help to resolve this problem.

1. Redesign the fuel efficiency tests.

2. Revise the quality risk analysis.

3. Modify the test environment to gather more detailed actual results.

4. Check for consistency in tested fuel mixtures.

5. Report fuel efficiency as apparently unchanged.

Q-28: Assume you are a test manager in charge of integration testing, system testing, and acceptance testing for a bank. You are working on a project to upgrade an existing automated teller machine system to allow customers to obtain cash advances from supported credit cards.

The system should allow cash advances from $20 to $500, inclusively, for all supported credit cards. The supported credit cards are American Express, Visa, Japan Credit Bank, Eurocard, and MasterCard.

During test execution, you find five defects, each reported by a different tester, that involve the same problem with cash advances, with the only difference between these reports being the credit card tested. Which of the following is an improvement to the test process that you might suggest?

1. Revise all cash advance test cases to test with only one credit card.

2. Review all reports filed subsequently and close any such duplicate defect reports before

assignment to development.

3. Change the requirements to delete support for American Express cards.

4. Have testers check for similar problems with other cards and report their findings in

defect reports.

Q-29: You are the manager of a bank's quality assessment group, in charge of independent testing for banking applications. You are working on a project to implement an integrated system that will use three off-the-shelf systems to manage a bank's accounts-receivable system. You are currently managing the execution of system integration testing.

Consider the following bug open/closed or convergence chart.

Which of the following interpretations of this chart provides a reason to not declare the system integration testing complete?

1. The bug find rate has not leveled off.

2. Developers aren't fixing bugs fast enough.

3. The complete set of tests has not yet been run.

4. A number of unresolved bugs remain in the backlog.

Q-30: Which of the following is an example of a cost of internal failure?

1. Finding a bug during testing

2. Training developers in secure coding practices

3. Designing test cases

4. Fixing a customer-detected bug

Q-31: You are the manager of a bank's quality assessment group, in charge of independent testing for banking applications. You are in charge of testing for a project to implement an integrated system that uses three off-the-shelf components to manage a bank's accounts-receivable system.

Which of the following is most likely to be a major business motivation for testing this system?

1. Avoiding loss of life

2. Having confidence in correct customer billing

3. Finding as many bugs as possible before release

4. Gathering evidence to sue the component vendors

Q-32: Which of the following is a risk of outsourced testing that might not apply to distributed testing?

1. Selection of an improper test partner

2. Communication problems created by time zone differences

3. Insufficient skills in some of the test team members

4. Inconsistent test processes across the testing locations

Q-33: You are the manager of a bank's quality assessment group, in charge of independent testing for banking applications. You used quality risk analysis to allocate effort and prioritize

your tests during test preparation. You are currently executing the system integration test. You have finished running each test case once. You are not certain how much time the project management team will allow for additional test execution because regulatory changes might require the system to be activated ahead of schedule.

Based on the severity and priority of the bugs found by each test case, you have calculated weighted failure for each test case. You also know the risk priority number for each test case based on the quality risk item(s) the test case covers. Considering both the weighted failure and the risk priority number, you have reprioritized your test cases for the final days or weeks of testing.

Which of the following is a benefit this reprioritization will provide?

1. If testing is curtailed, you will have expended the minimum amount of effort possible.

2. If testing is extended, you will have time to run all of your tests.

3. If testing is curtailed, you will have run the most important tests.

4. If testing is extended, you will have covered all of the requirements.

Q-34: Which of the following is a benefit of exploratory testing and other reactive test strategies that would not apply to an analytical requirements-based test strategy?

1. The ability to utilize a very experienced test team

2. The ability to accurately predict the residual risk prior to delivery

3. The ability to prevent defects during requirements analysis

4. The ability to test effectively without a complete test basis

Q-35: Which of the following is a type of defect that you can detect more easily in a review than by a dynamic test?

1. Regression

2. Maintainability

3. Performance

4. Reliability

Q-36: Which of the following is a type of review in which you would expect to detect the greatest percentage of defects present in the item under review?

1. Informal

2. Static analysis

3. Simulation

4. Inspection

Q-37: Assume you are a test manager working on a project to create a programmable thermostat for home use to control central heating, ventilation, and air conditioning (HVAC) systems. In addition to the normal HVAC control functions, the thermostat has the ability to download data to a browser-based application that runs on PCs for further analysis. During quality risk analysis, you identify compatibility problems between the browser-based application and the different PC configurations that can host that application as a quality risk item with a high level of likelihood. Select all of the following actions that should occur in the quality and test plans to best ensure that the project team will minimize this risk upon release?

1. Carefully select the list of supported configurations.

2. Review the list of supported configurations with project stake—holders.

3. Support only a single browser based on technical attributes.

4. Downgrade the likelihood of the risk based on available test resources.

5. Test the supported PC configurations early in test execution.

Q-38: Assume you are a test manager in charge of integration testing, system testing, and acceptance testing for a bank. You are working on a project to upgrade an existing automated teller machine system to allow customers to obtain cash advances from supported credit cards.

You have received a requirements specification that states that the system should allow cash advances from $20 to $500, inclusively, for all supported credit cards. Assume that the bank is required contractually to support the following credit cards: American Express, Visa, Japan Credit Bank, Eurocard, and MasterCard.

The bank has given you the responsibility of organizing a review of the requirements

specification. Which of the following is a risk for this review?

1. You do not know the supported credit cards.

2. You do not include the proper stakeholders in the review.

3. You do not know which test levels to address.

4. You do not receive the requirements specification.

Q-39: Assume you are a test manager working on a project to create a programmable thermostat for home use to control central heating, ventilation, and air conditioning (HVAC) systems. In addition to the normal HVAC control functions, the thermostat has the ability to download data to a browser-based application that runs on PCs for further analysis. During quality risk analysis, you identify compatibility problems between the browser-based application and the different PC configurations that can host that application as a quality risk item with a high level of likelihood.

Your test team is currently executing compatibility tests. Consider the following excerpt from the failure description of a compatibility bug report:

1. Connect the thermostat to a Windows Vista PC.

2. Start the thermostat analysis application on the PC. Application starts normally and

recognizes connected thermostat.

3. Attempt to download the data from the thermostat.

4. Data does not download.

5. Attempt to download the data three times. Data will not down—load.

Based on this information alone, which of the following is a problem that exists with this bug

report?

1. Lack of structured testing

2. Inadequate classification information

3. Insufficient isolation

4. Poorly documented steps to reproduce

Q-40: Continue with the previous scenario. Your test team is still executingcompatibility tests. Consider the following excerpt from the failure description of a compatibility bug report:

1. Install the thermostat analysis application on a Windows XP PC.

2. Attempt to start the thermostat analysis application.

3. Thermostat analysis application does not start.

4. Reinstall the thermostat analysis application three times. Thermo—stat analysis

application does not start after any reinstallation.

5. This test passed on the previous test release.

Based on this information alone, which of the following is the most reasonable hypothesis about

this bug?

1. The bug might be a regression.

2. The bug might be intermittent.

3. The application didn't install on Windows XP PCs before.

4. The bug might be a duplicate.

Answers:

1. A

2. A, B, E

3. D, E

4. A

5. C

6. D

7. A, B, D

8. A

9. A

10. B

11. C

12. B

13. A

14. D

15. A

16. C

17. B

18. A, C

19. A

20. C

21. A, B, E

22. B

23. D

24. C

25. A, C, E

26. D

27. A, C, D

28. D

29. D

30. A

31. B

32. A

33. C

34. D

35. B

36. D

37. A, B, E

38. B

39. C

40. A