BCS BCS Certifications ISTQB-TAE Questions & Answers

• Question 31:

  You have executed an automated test suite for a product that was released into production. Although all the tests passed, there was a major failure in production in an area that was covered well by your automated tests.

  You have run the automated tests again and one of the tests is now failing and this is directly related to the production defect that was raised. You decide to run the automated test suite again on the same version of the SUT and the test now

  passes.

  What SHOULD you do now to verify the validity of the automated tests?

  A. Remove the intermittently failing test from the test suite and investigate the reason why the test sometimes passes and sometimes fails.

  B. Check that the production defect that was reported was an actual defect

  C. Run the automated test suite again and if the test now passes - do nothing

  D. Reference: https://www.researchgate.net/publication/341396240_Intermittently_Failing_Tests_in_the_ Embedded_Systems_Domain

  Correct Answer: A

• Question 32:

  Consider a TAS that uses a keyword-driven framework. The SUT is a web application and there is a large set of keywords available for writing the automated tests that relate to highly specific user actions linked directly to the GUI of the SUT. The automated test written with the keywords are statically analyzed by a custom tool which highlight's repeated instances of identical sequence of keywords. The waiting mechanism implemented by the TAS for a webpage load is based on a synchronous sampling within a given timeout. The TAS allows checking a webpage load every seconds until a timeout value

  A. Changing the scripting approach to data-driven scripting

  B. Implementing keywords with a higher level of granularity

  C. Changing the wait mechanism to explicit hard-coded waits

  D. Establishing an error recovery process for TAS and SUT

  Correct Answer: C

• Question 33:

  Which of the following statements BEST describe aspects of the SUT to consider when designing a TAA?

  A. All the interaction between SUT and TAS should be logged with the highest level of detail

  B. All the internal test interfaces of the SUT should be removed prior to the product release

  C. All the interface of the SUT affected by the tests should be controllable by the TAA

  D. All the external test interfaces of the SUT should be removed prior to the product release

  Correct Answer: A

• Question 34:

  You are using a gTAA to create a TAS for a project. The TAS is aimed specifically at automating a suit of existing manual test cases for standalone desktop applications. All the interfaces between the TAS and SUT will be from the CUI of the application.

  Which of the following layers of the gTAA should you focus on for the TAS?

  A. The test Generation layer

  B. The Test Definition layer

  C. The Test Adaption layer

  D. The Test Execution layer

  Correct Answer: C

• Question 35:

  Your project is transitioning from manual to automated testing. You have decided to implement a pilot project so that lessons learned can inform future time estimates and schedules.

  Which two of the following represent the types of test cases that are MOST suited to a test automation pilot project?

  a) High added value test cases that require little effort to automate. b) Test that are run infrequently as these will be simpler to automate c) Reliability test cases that can show added value soon d) Technically challenging test cases to provide the best validation of manual test conversion e) Tests that are least Important to the business as these are safer to trial

  A. a and b

  B. a and c

  C. b and d

  D. c and e

  Correct Answer: B

  Reference: https://www.perfecto.io/blog/types-of-test-cases-to-automate

• Question 36:

  You have been asked to implement test automation for a project that is not meeting its deadlines. After further analysis you discover that the manual testers are not able to keep up with the new feature testing because the regression testing is taking 75% of their time. As a result, the new features are being released with many defects and customers are complaining about the quality.

  Given this information, what metric SHOULD you be tracking to show the value of test automation for this project?

  A. Percentage of code covered by the test automation.

  B. Equivalent Manual Test Effort for the automated tests.

  C. Number of defects found by test automation.

  D. Percentage of builds accepted/rejected by the automated tests.

  Correct Answer: B

  Reference: https://blog.testproject.io/2019/12/04/how-to-measure-the-value-of-your-test- automation/

• Question 37:

  As the TAE, you are working with the organisation's Test Manager to decide which external metrics and which internal metrics should be gathered for the new TAS. Which of the following represents the BEST internal metric that would help measure the quality of the TAS and the number of problems associated with the TAS?

  A. The average maintenance cost to keep an automated test in sync with the SUT

  B. The number of hours of manual test effort saved by implementing a TAS

  C. A measure of defect density within the TAS automation code

  D. A measure of how many automated tests pass and fail

  Correct Answer: C

• Question 38:

  Assume that you are the TAE responsible for the correct functioning of a TAS, deployed in a test environment that consists of a few machines running the same version of the operating system. The TAS has been working and stable since its deployment, it has been used to run an automated test suite consisting of many similar automated test. The infrastructure team is planning to update the operating system on these machines by installing a new the service pack for security reasons. Since the vendor of the operating system assurance full backward compatibility, the infrastructure team assurance that there will be no impacts on the functioning of the TAS.

  What is the BEST approach to confirm the correct functioning of the TAS in this scenario?

  A. Verify the behavior of the automated tests by running a small tests, then gradually run the remaining tests to confirm the correct functioning of the whole automated test suite.

  B. Make sure that the infrastructure team has completed installing the service pack on the machines where SUT is running, then run the whole automated test suite to verify its behavior

  C. Verify the behavior of the whole automated test suite by running all the automated tests

  D. Do not run any tests because you can immediately confirm the correct functioning of the automated test suite

  Correct Answer: A

• Question 39:

  Which of the following suitability criteria needs the MOST attention for the TAS?

  A. Technical planning in support of ROI analysis

  B. Frequency of use.

  C. Compatibility and tool support

  D. Maturity of the test process

  Correct Answer: C

  Reference: https://www.softwaretestinghelp.com/guide-to-functional-testing/

• Question 40:

  Consider a TAS associated to dynamically changing software frequent releases. Your goal is to determine the amount of effort required to maintain the automated tests of the regression test suite for each new release of the SUT. What is the MOST important metric to collect to achieve your goal?

  A. The code coverage achieved with the automated tests, for each new release of the SUT

  B. The number of automated tests which fail because of a single software defect, for each new release of the SUT

  C. The time it takes to execute all the automated tests, for each new release of the SUT.

  D. The number of automated tests requiring maintenance, for each new release of the SUT.

  Correct Answer: B