Real World Example

Testing at an E-commerce Company

Before a big sale like Flipkart Big Billion Days or Amazon Great Indian Festival, the QA team runs thousands of checks. A typical split looks like this:

AreaManualAutomated
New "Buy Now Pay Later" featureexploratory testing by QAadded to automation after it is stable
Login, search, cart, checkoutonly sanity on each buildnightly Selenium regression suite on Chrome, Firefox, Edge
Payment APIs-API tests in the CI pipeline
Look and feel of the sale bannermanual review on real phones-

A Regression Run Report

Example

A regression suite reports how many tests passed and failed. This plain-Java program builds the kind of summary you will see from TestNG later:

import java.util.*;

public class Main {
    public static void main(String[] args) {
        Map<String, String> results = new LinkedHashMap<>();
        results.put("TC_LOGIN_001 valid login", "PASS");
        results.put("TC_LOGIN_002 wrong password", "PASS");
        results.put("TC_SEARCH_001 search shoes", "PASS");
        results.put("TC_CART_001 add to cart", "FAIL");
        results.put("TC_CHECKOUT_001 place order", "SKIP");

        int pass = 0, fail = 0, skip = 0;
        for (Map.Entry<String, String> e : results.entrySet()) {
            System.out.printf("%-30s %s%n", e.getKey(), e.getValue());
            switch (e.getValue()) {
                case "PASS" -> pass++;
                case "FAIL" -> fail++;
                default -> skip++;
            }
        }
        System.out.println("Total: " + results.size() + ", Passed: " + pass + ", Failed: " + fail + ", Skipped: " + skip);
    }
}

Output

TC_LOGIN_001 valid login       PASS
TC_LOGIN_002 wrong password    PASS
TC_SEARCH_001 search shoes     PASS
TC_CART_001 add to cart        FAIL
TC_CHECKOUT_001 place order    SKIP
Total: 5, Passed: 3, Failed: 1, Skipped: 1