Pipeline and Reports

The Pipeline

pull_request ──> mvn test -DsuiteXml=testng-smoke.xml -Dheadless=true         (~1 min)
                    └─ upload Extent report + screenshots
deploy staging ──> docker Grid (3 Chrome + 1 Firefox)
               ──> mvn test -DsuiteXml=testng-regression.xml -DrunMode=remote  (~12 min)
                    └─ Allure results -> report with history
nightly 02:00 IST ──> testng-crossbrowser.xml on BrowserStack (Chrome, Edge, Firefox, Safari)
                    └─ mail subject [GREEN]/[RED] + Slack summary

A Sample Nightly Summary

Example

cat target/mail-subject.txt && tail -12 target/logs/test-run.log

Example output

[RED] ShopEase nightly: 236 passed, 2 failed, 3 skipped

2026-03-17 02:31:44 INFO  [main] SuiteSummaryListener - Suite finished in 27m 12s
2026-03-17 02:31:44 ERROR [main] SuiteSummaryListener - FAILED Safari > CheckoutTest.upiSandboxOrder
    org.openqa.selenium.TimeoutException: Expected condition failed: waiting for visibility of
    element located by By.id: payment-success (tried for 10 second(s) with 500 milliseconds interval)
2026-03-17 02:31:44 ERROR [main] SuiteSummaryListener - FAILED Edge > AdminProductsTest.editPrice
    java.lang.AssertionError: price on product page expected [₹1,299] but found [₹1,499]
2026-03-17 02:31:44 INFO  [main] SuiteSummaryListener - Retried and passed: SearchTest.sortByPrice (1 retry)
2026-03-17 02:31:45 INFO  [main] SuiteSummaryListener - Report: target/extent/ShopEaseReport.html

Note: Triage: the editPrice AssertionError looks like a real bug (cache not cleared after an admin edit). The Safari timeout is a known slow payment sandbox, already ticketed.