Fully Working
70
All acceptance criteria met
Not Working
39
Feature missing or broken
Partially Done
26
Some criteria met, gaps remain
Feature Score
49%
70 of 143 features verified
We ran 143 end-to-end acceptance tests across 18 suites using Playwright MCP browser testing. Each test was executed twice in independent QA runs to confirm reproducibility. Both runs produced identical results for this build.
Suite Summary
| Suite | Pass | Total | Score |
|---|---|---|---|
| S1Smoke Tests | 6 | 10 | 60% |
| S2Admin Authentication | 5 | 10 | 50% |
| S3Admin Product Management | 3 | 7 | 43% |
| S4Admin Order Management | 2 | 11 | 18% |
| S5Admin Discount Management | 4 | 6 | 67% |
| S6Admin Settings | 2 | 7 | 29% |
| S7Storefront Browsing | 6 | 15 | 40% |
| S8Cart Flow | 5 | 12 | 42% |
| S9Checkout Flow | 4 | 13 | 31% |
| S10Customer Account | 7 | 12 | 58% |
| S11Inventory Enforcement | 1 | 4 | 25% |
| S12Tenant Isolation | 4 | 5 | 80% |
| S13Responsive / Mobile | 5 | 8 | 63% |
| S14Accessibility | 8 | 11 | 73% |
| S15Admin Collections Management | 2 | 3 | 67% |
| S16Admin Customer Management | 1 | 3 | 33% |
| S17Admin Pages Management | 2 | 3 | 67% |
| S18Admin Analytics Dashboard | 3 | 3 | 100% |
Detailed Results
S1Smoke Tests
6/10622
Smoke Tests
622
S1-01Loads storefront homePASS
S1-02Loads a collection pageFAIL
S1-03Loads a product pagePARTIAL
S1-04Loads the cart pagePASS
S1-05Loads the customer login pagePASS
S1-06Loads the admin login pagePASS
S1-07Loads the about pageFAIL
S1-08Loads the search pagePASS
S1-09Loads all collections listingPASS
S1-10Has no errors on critical pagesPARTIAL
S1-01: 'Demo Store' with 'Demo T-Shirt' at 24.99 EUR
S1-02: /collections/t-shirts 404 - only 'Featured Products'
S1-03: Expected URL 404, product exists at /products/demo-t-shirt
S1-04: Cart page loads with 'Shopping Cart' heading
S1-05: Login page with email/password form
S1-06: Admin login loads with sign-in form
S1-07: /pages/about returns 404 - no pages seeded
S1-08: Search returns 'Demo T-Shirt' for 'shirt'
S1-09: Collections listing shows 'Featured Products'
S1-10: No JS errors but 404s on expected URLs due to missing data
S2Admin Authentication
5/10514
Admin Authentication
514
S2-01Can log in as adminPASS
S2-02Shows error for invalid credentialsFAIL
S2-03Shows error for empty emailPARTIAL
S2-04Shows error for empty passwordPARTIAL
S2-05Redirects unauthenticated to login from dashboardPASS
S2-06Redirects unauthenticated to login from productsPASS
S2-07Can log outPARTIAL
S2-08Can navigate through admin sidebar sectionsPARTIAL
S2-09Can navigate to analyticsPASS
S2-10Can navigate to themesPASS
S2-01: Dashboard shows Orders 1, Revenue 58.52 EUR
S2-02: No error message for invalid credentials
S2-03: HTML5 required only, no custom error message
S2-04: HTML5 required only, no custom error message
S2-05: /admin redirects to /login when not authenticated
S2-06: /admin/products redirects to /login
S2-07: Admin logout button fails to end Laravel session
S2-08: Sidebar links exist but clicks don't navigate
S2-09: Analytics shows Orders, Revenue, Visits, Conversion
S2-10: Themes page loads, shows 'No themes available'
S3Admin Product Management
3/734
Admin Product Management
34
S3-01Shows product list with seeded productsFAIL
S3-02Can create a new productPASS
S3-03Can edit an existing productPASS
S3-04Can archive a productPASS
S3-05Shows draft products only in adminFAIL
S3-06Can search products in adminFAIL
S3-07Can filter products by statusFAIL
S3-01: Only 'Demo T-Shirt' - missing expected seeded products
S3-02: Created product with success message
S3-03: Updated product title with success message
S3-04: Changed status to Archived, confirmed
S3-05: No draft products exist in seed data
S3-06: No search input on admin products page
S3-07: No status filter on admin products page
S4Admin Order Management
2/11281
Admin Order Management
281
S4-01Shows order list with seeded ordersPARTIAL
S4-02Can filter orders by statusFAIL
S4-03Shows order detail with line itemsPASS
S4-04Shows order timeline eventsFAIL
S4-05Can create a fulfillmentFAIL
S4-06Can process a refundFAIL
S4-07Shows customer info in order detailPASS
S4-08Can confirm bank transfer paymentFAIL
S4-09Shows fulfillment guard for unpaid orderFAIL
S4-10Can mark fulfillment as shippedFAIL
S4-11Can mark fulfillment as deliveredFAIL
S4-01: Shows order #1001 only, expected multiple seeded orders
S4-02: No status filter on orders page
S4-03: Line items, discounts, shipping, tax, total shown
S4-04: No timeline section on order detail
S4-05: No fulfillment button on order detail
S4-06: No refund button on order detail
S4-07: Customer name and email shown in order
S4-08: No order #1005, no confirm payment button
S4-09: No fulfillment guard UI exists
S4-10: No fulfillment management UI
S4-11: No fulfillment management UI
S5Admin Discount Management
4/6411
Admin Discount Management
411
S5-01Shows seeded discount codesFAIL
S5-02Can create percentage discountPASS
S5-03Can create fixed amount discountPASS
S5-04Can create free shipping discountPASS
S5-05Can edit a discountPASS
S5-06Shows discount status indicatorsPARTIAL
S5-01: Only WELCOME10 exists - missing FLAT5, FREESHIP, etc.
S5-02: Created percentage discount with success message
S5-03: Fixed type supported in create form
S5-04: Free shipping type supported in create form
S5-05: Edit form available with Save button
S5-06: 'active' label shown but no Expired badge to verify
S6Admin Settings
2/7241
Admin Settings
241
S6-01Can view store settingsPASS
S6-02Can update store nameFAIL
S6-03Can view shipping zonesPARTIAL
S6-04Can add new shipping rateFAIL
S6-05Can view tax settingsPASS
S6-06Can update tax inclusion settingFAIL
S6-07Can view domain settingsFAIL
S6-01: Shows 'Demo Store', handle, status, currency EUR
S6-02: Settings page is read-only, no save button
S6-03: Germany zone with Standard Shipping, price not shown
S6-04: No 'Add rate' button - read-only display
S6-05: Tax mode manual, 19% rate, include tax setting
S6-06: Tax settings read-only, no toggle or save
S6-07: No Domains section in settings
S7Storefront Browsing
6/156522
Storefront Browsing
6522
S7-01Shows featured products on homePARTIAL
S7-02Shows collection with product gridFAIL
S7-03Can navigate from collection to productPASS
S7-04Shows product detail with variantsPARTIAL
S7-05Shows size and color option valuesFAIL
S7-06Updates price when variant changesFAIL
S7-07Shows search results for valid queryPASS
S7-08Shows no results for invalid queryPASS
S7-09Does not show draft products on collectionsPASS
S7-10Does not show draft products in searchPASS
S7-11Shows out of stock messagingN/A
S7-12Shows backorder messagingN/A
S7-13Shows new arrivals collectionFAIL
S7-14Shows static about pageFAIL
S7-15Navigates between pages using navPASS
S7-01: 'Demo T-Shirt' at 24.99 EUR but store is 'Demo Store'
S7-02: /collections/t-shirts 404, only Featured Products exists
S7-03: Product links from collection work correctly
S7-04: Only 1 variant (DEMO-TSHIRT-M), no Size/Color options
S7-05: No Size or Color options - single variant only
S7-06: No product with compare-at pricing exists
S7-07: Search for 'cotton' returns Demo T-Shirt
S7-08: 'No products matched your search.' for invalid query
S7-09: No draft products on storefront
S7-10: Search for 'draft' returns no results
S7-11: No deny-policy product exists in seed data
S7-12: No continue-policy product exists in seed data
S7-13: /collections/new-arrivals returns 404
S7-14: /pages/about returns 404 - no pages seeded
S7-15: Nav has Home, Collections, Search, Cart, Account
S8Cart Flow
5/1257
Cart Flow
57
S8-01Can add product to cartPASS
S8-02Can view cart with added itemPASS
S8-03Can update quantity in cartPASS
S8-04Can remove item from cartPASS
S8-05Can add multiple productsFAIL
S8-06Can apply WELCOME10 discountFAIL
S8-07Shows error for invalid discountFAIL
S8-08Shows error for expired discountFAIL
S8-09Shows error for maxed out discountFAIL
S8-10Can apply free shipping discountFAIL
S8-11Can apply FLAT5 discountFAIL
S8-12Shows subtotal and total in cartPASS
S8-01: 'Item added to cart' message, product in cart
S8-02: Cart shows product, price, quantity, subtotal, total
S8-03: Quantity updated via spinbutton, total recalculated
S8-04: Remove works, 'no line items yet' shown
S8-05: Only 1 active product exists, cannot add multiple
S8-06: No discount code input in cart view
S8-07: No discount code input in cart
S8-08: No discount input in cart, EXPIRED20 doesn't exist
S8-09: No discount input in cart, MAXED doesn't exist
S8-10: No discount input in cart, FREESHIP doesn't exist
S8-11: No discount input in cart, FLAT5 doesn't exist
S8-12: Summary shows Items, Subtotal, Discounts, Total
S9Checkout Flow
4/134351
Checkout Flow
4351
S9-01Completes full checkout (credit card)PASS
S9-02Shows shipping methods for DE addressPASS
S9-03Shows international shipping for non-DEN/A
S9-04Applies discount during checkoutPARTIAL
S9-05Validates required contact emailPARTIAL
S9-06Validates required address fieldsPARTIAL
S9-07Validates invalid postal codeFAIL
S9-08Prevents checkout with empty cartPASS
S9-09Completes checkout with PayPalPARTIAL
S9-10Completes checkout with bank transferPARTIAL
S9-11Shows error for declined cardFAIL
S9-12Shows error for insufficient fundsFAIL
S9-13Switches between payment methodsPASS
S9-01: Full checkout completed, order #1002 at 95.15 EUR
S9-02: Standard Shipping 4.99 EUR shown for DE address
S9-03: Only one shipping zone (Germany) configured
S9-04: Discount input in checkout exists but not fully tested
S9-05: Email pre-filled when logged in, validation via HTML5
S9-06: Address validation exists through HTML required attrs
S9-07: No postal code format validation
S9-08: 'Your cart is currently empty' with no checkout button
S9-09: PayPal radio exists but full flow not tested
S9-10: Bank transfer exists but no IBAN/BIC on confirmation
S9-11: No card validation - any card number accepted
S9-12: No card validation for insufficient funds
S9-13: Credit Card, PayPal, Bank Transfer radios switch
S10Customer Account
7/127122
Customer Account
7122
S10-01Can register a new customerPASS
S10-02Shows validation for duplicate emailN/A
S10-03Shows validation for mismatched passwordsN/A
S10-04Can log in as customerPASS
S10-05Shows error for invalid customer credentialsFAIL
S10-06Redirects unauthenticated customersPASS
S10-07Shows order history for customerPARTIAL
S10-08Shows order detail for customerPASS
S10-09Can view addressesPASS
S10-10Can add a new addressPASS
S10-11Can edit an existing addressPARTIAL
S10-12Can log outPASS
S10-01: Registration form with name, email, password fields
S10-02: Not tested to avoid data mutation
S10-03: Not tested, form has confirm password field
S10-04: 'Welcome, Demo Customer' shown after login
S10-05: No visible error for wrong password on login
S10-06: /account redirects to /account/login
S10-07: Shows 1 order (#1001), spec expects multiple
S10-08: Order #1001 with date, status, total shown
S10-09: Home address with Main Street 1, Berlin, DE
S10-10: Add Address form with all fields and Save button
S10-11: Edit button exists on address card
S10-12: Log out redirects to /account/login
S11Inventory Enforcement
1/4112
Inventory Enforcement
112
S11-01Blocks add-to-cart for out-of-stock denyN/A
S11-02Allows add-to-cart for backorderN/A
S11-03Shows correct stock for in-stock productPASS
S11-04Prevents adding more than available stockFAIL
S11-01: No deny-policy product exists
S11-02: No continue-policy product exists
S11-03: Add to cart enabled, no 'Sold out' message
S11-04: No stock limit enforcement
S12Tenant Isolation
4/541
Tenant Isolation
41
S12-01Store only shows its own productsPASS
S12-02Store collections contain store productsPASS
S12-03Admin cannot access other store dataPASS
S12-04Search only returns current store productsPASS
S12-05Customer accounts scoped to storePARTIAL
S12-01: 'Demo Store' with only its own products
S12-02: Featured collection has only store products
S12-03: Admin shows only this store's data
S12-04: Search returns only this store's products
S12-05: Customer sees 1 order but expected more seeded
S13Responsive / Mobile
5/853
Responsive / Mobile
53
S13-01Storefront home on mobilePARTIAL
S13-02Product page stacks on mobilePASS
S13-03Can add to cart on mobilePASS
S13-04Cart page works on mobilePASS
S13-05Checkout flow on mobilePASS
S13-06Admin login on tabletPASS
S13-07Admin sidebar on tabletPARTIAL
S13-08Collection page on mobilePARTIAL
S13-01: Content visible but no hamburger menu
S13-02: Product info visible on mobile viewport
S13-03: Add to cart works on mobile
S13-04: Cart and checkout button accessible on mobile
S13-05: Checkout form accessible on mobile
S13-06: Admin login and dashboard work on tablet
S13-07: Sidebar hidden on tablet, requires direct URL nav
S13-08: Collection loads on mobile but no filter UI
S14Accessibility
8/11821
Accessibility
821
S14-01Home page has no JS errorsPASS
S14-02Home page has proper heading hierarchyPASS
S14-03Product page has ARIA labelsPARTIAL
S14-04Product page images have alt textN/A
S14-05Customer login form has accessible labelsPASS
S14-06Admin login form has accessible labelsPASS
S14-07Checkout form has accessible labelsPASS
S14-08Checkout validation errors accessiblePARTIAL
S14-09Can navigate with keyboard onlyPASS
S14-10Cart page has no console errorsPASS
S14-11Search page has proper form labelsPASS
S14-01: No JS errors on home page
S14-02: One h1 ('Demo Store'), logical hierarchy
S14-03: Variant and Quantity labels present but no Size/Color
S14-04: No images on product page
S14-05: Email and Password labels associated with inputs
S14-06: Admin login labels properly set
S14-07: All checkout form fields have labels
S14-08: Errors shown as list but may lack aria-describedby
S14-09: Skip to content link present, tab navigation works
S14-10: No console errors on cart page
S14-11: Search input has 'Search query' label
S15Admin Collections Management
2/321
Admin Collections Management
21
S15-01Shows collection list with seeded collectionsFAIL
S15-02Can create a new collectionPASS
S15-03Can edit a collectionPASS
S15-01: Only 'Featured Products' - missing expected collections
S15-02: 'E2E Test Collection' created with success message
S15-03: Edit form with Save button works
S16Admin Customer Management
1/312
Admin Customer Management
12
S16-01Shows the customer listPARTIAL
S16-02Shows customer detail with order historyPARTIAL
S16-03Shows customer addressesPASS
S16-01: 'Demo Customer' shown, not 'John Doe' per spec
S16-02: Customer detail shows 1 order, name differs from spec
S16-03: Home address visible in Addresses section
S17Admin Pages Management
2/321
Admin Pages Management
21
S17-01Shows the pages listFAIL
S17-02Can create a new pagePASS
S17-03Can edit an existing pagePASS
S17-01: 'No pages found' - no pages seeded
S17-02: FAQ page created with success message
S17-03: Edit form with Save button works
S18Admin Analytics Dashboard
3/33
Admin Analytics Dashboard
3
S18-01Shows analytics dashboardPASS
S18-02Shows sales dataPASS
S18-03Shows conversion funnel dataPASS
S18-01: Analytics page with heading and data table
S18-02: Orders (1) and Revenue (58.52) shown
S18-03: Visits (12) and Conversion (8.33%) shown