#16 Cursor · Grok 4.5 (Multi-Model Sub-Agents)

Features

2026-07-18-cursor-grok-4-5 · Cursor

Fully Working

127

All acceptance criteria met

Not Working

11

Feature missing or broken

Partially Done

5

Some criteria met, gaps remain

Feature Score

91%

127 of 143 tests pass (weighted)

We ran 143 end-to-end acceptance tests across 18 suites using Playwright MCP browser testing. Each test was executed non-scripted by an independent QA run against the local dev build.

Suite Summary

SuitePassTotalScore
S1Smoke Tests1010
100%
S2Admin Authentication1010
100%
S3Admin Product Management77
100%
S4Admin Order Management911
82%
S5Admin Discount Management66
100%
S6Admin Settings67
86%
S7Storefront Browsing1415
93%
S8Cart Flow1212
100%
S9Checkout Flow1213
92%
S10Customer Account712
58%
S11Inventory Enforcement24
50%
S12Tenant Isolation45
80%
S13Responsive / Mobile88
100%
S14Accessibility1011
91%
S15Admin Collections Management33
100%
S16Admin Customer Management33
100%
S17Admin Pages Management23
67%
S18Admin Analytics Dashboard23
67%

Detailed Results

S1

Smoke Tests

10/10
10
S1-01Loads storefront homePASS
S1-02Loads a collection pagePASS
S1-03Loads a product pagePASS
S1-04Loads the cart pagePASS
S1-05Loads the customer login pagePASS
S1-06Loads the admin login pagePASS
S1-07Loads the about pagePASS
S1-08Loads the search pagePASS
S1-09Loads all collections listingPASS
S1-10Has no errors on critical pagesPASS
S1-01: "Welcome to Acme Fashion" hero, 4 collection cards, 8 featured products; only a favicon 404 in console.
S1-02: `/collections/t-shirts`: "T-Shirts", 4 products, sort + filters sidebar.
S1-03: `/products/classic-cotton-t-shirt`: title, 24.99 EUR, labelled Size/Color groups, Add to cart.
S1-04: "Your Cart" heading, empty-state copy + "Continue shopping".
S1-05: "Log in" with Email/Password + "Create one" link.
S1-06: "Admin sign in" form.
S1-07: `/pages/about` → "About Us".
S1-08: `/search?q=shirt` → "2 results for shirt".
S1-09: Lists New Arrivals, Pants & Jeans, Sale, T-Shirts.
S1-10: No JS exceptions or 500s across the batch (favicon 404 only).
S2

Admin Authentication

10/10
10
S2-01Can log in as adminPASS
S2-02Shows error for invalid credentialsPASS
S2-03Shows error for empty emailPASS
S2-04Shows error for empty passwordPASS
S2-05Redirects unauthenticated to login from dashboardPASS
S2-06Redirects unauthenticated to login from productsPASS
S2-07Can log outPASS
S2-08Can navigate through admin sidebar sectionsPASS
S2-09Can navigate to analyticsPASS
S2-10Can navigate to themesPASS
S2-01: Dashboard with revenue/orders/AOV/customers KPIs and recent-orders table.
S2-02: "Invalid credentials." alert tied to the email field.
S2-03: "The email field is required."
S2-04: "The password field is required."
S2-05: Redirects to `/admin/login`.
S2-06: Redirects to `/admin/login`.
S2-07: Sidebar "Log out" → `/admin/login`.
S2-08: Products / Orders / Customers / Discounts / Settings all load with correct headings.
S2-09: `/admin/analytics` → "Analytics".
S2-10: `/admin/themes` loads.
S3

Admin Product Management

7/7
7
S3-01Shows product list with seeded productsPASS
S3-02Can create a new productPASS
S3-03Can edit an existing productPASS
S3-04Can archive a productPASS
S3-05Shows draft products only in adminPASS
S3-06Can search products in adminPASS
S3-07Can filter products by statusPASS
S3-01: 21 products incl. Classic Cotton T-Shirt + Premium Slim Fit Jeans; status filter, search, pagination.
S3-02: Fields labelled "Price (minor units)" / "Inventory quantity"; entered 2999/50 → "Product saved.", product id 26 created at €29.99.
S3-03: Renamed "Classic Cotton T-Shirt" → "...Updated" and back; "Product saved." both times, no crash.
S3-04: Set product 26 status → Archived; "Active" filter excludes it, "Archived" filter includes it.
S3-05: "Unreleased Winter Jacket" visible in admin (Draft filter); storefront search for "Unreleased" → 0 results.
S3-06: "Cotton" → only "Classic Cotton T-Shirt".
S3-07: Active/Draft/Archived dropdown filters correctly (URL query param is ignored, but the UI dropdown works).
S4

Admin Order Management

9/11
92
S4-01Shows order list with seeded ordersPASS
S4-02Can filter orders by statusFAIL
S4-03Shows order detail with line itemsPASS
S4-04Shows order timeline eventsFAIL
S4-05Can create a fulfillmentPASS
S4-06Can process a refundPASS
S4-07Shows customer info in order detailPASS
S4-08Can confirm bank transfer paymentPASS
S4-09Shows fulfillment guard for unpaid orderPASS
S4-10Can mark fulfillment as shippedPASS
S4-11Can mark fulfillment as deliveredPASS
S4-01: 16+ orders incl. #1001, with payment/fulfillment columns.
S4-02: The "paid" tab excludes three genuinely-Paid orders (#1001, #1002, #1007) and incorrectly includes #1008 (Partially refunded).
S4-03: #1001: line item, Subtotal/Discount/Shipping/Tax/Total (54.97 EUR), customer + addresses.
S4-04: No Timeline/Activity section exists on the order-detail page.
S4-05: DHL + DHL123456789 on #1015 → "Fulfillment created." toast, tracking visible, "Mark shipped" appears (modal stays open — minor).
S4-06: 10.00 EUR refund on #1001 → "Refund issued." toast, status → "Partially refunded" (modal stays open — minor).
S4-07: John Doe / customer@acme.test shown with shipping/billing addresses.
S4-08: Pending #1005 → "Confirm payment" → "Payment confirmed." status → Paid, button gone.
S4-09: Pending #1005 shows "Payment must be confirmed before items can be fulfilled." with no fulfillment button.
S4-10: "Mark shipped" → status "Shipped", "Mark delivered" appears.
S4-11: "Mark delivered" → fulfillment "Delivered", order fulfillment status → Fulfilled.
S5

Admin Discount Management

6/6
6
S5-01Shows seeded discount codesPASS
S5-02Can create percentage discountPASS
S5-03Can create fixed amount discountPASS
S5-04Can create free shipping discountPASS
S5-05Can edit a discountPASS
S5-06Shows discount status indicatorsPASS
S5-01: WELCOME10 (10%), FLAT5 (5.00), FREESHIP, EXPIRED20 (Expired), MAXED (5/5) all present with status badges.
S5-02: `E2ETEST25-CURSORGROK45` 25% → "Discount saved.", appears in list.
S5-03: `E2EFLAT10-CURSORGROK45` 1000 (10.00) → saved; list shows "10.00".
S5-04: `E2EFREESHIP-CURSORGROK45` → Value field correctly hidden for Free shipping; saved.
S5-05: WELCOME10 value 10 → 15 → "Discount saved."; reverted to 10.
S5-06: "Active" badges for active codes; EXPIRED20 shows "Expired".
S6

Admin Settings

6/7
61
S6-01Can view store settingsPASS
S6-02Can update store namePASS
S6-03Can view shipping zonesPASS
S6-04Can add new shipping ratePASS
S6-05Can view tax settingsPASS
S6-06Can update tax inclusion settingPASS
S6-07Can view domain settingsFAIL
S6-01: "Settings": Store name "Acme Fashion", disabled handle, currency/language/timezone; General/Shipping/Taxes tabs.
S6-02: → "Acme Fashion Updated" → "Settings saved." toast, persisted on reload, header updated; reverted.
S6-03: Domestic (DE) Standard 4.99 + Express 9.99; EU 8.99; Rest of World (US, GB, CA, AU) International 14.99.
S6-04: "Overnight Shipping" 14.99 added to Domestic zone, appears immediately and later at checkout.
S6-05: Manual tax-rate mode, "Prices include tax" toggle (checked).
S6-06: Toggled off → "Tax settings saved."; reverted, saved again.
S6-07: No Domains tab exists; `/admin/settings/domains` returns 404.
S7

Storefront Browsing

14/15
141
S7-01Shows featured products on homePASS
S7-02Shows collection with product gridPASS
S7-03Can navigate from collection to productPASS
S7-04Shows product detail with variantsPASS
S7-05Shows size and color option valuesPASS
S7-06Updates price when variant changesPASS
S7-07Shows search results for valid queryPASS
S7-08Shows no results for invalid queryPASS
S7-09Does not show draft products on collectionsPASS
S7-10Does not show draft products in searchPASS
S7-11Shows out of stock messagingPASS
S7-12Shows backorder messagingPARTIAL
S7-13Shows new arrivals collectionPASS
S7-14Shows static about pagePASS
S7-15Navigates between pages using navPASS
S7-01: Store name + 8 featured products with prices (Cashmere Overcoat, Gift Card, Bucket Hat 24.99, Wide Leg Trousers on sale, etc.); Classic Cotton T-Shirt is not in the featured set (same as prior builds on this seed).
S7-02: t-shirts: 4 products + sort/filter sidebar.
S7-03: Nav from collection to Classic Cotton T-Shirt PDP.
S7-04: Labelled `group "Size"` and `group "Color"` with S/M/L/XL and White/Black/Navy.
S7-05: All option values shown as individually selectable buttons.
S7-06: Premium Slim Fit Jeans: 79.99 EUR sale + 99.99 EUR compare-at + "Sale" badge.
S7-07: "cotton" → Classic Cotton T-Shirt.
S7-08: `zznonexistentproductzz` → "0 results" + "No results for …".
S7-09: "Unreleased Winter Jacket" not present in any collection.
S7-10: `/search?q=Unreleased` → 0 results.
S7-11: Limited Edition Sneakers: "Out of stock", "Sold out" button disabled.
S7-12: Backorder Denim Jacket adds to cart (continue-policy correct) but the PDP reads "In stock" rather than "Available on backorder".
S7-13: `/collections/new-arrivals` → "New Arrivals".
S7-14: Renders Our Story / Our Values / Our Team.
S7-15: Direct "T-Shirts" nav link → collection page.
S8

Cart Flow

12/12
12
S8-01Can add product to cartPASS
S8-02Can view cart with added itemPASS
S8-03Can update quantity in cartPASS
S8-04Can remove item from cartPASS
S8-05Can add multiple productsPASS
S8-06Can apply WELCOME10 discountPASS
S8-07Shows error for invalid discountPASS
S8-08Shows error for expired discountPASS
S8-09Shows error for maxed out discountPASS
S8-10Can apply free shipping discountPASS
S8-11Can apply FLAT5 discountPASS
S8-12Shows subtotal and total in cartPASS
S8-01: Classic Cotton T-Shirt M/Black → "Added to cart", cart drawer opens with item + 24.99 EUR, count → 1.
S8-02: `/cart` shows item + 24.99 EUR.
S8-03: qty 2 → line total 49.98 EUR.
S8-04: Remove (with confirm dialog) → "Your cart is empty".
S8-05: T-Shirt + Premium Slim Fit Jeans both present, Subtotal 104.98 EUR.
S8-06: "WELCOME10 applied", −2.50 EUR (10% of 24.99), total 22.49 EUR.
S8-07: "INVALID" → "Discount not found".
S8-08: "EXPIRED20" → "Discount expired".
S8-09: "MAXED" → "Discount usage limit reached".
S8-10: "FREESHIP applied" label shown.
S8-11: "FLAT5 applied", −5.00 EUR, total 19.99 EUR.
S8-12: Subtotal + Total both shown with correct amounts.
S9

Checkout Flow

12/13
121
S9-01Completes full checkout (credit card)PASS
S9-02Shows shipping methods for DE addressPASS
S9-03Shows international shipping for non-DEPASS
S9-04Applies discount during checkoutPASS
S9-05Validates required contact emailPASS
S9-06Validates required address fieldsPASS
S9-07Validates invalid postal codeFAIL
S9-08Prevents checkout with empty cartPASS
S9-09Completes checkout with PayPalPASS
S9-10Completes checkout with bank transferPASS
S9-11Shows error for declined cardPASS
S9-12Shows error for insufficient fundsPASS
S9-13Switches between payment methodsPASS
S9-01: `4242 4242 4242 4242` → "Thank you for your order!" Order #1017, total 24.98 EUR (with FLAT5).
S9-02: DE/Berlin → Domestic: Standard 4.99 / Express 9.99 / Overnight 14.99 (incl. the rate added in S6-04).
S9-03: US/New York → "International" 14.99, distinct from Domestic rates.
S9-04: FLAT5 carries from cart; total resolves to 24.98 EUR (24.99 − 5.00 + 4.99).
S9-05: Continue with empty email → native "Please fill in this field."
S9-06: Native required validation on email, first name, last name, address, city, postal code.
S9-07: `INVALID` + DE is accepted and advances to the shipping step with no format error.
S9-08: Empty cart hides Checkout, shows empty state; `/checkout` (no id) returns 404.
S9-09: PayPal → "Thank you for your order!" Order #1018, Payment Method "PayPal".
S9-10: Order #1019 with full instructions: Mock Bank AG, IBAN DE89 3704 0044 0532 0130 00, BIC COBADEFFXXX, reference #1019, 7-day hold.
S9-11: `4000 0000 0000 0002` → "Payment declined: The card was declined.", stays on checkout.
S9-12: `4000 0000 0000 9995` → "Payment declined: The card has insufficient funds.", stays on checkout.
S9-13: Card fields hide for PayPal/Bank Transfer; each method shows distinct CTA ("Pay now" / "Pay with PayPal" / "Place order") and its own copy.
S10

Customer Account

7/12
741
S10-01Can register a new customerPASS
S10-02Shows validation for duplicate emailPASS
S10-03Shows validation for mismatched passwordsPASS
S10-04Can log in as customerPASS
S10-05Shows error for invalid customer credentialsFAIL
S10-06Redirects unauthenticated customersPASS
S10-07Shows order history for customerPASS
S10-08Shows order detail for customerFAIL
S10-09Can view addressesPASS
S10-10Can add a new addressFAIL
S10-11Can edit an existing addressFAIL
S10-12Can log outPARTIAL
S10-01: "Welcome back, New Customer E2E!" on `/account` after registration.
S10-02: `customer@acme.test` → "An account with this email already exists."
S10-03: "The password field confirmation does not match."
S10-04: `customer@acme.test` → "Welcome back, John Doe!" with recent orders.
S10-05: Wrong password clears the form but shows no error message at all — silent failure.
S10-06: `/account` (logged out) → redirected to `/account/login`.
S10-07: #1015, #1010, #1001, #1002, #1004 listed for John Doe with status and total.
S10-08: Order-number and "View" links point at `…/orders/#1001` (literal `#` fragment) so clicking does nothing; the detail page only renders when the `#` is URL-encoded (`%231001`).
S10-09: "Home (Default)" and "Work" addresses listed.
S10-10: "Add new address" is inert — no modal, no request; page throws `ReferenceError: fluxModal is not defined` on load.
S10-11: "Edit" on any address is equally inert (same root cause).
S10-12: Logout works on a fresh page load (verified for the newly-registered customer) but the account-page button stops responding after SPA-navigating through the broken addresses page; a hard reload or direct form POST is required.
S11

Inventory Enforcement

2/4
22
S11-01Blocks add-to-cart for out-of-stock denyPASS
S11-02Allows add-to-cart for backorderPARTIAL
S11-03Shows correct stock for in-stock productPASS
S11-04Prevents adding more than available stockPARTIAL
S11-01: Limited Edition Sneakers: "Out of stock", "Sold out" button disabled, quantity locked.
S11-02: Backorder Denim Jacket adds to cart successfully (continue-policy correct) but the PDP shows "In stock" rather than "Available on backorder".
S11-03: Classic Cotton T-Shirt: "In stock", Add-to-cart enabled.
S11-04: Requesting 20 against an 8-in-stock jeans variant is correctly blocked (increment button disables, cart stays empty) but with no user-facing error.
S12

Tenant Isolation

4/5
41
S12-01Store only shows its own productsPASS
S12-02Store collections contain store productsPASS
S12-03Admin cannot access other store dataFAIL
S12-04Search only returns current store productsPASS
S12-05Customer accounts scoped to storePASS
S12-01: `acme-electronics.test` storefront shows only Electronics products (Monitor Stand, Mechanical Keyboard, etc.), no Fashion products.
S12-02: Electronics "Accessories" collection contains only USB-C Cable + Monitor Stand.
S12-03: **Critical.** `acme-electronics.test/admin/products` (shared credentials) shows Acme Fashion's full 21-product catalog; the header store-switcher reads "Acme Fashion" on the Electronics domain.
S12-04: Electronics storefront search for "fashion" → 0 results, no cross-store leakage.
S12-05: Fashion's `customer@acme.test` login is rejected on the Electronics storefront (returns to login).
S13

Responsive / Mobile

8/8
8
S13-01Storefront home on mobilePASS
S13-02Product page stacks on mobilePASS
S13-03Can add to cart on mobilePASS
S13-04Cart page works on mobilePASS
S13-05Checkout flow on mobilePASS
S13-06Admin login on tabletPASS
S13-07Admin sidebar on tabletPASS
S13-08Collection page on mobilePASS
S13-01: "Open mobile navigation" hamburger visible, scrollWidth == clientWidth (no horizontal scroll).
S13-02: Title/price/variant selectors/Add to cart all visible, no horizontal scroll.
S13-03: "Added to cart" + cart drawer with item confirms add.
S13-04: Item + Checkout button visible, no horizontal scroll.
S13-05: Collapsible "Show order summary" bar; address + shipping steps reachable, no horizontal scroll.
S13-06: At 768×1024: Dashboard loads after sign-in, no horizontal scroll.
S13-07: Products and Orders sections load with correct headings.
S13-08: t-shirts collection: title, products, Filters sidebar present, no horizontal scroll.
S14

Accessibility

10/11
101
S14-01Home page has no JS errorsPASS
S14-02Home page has proper heading hierarchyPASS
S14-03Product page has ARIA labelsPASS
S14-04Product page images have alt textPARTIAL
S14-05Customer login form has accessible labelsPASS
S14-06Admin login form has accessible labelsPASS
S14-07Checkout form has accessible labelsPASS
S14-08Checkout validation errors accessiblePASS
S14-09Can navigate with keyboard onlyPASS
S14-10Cart page has no console errorsPASS
S14-11Search page has proper form labelsPASS
S14-01: 0 console errors/warnings on the home page (favicon 404 aside).
S14-02: Exactly one visible H1 ("Welcome to Acme Fashion"), logical H2/H3 order (the hidden cart-drawer H2 is `display:none`).
S14-03: `group "Size"` / `group "Color"` with accessible names; "Add to cart" labelled.
S14-04: No real product photography; placeholder is an `aria-hidden` SVG inside `role="region" aria-label="Product images"` — the region is named but no per-product accessible name is exposed.
S14-05: "Email" and "Password" labels associated with inputs.
S14-06: "Email address" / "Password" labels present.
S14-07: Email + all address/payment fields have accessible names.
S14-08: Native required-field messages associated with their inputs.
S14-09: First Tab focuses "Skip to main content" (visible focus outline); Tab → "New Arrivals" nav link, Enter navigates there.
S14-10: 0 console errors/warnings on cart load.
S14-11: Search input has an accessible name ("Search products"/searchbox).
S15

Admin Collections Management

3/3
3
S15-01Shows collection list with seeded collectionsPASS
S15-02Can create a new collectionPASS
S15-03Can edit a collectionPASS
S15-01: New Arrivals, T-Shirts, Pants & Jeans, Sale listed with product counts.
S15-02: "E2E Test Collection" created and appears in the list (save round-trip is slow, >5s, but succeeds).
S15-03: T-Shirts description updated → "Collection saved." (again a slow round-trip).
S16

Admin Customer Management

3/3
3
S16-01Shows the customer listPASS
S16-02Shows customer detail with order historyPASS
S16-03Shows customer addressesPASS
S16-01: John Doe / customer@acme.test present with order count + total spent, alongside seeded and test customers.
S16-02: John Doe: customer info + order history (#1015, #1010, #1001, #1002, #1004) with correct numeric order links (`/admin/orders/1`, etc.).
S16-03: "Addresses" section shows Home (Default) + Work with Edit/Default/Delete actions and an "Add" button.
S17

Admin Pages Management

2/3
21
S17-01Shows the pages listPASS
S17-02Can create a new pageFAIL
S17-03Can edit an existing pagePASS
S17-01: About Us, FAQ, Shipping & Returns, Privacy Policy, Terms of Service listed.
S17-02: Creating a page titled "FAQ" (handle collides with the seeded `faq`) returns HTTP 500 and renders the full Ignition debug page (`UniqueConstraintViolationException`, source, raw SQL, session cookies) instead of an inline validation error. Creating a page with a unique title works.
S17-03: About Us body edited → "Page saved.", persisted; reverted to original.
S18

Admin Analytics Dashboard

2/3
21
S18-01Shows analytics dashboardPASS
S18-02Shows sales dataPASS
S18-03Shows conversion funnel dataFAIL
S18-01: "Analytics" heading with Date range / Channel / Device filters.
S18-02: KPI tiles: Total sales 1,582.08 EUR, Orders 19, Average order 83.26, Conversion rate 0.0%.
S18-03: No funnel: there is no "Visits" / Add-to-cart / Checkout-started / Orders funnel — only KPI tiles and a "Sales trend" placeholder ("Detailed event analytics will appear as traffic is collected.").