#02 Claude Code Sub-Agents

Features

claude-subagents ยท v2.1.41

Fully Working

73

All acceptance criteria met

Not Working

43

Feature missing or broken

Partially Done

27

Some criteria met, gaps remain

Feature Score

51%

73 of 143 features verified

We ran 143 end-to-end acceptance tests across 18 suites using Playwright MCP browser testing. Each test was executed twice in independent QA runs to confirm reproducibility. Both runs produced identical results for this build.

Suite Summary

SuitePassTotalScore
S1Smoke Tests810
80%
S2Admin Authentication710
70%
S3Admin Product Management67
86%
S4Admin Order Management411
36%
S5Admin Discount Management26
33%
S6Admin Settings17
14%
S7Storefront Browsing1115
73%
S8Cart Flow512
42%
S9Checkout Flow113
8%
S10Customer Account412
33%
S11Inventory Enforcement24
50%
S12Tenant Isolation55
100%
S13Responsive / Mobile68
75%
S14Accessibility711
64%
S15Admin Collections Management13
33%
S16Admin Customer Management23
67%
S17Admin Pages Management13
33%
S18Admin Analytics Dashboard03
0%

Detailed Results

S1

Smoke Tests

8/10
82
S1-01Loads storefront homePASS
S1-02Loads a collection pagePASS
S1-03Loads a product pagePASS
S1-04Loads the cart pagePASS
S1-05Loads the customer login pagePARTIAL
S1-06Loads the admin login pagePASS
S1-07Loads the about pagePASS
S1-08Loads the search pagePASS
S1-09Loads all collections listingPASS
S1-10Has no errors on critical pagesPARTIAL
S1-01: Shows 'Acme Fashion' with featured products
S1-02: T-Shirts collection loads with product grid
S1-03: Product page shows title, price 24.99 EUR, add to cart
S1-04: Cart page loads with 'Your Cart' heading
S1-05: Login form renders but has Alpine JS errors
S1-06: Admin login form renders and works
S1-07: About page shows Our Story, Our Values, Our Team
S1-08: Search for 'shirt' returns 4 results
S1-09: Shows New Arrivals, Pants & Jeans, Sale, T-Shirts
S1-10: Auth pages have Alpine/Livewire JS errors
S2

Admin Authentication

7/10
73
S2-01Can log in as adminPASS
S2-02Shows error for invalid credentialsPASS
S2-03Shows error for empty emailPARTIAL
S2-04Shows error for empty passwordPARTIAL
S2-05Redirects unauthenticated to login from dashboardPASS
S2-06Redirects unauthenticated to login from productsPASS
S2-07Can log outPASS
S2-08Can navigate through admin sidebar sectionsPASS
S2-09Can navigate to analyticsPARTIAL
S2-10Can navigate to themesPASS
S2-01: Dashboard shows Total Sales $1,517.12, Orders 15
S2-02: Shows 'credentials do not match' for wrong password
S2-03: HTML5 validation only, no custom error message
S2-04: HTML5 validation only, no custom error message
S2-05: Redirects to login when not authenticated
S2-06: /admin/products redirects to login
S2-07: Logout via dropdown redirects to login
S2-08: All sidebar sections load correctly
S2-09: Shows placeholder 'Analytics dashboard coming soon'
S2-10: Themes page shows Default Theme with preview
S3

Admin Product Management

6/7
61
S3-01Shows product list with seeded productsPASS
S3-02Can create a new productPASS
S3-03Can edit an existing productPASS
S3-04Can archive a productPASS
S3-05Shows draft products only in adminPASS
S3-06Can search products in adminFAIL
S3-07Can filter products by statusPASS
S3-01: 21 products across 2 pages with columns and filters
S3-02: Created product, redirected to edit page
S3-03: Updated title, success message shown
S3-04: Status changed to Archived, badge shown
S3-05: Draft products hidden from storefront
S3-06: Search input present but typing does not filter
S3-07: Status filter works, Draft shows 2 products
S4

Admin Order Management

4/11
461
S4-01Shows order list with seeded ordersPASS
S4-02Can filter orders by statusPASS
S4-03Shows order detail with line itemsPASS
S4-04Shows order timeline eventsFAIL
S4-05Can create a fulfillmentPARTIAL
S4-06Can process a refundFAIL
S4-07Shows customer info in order detailPASS
S4-08Can confirm bank transfer paymentFAIL
S4-09Shows fulfillment guard for unpaid orderFAIL
S4-10Can mark fulfillment as shippedFAIL
S4-11Can mark fulfillment as deliveredFAIL
S4-01: 15 orders with customer, status, payment, total
S4-02: 3 filter dropdowns: status, financial, fulfillment
S4-03: Line items with SKU, qty, prices, and totals
S4-04: No timeline section on order detail page
S4-05: Fulfillment modal opens but submit returns 500 error
S4-06: Refund action returns 500 Server Error
S4-07: Customer name and email shown in order detail
S4-08: No 'Confirm payment' button for pending orders
S4-09: Fulfill button enabled for unpaid orders, no guard
S4-10: Fulfillment creation fails with 500 error
S4-11: Fulfillment creation fails with 500 error
S5

Admin Discount Management

2/6
24
S5-01Shows seeded discount codesPASS
S5-02Can create percentage discountFAIL
S5-03Can create fixed amount discountFAIL
S5-04Can create free shipping discountFAIL
S5-05Can edit a discountFAIL
S5-06Shows discount status indicatorsPASS
S5-01: All 5 discount codes shown with usage counts
S5-02: Form exists but submission returns 500 Server Error
S5-03: 500 Server Error on form submission
S5-04: 500 Server Error on form submission
S5-05: Edit page exists but Livewire fails with 500 error
S5-06: Active/Expired badges and usage counts shown
S6

Admin Settings

1/7
16
S6-01Can view store settingsPASS
S6-02Can update store nameFAIL
S6-03Can view shipping zonesFAIL
S6-04Can add new shipping rateFAIL
S6-05Can view tax settingsFAIL
S6-06Can update tax inclusion settingFAIL
S6-07Can view domain settingsFAIL
S6-01: Shows store name, currency EUR, timezone
S6-02: Livewire form submissions return 500 errors
S6-03: Shipping tab does not switch content, stays on General
S6-04: Cannot access shipping settings - tab switching broken
S6-05: Taxes tab does not switch content
S6-06: Cannot access tax settings - tab switching broken
S6-07: No Domains tab - only General, Shipping, Taxes
S7

Storefront Browsing

11/15
1131
S7-01Shows featured products on homePASS
S7-02Shows collection with product gridPASS
S7-03Can navigate from collection to productPASS
S7-04Shows product detail with variantsFAIL
S7-05Shows size and color option valuesFAIL
S7-06Updates price when variant changesPARTIAL
S7-07Shows search results for valid queryPASS
S7-08Shows no results for invalid queryPASS
S7-09Does not show draft products on collectionsPASS
S7-10Does not show draft products in searchPASS
S7-11Shows out of stock messagingFAIL
S7-12Shows backorder messagingPASS
S7-13Shows new arrivals collectionPASS
S7-14Shows static about pagePASS
S7-15Navigates between pages using navPASS
S7-01: Featured products with prices and collection section
S7-02: T-Shirts collection shows product grid
S7-03: Collection product links navigate to detail pages
S7-04: No variant selectors on product pages
S7-05: No Size or Color options visible on any product page
S7-06: Sale pricing works but no variant selector to test switch
S7-07: Search for 'cotton' returns correct results
S7-08: Invalid query shows no results / empty state
S7-09: Draft products hidden from storefront collections
S7-10: Draft products not returned in search
S7-11: Deny-policy not enforced - shows 'backorder' instead
S7-12: 'Available on backorder' with enabled add to cart
S7-13: New Arrivals collection loads with products
S7-14: About page shows full content
S7-15: Nav has Home, New Arrivals, T-Shirts, Pants, Sale
S8

Cart Flow

5/12
561
S8-01Can add product to cartPASS
S8-02Can view cart with added itemPASS
S8-03Can update quantity in cartPASS
S8-04Can remove item from cartPASS
S8-05Can add multiple productsPARTIAL
S8-06Can apply WELCOME10 discountFAIL
S8-07Shows error for invalid discountFAIL
S8-08Shows error for expired discountFAIL
S8-09Shows error for maxed out discountFAIL
S8-10Can apply free shipping discountFAIL
S8-11Can apply FLAT5 discountFAIL
S8-12Shows subtotal and total in cartPASS
S8-01: Add to cart works, cart drawer shows product
S8-02: Cart shows product, price, quantity, remove button
S8-03: Quantity increment works, total updates correctly
S8-04: Remove works, shows 'cart is empty'
S8-05: Multiple products added but no variant selection
S8-06: No discount code input field on cart page
S8-07: No discount code input on cart page
S8-08: No discount code input on cart page
S8-09: No discount code input on cart page
S8-10: No discount code input on cart page
S8-11: No discount code input on cart page
S8-12: Order Summary shows subtotal and shipping note
S9

Checkout Flow

1/13
148
S9-01Completes full checkout (credit card)PARTIAL
S9-02Shows shipping methods for DE addressPARTIAL
S9-03Shows international shipping for non-DEPARTIAL
S9-04Applies discount during checkoutFAIL
S9-05Validates required contact emailPARTIAL
S9-06Validates required address fieldsPARTIAL
S9-07Validates invalid postal codeFAIL
S9-08Prevents checkout with empty cartPASS
S9-09Completes checkout with PayPalPARTIAL
S9-10Completes checkout with bank transferPARTIAL
S9-11Shows error for declined cardFAIL
S9-12Shows error for insufficient fundsFAIL
S9-13Switches between payment methodsPARTIAL
S9-01: Checkout completes but no card form fields exist
S9-02: Shipping methods shown but no prices displayed
S9-03: Same shipping options regardless of country
S9-04: No discount code input in checkout flow
S9-05: HTML5 native validation only, no custom messages
S9-06: HTML5 native validation only, no custom messages
S9-07: No postal code format validation
S9-08: Empty cart shows no checkout button
S9-09: PayPal option exists but no actual PayPal flow
S9-10: Bank transfer works but no IBAN/BIC on confirmation
S9-11: No card form fields - cannot enter decline card number
S9-12: No card form fields - cannot test
S9-13: Payment methods switch visually but no sub-forms
S10

Customer Account

4/12
444
S10-01Can register a new customerPARTIAL
S10-02Shows validation for duplicate emailFAIL
S10-03Shows validation for mismatched passwordsFAIL
S10-04Can log in as customerPASS
S10-05Shows error for invalid customer credentialsPARTIAL
S10-06Redirects unauthenticated customersPASS
S10-07Shows order history for customerPASS
S10-08Shows order detail for customerPARTIAL
S10-09Can view addressesPASS
S10-10Can add a new addressFAIL
S10-11Can edit an existing addressFAIL
S10-12Can log outPARTIAL
S10-01: Registration form present but Alpine JS errors
S10-02: Cannot test - Alpine/Livewire JS errors on page
S10-03: Cannot test - Alpine/Livewire JS errors on page
S10-04: Login works, shows 'Welcome back, John Doe'
S10-05: Login form has JS errors, behavior not fully verified
S10-06: /account redirects to /account/login
S10-07: Customer order history shows orders #1001, #1010, etc.
S10-08: Order links exist but detail rendering not verified
S10-09: 2 addresses with Edit, Delete, Add buttons
S10-10: Livewire form submissions have 500 error issues
S10-11: Livewire form submissions have 500 error issues
S10-12: Logout mechanism exists but not fully verified
S11

Inventory Enforcement

2/4
22
S11-01Blocks add-to-cart for out-of-stock denyFAIL
S11-02Allows add-to-cart for backorderPASS
S11-03Shows correct stock for in-stock productPASS
S11-04Prevents adding more than available stockFAIL
S11-01: Deny-policy not enforced - shows 'backorder' instead
S11-02: 'Available on backorder' with enabled add to cart
S11-03: Add to cart enabled for in-stock product
S11-04: No stock quantity limit enforcement in cart
S12

Tenant Isolation

5/5
5
S12-01Store only shows its own productsPASS
S12-02Store collections contain store productsPASS
S12-03Admin cannot access other store dataPASS
S12-04Search only returns current store productsPASS
S12-05Customer accounts scoped to storePASS
S12-01: Only Acme Fashion products visible
S12-02: Collections contain only store-specific products
S12-03: Admin shows only this store's data
S12-04: Search returns only this store's products
S12-05: Customer sees only this store's orders
S13

Responsive / Mobile

6/8
62
S13-01Storefront home on mobilePASS
S13-02Product page stacks on mobilePASS
S13-03Can add to cart on mobilePASS
S13-04Cart page works on mobilePASS
S13-05Checkout flow on mobilePARTIAL
S13-06Admin login on tabletPASS
S13-07Admin sidebar on tabletPASS
S13-08Collection page on mobilePARTIAL
S13-01: Mobile layout with hamburger menu, no horizontal scroll
S13-02: Product info stacked on mobile viewport
S13-03: Add to cart functional on mobile
S13-04: Cart renders correctly on mobile
S13-05: Checkout accessible but same issues as desktop
S13-06: Admin login and dashboard work on tablet
S13-07: Admin sidebar functional on tablet
S13-08: Collection shows products but no filter controls
S14

Accessibility

7/11
713
S14-01Home page has no JS errorsPASS
S14-02Home page has proper heading hierarchyPASS
S14-03Product page has ARIA labelsFAIL
S14-04Product page images have alt textPASS
S14-05Customer login form has accessible labelsPARTIAL
S14-06Admin login form has accessible labelsPARTIAL
S14-07Checkout form has accessible labelsPASS
S14-08Checkout validation errors accessiblePARTIAL
S14-09Can navigate with keyboard onlyPASS
S14-10Cart page has no console errorsPASS
S14-11Search page has proper form labelsPASS
S14-01: Home page loads with 0 JS errors
S14-02: One h1, logical heading hierarchy, lang='en'
S14-03: No variant selectors exist - missing ARIA controls
S14-04: Product images have alt text
S14-05: Labels present but Alpine JS errors on page
S14-06: Labels present but multiple Livewire/Alpine errors
S14-07: Checkout fields properly labeled
S14-08: HTML5 native validation only, no custom messages
S14-09: Skip to content link present, tab navigation works
S14-10: Cart page loads without errors
S14-11: Search form has proper structure and labels
S15

Admin Collections Management

1/3
12
S15-01Shows collection list with seeded collectionsPASS
S15-02Can create a new collectionFAIL
S15-03Can edit a collectionFAIL
S15-01: 4 collections with type, status, product counts
S15-02: Livewire form submission returns 500 Server Error
S15-03: Livewire form submission returns 500 Server Error
S16

Admin Customer Management

2/3
21
S16-01Shows the customer listPASS
S16-02Shows customer detail with order historyPASS
S16-03Shows customer addressesPARTIAL
S16-01: Customer list shows John Doe and others
S16-02: Customer detail shows name, email, order history
S16-03: Addresses managed via storefront, not admin panel
S17

Admin Pages Management

1/3
12
S17-01Shows the pages listPASS
S17-02Can create a new pageFAIL
S17-03Can edit an existing pageFAIL
S17-01: Pages list shows About Us, FAQ, Privacy Policy, etc.
S17-02: Livewire form submission returns 500 Server Error
S17-03: Livewire form submission returns 500 Server Error
S18

Admin Analytics Dashboard

0/3
21
S18-01Shows analytics dashboardPARTIAL
S18-02Shows sales dataFAIL
S18-03Shows conversion funnel dataFAIL
S18-01: Shows placeholder 'Analytics dashboard coming soon'
S18-02: No analytics data - only placeholder text
S18-03: No conversion funnel or metrics shown