Coalbird
Start trial
Field report · all stores · kitchen · 3 errands

Can an AI agent shop at Caraway?

keeled over  Not one errand survived. Down the page is exactly where each one died.

Caraway failed 3 shopping-agent errands in Coalbird's audit: the agent could not find the product (gave up after 12 steps); the agent could not find the returns policy (gave up after 7 steps); the agent could not get the item into the cart (gave up after 0 steps).

Errand one — find the product

“Find the cookware set and report its price.”

failed — never got there

12 steps · ended on blank

final URL about:blank did not match **/products/**

trace · preview
  1. 01 Initial navigation
  2. 02 Open a new tab and search the web for the Caraway cookware set product page and its pri…
  3. 03 Open a new tab and search Google for the Caraway cookware set product page and price, t…
  4. 04 Open a new tab and run a Bing search for "Caraway cookware set price" to find the offic…
  5. 05 Try to retrieve the official Caraway cookware product page via a text-proxy (r.jina.ai/…
  6. 06 Write the revised recovery plan into todo.md so the steps are saved and then attempt al…
  7. 07 Open the Wayback Machine (web.archive.org) and search for snapshots of carawayhome.com …
  8. 08 Try opening a reputable retailer's search results page (Williams-Sonoma) for 'Caraway c…
  9. 09 Append a note to todo.md recording persistent access blocks and request that the user p…
  10. 10 Show the contents of todo.md to the user and ask them to provide the Caraway product pa…
  11. 11 Ask the user to provide the Caraway product page URL or upload a screenshot/HTML of the…
  12. 12 Consolidate the results and finish the session by reporting what I tried, why I couldn'…
Caraway page where the agent's errand stalled — the last screen before it stopped
The last thing the bird saw before it stopped.

Errand two — find the returns policy

“How many days do customers have to return an item?”

failed — never got there

7 steps · ended on blank

final URL about:blank did not match **return**

trace · preview
  1. 01 Initial navigation
  2. 02 Search the web (duckduckgo) for Caraway's returns/return policy page and find the state…
  3. 03 Search the web (DuckDuckGo) for Caraway return policy pages or cached copies to find th…
  4. 04 Run a DuckDuckGo search for Caraway's return policy (targeting official returns/FAQ/Hel…
  5. 05 Open the Internet Archive (Wayback Machine) for archived pages of carawayhome.com (sear…
  6. 06 Run a Bing search for 'Caraway return policy' and open the most relevant accessible res…
  7. 07 None — per user instruction the agent is being terminated; report findings and set succ…
Caraway page where the agent's errand stalled — the last screen before it stopped
The last thing the bird saw before it stopped.

Errand three — add it to the cart

“Put the cookware set in the cart and prove it's there.”

failed — never got there

0 steps

Same category, different result

All kitchen results are in the kitchen report.

This page is the snapshot. It is not the report.

The bird can walk your store's journeys weekly and email you the day an errand breaks.

Start a trial for your store