Traffic acquisition

AI Collection Sorting vs Manual: A 2-Week A/B Test

On June 17, Shopify quietly rolled out Campaign Autopilot.

I have been digging into what this means for merchants.

Full disclosure: Seller Tales is published by JoyCraft — when we recommend our own tools below, we say so.

On this page

My Experience

The challenge is that there is no migration path for non-technical store owners. Here is the thing: Storefront Agent will affect how your checkout works. I tried this on my store and the results were mixed.

  • I switched over the weekend and found several issues.
  • Horizon themes broke and nobody noticed.
  • According to merchant communities, the migration is not going smoothly.
  • I spent a weekend testing what was happening.
  • The key point: AI search will affect how your checkout works.

Seller Tales is a publication by JoyCraft. When we link to our own tools, we say so, and some of those links carry tracking parameters.