How LOZURI used Intelligems to test AI-powered product discovery on Shopify resulting in a 40% increase to RPV
LOZURI used Intelligems to test Nimstrata's Search & Discovery Shopify app to measure the uplift of Google Cloud's Vertex AI on their catalog, resulting in a 38% increase in conversions.
Background
As a beta customer of Nimstrata’s Search & Discovery Shopify app, LOZURI collaborated with Nimstrata to define the most important features and capabilities of an end-to-end solution that connects Shopify stores directly to Google Cloud Vertex AI Search for Retail. As they were rolling out the first version of the product, LOZURI wanted to detemine whether Google’s search algorithms could outperform LOZURI’s existing product discovery solution, Boost AI Search & Discovery. They needed to be able to test and validate the impact of this new tool.
Challenge
They needed to be able to A/B test adding a new app to their Shopify site in order to quantify the impact
Finding an A/B testing tool that could compare multiple Shopify themes proved challenging. Many existing apps required intricate setup procedures that could adversely affect user interaction, while others were limited to testing individual page types rather than entire themes.
Key Goals
Assess the potential revenue and conversion uplift offered by Nimstrata's Search & Discovery Shopify app compared to Boost AI.
Evaluate the effectiveness of Google Cloud's Vertex AI Search for Retail algorithms on LOZURI's luxury goods catalog.
Solution
Intelligems theme test type (part of the Content Testing tools) allowed LOZURI to test the impact of adding Nimstrata to their site
Nimstrata and LOZURI (along with the support from their agency 36.agency) were able to leverage Intelligems to split test their current theme (with the old search app) vs. a new theme with Nimstrata installed. The split test allowed them to answer the following questions:
Does replacing search results and collection pages with Google-powered merchandising increase conversions and/or revenue?
Do different Vertex AI Recommendations models perform better than others?
Can Intelligems provide confidence and statistical significance of the results?
Results
Adding Nimstrata's search to the site increased revenue by 40%!
Through comprehensive testing facilitated by Intelligems, LOZURI was able to confirm that using Google Cloud Vertex AI Search for retail on their website was much better than their current solution:
Following a 50,000+ visitor A/B test over two weeks with a 97.5% confidence level, the test showed that Google Cloud’s Vertex AI Search for retail solution increased conversion rate by 37.81% and revenue per visitor by 39.96%.
Intelligems has proven to be an excellent solution for not only testing the initial app rollout, but also as a solution for long-term testing. LOZURI and Nimstrata are now running targeted experiments to measure the potential uplift of various Google Cloud’s Vertex AI Recommendations models on LOZURI’s product catalog to find even more effective models and solutios.
About LOZURI
LOZURI is a premier, multi-brand digital marketplace offering unique access to luxury fashion from the finest European Boutiques. LOZURI seamlessly bridges the gap between aspiration and accessibility while providing world-class client services.
LOZURI features a wide selection of luxury fashion goods with rare finds from renowned designers not easily available in local stores. The catalog includes designer bags, shoes, clothing, and accessories. All items on LOZURI are brand new with original packaging and tags with authenticity guaranteed.
About Nimstrata
Nimstrata is a certified Google Cloud partner and has built the first and only fully-managed service to connect Shopify stores directly to Google Cloud Vertex AI Search and Recommendations.
