How to A/B Test an App Icon on iOS and Android

How to A/B test an app icon

Follow these steps in order. Each one is something we do on client work.

Design truly different variants. Colour or symbol, not tiny tweaks.
Include icons in the binary on iOS. Product page optimization icon treatments need alternate icons in the build.
Set up the test. PPO on iOS; store listing experiments on Play.
Run full weeks. Wait for confidence.
Apply and update the build. Make sure the in-app icon matches.
Log the result. For future tests.

A/B test app icon: key rules and context

iOS steps

Add alternate icon assets in Xcode.
Ship that build.
In PPO, create treatments using those icons (Apple: PPO).
Run; apply the winner as the primary icon in the next build.

Google Play steps. Store listing experiments > icon variants > audience % > start (guide).

Pitfalls. Changing several things at once, stopping early, and testing tiny differences. Test meaningfully different icons.

Getting variants. See create an app icon or buy Icons A/B.

Worked example (hypothetical)

This example is illustrative. The app is made up, and so are any numbers in it.

Imagine TaskTiger tests orange versus blue. We'd add both as alternate icons in the iOS build, run PPO, and apply the winner as the primary icon in the next update.

Common mistakes

Tiny differences. No signal.
Forgetting alternate icons in the build. Can't test icons on iOS.
Stopping early. Noise.
Mismatched home-screen icon. Confusing.

If you want this handled for you, our pricing page lists every fixed package.

Native testing tools compared

Use the store's own test tool before any third-party guesswork.

	Apple product page optimization	Google Play store listing experiments
What you can test	Icon, screenshots, previews	Graphics and text (icon, screenshots, descriptions)
Variants	Up to 3 treatments vs original	Up to 2 variants vs current listing
Localization	Treatments can be localized	Run per language (localized experiments)
How winners are judged	Estimated conversion lift with confidence	Performance vs current listing over the test

Icon specs for both stores

Design once at high resolution, then export to each store's rules.

Store	Size	Rules
App Store	1024 × 1024 px master	Layered icon; the system applies the mask, so don't bake in rounded corners
Google Play	512 × 512 px	32-bit PNG with alpha, max 1,024 KB
Google Play policy	—	No badges, ranking text or misleading symbols (e.g. fake notification dots)
App Store policy (2.3.8)	—	Icons must suit a 4+ audience even if the app is rated higher

How we measure the result

For A/B test app icon, we treat the icon as a conversion asset first. The icon appears in search results, charts, the product page and on the home screen, which makes it one of the highest-leverage assets to test. On Google Play, store listing experiments can test graphics, including the icon.

Checklist

Copy this list into your release notes or ticket and tick each item off before you ship.

Sources

Apple: Product page optimization (accessed 26 October 2026)
Google Play Console Help: Run store listing experiments (accessed 26 October 2026)
Apple Human Interface Guidelines: App icons (accessed 26 October 2026)
Apple App Store Connect Help: Overview of product page optimization (accessed 26 October 2026)
Play Console Help: Add preview assets to showcase your app (accessed 26 October 2026)
Play Console Help: Metadata policy (accessed 26 October 2026)
Apple: App Review Guidelines (accessed 26 October 2026)

FAQ

Questions

Can I test icons without a new build on iOS?

No.

How long should an icon test run?

Until confident, often 1–3 weeks.

Which metric?

Conversion rate (iOS), retained installers (Play).

Does the icon change on users' phones?

Only for users who install from the treatment, on iOS.

Can you make the variants?

Yes.

Can I test app icons on the App Store?

Yes. Product page optimization can test up to three different icons, with the icons included in the app binary.

How to A/B test an app icon