Back to portfolio

Cutting Wasted Ad Spend 48% with New-User Research

Developer tooling / PaaSSep 2020 - Jul 2021

Role: Growth Marketing Manager

As Growth Marketing Manager at Upsun (formerly Platform.sh), I opened a direct chat line to users in their first two weeks to learn who our paid acquisition was really bringing in. I ran the analytics myself and turned those conversations into a targeting brief for the in-house ads team.

The findings showed our ads were vague enough to attract people the platform could never help. The ads team rewrote targeting and messaging from the brief, and within two weeks wasted ad spend fell 48% and non-ICP signups fell 45%.

48%

ad spend optimized

New-user chat interviews exposed wrong-intent arrivals; briefed the in-house ads team on targeting and messaging.

within two weeks

-45%

non-ICP signups

Rewritten targeting and messaging stopped paying for arrivals whose job didn't match the platform.

within two weeks

First 2 weeks

the research cohort

Scoped chat access to users in their first two weeks, early enough to catch intent before it faded.

designed cohort

2 weeks

brief to rewritten campaigns

An evidence-backed targeting brief the ads team could act on immediately.

implementation speed

Company context

Upsun, the cloud application platform humans and AI agents love, is a Series D startup having raised over $180 million in equity funding. It is a fully managed cloud application platform (PaaS) designed to help developers build, test, and deploy software without managing underlying infrastructure.

Company fact
A Series D company
Company fact
Raised $180 million in total funding
Company fact
Developer platform / cloud infrastructure

The problem: healthy dashboards, quiet users

In 2020–2021 I was Growth Marketing Manager at Upsun (formerly Platform.sh), a managed cloud application platform for developers. On the dashboards, acquisition worked: traffic arrived, accounts got created, and the paid channels hit their volume goals. Then too many of those new accounts went quiet.

Two signals disagreed. The traffic data said the ads were winning. The behavior of the people those ads brought in said we were buying the wrong visitors. Both traced to a single root cause. Nobody had asked the arrivals who they were or what they came to do.

Ask the people who just arrived

I scoped a chat cohort in Drift to users in their first two weeks, when intent and confusion are freshest, and gave them a direct line to ask us anything.

Their questions did the diagnosing. The jobs new arrivals wanted done didn't match what the platform does. The ads lacked the clarity to filter out an audience that would never get value from the platform.

The loop, start to finish

Every growth problem I take on runs the same loop. Here is how it ran for this one:

Define the metric. What mattered was the share of new signups matching our ICP and the ad spend buying everyone else.

Read real user signal. The two-week cohort surfaced who was actually arriving and what they expected the platform to do.

Form the hypothesis. Paid targeting and messaging were acquiring people whose jobs the platform was wrong for.

Brief the owning team. The in-house ads managers got an evidence-backed brief on how targeting and messaging needed to change. They implemented, and they kept ownership of their channel.

Report the result. The same cohorts and funnels that found the problem measured the fix.

What changed in two weeks

The brief's instruction fit in one line: stop paying to acquire people the product can't help. The ads team rewrote the campaigns, and two weeks later the numbers were in.

Wasted ad spend fell 48%. The savings came from clearer targeting and messaging, not from cutting budget.

Non-ICP signups fell 45%. The quality check on the spend number. The same budget was now buying arrivals whose jobs matched the platform.

The motion outlived the project. The cohort research and the reporting became standing programs, adopted by the marketing team.

Built hands-on

I was the analytics operator as well as the marketer. The cohorts, funnels, and readouts were mine, built in Pendo, Amplitude, FullStory, PostHog, Google Analytics, and BigQuery (SQL), with Drift running the in-product research.

  • Acquisition looked healthy, with traffic and registrations still coming, but too many new users went quiet.
  • Paid ads routed people straight into the product with nothing checking who they were or what they wanted.
  • Nobody had asked the arrivals themselves who they were or what they expected the platform to do.

How the work unfolded

  1. 1

    New-user research cohort

    2020

    Opened a Drift chat line to users younger than two weeks old to learn who acquisition was really bringing in and what they expected.

  2. 2

    The diagnosis

    2020

    Conversations revealed the ads lacked the clarity to filter out arrivals whose intended job didn't match the platform.

  3. 3

    Ads brief

    2020

    Briefed the in-house ads managers on how targeting and messaging needed to change; they implemented.

  4. 4

    Measured result

    2020

    Within two weeks, ad spend was optimized 48% and non-ICP signups fell 45%.

Want to know who your spend is really buying?

I design the research, run the analytics myself, and brief the changes, then report what happened.

Say hello

Let's talk.

I'm open to conversations about product, AI, or the right opportunity.

© 2026 Tyler Mills·Built by Tyler on Laravel for flexibility • AI-discoverable & MCP-enabled