Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Product Metrics

Overview

This document defines the key metrics we track to measure product success and guide decision-making.

North Star Metrics

Primary Metric: Weekly Active Builds

  • Definition: Unique organizations with at least one successful build in the past 7 days
  • Target: 20% month-over-month growth
  • Current: [Dashboard Link]

Product Metrics

Activation

  • Time to First Build: Time from signup to first successful build
    • Target: < 10 minutes
    • Measured from: Account creation to first build completion
  • Activation Rate: % of signups that complete first build within 7 days
    • Target: > 80%
    • Segmented by: Source, plan type

Engagement

  • Build Frequency: Average builds per organization per week

    • Target: > 50 builds/week for active orgs
    • Segmented by: Organization size, industry

  • Runner Utilization: % of time runners are actively building

    • Target: > 70% during business hours
    • Measured: CPU time / available time

Retention

  • 30-Day Retention: % of orgs active after 30 days

    • Target: > 85%
    • Cohorted by: Signup month

  • 90-Day Retention: % of orgs active after 90 days

    • Target: > 75%
    • Leading indicator: Build frequency in first week

Revenue

  • MRR Growth: Month-over-month recurring revenue growth

    • Target: 15% MoM
    • Segmented by: Plan type, acquisition channel

  • Net Revenue Retention: Revenue from existing customers

    • Target: > 120%
    • Includes: Upgrades, downgrades, churn

Operational Metrics

Performance

  • Build Success Rate: % of builds completing successfully

    • Target: > 99%
    • Excluding: User errors

  • API Latency: p95 response time

    • Target: < 200ms
    • Measured: All API endpoints

Quality

  • Customer Satisfaction (CSAT): Post-interaction survey

    • Target: > 4.5/5
    • Measured: Support interactions

  • Net Promoter Score (NPS): Quarterly survey

    • Target: > 50
    • Segmented by: Customer segment

Leading Indicators

Feature Adoption

  • CLI usage rate
  • API integration rate
  • Advanced features usage

Customer Health

  • Support ticket volume
  • Feature request patterns
  • Churn risk scores

Data Collection

Tools

  • Amplitude: Product analytics
  • Segment: Event tracking
  • Metabase: Business intelligence
  • Custom dashboards: Real-time metrics

Privacy

  • All metrics are aggregated
  • No PII in analytics
  • GDPR compliant tracking
  • User consent required

Reporting

Weekly

  • North star metric update
  • Key metric changes
  • Anomaly alerts

Monthly

  • Full metrics review
  • Cohort analysis
  • Revenue metrics
  • OKR progress

Quarterly

  • Strategic metric review
  • NPS survey results
  • Market comparison
  • Forecast updates