$30 off During Our Annual Pro Sale. View Details »

Ensuring Value in our Work: The ROI of Design (FEDC 2018)

Jared Ponchot
April 26, 2018
83

Ensuring Value in our Work: The ROI of Design (FEDC 2018)

This was a talk at FEDC 2018 about how to measure the ROI of design.

Jared Ponchot

April 26, 2018
Tweet

Transcript

  1. ENSURING VALUE
    IN OUR WORK
    The ROI of Design
    JARED PONCHOT // @JPONCH // FEDC 2018

    View Slide

  2. ‣Understanding the ROI of an
    improved User Experience
    WHAT’S MOST IMPORTANT FOR YOUR AGENCY RIGHT NOW?

    View Slide

  3. THE ROI OF DESIGN?

    View Slide

  4. ROI=

    RETURN ON
    INVESTMENT

    View Slide

  5. the resources (e.g. time, money) we
    invest in design will wind up getting
    us even more money in return?
    HOW CAN WE KNOW THAT …

    View Slide

  6. View Slide


  7. — ALBERT EINSTEIN
    If you can’t explain it to a six year
    old, you don’t understand it yourself.

    View Slide

  8. A TAXONOMY FOR
    DESIGN VALUE

    View Slide

  9. ‣ Brand
    ‣ Innovation
    ‣ Efficiency
    ‣ Satisfaction
    ‣ Sustainability

    View Slide

  10. BRAND

    View Slide


  11. — HARTMUT ESSLINGER, FROG DESIGN
    Money buys, but emotion sells.

    View Slide

  12. View Slide

  13. Desirability Studies

    View Slide

  14. INNOVATION

    View Slide

  15. ‣ Making strategic initiatives possible
    ‣ Creating new products, services, etc.
    ‣ Enabling entry into new markets
    INNOVATION THROUGH

    View Slide

  16. Re-imagining
    problems

    View Slide

  17. Tesco Subway Store in South Korea image from littledoremi.com

    View Slide

  18. from evigo.com

    View Slide

  19. from jcdecaux-oneworld.com

    View Slide

  20. Intellectual Property

    View Slide

  21. EFFICIENCY

    View Slide

  22. 25% FAIL OUTRIGHT
    IT PROJECTS
    PROVIDE NO ROI (IF THEY SUCCEED)
    20-25%
    REQUIRE SIGNIFICANT REWORK
    50%
    Based on a 2009 study

    View Slide

  23. Poor requirements

    View Slide

  24. Editorial & process
    improvements

    View Slide

  25. Customer service
    requests

    View Slide

  26. SATISFACTION

    View Slide


  27. — JEROME KATHMAN, CEO OF LPK
    Consumer-preferred design outperforms
    management-preferred design.

    View Slide

  28. Usability

    View Slide

  29. SUSTAINABILITY

    View Slide

  30. YOUR USERS

    desirability YOUR BUSINESS

    viability
    YOUR BUILD TEAM

    feasibility

    View Slide

  31. ‣ Is it changing how customers see our brand?
    ‣ Is it helping us innovate?
    ‣ Is it increasing efficiency?
    ‣ Is it improving satisfaction?
    ‣ Is it making things more sustainable?

    View Slide

  32. MEASURING IS HARD

    View Slide

  33. Projects often begin with a
    measurement to improve

    View Slide

  34. Simpson’s Paradox

    View Slide

  35. 7.9%
    11%

    View Slide

  36. 22.9%
    2.8%
    0%
    11.3%

    View Slide

  37. View Slide

  38. View Slide

  39. “If an unfriendly foreign power
    had attempted to impose these
    bad schools on us, we might well
    have viewed it as an act of war.”

    View Slide

  40. MATH SCORES
    40pts
    VERBAL SCORES
    50pts

    View Slide

  41. Bad Teachers

    View Slide

  42. More test takers

    View Slide

  43. LOW INCOME
    INCOME:
    LURKING VARIABLE
    MIDDLE INCOME
    HIGH INCOME

    View Slide

  44. LOW INCOME
    INCOME:
    LURKING VARIABLE
    MIDDLE INCOME
    HIGH INCOME

    View Slide

  45. LOW INCOME
    INCOME:
    LURKING VARIABLE
    MIDDLE INCOME
    HIGH INCOME

    View Slide

  46. LOW INCOME
    INCOME:
    LURKING VARIABLE
    MIDDLE INCOME
    HIGH INCOME

    View Slide

  47. 448/8,000 VISITS
    PAGE A
    5.6%
    584/8,000 VISITS
    7.3%
    PAGE B

    View Slide

  48. PAGE A PAGE B

    View Slide

  49. PAGE A PAGE B
    FACEBOOK
    300/6,000
    5%

    View Slide

  50. PAGE A
    FACEBOOK
    30/750
    4%
    PAGE B
    FACEBOOK
    300/6,000
    5%

    View Slide

  51. PAGE A
    GOOGLE ADS
    60/1,000
    6%
    FACEBOOK
    30/750
    4%
    PAGE B
    FACEBOOK
    300/6,000
    5%

    View Slide

  52. PAGE A
    GOOGLE ADS
    60/1,000
    6% GOOGLE ADS
    40/800
    5%
    FACEBOOK
    30/750
    4%
    PAGE B
    FACEBOOK
    300/6,000
    5%

    View Slide

  53. PAGE A
    GOOGLE ADS
    60/1,000
    6%
    EMAIL
    90/1,000
    9%
    GOOGLE ADS
    40/800
    5%
    FACEBOOK
    30/750
    4%
    PAGE B
    FACEBOOK
    300/6,000
    5%

    View Slide

  54. PAGE A
    GOOGLE ADS
    60/1,000
    6%
    EMAIL
    90/1,000
    9%
    GOOGLE ADS
    40/800
    5%
    EMAIL
    516/6,450
    8%
    FACEBOOK
    30/750
    4%
    PAGE B
    FACEBOOK
    300/6,000
    5%

    View Slide

  55. View Slide

  56. DATA != MEANING

    View Slide

  57. Confirmation Bias

    View Slide


  58. — UPTON SINCLAIR
    It is difficult to get a man to
    understand something, when his
    salary depends on his NOT
    understanding it.

    View Slide

  59. Gestalt Principle:
    Isomorphism

    View Slide

  60. View Slide

  61. Photos from Reddit

    View Slide


  62. — JACK HANDY
    To me, clowns aren't funny. In fact,
    they're kind of scary. I've wondered
    where this started and I think it goes
    back to the time I went to the circus,
    and a clown killed my dad.

    View Slide

  63. Photo by Ghida Basma

    View Slide

  64. Availability Heuristic

    View Slide

  65. View Slide


  66. — ERIKA HALL
    We tend to measure what we can easily
    count, but not necessarily what counts.

    View Slide

  67. Goodhart’s Law

    View Slide

  68. MORE DATA !=
    BETTER DECISIONS

    View Slide

  69. Photos by Reuters / Bassim Shati and from https://www.huffingtonpost.co.uk/2014/05/07/working-at-amazon-like_n_5278503.html

    View Slide

  70. The allure of cheap science

    View Slide

  71. SCIENCE & ART

    View Slide

  72. View Slide

  73. Sunset photo from http://www.city-data.com/picfilesv/picv16390.php

    View Slide

  74. View Slide

  75. From https://reasonandreflection.wordpress.com/tag/atomic-bomb/

    View Slide

  76. 1. Mystery
    2. Hypothesis
    3. Repeated Experimentation
    4. Theory
    5. Fact
    SCIENTIFIC METHOD

    View Slide

  77. 1. Mystery

    View Slide

  78. 2. Hypothesis

    View Slide

  79. 3. Repeated
    Experimentation

    View Slide

  80. 4. Theory

    View Slide

  81. 5. Fact

    View Slide

  82. Repeat

    View Slide

  83. EPISTEMOLOGY

    View Slide

  84. How do we know things?

    View Slide

  85. From wallpapercave.com

    View Slide


  86. — JEFF BEZOS
    “Most decisions should probably be
    made with somewhere around 70% of
    the information you wish you had. If
    you wait for 90%, in most cases,
    you’re probably being slow.

    View Slide

  87. Trust

    View Slide

  88. TAKE RISKS

    View Slide

  89. The value of design

    View Slide


  90. — ANNE LAMOTT
    Perfectionism is the voice of the
    oppressor, the enemy of the people. It
    will keep you cramped and insane your
    whole life, and it is the main obstacle
    between you and a shitty first draft.

    View Slide

  91. THANKS!
    Jared Ponchot
    @jponch

    View Slide