Ensuring Value in our Work: The ROI of Design (FEDC 2018)

Transcript

1. ENSURING VALUE
   IN OUR WORK
   The ROI of Design
   JARED PONCHOT // @JPONCH // FEDC 2018
   

   View Slide

2. ‣Understanding the ROI of an
   improved User Experience
   WHAT’S MOST IMPORTANT FOR YOUR AGENCY RIGHT NOW?
   

   View Slide

3. THE ROI OF DESIGN?
   

   View Slide

4. ROI=

   RETURN ON
   INVESTMENT
   

   View Slide

5. the resources (e.g. time, money) we
   invest in design will wind up getting
   us even more money in return?
   HOW CAN WE KNOW THAT …
   

   View Slide

6. View Slide

7. “
   — ALBERT EINSTEIN
   If you can’t explain it to a six year
   old, you don’t understand it yourself.
   

   View Slide

8. A TAXONOMY FOR
   DESIGN VALUE
   

   View Slide

9. ‣ Brand
   ‣ Innovation
   ‣ Efficiency
   ‣ Satisfaction
   ‣ Sustainability
   

   View Slide

10. BRAND
    

    View Slide

11. “
    — HARTMUT ESSLINGER, FROG DESIGN
    Money buys, but emotion sells.
    

    View Slide

12. View Slide

13. Desirability Studies
    

    View Slide

14. INNOVATION
    

    View Slide

15. ‣ Making strategic initiatives possible
    ‣ Creating new products, services, etc.
    ‣ Enabling entry into new markets
    INNOVATION THROUGH
    

    View Slide

16. Re-imagining
    problems
    

    View Slide

17. Tesco Subway Store in South Korea image from littledoremi.com
    

    View Slide

18. from evigo.com
    

    View Slide

19. from jcdecaux-oneworld.com
    

    View Slide

20. Intellectual Property
    

    View Slide

21. EFFICIENCY
    

    View Slide

22. 25% FAIL OUTRIGHT
    IT PROJECTS
    PROVIDE NO ROI (IF THEY SUCCEED)
    20-25%
    REQUIRE SIGNIFICANT REWORK
    50%
    Based on a 2009 study
    

    View Slide

23. Poor requirements
    

    View Slide

24. Editorial & process
    improvements
    

    View Slide

25. Customer service
    requests
    

    View Slide

26. SATISFACTION
    

    View Slide

27. “
    — JEROME KATHMAN, CEO OF LPK
    Consumer-preferred design outperforms
    management-preferred design.
    

    View Slide

28. Usability
    

    View Slide

29. SUSTAINABILITY
    

    View Slide

30. YOUR USERS

    desirability YOUR BUSINESS

    viability
    YOUR BUILD TEAM

    feasibility
    

    View Slide

31. ‣ Is it changing how customers see our brand?
    ‣ Is it helping us innovate?
    ‣ Is it increasing efficiency?
    ‣ Is it improving satisfaction?
    ‣ Is it making things more sustainable?
    

    View Slide

32. MEASURING IS HARD
    

    View Slide

33. Projects often begin with a
    measurement to improve
    

    View Slide

34. Simpson’s Paradox
    

    View Slide

35. 7.9%
    11%
    

    View Slide

36. 22.9%
    2.8%
    0%
    11.3%
    

    View Slide

37. View Slide

38. View Slide

39. “If an unfriendly foreign power
    had attempted to impose these
    bad schools on us, we might well
    have viewed it as an act of war.”
    

    View Slide

40. MATH SCORES
    40pts
    VERBAL SCORES
    50pts
    

    View Slide

41. Bad Teachers
    

    View Slide

42. More test takers
    

    View Slide

43. LOW INCOME
    INCOME:
    LURKING VARIABLE
    MIDDLE INCOME
    HIGH INCOME
    

    View Slide

44. LOW INCOME
    INCOME:
    LURKING VARIABLE
    MIDDLE INCOME
    HIGH INCOME
    

    View Slide

45. LOW INCOME
    INCOME:
    LURKING VARIABLE
    MIDDLE INCOME
    HIGH INCOME
    

    View Slide

46. LOW INCOME
    INCOME:
    LURKING VARIABLE
    MIDDLE INCOME
    HIGH INCOME
    

    View Slide

47. 448/8,000 VISITS
    PAGE A
    5.6%
    584/8,000 VISITS
    7.3%
    PAGE B
    

    View Slide

48. PAGE A PAGE B
    

    View Slide

49. PAGE A PAGE B
    FACEBOOK
    300/6,000
    5%
    

    View Slide

50. PAGE A
    FACEBOOK
    30/750
    4%
    PAGE B
    FACEBOOK
    300/6,000
    5%
    

    View Slide

51. PAGE A
    GOOGLE ADS
    60/1,000
    6%
    FACEBOOK
    30/750
    4%
    PAGE B
    FACEBOOK
    300/6,000
    5%
    

    View Slide

52. PAGE A
    GOOGLE ADS
    60/1,000
    6% GOOGLE ADS
    40/800
    5%
    FACEBOOK
    30/750
    4%
    PAGE B
    FACEBOOK
    300/6,000
    5%
    

    View Slide

53. PAGE A
    GOOGLE ADS
    60/1,000
    6%
    EMAIL
    90/1,000
    9%
    GOOGLE ADS
    40/800
    5%
    FACEBOOK
    30/750
    4%
    PAGE B
    FACEBOOK
    300/6,000
    5%
    

    View Slide

54. PAGE A
    GOOGLE ADS
    60/1,000
    6%
    EMAIL
    90/1,000
    9%
    GOOGLE ADS
    40/800
    5%
    EMAIL
    516/6,450
    8%
    FACEBOOK
    30/750
    4%
    PAGE B
    FACEBOOK
    300/6,000
    5%
    

    View Slide

55. View Slide

56. DATA != MEANING
    

    View Slide

57. Confirmation Bias
    

    View Slide

58. “
    — UPTON SINCLAIR
    It is difficult to get a man to
    understand something, when his
    salary depends on his NOT
    understanding it.
    

    View Slide

59. Gestalt Principle:
    Isomorphism
    

    View Slide

60. View Slide

61. Photos from Reddit
    

    View Slide

62. “
    — JACK HANDY
    To me, clowns aren't funny. In fact,
    they're kind of scary. I've wondered
    where this started and I think it goes
    back to the time I went to the circus,
    and a clown killed my dad.
    

    View Slide

63. Photo by Ghida Basma
    

    View Slide

64. Availability Heuristic
    

    View Slide

65. View Slide

66. “
    — ERIKA HALL
    We tend to measure what we can easily
    count, but not necessarily what counts.
    

    View Slide

67. Goodhart’s Law
    

    View Slide

68. MORE DATA !=
    BETTER DECISIONS
    

    View Slide

69. Photos by Reuters / Bassim Shati and from https://www.huffingtonpost.co.uk/2014/05/07/working-at-amazon-like_n_5278503.html
    

    View Slide

70. The allure of cheap science
    

    View Slide

71. SCIENCE & ART
    

    View Slide

72. View Slide

73. Sunset photo from http://www.city-data.com/picfilesv/picv16390.php
    

    View Slide

74. View Slide

75. From https://reasonandreflection.wordpress.com/tag/atomic-bomb/
    

    View Slide

76. 1. Mystery
    2. Hypothesis
    3. Repeated Experimentation
    4. Theory
    5. Fact
    SCIENTIFIC METHOD
    

    View Slide

77. 1. Mystery
    

    View Slide

78. 2. Hypothesis
    

    View Slide

79. 3. Repeated
    Experimentation
    

    View Slide

80. 4. Theory
    

    View Slide

81. 5. Fact
    

    View Slide

82. Repeat
    

    View Slide

83. EPISTEMOLOGY
    

    View Slide

84. How do we know things?
    

    View Slide

85. From wallpapercave.com
    

    View Slide

86. “
    — JEFF BEZOS
    “Most decisions should probably be
    made with somewhere around 70% of
    the information you wish you had. If
    you wait for 90%, in most cases,
    you’re probably being slow.
    

    View Slide

87. Trust
    

    View Slide

88. TAKE RISKS
    

    View Slide

89. The value of design
    

    View Slide

90. “
    — ANNE LAMOTT
    Perfectionism is the voice of the
    oppressor, the enemy of the people. It
    will keep you cramped and insane your
    whole life, and it is the main obstacle
    between you and a shitty first draft.
    

    View Slide

91. THANKS!
    Jared Ponchot
    @jponch
    

    View Slide