Following the insights that the positioning and visibility of features inside the running application caused a variety of different issues and pain points for our users, it was first important to gain an understanding of what the most problematic features to find and discover were. Following a collaboration with the researchers at Runtastic a tree testing study was conducted to see where users would look for common features in the running app.
The tree testing identified a high level of misunderstanding about where some features should be located in our app, a lot of these features with a high level of uncertainty were social based features, most of which had been added to the app at later stages through the 10 year life of the running application thus being scattered across the app.
As a next step we wanted to find out where users would cluster features. 2 rounds of card sortings were undertaken. This gave valuable insights on how to create a new IA that users would understand and expect.
With both rounds of Card Sorting revealing a largely consistent outcome, we translated these insights into a new tab structure and established a purpose definition for each tab. The goal of setting a clear purpose was to guide ย future placement for new features and experiences in the adidas Running app. The structure was defined as follows:
โ
With the existing architecture comprising of a largely modular card based design, reorganising this was fairly easy from a design point of view, the real challenge and effort came when trying to get management buy in to invest in making this change.
This was achieved by presenting the initial user problem with the research findings. We also demonstrated the business value of making this change by setting an outcome to improve the social feature interaction and friend connection rates. 2 metrics that we believed would be positively impacted.
With such a major change to the way the user would interact with the app it was crucial sufficient testing was done to validate that the research based changes worked on a practical level for users. I, alongside a couple of other designers created a substantial prototype covering all main tabs and the specific user journeys covered in the usability test tasks. The prototype was built using Figma and the usability test was conducted with both new and existing users.
In total 8 people tested this concept and were given a series of tasks to reach features within the app. We observed and then concluded if the task had been a success or failure based largely on if a user managed to successfully find the feature/functionality. In addition to this, we closely monitored the thoughts and feeling of the participants and finally quantified the overall perception towards ease of use with a System Usability Scale.
The most astonishing insight that I got from the Usability Testing was that users did not notice the new tab structure on initial glance and instead took quite some time to eventually identify the difference. Due to this I felt it was important to properly onboard the user to ensure we have control of the moment they discover the change.
โ
To action this, I organised a workshop with 7 other stakeholders across the product teams working on the restructuring product. I used storytelling in the workshop from a perspective of someone who went grocery shopping only to find the item she was looking for had been moved. This provided a powerful opening to the main purpose of the session which was to ideate on potential onboarding solutions to inform users of the change to the app structure.
โ
The workshop resulted in a preferred solution being identified, that was to use a ILIAM (In Line In App Message) placed in the community tab welcoming the user to the new tab and describe what the purpose of the new tab is.
โ
Coinciding with the onboarding, I presented an opportunity to the team to also use this point to gather some quantitative & qualitative feedback to understand the users early perceptions of the changes. This also allowed us to gather ideas from users on potential next steps to improve the new community tab.
โ
Tapping "Give Feedback" opened a brief survey containing the following questions:
โ
In April 2020 the new app structure went live to users with the 11.0 release of adidas Running. Overall the majority of users had a positive reaction to this change. We received over 4800 responses in the community feedback survey with written feedback being clustered and quantified to provide an understanding of what improvements can be made as a next step. This feedback was then distributed internally to the relevant product teams.
โ
improving the way we measure- One of the UX metrics was the improvement of interaction rates, particularly of the social features. Due to technical constraints the restructuring could not be released as an A/B test. This meant it was inconclusive if improvements to interaction rates were related to new content, seasonality or UA changes. On reflection it would have been valuable to scale the usability testing to also bring more qualitative insights as a measure of success.