â
With Kate Towsey, Research Operations Manager at Atlassian, author of Research That Scales: The Research Operations Handbook, and keynote speaker at People Who Do Research 2023
âScale. Itâs the business word of the decade."
But what does it all mean? Kate Towsey â Research Operations Manager at Atlassian, author of Research That Scales: The Research Operations Handbook, and creator of the phrase âPeople Who Do Researchâ â has some ideas, which she shared in her keynote presentation at the inaugural People Who Do Research virtual conference hosted by Great Question on Wednesday, February 8, 2023.
The word âscaleâ has become shorthand in business for companies who grow or expand in a proportional, profitable way. Everyone wants to scale everything, but itâs not so cut-and-dry. Towsey sees a particular problem when applied to the field of research, where âthereâs not a lot thatâs absolutely constant, in ratio, or purely proportional.â
In this session, Towsey shares how her team of 10 has successfully scaled research operations to support 500 people at Atlassian. Listen to Towseyâs talk or read our recap below.
â
âResearch is not cookie-cutter work. It isnât in any way similar to making millions of chocolate bars, or hundreds of thousands of the same motor car. Every single study you do is unique.â
Thatâs the problem with trying to scale research. Variation rules, and that doesnât scale. Interviews, usability testing, ethnographic research, longitudinal studies, and quantitative research are just a few of the different methods that researchers run, all of which require their own specific types of operations, tools, and approaches in order to be effective.
âResearch is less of the cookie-cutter manufacturing line, and more like an assortment of confectionaries. It runs on variety.â
This variety is on display not just with UX research methods, but also with the various types of people who do research and those who need research â a careful distinction Towsey breaks down in detail.
People Who Do Research (PWDR) consist of UX researchers, product managers, designers, and anyone else who conducts research to better understand their customers so they can do their jobs well. PWDR need research operations to find out new information. This includes access to participants, tools and vendors, training, support, ethics and privacy, and funding.
But thereâs another important group that PWDR donât think about enough â People Who Need Research (PWNR). These are the product managers, executives, designers, and others who need research operations to understand what other people in the organization already know.
PWNR need access to PWDR, whether itâs in-house or at an agency. Ideally, theyâre already observing research thatâs going on in the organization, and consuming the reports and videos that follow. Hopefully, theyâre engaging through meetings and presentations, and able to find the insights they need in their research repository or by networking.
Understanding the relationship between PWDR and PWNR helps explain the role of research operations.
âItâs a combination of two things: giving people ways to find out and giving people ways to understand.â
âYou canât talk about People Who Do Research without talking about democratization.â
This sheds light on a key variable at play â rigor. More specifically, the various levels of rigor that are required to meet the standards of quality research, depending on the person who is doing the research. Towsey shares examples of research being conducted with different levels of rigor by working her way along a spectrum, from chatting to academia.
Given the variety in rigor being applied by PWDR in any given organization, research operations requires variety, too. It requires that you account for various types of people using various methods to research various products, all which have unique needs, speeds, and levels of rigor.
An âassortment of confectionariesâ like this is hard to scale. Whether youâre a team of one or manage a team of 10 like Towsey, youâll need more resources to deliver high-quality research to everyone. As the number of PWDR and PWNR increase, so does the assortment of research thatâs required â a reality research operations canât survive without the right strategy.
Towsey leads a team of 10 research operations professionals responsible for looking after 500 people who do research. They know a thing or two about scale â and where it falls down.
To operationalize the ways people use research to find out and to understand, Towsey believes these worlds should be brought together with a cohesive model. At Atlassian, they call it The Insights Flywheel.
The inner ring of The Insights Flywheel consists of different ways of learning, with the outer rings made up of different things Towsey and her team can do to support people in engaging with these different ways of learning. All of it revolves around Insights in the center.Â
âThis is what a learning organization should look like. Itâs what research is all about.â
Towsey breaks the flywheel down by quadrant to explain.
From there, Towsey highlights the primary use cases of each quadrant, with a specific focus on DIY research.
DIY research is where many research democratization efforts begin, including those of Towseyâs team at Atlassian. Itâs the quadrant of the flywheel where the necessary tools and systems are put in place, and people are coached and trained on how to use them.
âWe give them operations to enable them to do great research, or at least that isnât rubbish, in ways that are really efficient and fast enough for them or slow enough for them depending on their needs.â
Towsey then slices the flywheel into âways to find outâ and âways to understandâ â the two key components of research operations she touched on earlier. The top half of the flywheel consists of ways to find out new things that the organization hasnât learned yet. The bottom half consists of ways to understand what the organization already knows from past research.
â
In order to keep the flywheel running smoothly, constant communication is required between these two sections. But even then, The Insights Flywheel presented so far still has its limitations for scaling research, because, as Towsey reminds us, âvariation rules.â
Thatâs why the next part is so important.
The Insights Flywheel works best if you start with a cookie. A standard-issue research ops cookie.
âItâs vanilla. Not bad, but not exciting. An excellent baseline for lots of other types of flavors. If youâre starving, a vanilla cookie is better than nothing.â
Standard-issue research operations sets a basic level of requirements and expectations for research in an organization, from participants and consent forms to training and tools. Itâs also highly scalable.
âAs a team of 10, weâve scaled standard issue to 500 Atlassians. And it works ok. Itâs a good starting point. No one is ever going to starve.â
But the larger the team, the more and more specialists youâll work with, each of which has their own set of particular needs. If you ignore these needs over time in favor of scalability, the cookie will crumble.
â
Standard-issue operations will leave many people without the resources they need to conduct specific, important projects, such as enterprise, churn, or accessibility research.
âStandard issue is a great baseline for operations to start with. Itâs not rubbish. You can build things on top of it and itâs highly scalable. You just have to remember that a vanilla cookie wonât satisfy everyone.â
If Towsey had to, itâs where sheâd start all over again â with one caveat. One of the mistakes Towsey and her team made was presenting their standard issue operations to the organization without sharing what their plans were to build on top of it and meet all the other needs people were asking for.
âMake your standard issue as efficient as possible so you buy yourself space to start looking at these alternative important needs. Itâs up to you to look across your organization to determine the standard issue research operations kit that people need to get off the ground and not be hungry. And then later, build on it to help them develop research thatâs great.â
The baseline of tools, structures, handbooks, and training you build must be strong enough and flexible enough that you can later build on top of them to meet the specialized needs of your organization.
âIf you donât think about diversity up front, the cookie will crumble.â
To scale research that rocks đ€(or at least isnât rubbish), Towsey recommends:
Because variation rules, and vanilla cookies scale.
â
You can follow Kate on Twitter here or visit her website here.
Jack is the Content Marketing Lead at Great Question, the end-to-end UXÂ research platform for customer-centric teams. Previously, he led content marketing and strategy as the first hire at two insurtech startups, Breeze and LeverageRx. He lives in Omaha, Nebraska.