An official website of the United States government
Official websites use .gov A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS A lock ( Lock Locked padlock icon ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.
- Publications
- Account settings
- Advanced Search
- Journal List
Operational Research – Putting Ideas into Practice: The Research of Improvement
Girish malleshappa sogi.
- Author information
- Copyright and License information
This is an open access journal, and articles are distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 License, which allows others to remix, tweak, and build upon the work non-commercially, as long as appropriate credit is given and the new creations are licensed under the identical terms.
Research is the driving force for progress in all the scientific fields, and the World Health Organization has also recognized health research as cornerstone for all national and international health policies; the World Health Report in 2012 for the first time in its history focused on the theme of “No Health without Research.” Although research activities are conducted in diverse fields of science, the defining principles of research are typically the same. All research/health research starts with a quest of knowledge and is expected to enhance existing knowledge or improve health of the populations. However, ground reality differs in the fact that there is a huge gap in what we know from research and how we implement this research. In practice, the latter is seldom monitored; tracking the effects of research on policy, practice, and program performance beyond publication rarely occurs. Operational/operations/implementation research plays a significant role in bridging this know-do or implementation gap, particularly in field of health care where it is essential to ensure that limited resources invested in health to strengthen health services and benefit populations. It is a discipline that uses advanced analytical methods to better understand complex systems and aid in decision-making.
Many definitions of operational research (OR) exist, but from a disease control perspective, it is the search for knowledge on strategies, interventions, or technologies that can improve the results of the health programs under investigation. OR focuses on finding, measurable, easy to implement, and sustainable solutions to the problems in program implementation. The need for operational research arises when there is a discrepancy between what is and what should be, operational research is particularly effective in analyzing complex global health issues – especially in settings where the burden of disease is high, but health systems are weak and resources are limited. This research should provide answers of direct, practical relevance to improvement of health-care delivery and should ensure that investments are used wisely to maximize health returns. OR is sufficiently effective when carried out by the unit of program implementers and researchers who work in close association with each other. The key elements of OR are the specific factors in particular program that are under the control of the implementers and contribute to achieving program objectives; if not, then the research is not OR. The methods of OR range from the qualitative to the quantitative, and the study designs from the nonexperimental to the true experimental. On the ground, it is an iterative process, and changes in policy and/or practice are the ultimate end measure of success of OR.
The subject of OR is increasingly being discussed, and it has contributed to an improvement in performance or influenced policy change at district, national, or even international levels, for example; adoption of the WHO antiretroviral therapy (ART) guidelines with ART being offered to all HIV Infected TB patients countrywide. The National TB program in India adopted a single sputum specimen policy for monitoring multidrug-resistant TB patients while on treatment. Despite this demonstrated program strengthening value of OR, the implementation of OR is weak in many of the low- and middle-income countries that are in most need of it.
Regardless of this encouraging momentum in public health, very little OR emerges from the oral health research. This disparity cannot be reduced in an isolated way but may effectively take place through work within the framework of the health research. Oral health needs to be prioritized as part of the global strategy for better health.
Bibliography
- 1. Zachariah R, Reid T, Srinath S, Chakaya J, Legins K, Karunakara U, et al. Building leadership capacity and future leaders in operational research in low-income countries: why and how? Int J Tuberc Lung Dis. 2011;15:1426–35, i. doi: 10.5588/ijtld.11.0316. [ DOI ] [ PubMed ] [ Google Scholar ]
- 2. Zachariah R, Ford N, Maher D, Bissell K, van den Bergh R, van den Boogaard W, et al. Is operational research delivering the goods? The journey to success in low-income countries. Lancet Infect Dis. 2012;12:415–21. doi: 10.1016/S1473-3099(11)70309-7. [ DOI ] [ PubMed ] [ Google Scholar ]
- 3. Zachariah R, Harries AD, Ishikawa N, Rieder HL, Bissell K, Laserson K, et al. Operational research in low-income countries: What, why, and how? Lancet Infect Dis. 2009;9:711–7. doi: 10.1016/S1473-3099(09)70229-4. [ DOI ] [ PubMed ] [ Google Scholar ]
- 4. Kumar AM, Gupta D, Rewari BB, Bachani D, Mohammed S, Sharma V, et al. Will adoption of the 2010 WHO ART guidelines for HIV-infected TB patients increase the demand for ART services in India? PLoS One. 2011;6:e24297. doi: 10.1371/journal.pone.0024297. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 5. Nagaraja SB, Kumar AM, Sachdeva KS, Ramachandran R, Satyanarayana S, Bansal A, et al. Is one sputum specimen as good as two during follow-up cultures for monitoring multi drug resistant tuberculosis patients in India? PLoS One. 2012;7:e45554. doi: 10.1371/journal.pone.0045554. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 6. Ramsay A, Harries AD, Zachariah R, Bissell K, Hinderaker SG, Edginton M, et al. The structured operational research and training initiative for public health programmes. Public Health Action. 2014;4:79–84. doi: 10.5588/pha.14.0011. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 7. Tripathy JP, Kumar AM, Guillerm N, Berger SD, Bissell K, Reid A, et al. Does the structured operational research and training initiative (SORT IT) continue to influence health policy and/or practice? Global Health Action. 11:1. doi: 10.1080/16549716.2018.1500762. DOI: 10.1080/16549716.2018.1500762. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 8. Zachariah R, Guillerm N, Berger S, Kumar AM, Satyanarayana S, Bissell K, et al. Research to policy and practice change: Is capacity building in operational research delivering the goods? Trop Med Int Health. 2014;19:1068–75. doi: 10.1111/tmi.12343. [ DOI ] [ PubMed ] [ Google Scholar ]
- 9. World Health Organization. Guide to Operational Research in Programmes Supported by the Global Fund. Geneva, Switzerland: WHO; 2008. [Last accessed on 2020 Jan 10]. Available from: http://www.who.int/hiv/pub/operational/globalfund/en/index.html20 . [ Google Scholar ]
- 10. World Health Organization. Consolidated guidelines on the use of antiretroviral drugs for treating and preventing HIV infection: recommendations for a public health approach. 2nd ed. 2016. [Last accessed on 2020 Jan 10]. Available from; https://apps.who.int/iris/bitstream/handle/ [ PubMed ]
- View on publisher site
- PDF (423.3 KB)
- Collections
Similar articles
Cited by other articles, links to ncbi databases.
- Download .nbib .nbib
- Format: AMA APA MLA NLM
Add to Collections
- Panel Management Enterprise Pool of participants for research that you manage
- Intercepts Targeted elegant intercepts on web, iOS or Android
- Incentives Pay participants in any currency or country
- Scheduling High-touch automatic research scheduling
- Screeners Links you can send out or post on social media
- Customer Stories Meet the Ethnio customers
- Security Framework, architecture, SSO, 2FA
- Compliance GDPR, CCPA & more
- Integrations New Alerts, Calendar and Testing
- Updates Read about what’s new with Etnhio
- Performance Intercepts, screeners & incentives
- API Access, erasure & screener response
- Help Center How to articles about using Ethnio
- Training Part of Enterprise plans
- Incentive Calculator Free Free tool for paying UXR participants
- Events UX Research nights in a city near you
- Webinars Insider tips from expert customers
- Blog Mostly AI writes this if we’re being honest
The UX research operations guide for all your ReOps questions
Master the 8 pillars framework, focusing on the processes, tools, and strategies that support the execution of ux research in your org..
User research (UXR) is the backbone of creating successful products. But as research efforts grow, managing logistics, participants, and data can become overwhelming. This is where ResearchOps comes in to lay the groundwork for user-centric product development. Whether you're new to ResearchOps or a seasoned pro, this guide offers insights into building collaborative, efficient, and secure research practices.
Defining ResearchOps
ResearchOps (or ReOps) is a specialized area of design operations focused on optimizing and empowering user research (UXR) efforts. It includes the processes, tools, and strategies that streamline research. By streamlining workflows, ResearchOps frees researchers to focus on what matters most – uncovering user needs.
In order to increase product adoption, customer satisfaction, and revenue growth. From managing tools and resources to streamlining participant recruitment, ResearchOps is the engine that drives impactful user research for business success.
Why is Research Ops important?
Effective ResearchOps fosters a collaborative environment where the user's voice is at the heart of every product decision.
Research Ops helps organizations make more informed decisions, improve the user experience of their products or services, and drive business growth by aligning research efforts with strategic objectives.
The aim is to optimize research efforts' efficiency, quality, and impact while enabling better collaboration and knowledge sharing among researchers, facilitating cross-functional teams to access and leverage research findings.
re+ops, the world's biggest Research Ops community, outlined several core reasons why the practice is essential :
Protecting participant privacy
Making research easier to do (i.e., democratizing research )
Operationalizing respect for the people who participate in our research
Magnifying the impact of our research (knowledge sharing)
The Research Ops Framework
The re+ops community created a framework to define Research Ops, its functions, and its responsibilities within an organization. The initiative used survey data and outcomes from 33 #WhatisResearchOps workshops worldwide to highlight twelve key Research Ops elements.
This framework can enhance your understanding of Research Ops and enable you to structure operational systems and procedures using global best practices.
Knowledge management
Internal communications
Asset management, budget management, research spaces, participant recruitment, event management, team building and care, capability & opportunity, guidelines and templates.
The DIKW Pyramid — image credit: Ontotext
Knowledge management is a strategic approach of capturing, organizing, and leveraging research insights and information within an organization. It involves creating processes, tools, and systems that enable researchers —and other team members— to effectively store, share, and access knowledge generated through research activities. Empowering collaboration, knowledge sharing, and reuse of research insights across teams and projects. Therefore organizations make informed decisions based on user-centric data.
Some core components of knowledge management include:
Content management systems
Documentation of research findings
Research roadmaps
Centralized data repositories
Sharing— research, tools, findings, etc.
Best practices
Universal research vocabulary
Data gardening—retention schedule & archiving
The internal communications element is directly linked to knowledge management and involves establishing effective channels and processes for communication within the research team and across the organization. It ensures smooth information flow, collaboration, and alignment among researchers, stakeholders, and other teams.
Effective internal communications enable Research Ops to enhance collaboration, reduce duplication of efforts, and promote a shared understanding of research goals and outcomes within the organization.
Some core components of internal communications include:
Reporting—quarterly, customer, etc.
Information architecture
Platforms for socializing research
Asset management includes organizing and maintaining a centralized repository of raw and processed data, including research-related assets, such as research reports, participant data, interview recordings, and design artifacts. UXRs must make this data accessible, findable, and useful for team members while adhering to security and permissions.
Some core components of asset management include:
Findable assets
Security & privacy
Centralized storage and distribution
Effective storage for RAW data—i.e., unedited A/V
Managing personal identifiable information
Permissions
Tools are the software and platforms that facilitate various research activities, such as participant recruitment , data collection and analysis, collaboration, and knowledge management.
Research Ops tools fall into five primary categories:
Participant recruitment platforms streamline finding , recruiting participants , scheduling , and paying for research studies, ensuring representative and diverse user samples.
Research management platforms help manage and track research projects, participant recruitment, scheduling, and logistics, streamlining the end-to-end research process.
Data collection and analysis tools enable researchers to collect and analyze qualitative and quantitative data, such as surveys, interviews, usability testing, and analytics, providing valuable insights for decision-making.
Collaboration and communication tools facilitate seamless collaboration among researchers, stakeholders, and team members, enabling efficient knowledge sharing, feedback exchange, and project management.
Knowledge management systems assist in organizing, storing, and retrieving research assets, such as reports, insights, and design artifacts, making them easily accessible and reusable across the organization.
Some core components of tooling include:
Help me find the right tools
Tool sets—hardware, software, A/V equipment
Management—permissions, licenses, users, staff onboarding
Procurement
Planning of tools
Ethnio— a user research CRM to solve common UXR pain points
Before Ethnio, many customers:
Managed an Amazon account to send individual incentives—a lot of wasted time and resources
Didn’t do any live/in-the-moment participant recruiting—enter Intercepts
Manually created each calendar event for their sessions, which Ethnio’s Scheduling automates for both Google Calendar and Outlook.
Managed a participant database in a tool like Airtable, which is fine, but doesn’t have the complexity of Ethnio Pool with rules and governance, tracking, and automations.
Budget management is the planning, allocating, and tracking financial resources for research activities. It ensures that research projects are executed within budgetary constraints while maximizing the impact and value of the research investments.
Effective Research Ops budget management must consider these five factors:
Budget planning: Research Ops teams collaborate with stakeholders to define the research goals, objectives, and scope to estimate the required resources and associated costs.
Cost estimation: Based on the research requirements, Research Ops teams assess the costs involved in participant recruitment, research tools, technology, travel expenses, incentives, and other research-related expenses.
Budget allocation: Once the budget is determined, Research Ops teams allocate funds to various research projects, ensuring an appropriate distribution of resources based on priorities and strategic objectives.
Expense tracking: Research Ops teams monitor and track expenses throughout research projects, ensuring that spending aligns with the budget. They also identify potential cost overruns or variances and take necessary measures to mitigate them.
Reporting and analysis: Research Ops teams provide regular budget reports to stakeholders, outlining the utilization of funds, highlighting any significant variances, and providing insights into the return on investment from research activities.
Some core components of budget management include:
Tracking operational spend
Synching with broader budgetary processes
Budget approvals
Budget allocations per project
Research spaces are the physical or virtual environments where research activities take place. UXRs must design spaces that foster high-quality research, support seamless collaboration, and enhance the research experience for researchers and participants.
Researchers must consider procedures and protocols for these five essential research space components:
Physical research spaces: are dedicated rooms or facilities equipped with appropriate tools and equipment for conducting in-person research sessions, such as usability tests, interviews, or focus groups. Research Ops teams ensure these spaces are well-designed, comfortable, and equipped with the necessary technology and recording capabilities.
Virtual research spaces: include online platforms, video conferencing tools, and collaboration software that enable researchers to conduct remote studies, engage with participants, and facilitate remote collaboration among research team members.
Lab management: UXRs must manage and maintain physical research spaces, including scheduling, resource allocation, and ensuring the spaces are appropriate for each research session, including coordinating with facilities management, IT/AV support, and other stakeholders to ensure a smooth research environment.
Participant management: coordinate with participants, providing them with necessary instructions, directions, and any required equipment or technology to ensure a seamless research session.
Accessibility and inclusivity: Research Ops teams consider accessibility and inclusivity when designing and managing research spaces. They ensure that spaces and tools are accessible to participants with different abilities and accommodate diverse user needs.
Research Ops teams ensure research studies have the right participants , leading to more accurate insights and informed decision-making. They streamline the recruitment process, optimize participant selection, and create a positive experience for participants, enhancing the overall research operations within an organization.
Here are some of the key UXR responsibilities of participant recruitment:
Participant sourcing: Research Ops teams collaborate with researchers and stakeholders to define the target audience for research studies. They employ various methods to source participants , such as intercepts , recruiting from existing user databases , utilizing recruitment agencies, or leveraging online platforms and communities.
Screening and qualification: Research Ops teams must screen participants to determine their suitability for specific research studies. Screening involves assessing participants' demographics, background, experience, or any specific criteria defined for the study.
Consent and incentives: the administrative tasks related to participant recruitment, such as obtaining informed consent from participants, managing confidentiality agreements, and facilitating the provision of incentives or compensation for their time and effort.
Scheduling and logistics: UXRs coordinate with participants, team members, and stakeholders to schedule research sessions , ensuring their availability aligns with the research timeline. They handle logistics, such as sharing session details, preparing participants for the research process, and addressing any questions or concerns they may have.
Participant database management: a participant database captures and stores relevant information about participants, their preferences, and their history of participation. This database helps streamline future recruitment efforts and enables efficient participant management for ongoing research initiatives.
Some core components of participant recruitment include:
Quality for the price
Manage both internal and outsourced recruitment
Engaging with external recruiters
Managing recruitment tools
Incentive management
Need to understand design and research
Managing a secure database of consent forms
Thanking respondents
Developing and maintaining a diverse customer panel
Governance refers to establishing and implementing frameworks, processes, and policies that ensure research activities are conducted effectively, ethically, and in alignment with organizational objectives.
Clear governance procedures are especially critical for research democratization because they provide non-researchers with the frameworks, guardrails, oversight, tools, and processes to conduct proper research.
Here is a high-level overview of Research Ops governance and what UXRs must consider for effective implementation:
Research standards and guidelines: establish and communicate research standards and guidelines to maintain consistency and quality across research projects, including research methodologies, ethical considerations, data privacy regulations, and reporting requirements.
Compliance and ethics: standards related to research, such as obtaining informed consent from participants, protecting participant privacy and data, and adhering to industry regulations and guidelines.
Documentation and reporting: Ensure findings, insights, and recommendations are adequately recorded and shared with relevant stakeholders. UXRs establish templates and guidelines for research documentation, making it easier for teams to capture and communicate their work effectively.
Stakeholder alignment: UXRs facilitate communication channels, such as regular research meetings or reporting mechanisms, to share research insights, validate findings, and gather feedback.
Process optimization: Identify bottlenecks, streamline workflows, and implement best practices to optimize the research operations and enable researchers to focus on generating valuable insights.
Risk management: Identifying potential biases, ensuring data security and privacy, and implementing safeguards to protect participants and intellectual property.
London based research team in a UXR workshop. Image credit: Dave Hora .
Researchers are responsible for event management, including planning, coordination, and execution of research-related events, such as user research sessions, workshops, conferences, or training programs. UXRs ensure that sessions and activities run smoothly, participants have a positive experience, and they meet event objectives.
Some core components of event management include:
Arranging distinguished speakers
Social events
Company events
Team meetings
According to re+ops findings, "Research Ops is as much about people and forging relationships and connections as it is about efficiency, support, and data." This framework element celebrates team members, helping to recruit and retain them longer— especially in remote organizations where team members are more likely to feel disconnected .
Some core components of team building and care include:
Celebrations
Pre-approved counseling service
Secondment opportunities
Onboarding new staff
Image credit: re+ops community .
Developing researcher career progression is essential for growing the research team's experience, skill sets, confidence, and opportunities. This personal and team growth enhances their professional development and contributes to the overall success and effectiveness of the research operations within the organization.
Some core components of capability & opportunity include:
Professional development opportunities
Research skills and maturity matrix
Mentoring opportunities
Training opportunities
Book or reading club
Peer review sessions
Sparring sessions
Image credit: Rodrigo Dalcin .
Guidelines and templates help maintain consistency, efficiency, and quality in research activities. They enable researchers—and non-researchers—to focus more on the research rather than reinventing processes or struggling with documentation. These guidelines lead to improved research outcomes and better-informed decision-making within the organization.
Some core components of guidelines and templates include:
Database of methods
Shared templates & methodology = shared understanding
Research briefing and reporting templates
Maintaining the content
Platform for sharing guidelines and templates
Clear guidelines and rules
How-to guides
Recruitment guidelines
Ethics guidelines
Customer contact guidelines
The Eight Pillars of Scaling Research Ops
The re+ops community has also devised the eight pillars of Research Ops . The community-driven initiative created a strategy for scaling research and ResearchOps. This framework can be used as a checklist to identify problem areas, bottlenecks, and inefficiencies and implement effective solutions.
User Experience Research and Design Leader at Meta, Emma Boulton, summarized the eight pillars of Research Ops in a Medium article.
Environment: Why does research happen, and who engages with what I do?
People silos
Value of research
Internally focused
Stakeholders
Scope: How and when does research happen? What methods?
Cadence
Sharing insights
Prioritization
Integrating insights
Research as a team sport—democratization
Recruitment and admin: How do I manage all the project and participant admin?
Panel management
Participant coordination
Data and knowledge management: What happens to the findings, data, and insights?
Research library
Data gardening
Document templates
People: Who is responsible for carrying out research?
Community of practice
Professional development
Mature career paths
Organizational context: What are the internal and external constraints?
Business constraints
Market forces
Org maturity
Governance: What are the legal and ethical considerations?
Risk assessments
Tools and infrastructure: What systems and tools do I need for my projects?
By implementing a well-defined ResearchOps strategy, organizations can transform user research from isolated activities to a strategic asset that drives innovation and business success.
Elevate Your ResearchOps with Ethnio
When researchers manage every aspect themselves, maintaining top-tier research practices across all stages can be challenging.
Ethnio is your partner in building a robust ResearchOps practice. Let's take your research to the next level.
Elevate Your UXR with ResearchOps and EthnioWhen researchers manage every aspect themselves, maintaining top-tier research practices across all stages can be challenging.
More from the blog, tools for automating ux research panel recruitment and management in 2024, accessibility in ux research, subscribe to updates.