Virtual Focus Group Challenges

Kerry Levin

A guy lounging without a shirt. A 5-year-old demanding attention. A dog barking at the UPS driver. Someone has been drinking. A woman is speaking but no one can hear her. Pre-COVID-19, the chance of encountering any—let alone all!—of these scenarios during focus group sessions was pretty slim. Focus groups were carried out in an in-person facility, with prescreened respondents and a gatekeeper to send anyone home who was behaving inappropriately. Accommodations required by the pandemic have changed all that. Kerry Levin, Ph.D., and Cynthia Robins, Ph.D., Westat qualitative research experts, recently shared lessons learned over the past few months. “We didn’t know what we didn’t know,” admits Dr. Levin, a Westat Vice President, “but we do now. And we’re developing solutions and stronger partnerships with our clients as we move through this challenging time together.”

Recruitment & Attendance

Cynthia Robins

Pre-COVID-19, Westat worked with brick-and-mortar facilities whose staff have extensive experience recruiting participants for in-person focus groups. To adapt to the new environment, we tried to pivot to online vendors, some of whom cater more to market research efforts. “We have criteria for recruitment and found these new vendors reached out via social media for participants. Many participants didn’t understand what a focus group was, requirements for participating, or at times, even appropriate behavior,” comments Dr. Robins, a Westat Senior Study Director. “Vendors weren’t aware that we didn’t want just any warm body. We’re looking for participants with accountability who meet very specific recruitment criteria.”

Technology

Tech support is key in the virtual environment, as we’ve all learned in 2020. “This is a huge issue,” notes Dr. Robins. “We work now with a company to help people sign in and maintain connectivity throughout.” The communication with the session moderator and tech support is critical in maximizing the group’s engagement and minimizing session distractions, particularly if it is obvious that a participant is struggling or exhibiting poor behavior. “Then, it is critical that we can rely on tech support to quickly step in and help those struggling with technology or disengage with those who are disruptive to the session,” she explains.

Moderation

The role of the focus group moderator is in many ways more challenging than before. She has to concentrate on the screen to maintain direct eye contact and engagement with all participants, scan to see if anyone wants to add something to the discussion, and ensure the research protocol is being followed as written. “Simply looking away from the camera to check your notes could potentially cut off rapport,” explains Dr. Robins. In an in-person environment, the group develops its own vibe and interacts, and the moderator helps bring the energy. “Unfortunately, no amount of technology can replicate that experience in a virtual environment,” she concedes.

Solutions

Westat has developed a number of mitigation strategies to improve the process. We are canvassing, interviewing, and meeting with multiple vendors and requiring that they have expertise in recruitment and technical assistance. Our team is building more robust screening processes for vendors to follow, with protocols for acceptable online participant behavior and adding a recruitment stage to verify a person’s “ability to connect and use the technology. A hybrid approach is also being considered in which we use in-house support to manage the technology. The goal is to have a smooth, fluid experience,” notes Dr. Robins.

While these past few months have been challenging, they have also provided unique learning experiences for all, including our clients. “It is critical for us to maintain close communication with our team and our clients throughout,” says Dr. Robins, “and we have course-corrected along the way.” Dr. Levin adds that the experience has been beneficial in a number of ways: “We’ve found ways to move in positive, creative directions. Clients, having experienced firsthand along with us how difficult this is, acknowledge and appreciate our transparency, flexibility, and willingness to adapt through this entire process.”

Read other Feature Stories in this series on qualitative research:

We’ve found ways to move in positive, creative directions. Clients, having experienced firsthand along with us how difficult this is, acknowledge and appreciate our transparency, flexibility, and willingness to adapt through this entire process.

- Kerry Levin, Ph.D., Westat Vice President, Social Policy & Economics

Want to work with us?
You’ll be in great company.

About Us Careers

Westat Employees.
Westat Employee.
Centers for Disease Control and Prevention
Centers for Medicare & Medicaid Services
Substance Abuse and Mental Health Services Administration
The National Institutes of Health
AAA Foundation for Traffic Safety
The Johns Hopkins University
University of Maryland Baltimore Campus
University of Denver
U.S. Department of Veterans Affairs
U.S. Department of Transportation
U.S. Department of Justice
U.S. Department of Health and Human Services
U.S. Department of Education
U.S. Department of Agriculture
Toyota
The Verizon Foundation
Texas Education Agency
Baltimore Metropolitan Council
Teach for America
Social Security Administration
SiriusXM
Robert Wood Johnson Foundation
Organization for Economic Cooperation and Development
NYC Mayor’s Office for Economic Opportunity
National Science Foundation
Michigan Department of Health and Human Services
Maryland Cancer Registry
Internal Revenue Service
Georgia Department of Transportation
DC Public Schools
ClearWay Minnesota
Chicago Metropolitan Agency for Planning
University of Michigan
Explore Our Clients

Please wait...

Forbes 2020 The Best Employers for Diversity Powered by Statista Copyright 2019 Forbes Media LLC. Used with permissionForbes 2019: The Best Employers for Women Powered by Statista Copyright 2019 Forbes Media LLC. Used with permission

Westat is an Equal Opportunity Employer and does not discriminate on the basis of race, creed, color, religion, sex, national origin, age, veteran status, disability, marital status, sexual orientation, citizenship status, genetic information, gender identity or expression, or any other protected status under applicable law. Notices to Employees & Applicants.