Virtual Focus Group Challenges

Kerry Levin

A guy lounging without a shirt. A 5-year-old demanding attention. A dog barking at the UPS driver. Someone has been drinking. A woman is speaking but no one can hear her. Pre-COVID-19, the chance of encountering any—let alone all!—of these scenarios during focus group sessions was pretty slim. Focus groups were carried out in an in-person facility, with prescreened respondents and a gatekeeper to send anyone home who was behaving inappropriately. Accommodations required by the pandemic have changed all that. Kerry Levin, Ph.D., and Cynthia Robins, Ph.D., Westat qualitative research experts, recently shared lessons learned over the past few months. “We didn’t know what we didn’t know,” admits Dr. Levin, a Westat Vice President, “but we do now. And we’re developing solutions and stronger partnerships with our clients as we move through this challenging time together.”

Recruitment & Attendance

Cynthia Robins

Pre-COVID-19, Westat worked with brick-and-mortar facilities whose staff have extensive experience recruiting participants for in-person focus groups. To adapt to the new environment, we tried to pivot to online vendors, some of whom cater more to market research efforts. “We have criteria for recruitment and found these new vendors reached out via social media for participants. Many participants didn’t understand what a focus group was, requirements for participating, or at times, even appropriate behavior,” comments Dr. Robins, a Westat Senior Study Director. “Vendors weren’t aware that we didn’t want just any warm body. We’re looking for participants with accountability who meet very specific recruitment criteria.”

Technology

Tech support is key in the virtual environment, as we’ve all learned in 2020. “This is a huge issue,” notes Dr. Robins. “We work now with a company to help people sign in and maintain connectivity throughout.” The communication with the session moderator and tech support is critical in maximizing the group’s engagement and minimizing session distractions, particularly if it is obvious that a participant is struggling or exhibiting poor behavior. “Then, it is critical that we can rely on tech support to quickly step in and help those struggling with technology or disengage with those who are disruptive to the session,” she explains.

Moderation

The role of the focus group moderator is in many ways more challenging than before. She has to concentrate on the screen to maintain direct eye contact and engagement with all participants, scan to see if anyone wants to add something to the discussion, and ensure the research protocol is being followed as written. “Simply looking away from the camera to check your notes could potentially cut off rapport,” explains Dr. Robins. In an in-person environment, the group develops its own vibe and interacts, and the moderator helps bring the energy. “Unfortunately, no amount of technology can replicate that experience in a virtual environment,” she concedes.

Solutions

Westat has developed a number of mitigation strategies to improve the process. We are canvassing, interviewing, and meeting with multiple vendors and requiring that they have expertise in recruitment and technical assistance. Our team is building more robust screening processes for vendors to follow, with protocols for acceptable online participant behavior and adding a recruitment stage to verify a person’s “ability to connect and use the technology. A hybrid approach is also being considered in which we use in-house support to manage the technology. The goal is to have a smooth, fluid experience,” notes Dr. Robins.

While these past few months have been challenging, they have also provided unique learning experiences for all, including our clients. “It is critical for us to maintain close communication with our team and our clients throughout,” says Dr. Robins, “and we have course-corrected along the way.” Dr. Levin adds that the experience has been beneficial in a number of ways: “We’ve found ways to move in positive, creative directions. Clients, having experienced firsthand along with us how difficult this is, acknowledge and appreciate our transparency, flexibility, and willingness to adapt through this entire process.”

Read other Feature Stories in this series on qualitative research:

We’ve found ways to move in positive, creative directions. Clients, having experienced firsthand along with us how difficult this is, acknowledge and appreciate our transparency, flexibility, and willingness to adapt through this entire process.

- Kerry Levin, Ph.D., Westat Vice President, Social Policy & Economics

Want to work with us?
You’ll be in great company.

About Us Careers

Westat Employees.
Westat Employee.
AAA Foundation for Traffic Safety
Baltimore Metropolitan Council
Centers for Disease Control and Prevention
Centers for Medicare & Medicaid Services
Chicago Metropolitan Agency for Planning
DC Public Schools
Georgia Department of Transportation
Internal Revenue Service
Leadership Montgomery
Maryland Cancer Registry
Michigan Department of Health and Human Services
National Science Foundation
NYC Mayor’s Office for Economic Opportunity
Organization for Economic Cooperation and Development
Robert Wood Johnson Foundation
SiriusXM
Social Security Administration
Substance Abuse and Mental Health Services Administration
Teach for America
Texas Education Agency
The Johns Hopkins University
The National Institutes of Health
The Verizon Foundation
Toyota
U.S. Department of Agriculture
U.S. Department of Education
U.S. Department of Health and Human Services
U.S. Department of Justice
U.S. Department of Transportation
U.S. Department of Veterans Affairs
University of Maryland Baltimore Campus
University of Michigan
University System of Maryland
Explore Our Clients

Please wait...

Forbes 2021 The Best Employers for Diversity Powered by StatistaForbes 2021: America's Best Midsize Employer Powered by Statista

Westat is an Equal Opportunity Employer and does not discriminate on the basis of race, creed, color, religion, sex, national origin, age, veteran status, disability, marital status, sexual orientation, citizenship status, genetic information, gender identity or expression, or any other protected status under applicable law. Notices to Employees & Applicants.