How The Martec Group Partnered with Quest Mindshare to Safeguard a Large B2B Study—And What Others Can Learn From It
The stakes for data integrity in market research have never been higher. Clients depend on research findings to inform multi-million-dollar decisions, and compromised data quality can quickly compromise outcomes and erode confidence in quantitative research. Fraudulent survey activity—whether from bots or, more often, real people misrepresenting themselves—remains a persistent threat.
The following success story illustrates how our firm, working with our panel provider and in close collaboration with the client, navigated significant data-quality challenges in the course of a large B2B brand and pricing study. While the client remains anonymous, the lessons are clear and broadly applicable: vigilance, communication, and collaboration are the cornerstones of trustworthy insights.
Mission Accomplished: Achieving Data Integrity with a Difficult Challenge
The project was straightforward in design but complex in execution: conduct brand and pricing research among U.S. buyers of a niche B2B product. The study required a large, representative sample to generate statistically valid insights, which can be challenging to find in business-to-business buying dynamics.
From the outset, both we, as the research team, and our panel provider Quest Mindshare knew that finding and qualifying qualified respondents would be a challenge. The market in question was specialized, the qualifying criteria strict, and the sample size ambitious. These conditions created fertile ground for fraud, particularly from international respondents seeking incentives despite not fitting the sample criteria.
As fieldwork began, the concerns proved justified. Red flags surfaced:
- Suspicious IP addresses and multiple respondents logging in from the same source
- Contradictory open-end responses, suggesting that some participants were not actually in the U.S., despite claiming otherwise
- Low-knowledge answers that betrayed unfamiliarity with the product category
Left unchecked, these issues threatened the viability of the sample—and, by extension, the insights the client was counting on.
The Approach: Collaborative Problem-Solving
Rather than treating these issues as routine cleanup tasks at the end of fieldwork, the Martec and Quest Mindshare teams engaged in real-time collaboration to protect the integrity of the study.
Multi-Layered Screening and Monitoring
The panel provider deployed its data quality platform, integrated with dtect, to evaluate respondents on criteria such as device metadata, geolocation, browser settings, and behavioral patterns. This helped flag discrepancies early. For example, the sample team noticed respondents logging in with U.S. IP addresses but time zones or language settings inconsistent with that claim.
At the same time, the research team scrutinized open-end responses for signs of inauthenticity. When participants claimed to be U.S.-based but their narrative responses revealed otherwise, those cases were escalated immediately
Removing Fraudulent Respondents
Suspicious respondents were not only removed from the study sample but also from the panel provider’s system altogether, meaning they were ineligible for any future panel participation in a Quest-Mindshare-related research study. This dual action created immediate benefit for the client project in the short term and long-term value for future researchers using the same panel.
Transparent Communication
What made this process effective was not just technology; more importantly the human partnership between Martec and Quest Mindshare. It was immensely critical and ultimately rewarding that the research firm and panel provider maintained ongoing, transparent communication throughout fieldwork. Suspicious patterns—such as clusters of respondents from a single IP—were flagged, discussed, and acted upon quickly.
This eliminated the “black box” dynamic that sometimes plagues research relationships if there isn’t open communication and constant collaboration. In this case, both the Martec team and the Quest Mindshare team worked with a shared sense of responsibility for protecting the data and achieving the necessary outcome for the client.
Outcome: Trust Restored
By combining automated screening tools, human oversight, and proactive collaboration, the team was able to deliver a clean, actionable dataset that met the project’s requirements. However, perhaps the greatest reward was the very remedy itself: trust.
Not only was trust deployed, it was delivered as well:
- For the client: Trust that the insights were drawn from a credible sample, enabling better decision-making.
- For the panel provider: A healthier panel that delivers a higher level of trust, with fraudulent actors removed from the system.
- For the research firm: Reinforced credibility with the client, demonstrating that issues were anticipated, detected, and resolved rather than ignored.
- For the process: Trust, in this case, was a three-way street.
- The research firm and panel partner were operating with a universal trust in each other, allowing for honest communication, transparency, and mutual accountability.
- The research firm earns the trust of the client when credible insights are delivered.
- And the panel provider becomes a trusted resource for the research firm, both in the here and now and well into the future.
While no dataset is ever entirely free of risk, the proactive stance transformed a potential liability into a proof point for the value of integrated data integrity practices.
Lessons Learned: How Others Can Safeguard Research
This experience reinforces several best practices that other research firms and panel providers can apply:
- Assume fraud will happen. The sophistication of today’s fraudsters, particularly real people gaming the system, means prevention must be built in from the start, not left to post-fieldwork cleaning.
- Use knowledge-based screening. Demographics alone are not enough. Questions that require domain knowledge (e.g., brand familiarity, product specifications) help separate genuine respondents from pretenders.
- Leverage technology wisely. Platforms like dtect can analyze digital fingerprints and behavioral cues at scale, but they work best in tandem with human judgment.
- Maintain constant communication. Data integrity is not a solo mission. Open dialogue between researchers and panel providers enables swift action when anomalies arise.
- Think beyond the project. Removing fraudulent respondents from panels benefits not only the current study but the entire ecosystem of future research.
- Anchor trust at every level. Panel providers must trust respondents, researchers must trust panel providers, and ultimately clients must trust the data. Without that chain of trust, insights lose their value.
In Their Own Words: Data Integrity Is a Lifecycle Commitment
“Data integrity is not just a checkpoint, but a commitment throughout the lifecycle of every project. By working collaboratively, maintaining open lines of communication, and applying both human oversight and advanced technology, we ensure that every dataset meets the highest standards of quality. Our shared goal is simple: to deliver insights clients can trust and act on with confidence.”
“The takeaway for others in the industry (and their clients) is clear: don’t wait for fraud to reveal itself at the end of a project. Build prevention into your workflows, invest in both tools and relationships, and commit to transparency at every stage.”
— Ken Donaven, Partner, The Martec Group,
Kyle Hope, Director of Partnerships and Supply, Quest Mindshare
