Probability-based and Open Participation Surveys

  • 10 June 2021
  • 1 reply
  • 84 views

Userlevel 2

Curious about the difference between probability-based versus open participation surveys? Here are some details:

 

What's an open participation survey and what are the benefits?

An open participation survey is offered to all residents in a community. This method is important because it provides engagement opportunities to all, thus often providing a higher number of completed responses overall and for population sub-groups. It can be less resource intensive and require less time from administration to actionable data. It is programmed as an online survey with invitations sent widely through as many communication channels as possible (social media, email lists, newsletters, media reporting, etc.). Open participation surveys also can benefit from snowball sampling whereby existing survey respondents can recruit their friends and acquaintances and response grows like a rolling snowball. This sampling method can be used to elevate general awareness of the research effort and increase overall response and the response from those who do not traditionally participate in surveys.
 

What's a probability-based survey and what are the benefits?

A probability-based survey uses a sampling method where every eligible person or household in a community has a known chance of being selected to participate. Respondents are selected at random from a comprehensive list (usually of residential addresses) as an effort to reduce bias. Probability-based sampling is considered the gold standard for survey methods, although with declining response rates and the advent of new outreach and weighting methods -- this status may change in the near future. 

 

Can I do a probability-based survey and an open participation survey at the same time?

Yes, in fact it is always advisable to include an open participation survey when implementing a survey with a probability-based sample. The probability-based method ensures that every resident has an equal chance of being selected - but most are not selected. The open participation works to increase the number of completed surveys and also ensures that the whole community feels included and everyone has a chance to be heard. 

 

How do I know which type of survey to choose?

A number of factors play into the choice of a probability-based survey versus an open participation one. Timeline, resources and ability to do adequate outreach all may affect the decision. Additionally, if this is not your first survey with Polco the robustness of your panel of respondents should be factored in. The survey purpose may also impact the choice. Those looking to do performance measurement often choose probability based methods along with an open participation survey. Those who need quick input, feedback where they are most interested in in-depth exploration of reasons for opinions, or crowdsourcing ideas may be best served by open participation. 

 

What do I do with the two types of data?

There are options! The data can be treated separately, using the probability-based survey to gain insights from the representative sample and the open participation to better understand the prevalent opinions in the community.

At Polco, we also have the statistical tools to blend the samples together to create a larger, stronger set of responses. 


1 reply

What's a probability-based survey and what are the benefits?

A probability-based survey uses a sampling method where every eligible person or household in a community has a known chance of being selected to participate. Respondents are selected at random from a comprehensive list (usually of residential addresses) as an effort to reduce bias. Probability-based sampling is considered the gold standard for survey methods, although with declining response rates and the advent of new outreach and weighting methods -- this status may change in the near future. 

Has this status changed since this was posted a year ago?

Reply