Undercoverage Bias

What Is Undercoverage Bias?

Undercoverage bias occurs when the “sampling frame” (the list of people you are choosing from) does not match the actual population you are trying to study. If a specific group is left off that list, they are “undercovered,” and your research results will be skewed because their voices are missing.

What Are The Causes Of Undercoverage Bias?

The following are some causes of undercoverage bias:
 

Problems with the Sampling Frame

A sampling frame is a list or illustration of the intended audience from which the sample is chosen. Certain people or groups may be left out of the sampling frame if insufficient or wrong, which could result in under-coverage bias. It will occur if individuals from far-off communities, travelling people, or those without fixed addresses are excluded from the sampling frame.
 

Non-Response

Non-response bias occurs when chosen participants in a survey or study choose not to take part or fail to deliver responses. Undercoverage bias may result if the non-response is not random, and some groups are more likely to decline participation. 

For instance, their viewpoints could not be adequately reflected if people from lower socioeconomic backgrounds were less likely to reply to surveys.
 

Selection Bias

When the method used to pick participants does not sufficiently capture the complete population, selection bias can contribute to undercoverage bias. For instance, undercoverage bias may occur if a study depends on convenience sampling or voluntary participation, which may systematically exclude particular demographic groups.
 

Exclusion Criteria

Specific criteria may be used to exclude particular populations from participation in some research studies or surveys. For instance, by not including people with specific health difficulties, a health study that excludes people with pre-existing diseases may introduce undercoverage bias.
 

Access Restrictions

Undercoverage sampling bias results from restricted access to particular groups or communities. For instance, if a poll is performed online but doesn’t include people without internet access, it can underrepresent people with poor connectivity or marginalised by the digital world.
 

Language or Cultural Obstacles

If the survey or study materials are unavailable in the chosen language or fail to consider cultural sensitivities, language or cultural obstacles may lead to undercoverage bias. People from particular languages or cultural backgrounds may be excluded or have less opportunity to participate.
 

Examples Of Undercoverage Bias

Here are a few examples of undercoverage bias in different settings.
 

Telephone Surveys

Because it excludes people who need access to landlines or mobile phones, conducting surveys exclusively through telephone interviews may lead to undercoverage bias. This can result in the underrepresentation of specific socioeconomic or age groups.

Online Surveys

If a survey is only available online, people with poor internet access or not comfortable utilising digital platforms may not be included. This may result in undercoverage bias, especially for elderly people, people with lesser incomes, or people living in remote areas.

Household Surveys

In household surveys, undercoverage bias can happen if particular categories of households, such as homeless populations, group living circumstances, or people living in unusual housing arrangements, are left out of the sampling frame.

Employment Surveys

If particular workforce groups, such as part-time or remote workers, are not included in the sampling frame, workplace surveys may suffer from undercoverage bias. This can result in an inaccurate portrayal of the traits or experiences of the workforce.

Geographical Surveys

Undercoverage bias may appear if a survey concentrates on a certain geographic area but leaves out some neighbourhoods or regions. This may occur if the target population is not included in the sampling frame within the specified geographic boundaries.

Radio Shows

Radio programmes that allow listeners to ring in and voice their opinions on a particular subject are known as “phone-in radio shows,” the sample of callers only includes those who voluntarily choose to participate. As a result, excluding people who do not call in or listen to the radio can introduce coverage sampling bias and skew the general public’s perception of the issue.

How To Avoid Undercoverage Bias

Develop a comprehensive sampling frame that considers the full target population of interest. Ensure the sampling frame is correct, current, and includes all necessary population subgroups.
 

Use Random Sampling Methods

Use random sampling methods to pick participants, such as basic random, stratified, or cluster sampling. Undercoverage bias is less likely due to random sampling’s guarantee that each member of the population has an equal probability of being included.
 

Unique Data Collection Methods

Utilise various methods of data collection to connect with people who might not be reachable via a single technique. To increase participation and coverage, this might combine telephone polls with internet surveys, in-person interviews, or paper-based questionnaires.
 

Adjustments and Weighting

Use adjustments or weighting strategies to take into account any groups in the sample that were underrepresented. This may entail giving people from underrepresented communities heavier weights. To account for their smaller representation in the sample
 

Active Engagement

Actively involve underrepresented groups through outreach and engagement to boost their participation. This can be accomplished by making focused recruitment efforts, forming community alliances, or working with organisations that have contacts with the targeted group.
 

Multilingual and Culturally Sensitive Approaches

To effectively reach various audiences, ensure that survey instruments, materials, and communication are available in many languages and sensitive to cultural differences. This aids in removing linguistic and cultural obstacles that can cause undercoverage bias.
 

Non-Institutional Populations

Consider alternate sampling techniques and strategies to include non-institutional populations, such as homeless people, people who live in groups, or those who don’t have permanent addresses. If you want to reach communities, this may entail working with regional organisations or employing focused outreach techniques.
 

Frequently Asked Questions