language bias
The Texas Recipe for Muting the Hispanic Voice in Public Opinion Polls
- The 16,000 households selected as respondents received only an English-language version of the survey.
- The cover letter that was included with the English-language survey was provided only in English, and did not offer respondents any support to complete the survey in another language.
- A question that asked respondents to identify their race-ethnic background provided only one ethnic identifier for Spanish-speaking respondents — “Hispanic” – which could partly explain the under-count of these respondents because other labels are often preferred over the “Hispanic” option.
- A call center was supposedly set up to receive incoming calls from survey respondents that had questions or needed Spanish-language support. But this call center probably received few calls from Spanish-speaking respondents since the cover letter did not provide the needed contact information. Moreover, the report did not include a copy of the Spanish-language telephone survey that was supposedly used by the survey vendor’s call center to capture incoming calls by the survey respondents.
- The study design required that automated advanced calls (or “robo calls”) be made to the selected households prior to the survey mailing. Automated calls are a recognized nuisance from telemarketers and political campaigns that often discourage response rates to legitimate public opinion polls.
- The report indicated that the survey “participation rate” was 34.6 percent – a rate that appears subjectively created and not recognizable by the American Association of Public Opinion Research (2011). Instead, the overall survey response rate was more likely to be a much lower 9.7 percent (1,559 completions /16,000 invited participants) – not surprising given the recognized shortcomings in the methodology.
- While the vendor acknowledged that Hispanic respondents were significantly under-represented and non-Hispanic whites were over-represented, no explanation was provided about the potential causes or consequences of this imbalance.
- The fact that the survey planners ignored a previous warning about the potential flaws in the survey methodology suggests that the poor survey outcomes did not result from just simple carelessness.
To make matters worse, the same survey vendor was awarded a second contract to conduct another public opinion poll of Texas residents using the same flawed methodology. Why are state officials allowing such flawed practices to take place, especially at a time when the state’s population is being heavily impacted by the growing Hispanic population?
- Research firms that compete for opinion polls in the public sector should be required to produce evidence that they have the staff, facilities and past experience to conduct polls in linguistically and culturally diverse communities. If a research firm does not produce a representative sample of such communities in a contracted study, they should not be rewarded with another contract that utilizes the same flawed methodology.
- The committee members convened by public agencies to evaluate research proposals may not have the expertise to judge these proposals in terms of their adequacy for diverse communities. The inclusion of experts with experience in conducting polls in diverse communities may have prevented the missteps in the Texas A & M studies.
- In the haste to award a contract to the lowest bidder, proposal evaluators do not regularly check the references provided by the different bidders, but oddly enough still find a way to rate the relevant experiences of the bidders without this information. Prior to contract award, an audit should be conducted to ensure that such references were verified for all of the vendors that submitted a bid in such competitions.
It is unclear that the State of Texas got the “best value” by selecting the lowest bidder from outside of Texas. Indeed, what is the economic benefit to Texans when a contract is awarded to a non-Texas vendor whose payrolls, taxes and local spending for goods and services will only benefit another state?
Segmenting Multicultural Consumers: Old Dinosaurs Die Slowly
Eventually, any organization that plans a marketing program comes to grips with the realization that their product or service cannot please everyone. Consequently, the need to define a target segment – those customers whose needs are most likely to be satisfied with a product or service – becomes a critical decision for the marketing program. Indeed, it makes little sense to introduce a product and spend significant advertising dollars only to discover later that the customers that you had hoped would buy the product are not interested.
Although market segmentation is a well-established concept in the marketing world, I am often amazed at the many companies who invest considerable financial resources to launch a multicultural campaign with little more than their own personal insights or advice from ethnic employees to guide these campaigns. To such marketers, segmentation research is not a priority because, for all intents and purposes, ethnic consumers tend to think alike, speak the same language, watch similar media, desire the same products, and shop at similar places. Ironically, when the campaign struggles or just fails, consumers are readily blamed for their lack of interest.
Even marketers who understand the need to segment multicultural consumers have been misguided by the industry’s preoccupation with language segmentation or “language buckets,” as I like to call it. Language buckets are created from responses to questions about the language that a person speaks most often at home. In the case of Hispanics, the language buckets typically used are Spanish all the time, Spanish most of the time, Spanish and English equally, English most of the time, and English all of the time. Marketers often use these language buckets to select a segment of Hispanics that they believe will be more responsive to their advertising campaigns, such as Spanish-dominant Hispanics (i.e., speaks Spanish all the time or most of the time). Despite the often biased and self-serving nature of their research, Spanish-language advocates have been successful in convincing Corporate America to spend nearly 90 percent of all Hispanic-targeted media expenditures on Spanish-language media – quite a remarkable achievement given that 60 percent of U.S. Hispanics are native-born and primarily use English-language media. It is not difficult to understand why some industry stakeholders would not want to change how language segmentation is currently practiced.
Nonetheless, choosing potential customers based on their self-reported home language speaking skills is problematic for two important reasons. First, it makes little sense to select a target segment of consumers based on their language abilities without first determining whether a product or service will meet their needs – like putting the cart before the horse – a practice that overlooks other consumer segments that may also find the product appealing. As a case in point, it seems reasonable to assume that most Hispanic homeowners need home improvement supplies, regardless of their language skills. Rather than focus on Hispanic consumers in a specific language bucket, it makes more sense to identify segments of Hispanic homeowners according to their propensity to buy home improvement supplies, and then design the marketing mix that reaches the desired segments effectively – which may include a combination of English and Spanish-language media. The home improvement company could clearly lose sales if their advertising agency recommended a specific linguistic strategy without first understanding the home improvement needs of all Hispanic consumers and then selecting the most desirable target segment.
Secondly, it is disturbing although not surprising to observe how the marketing industry has embraced such a vague and simplistic concept as home language usage to segment Hispanic consumers. The credit goes to The Nielsen Company for popularizing the use of language buckets to segment Hispanics. Nielsen sponsors national telephone surveys each year of U.S. Hispanics to create the needed information for their television ratings, and shares these universe language estimates with other research firms like Arbitron to compare or adjust their language data on Hispanics.
But the language behavior of Hispanics is not as simplistic as The Nielsen Company would have us believe. Based on various studies of U.S. Hispanics, our research shows that the language that one speaks at home varies considerably within any one Hispanic household – it depends on the subject matter under discussion, the age of the individuals engaged, their country of origin, the task at hand, and general proficiency with the language. In a typical Hispanic household, Spanish or English may be used when talking to specific family members but may take a different path when viewing television, completing homework assignments, listening to radio, playing games, talking to friends, and other activities. Because the language that one speaks at home is influenced by many factors, it lacks the stability needed to reliably segment Hispanic consumers and highly questionable when used to adjust television and radio ratings.
Language usage among multicultural consumers can lead to some unexpected surprises. In recruiting consumers for focus groups, we have learned that consumers who speak proficiently in one language do not necessarily know how to read or write in that language. In telephone interviews, we find that respondents often over-state their proficiency in one language as they try to impress the interviewer with their language skills – a social desirability response set. A more valid and practical measure of language ability can be achieved by being more specific about the language skill needed for a particular task or situation. For example:
- How often do you speak English when talking to friends?
- How often do you read Spanish when reading a newspaper?
- How well did you understand the English-language advice provided by your doctor?
Going forward, I believe that multicultural marketers should re-evaluate their campaigns to ensure that they have taken the appropriate steps to identify their target segment(s), and that their marketing strategies are aligned with the needs of the segments that appear the most attractive. Although language segmentation has been a popular way to identify target segments, the quality of the language data used is suspect and distracts attention away from more useful segmentation bases such as product usage, benefits, and lifestyles. Level of acculturation, which is typically defined by language usage and country of origin, has also been used in the past to understand and segment multicultural consumers; however, it has the same potential as language segmentation to mislead marketers by focusing on a specific linguistic strategy rather than one that is based on product consumption.