{'fraction_non_alphanumeric': 0.02612510802366549, 'fraction_numerical': 0.01848035631190587, 'mean_word_length': 4.983890214797136, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Willingness to Pay for a Hypothetical COVID-19 Vaccine in the United States: A Contingent Valuation Approach

Our objective was to estimate the individual willingness to pay (WTP) for a COVID-19 vaccine and evaluate its predictors in the United States. A double-bounded dichotomous choice contingent valuation with open-ended question technique was implemented based on the responses to a national survey administered during the first week of November 2020. The final sample size was 1285. The results showed that individual WTP values increased with income, whether a household member had any pre-existing condition, and perceived threat of the virus. The vaccine efficacy rate and duration of protection were found to be important factors for the respondents. The mean WTP for a vaccine with a 95 percent efficacy rate and 3-year protection (US$318.76) was approximately 35 percent greater than the vaccine with a 50 percent efficacy rate and 1-year protection (US$236.85). The initial aggregate direct benefit of the current vaccination program was estimated to be between 20 and 35.6 billion US dollars depending on the vaccine protection duration.


Introduction
Coronavirus disease 2019 (COVID-19) is a natural phenomenon that has generated dire consequences and caused immediate concerns and threats to public health. It is a strain of the coronavirus family that causes respiratory and fatal infections in humans [1]. An effective vaccine is essential to mitigate the impact and spread of this dangerous virus that has resulted in over 121 million confirmed cases and nearly 2.7 million deaths globally [2]. Pharmaceutical companies work in conjunction with governments and regulatory agencies to develop vaccines that induce protective immunity. As of 1 February 2021, the United States (U.S.) Food and Drug Administration (FDA) has authorized the emergency use of both Pfizer-BioNTech and Moderna vaccines that contain mRNA, a genetic molecule that helps the body produce proteins to create antibodies against COVID-19. Both vaccines are provided at no cost to the general population under the Coronavirus Aid, Relief, and Economic Security (CARES) Act [3].
The US Government, in collaboration with pharmaceutical companies, initiated the program Operation Warp Speed (OWS) to research, develop, and effectively distribute a viable vaccine or vaccines so that herd immunity can be achieved to end this deadly pandemic. While vaccine-associated risks may be proportionately small, socio-demographic differences, the health status of individuals, and factors related to perceived risk, knowledge, and even political perceptions can influence the willingness to accept a vaccine for protection. For instance, during the 2009 H1N1 outbreak (Swine Flu), only 50 percent to 64 percent of adults in the U.S. complied with the Centers for Disease Control and Prevention's (CDC) vaccination recommendations, mainly due to concerns about vaccine efficacy and safety [4]. It was further suggested that low uptake of vaccines was likely to be repeated due to the unpredictability of the behavior of the society.
Understanding the factors that impact the acceptance of vaccination is a necessary and crucial step for strategic public health intervention and evaluation. However, exploring the perceived values of vaccines becomes equally important, as economic evaluation of any vaccination program requires the calculation of its social value through aggregating individual willingness to pay (WTP) values [5]. The willingness of the public to pay for a vaccine is elicited by the contingent valuation model (CVM), which has been often applied to determine individual choices and estimate the monetary values of hypothetical vaccines. WTP for a vaccine can be defined as the maximum amount of money an individual is willing to pay subject to income restrictions. Its underlying theory depends on the balance of risk and wealth and measures of how much public value the benefits they would receive from vaccination.
The main objectives of this paper include: (1) Estimating mean and median WTP for a COVID-19 vaccine (2) analyzing the effects of socio-economic characteristics, healthrelated variables, perceived risk, and knowledge of the virus, and perceived effectiveness of policy measures on individual WTP values (3) assessing the differences in WTP values given the variation in vaccine efficacy rate and duration. Various efficacy rates and durations of vaccine protection were considered to assess society's attitudes towards different risk factors.

Materials and Methods
A global survey management company, QuestionPro, was hired to administer an online questionnaire to collect information about respondents' characteristics and their stated preferences for a hypothetical COVID-19 vaccine. The respondents were selected via convenience sampling, and an email invitation was sent to those who were 18 years of age and older. The survey took, on average, 10 min to complete and consisted of questions that intended to capture personal background information, knowledge of COVID-19, perceptions, and attitudes towards COVID-19, personal experience of the virus, and contingent valuation of a hypothetical vaccine.
Prior to the launch of the survey, a pilot test was administrated to 100 respondents to check for the accuracy of the questionnaire and confirm the feasibility of and adjust the initial bid values. The survey was conducted during the first week of November 2020 when the news about vaccine developments were circulating in the media, but there was yet to be an FDA approved vaccine. A total of 1501 responses were collected from the residents of the US in a seven-day period.
The primary purpose of the CVM is to estimate a value of a product or service that is hypothetical in nature and/or cannot be traded in a market setting. This preferred method also allows the respondents to state their perceptions and knowledge about the good or service in question. Even though the first applications of the CVM method intended to value certain leisure activities [6,7], the broadening scope of this method has been often observed in health-related research. Moreover, the CVM has been a reliable method to assess the values of vaccines when the public is aware of their importance and effectiveness.
Before a set of CVM questions were asked, a one-page summary outlining the meaning and relevance of different efficacy rates and duration was provided to each respondent. If a respondent accepted to pay for a vaccine out of pocket, a series of WTP questions for vaccines with 50% and 95% efficacy rates followed. It should be noted that, at the time of the survey administration, even though there were speculations about the efficacy rates of the candidate vaccines, data of their third-phase trials were still being reviewed by the FDA. The duration of vaccine protection, 1 year and 3 years, and the initial bid amounts (US$25, US$60, US$85, US$152, US$200) were randomly distributed to test the sensitivity of the elicited WTP. While this randomization provided a wider range of stated bids, the occurrence of anchoring bias was also minimized. These initial bids were structured based on the statistical analysis of the answers to the WTP questions that were collected during pre-survey testing.
While CVM can use a wide range of methods (payment cards, open-ended questions, bidding games) to help respondents state their pricing preferences, a double-bounded dichotomous choice (DBDC) with an open-ended maximum WTP question was adopted in this study, as it provides the most accurate estimates of WTP and reduces starting point bias [8,9]. As a part of this approach, if a respondent says yes to the initial bid, the next question doubles the price of the vaccine. If the respondent says no to the initial bid, the price is lowered by half in the follow-up question. Therefore, four possible WTP intervals can be obtained ("YesYes", "YesNo", "NoYes", "NoNo"). This process can be repeated one more time if the answer to the follow-up question does not change. Table 1 shows the distribution of Yes and No answers to the initial and follow-up questions for Vaccine-1 and Vaccine-2. For instance, if the respondent rejected the first bid but accepted the second bid, the response was marked as "NoYes". 41.7 percent of the respondents stated that they would not be willing to pay for any of the vaccines. As expected, the ratio of respondents who agreed to purchase a vaccine and the ratio of "YesYes" to total responses were higher for the vaccine with the highest efficacy rate (vaccine-2). Regardless of the answers to the last WTP question, each respondent was asked to state their maximum willingness to pay for the vaccine in question. However, the interval-censored observations were used in the statistical model as using open-ended questions cause significant biases [10,11] and inflated WTP values [12]. In other words, if a respondent accepted to pay US$50 for a vaccine but refused to pay US$100, the WTP could be assumed to be in the range of US$50 and US$100. If the same respondent's answer to the open-ended question was greater than US$100, this contradictory sample was excluded from further consideration due to the conflicting nature of the answers. Protest answers where respondents said no to all the WTP questions and stated 0 maximum willingness to pay were also censored. After the elimination of inconsistent responses, protest answers, and observations with missing values, the outliers were identified using box-plot and q-q plot methods thus removed from the final dataset.
Parametric estimation of the interval regression model was the preferred method in this study as it results in a more accurate estimation of mean WTP and is more suitable for the incorporation of socio-demographic factors [13]. Numerous classical distributions have been presented for the parametric estimation of DBDC data. While both logistic and normal distributions have been extensively used in the literature [14,15], the log-logistic distribution is an appropriate choice when choice responses are interval-censored, and WTP values are non-negative [16].

Respondent Characteristics
In total, 1285 respondents completed questionnaires containing measures of COVID-19 related attitudes and beliefs including socio-demographics, health-related, knowledge, perceived risk, and effectiveness of policy measure variables. The measurement of knowledge consisted of four separate questions, but for simplicity, the correct answers were aggregated by assigning equal weight to each correct response. Table 2 defines and provides summary statistics for the variables considered in this study. The dichotomous socio-demographic variables represented variation in age, gender, race, education, income, and marital status data. The health-related components were observed through the reflection of the health status of the respondents including preexisting and post-infection status. Additionally, the knowledge factors pertaining to contraction and symptoms of COVID-19, virus prevention measures, and contagiousness rates in the U.S were assessed to gauge the community's knowledge of COVID-19. A measure of risk assessment and perception was administrated and constructed based on the perceived seriousness and threat of the disease and the pandemic. The effectiveness of policy measures was recorded in reference to the responses of whether event and venue closings, mandatory stay at home orders, and the mandatory wearing of face masks were effective.

Factors Affecting WTP for COVID-19 Vaccine
We constructed and assessed three empirical models in this study. The main model (Model-1) included socio-demographic and other relevant characteristics to identify the factors that significantly contribute to the value of the COVID-19 vaccine with a 95 percent efficacy rate ( Table 3). The inclusion of these variables aimed to lower the negative effects of the omitted-variable bias. The estimated mean and median WTP values are based on Model-2 and Model-3 results (Appendix A, Table A1) and discussed later in the paper. Among the respondents who expressed willingness to pay for a vaccine with a 95 percent efficacy rate, gender, age, and income were the only socio-demographic characteristics that had significant impact on WTP. Among the respondents, an annual income of less than US$60,000 was associated with lower WTP than an income of US$100,000. The only age interval that was associated with lower WTP was 46-55. Males' higher WTP for a COVID-19 vaccine was consistent with the finding of a similar study that investigated the value of a hypothetical COVID-19 vaccine in Ecuador [17].
Health-related characteristics included the health status of the respondents and household members and their experiences with COVID-19. The regression results indicated that having health insurance and living with someone with a pre-existing condition were positively related to WTP. The scoring system to assess the knowledge of COVID-19 was found to have no statistical impact on WTP, which was found to be the case in Ecuador and Chile [17,18].
"Threat" and "worried" were used as the indicators of perceived risk for COVID-19. The respondents who agreed that the pandemic was a serious public threat had significantly higher WTP for the hypothetical vaccine. Additionally, certain policy measures to combat the COVID-19 pandemic were included in the model since these measures have important political dimensions, especially in the US. The respondents who found closing all shops except supermarkets and pharmacies effective were associated with higher WTP.
The empirical model had a good statistical fit (likelihood ratio test = 106.64, p = 0.000). To further confirm the wellness of the model performance, we followed a similar three-step validation process suggested by Palanca-Tan [13]. First, income was found to be statistically significant and positively related to WTP, a common and expected finding in the past CVM studies [17][18][19][20]. Second, the log of the bid had a negative sign with a p-value of 0.000. In other words, a respondent's probability of rejecting a bid was found to be rising as the bid amount was increased. Third, a scope test was performed by examining the relationship between the duration of the efficacy of the vaccine and WTP. The vaccine with longer protection from the disease was associated with higher WTP than the vaccine with shorter protection. This finding is especially important, as the efficacy durations of current vaccines are yet to be known.

Mean and Median WTP
In model 2 and model 3, only the socio-demographic characteristics were included. The primary purpose of constructing these models was not to identify the factors that would impact WTP, but to estimate the mean and median WTP values for vaccine-1 and vaccine-2. Table 4 presents the parametric estimates of the mean and median WTP values for vaccines with different efficacy rates and duration. It should be noted that the confidence interval for the estimates of mean and median values is 95 percent and based on the bootstrap method with 1000 replications. It can be readily observed that the efficacy rate played an important role in determining the value of the vaccine. Respondents on average would be willing to pay US$293 for a vaccine that had a 95 percent efficacy rate. Median WTP for a vaccine with a 95 percent efficacy rate (US$210.32) was approximately 35 percent higher than the vaccine with almost half the efficacy rate (US$154.21). A similar finding was observed in a recent study in which respondents in Australia would be willing to pay $23.92 for a percentage increase in COVID-19 vaccine efficacy [21].
After a vaccine with longer protection (three years) was introduced, the median WTP increased to US$236.81 (from US$185.28). Among all the four different vaccine scenarios, while the vaccine with a 3-year efficacy duration and a 95 percent efficacy rate had the highest mean and median values (US$318.76 and US$236.81), the vaccine with a 50 percent efficacy rate and 1 year protection was estimated to have the lowest (US$236.85 and US$154.21) values.

Discussion
A CVM was adopted to assess the value of a hypothetical COVID-19 vaccine and determine the associated exogenous variables in the U.S. Even though numerous studies investigated the willingness to accept (WTA) for a COVID-19 vaccine in the United States [22][23][24], to our best knowledge, this is one of the first studies that projected the value of a hypothetical COVID-19 vaccine using the CVM.
The survey data show that approximately 42 percent of the respondents would not buy a COVID-19 vaccine if the cost of the vaccine is fully paid by the respondents. However, this estimate should be interpreted with caution as the information about free vaccination, at least in 2021 or during the pandemic, was known by most Americans during the time of the survey administration. For instance, Reiter et al. [22] found that the WTA for a COVID-19 vaccine was nearly 70 percent in the US, but only 35 percent of the participants would be willing to pay US$50 or more for it. According to a survey administered by the Pew Research Center in December 2020 [25], 39 percent of the Americans stated that they "definitely or probably" would not get a coronavirus vaccine. Unlike the higher vaccine acceptance rates in China, Ecuador, and Chile [17,18,26], the vaccine resistance, budgetary concerns, and the expectation that the vaccine would be fully subsidized by the government most likely contributed to lower acceptance rates. Figure 1 presents the reasons for rejecting a COVID-19 vaccine. The uncertainty and knowledge deficiencies signify greater perceived risk-controlled via emotional appraisals and cognitive skills. The negative association of perceived risk, awareness, knowledge gap, and willingness to participate in vaccination was echoed in our survey responses. Even as cases surge throughout the globe, the pandemic denial is a reality, where nearly one-tenth of the participants expressed that COVID-19 was a perpetrated hoax. The lack of public knowledge about the disease or unveiled scientific evidence constituted the leading reason why people were rejecting the vaccine. This was followed by the preference to practice preventive measurements, which could be possibly related to the greater perceived health risk factors or the perceived cost and lack of benefit association. The economic aspects such as concerns over the vaccine's affordability, expectations of a free vaccination from the government, and seeking health insurance coverage stood out as substantial obstacles in the way of accepting self-paying vaccines. As confirmed by similar studies conducted in Indonesia [27], Ecuador [17], Chile [18], and Malaysia [28], pandemic vaccination programs should consider the economic status of lower income groups, as lower WTP and refusal to be vaccinated are partly due to financial reasons.
One interesting finding of this study is that while the health status of the respondents did not appear to influence the WTP, living with someone with a pre-existing condition was found to be more important in explaining the variation in WTP. This may echo the altruistic nature of the vaccination and decision to be vaccinated, especially when the family members are involved. Considering the lower acceptance rates of vaccines in the United States, unless cooperative altruism is widely adopted and acknowledged, the roadblocks to achieving herd immunity may be harder to remove.
As the estimated vaccine efficacy rate was widely recognized by the public during the data collection process, the vaccine with a 95 percent efficacy rate had been the center of this study's focus. As predicted, respondents were willing to pay significantly less for a vaccine that had almost half of the efficacy rate. The duration of protection was entered into the interval regression model and was found to increase individuals' perceived value of the vaccine. This is especially important because there is currently not enough data regarding how long Pfizer/Biotech and Moderna vaccines protect the individuals from COVID-19. Potential benefits of the vaccine would increase significantly as it provides longer protection, and the regression results confirmed the realization of these private benefits by the survey respondents. The optimal vaccination rate to reach herd immunity can be achieved if the higher WTP values are translated into higher WTA. One interesting finding of this study is that while the health status of the respondents did not appear to influence the WTP, living with someone with a pre-existing condition was found to be more important in explaining the variation in WTP. This may echo the altruistic nature of the vaccination and decision to be vaccinated, especially when the family members are involved. Considering the lower acceptance rates of vaccines in the United States, unless cooperative altruism is widely adopted and acknowledged, the roadblocks to achieving herd immunity may be harder to remove.
As the estimated vaccine efficacy rate was widely recognized by the public during the data collection process, the vaccine with a 95 percent efficacy rate had been the center of this study's focus. As predicted, respondents were willing to pay significantly less for a vaccine that had almost half of the efficacy rate. The duration of protection was entered into the interval regression model and was found to increase individuals' perceived value of the vaccine. This is especially important because there is currently not enough data regarding how long Pfizer/Biotech and Moderna vaccines protect the individuals from COVID-19. Potential benefits of the vaccine would increase significantly as it provides longer protection, and the regression results confirmed the realization of these private benefits by the survey respondents. The optimal vaccination rate to reach herd immunity can be achieved if the higher WTP values are translated into higher WTA.
Comparison of the estimated values of WTP can help us understand the important geographical and other differences that may impact the perceived value of vaccines. Sarasty et al. [17] assessed the value of a hypothetical COVID-19 vaccine with different efficacy rates and duration in Ecuador and found the mean and median WTP values to increase with higher efficacy rate and duration. Their parametric mean estimate of a vaccine with a 98 percent efficacy rate and 1-year duration is an important reference point, as it is almost identical to one of the four scenarios (1 year and a 95 percent efficacy rate) we investigated. They found the mean WTP to be US$327.81, which is slightly higher than our estimate of US$264.97. Dong et al. [26] also found that the respondents in China were willing to pay a premium for a higher efficacy rate and longer protection from the virus. Their estimate of mean WTP for a 90 percent efficacy rate and 18 months of protection was 1948 CNY (US$301.36). Garcia and Cerda [18] conducted a similar study in Chile and though the effectiveness of the hypothetical vaccine was not disclosed in the study, their mean estimate was within the range of US$169.92 and US$184.72. Comparison of the estimated values of WTP can help us understand the important geographical and other differences that may impact the perceived value of vaccines. Sarasty et al. [17] assessed the value of a hypothetical COVID-19 vaccine with different efficacy rates and duration in Ecuador and found the mean and median WTP values to increase with higher efficacy rate and duration. Their parametric mean estimate of a vaccine with a 98 percent efficacy rate and 1-year duration is an important reference point, as it is almost identical to one of the four scenarios (1 year and a 95 percent efficacy rate) we investigated. They found the mean WTP to be US$327.81, which is slightly higher than our estimate of US$264.97. Dong et al. [26] also found that the respondents in China were willing to pay a premium for a higher efficacy rate and longer protection from the virus. Their estimate of mean WTP for a 90 percent efficacy rate and 18 months of protection was 1948 CNY (US$301.36). Garcia and Cerda [18] conducted a similar study in Chile and though the effectiveness of the hypothetical vaccine was not disclosed in the study, their mean estimate was within the range of US$169.92 and US$184.72.
It is also worthwhile to mention similar studies that estimated significantly lower WTP values. For instance, the mean WTP for a hypothetical COVID-19 vaccine was US$57.2 and US$30.66 in Indonesia and Malaysia, respectively [27,28]. These discrepancies among countries should be evaluated within the context of macroeconomic and sociodemographic differences. In other words, it is important to evaluate the mean and median WTP projections based on economic, demographic, and social norms that are present where the surveys are administered. Additionally, the timing of the data collection is equally critical, as the severity of the pandemic has shown significant variations over time globally.
Estimated mean and median WTP values reflect the private values of disease prevention. Even though the U.S. government announced that the vaccine would be provided free of charge to the American people during the pandemic, identifying the private benefit of getting the vaccine is a crucial step in assessing the overall cost-benefit relationship of any vaccination program. As of January 2021, the U.S. government has secured the right to purchase 200 million doses of Pfizer/BionTech and Moderna vaccines under the program Operation Warp Speed (OWS), a public-private partnership. OWS's main objective of producing and delivering vaccines to American people is estimated to cost 10 billion dollars to the federal government [29]. According to the former Secretary of the Pennsylvania Department of Health, Dr. Rachel Levine's testimony at the Senate hearing in December 2020 [30], the States may have to bear an additional cost of 8 billion dollars. Assuming that the vaccine, at least initially, will be available to those who are 18 years of age and older, CDC's estimate of flu vaccination rate among adults can be used as a reference point.
During the 2019-2020 season, the flu vaccination rate among adults was 48.4 percent in the United States [31]. According to the US Census [32], the number of people who were 18 and older was 255,200,373 in 2019. If the flu vaccination rate is used as a reference point, the total number of people getting the COVID-19 vaccine would be 123,516,980. Table 5 reports the total private value of preventing COVID-19 through vaccination by efficacy duration using the parametric estimates of the mean and median WTP values. The above values are conservative estimates as lower vaccine acceptance rate and lower bound of mean and median WTP values were used in the calculations. If the COVID-19 vaccine provides protection for one year, the estimated private value of preventing the virus would be between 20 and 29 billion US dollars. This estimate increases significantly to the range of 25.7 and 35.6 billion US dollars if the vaccine protection lasts 3 years. Even though there are other direct and indirect costs and benefits of vaccinating the US population, documenting the private value can be a useful first step to assess the effectiveness of the current vaccination efforts. However, a more accurate estimation of total private value can be obtained by targeting a study sample that characterizes the US population. Therefore, one should be cautious interpreting these values.
It is worth mentioning the limitations and strengths of this study. Even though the CVM provides an accurate assessment of WTP values, respondents can always understate or overstate their perceived value of a hypothetical vaccine when there is a hypothetical outbreak. However, the circumstances are unique in a way that during the administration of this survey, the news about vaccine development were circulating in the media, but none of the candidate vaccines completed the formal approval process. Responses to survey questions about a quasi-hypothetical vaccine during a real outbreak may provide unique and perhaps more realistic estimates of vaccine valuation. However, the discussions about the pricing of the vaccines in preparation, the governmental decision to fully subsidize the vaccine cost, and information about the potential vaccines may have influenced the respondents' stated preferences.

Conclusions
The COVID-19 pandemic has been causing immense suffering and wreaking economic havoc across the globe. Tremendous resources have been allocated by public and private entities to end this deadly outbreak. Our estimates of the WTP values are important indicators of the benefits individuals receive from vaccination. These results can also be used to evaluate the costs and benefits of public and private vaccination efforts.
Author Contributions: S.C. and S.V. contributed equally to this research manuscript. Survey preparation and data organization were led by S.V. Statistical modeling and interpreting the results were performed by S.C. First draft of the manuscript was written by both authors. After incorporating the comments from both authors, the final draft was organized and approved. All authors have read and agreed to the published version of the manuscript. Informed Consent Statement: Informed consent was obtained from all subjects involved in the study. Participants of the survey were informed that their involvement was completely voluntary, and the survey could be stopped anytime. They were assured that their responses were anonymous and confidential. All respondents provided informed consent.

Data Availability Statement:
The data presented are available on request from the corresponding author.

Conflicts of Interest:
The authors declare no conflict of interest.

Variable
Model -