text:
Many immune correlates of CD8+ T-cell-mediated control of HIV replication, including polyfunctionality, proliferative ability, and inhibitory receptor expression, have been discovered. However, no functional correlates using ex vivo cells have been identified with the known ability to cause the direct elimination of HIV-infected cells. We have recently discovered the ability of human CD8+ T-cells to rapidly upregulate perforin—an essential molecule for cell-mediated cytotoxicity—following antigen-specific stimulation. Here, we examined perforin expression capability in a large cross-sectional cohort of chronically HIV-infected individuals with varying levels of viral load: elite controllers (n = 35), viremic controllers (n = 29), chronic progressors (n = 27), and viremic nonprogressors (n = 6). Using polychromatic flow cytometry and standard intracellular cytokine staining assays, we measured perforin upregulation, cytokine production, and degranulation following stimulation with overlapping peptide pools encompassing all proteins of HIV. We observed that HIV-specific CD8+ T-cells from elite controllers consistently display an enhanced ability to express perforin directly ex vivo compared to all other groups. This ability is not restricted to protective HLA-B haplotypes, does not require proliferation or the addition of exogenous factors, is not restored by HAART, and primarily originates from effector CD8+ T-cells with otherwise limited functional capability. Notably, we found an inverse relationship between HIV-specific perforin expression and viral load. Thus, the capability of HIV-specific CD8+ T-cells to rapidly express perforin defines a novel correlate of control in HIV infection.
Author Summary
While the majority HIV-infected individuals progress to AIDS, a fraction of these individuals—for reasons not completely understood—do not develop AIDS and also display sustained control over viral replication; these subjects are sometimes referred to as elite controllers (EC). Prior evidence has shown that HIV-specific CD8+ T-cells, a component of adaptive immunity against intracellular pathogens, from EC exhibit enhanced functionality compared to individuals with progressive disease. Therefore, HIV-specific CD8+ T-cells likely play an important role in the favorable clinical outcomes witnessed in EC. We show in this study that the ability to control HIV replication in EC is associated with the expression of a protein called perforin, a critical molecule that enables CD8+ T-cells to directly kill infected cells - thereby preventing the spread of HIV to previously uninfected cells. In infected subjects with nonprogressive disease, we show that HIV-specific CD8+ T-cells demonstrate a superior ability to express perforin upon antigen-specific stimulation, whereas in progressors this property is diminished. Thus, we identify a functional capability of CD8+ T-cells, readily measured by standard intracellular cytokine staining assays, that potentially has a direct impact on HIV replication in vivo. These findings may, therefore, provide an important qualifier for future HIV vaccine research.
Citation: Hersperger AR, Pereyra F, Nason M, Demers K, Sheth P, Shin LY, et al. (2010) Perforin Expression Directly Ex Vivo by HIV-Specific CD8+ T-Cells Is a Correlate of HIV Elite Control. PLoS Pathog 6(5): e1000917. doi:10.1371/journal.ppat.1000917
Editor: Joel Blankson, Johns Hopkins School of Medicine, United States of America
Received: December 23, 2009; Accepted: April 22, 2010; Published: May 27, 2010
This is an open-access article distributed under the terms of the Creative Commons Public Domain declaration which stipulates that, once placed in the public domain, this work may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose.
Funding: This study was funded in part through a grant from the National Institutes of Health (R01 AI076066). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Approximately 35–40 million people are currently infected with HIV worldwide. Most of these individuals fail to control HIV replication, and ultimately progress to acquired immune deficiency syndrome (AIDS) if left untreated. However, a subset (<1%) of the HIV-infected population, termed elite controllers (EC), can spontaneously control viral replication to undetectable levels [1], [2], [3]. Understanding the mechanisms of immunologic control of HIV replication in EC may identify candidate markers of immune control useful for assessing HIV vaccine strategies.
The host immune response, in particular HIV-specific CD8+ T-cells, is at least partially responsible for the control of viral replication in many EC. For example, EC are enriched for certain HLA alleles, such as HLA-B13, B15, B51, B27, B57, and B58 [4], [5], [6], [7]. EC contain a greater fraction of HIV-specific CD8+ T-cells that can degranulate, produce multiple functional cytokines and chemokines and display markedly better proliferative potential upon HIV peptide stimulation than individuals with progressive disease [7], [8], [9], [10], [11], [12], [13]. Additionally, recent evidence has demonstrated that HIV-specific CD8+ T-cells from EC have enhanced cytotoxic capabilities compared to progressors: Several groups have shown that HIV-specific CD8+ T-cells from EC display a superior ability to suppress the replication of HIV during extended culture [14], [15], [16]. Using CD8+ T-cells expanded in vitro for six days, Migueles and colleagues observed a higher cytotoxic capacity on a per-cell basis of HIV-specific CD8+ T-cells from EC [17]. Collectively, these findings suggest that CD8+ T-cells may be critical to the control of HIV replication in vivo.
CD8+ T-cells are thought to kill virally-infected cells predominantly through the release of lytic proteins - mainly perforin and granzymes - that are secreted via exocytosis of pre-formed granules following recognition of infected targets [18], [19], [20]. Granule-mediated killing by CD8+ T-cells occurs within minutes to hours of target cell recognition; however, the reconstitution of intracellular perforin following degranulation has been reported to first require cellular proliferation [13], [21], [22]. We have recently identified another mechanism by which perforin-mediated CD8+ T-cell killing can take place: the rapid upregulation and targeted release of newly produced perforin, which traffics to the immunological synapse via a route that largely bypasses cytotoxic granules [23]. De novo synthesis of perforin by human CD8+ T-cells can be detected by flow cytometry in conjunction with standard intracellular cytokine-staining (ICS) [24], thus permitting simultaneous assessment of CD8+ T-cell cytotoxic potential and cytokine production.
Here, we measured the ability of HIV-specific CD8+ T-cells to express perforin in a cross-sectional cohort of chronically-infected individuals that differentially control viral replication. Several previously published studies have examined perforin expression in HIV-specific CD8+ T-cells in both progressive and nonprogressive infection [13], [25], [26], [27]. However, due to the nature of the anti-perforin antibody employed [23], these studies have uniformly assessed only pre-formed, granule-associated perforin present within resting or long-term activated HIV-specific CD8+ T-cells. In this work we demonstrate that HIV-specific CD8+ T-cells from EC, compared to progressors, have a superior ability to express perforin immediately upon activation, without the need for prior proliferation or the addition of exogenous cytokines. Overall, this work identifies the rapid expression of perforin as a novel correlate of control of HIV replication and urges a closer examination of CD8+ T-cell polyfunctionality in HIV infection.
HIV-specific CD8+ T-cell response between EC and CP did not vary greatly in total magnitude, degranulation, or cytokine production
We assessed the magnitude and functional characteristics of HIV-specific CD8+ T-cells by stimulating PBMC from 35 elite controllers (EC), 29 viremic controllers (VC), and 27 chronic progressors (CP) [Table 1 and Table S1] with overlapping peptide pools encompassing all HIV-1 (clade B) proteins. We developed a flow cytometric staining panel (Fig. S1A) that simultaneously measured memory phenotype (CD27, CD45RO, and CD57), degranulation [surface expression of CD107a [28]], cytokine expression (IFN-γ, TNFα, and IL-2), and chemokine production (MIP1α). As a sixth functional parameter, we included an anti-perforin antibody (clone B-D48) to measure perforin upregulation [23], [24]. As shown in Figure S1B, the historically used antibody (δG9 clone) cannot detect perforin expression within activated CD8+ T-cells in the same ICS assay format.
As shown in Figure 1A, the total HIV-specific CD8+ T-cell response magnitude to Pol, Env, Nef, or TRVVV stimulation did not differ substantively across the groups, but EC displayed a somewhat higher Gag-specific response. The lack of large differences in response magnitude is in agreement with previous studies that measured the total magnitude of CD8+ T-cell responses in EC and CP using flow cytometry [7], [8], [13]. We next determined the relative contribution of CD107a, IFN-γ, TNFα, IL-2, and MIP1α to the HIV-specific CD8+ T-cell response (Fig. 1B). In general, no clear trends emerged in overall functionality between the groups. For example, compared to EC, CP demonstrated a slightly enhanced ability to degranulate, lower levels of TNFα, but no statistically significant difference in the proportion of the average HIV-specific CD8+ T-cell response comprised of either IFN-γ or MIP1α. The largest difference in functionality was IL-2 expression, which was higher among EC and VC compared to CP. Previous studies have also shown enhanced production of IL-2 after HIV-specific stimulation in subjects with low or undetectable viremia [7], [8], [10]. Similar overall observations were found for the individual HIV antigens as well (data not shown).
(A) The CD8+ T-cell response magnitude to all HIV peptide pools was calculated for EC, VC, and CP and plotted as percent of CD8+ T-cells (excluding naïve cells). The total magnitude was calculated by summing across all functional combinations. (A) The proportion of the average HIV-specific CD8+ T-cell response comprised of each single functional parameter (except perforin) is shown for EC, VC, and CP. (C) Representative flow cytometric plots of perforin versus IFN-γ are shown from one representative EC, VC, and CP. Percentages represent the proportion of functional cells that stain either positive or negative for perforin. Values in parentheses are the magnitude of each population and denote percent of CD8+ T-cells (excluding naïve cells). All reported values have been corrected for background. (D) The proportion of the average HIV-specific CD8+ T-cell response comprised of perforin is shown for EC, VC, and CP. (E) The relative contribution of perforin to the Gag-, Pol-, Env-, Nef-, and TRVVV-specific CD8+ T-cell responses is shown for EC, VC, and CP. (A, B, D, E) Statistical analysis was carried out using one-way ANOVA tests (nonparametric; Kruskal-Wallis) followed by a Dunns test for multiple comparisons. * denotes a p value <0.05, ** denotes a p value<0.01, and *** denotes a p value <0.001. All bars represent the mean and error bars indicate the standard deviation.
HIV-specific CD8+ T-cells in EC demonstrated a greater ability to express perforin than VC and CP
We next assessed perforin expression by HIV-specific CD8+ T-cells in each cohort group. We consistently observed higher co-expression of perforin within responding cells from EC compared to VC or CP for all HIV antigens (Fig. 1C shows representative Nef-specific responses producing IFN-γ; other HIV antigens are not shown but yielded similar results). In fact, perforin expression comprised a significantly greater proportion of the average HIV-specific CD8+ T-cell response in EC than in CP (Fig. 1D). The relative contribution of perforin to the CD8+ T-cell response was significantly higher (∼3 fold) in EC compared to CP for all of the individual HIV antigens (Fig. 1E). In addition to the proportion of the HIV-specific CD8+ T-cell response comprised of perforin, EC also displayed a greater magnitude of perforin expression upon stimulation by all HIV antigen pools compared to both VC and CP (Fig. S2). However, we found no correlation among EC between the total magnitude of an HIV-specific response and the corresponding amount of perforin expression (Fig. S3).
As shown in Figure S4, there was, however, some variability among EC subjects in the contribution of perforin to the HIV-specific CD8+ T-cell response. Within some EC there was low perforin expression induced by one HIV antigen (e.g. Gag) but higher perforin production to another peptide pool (e.g. Pol). Some EC demonstrated high HIV-specific perforin in response to every antigen. Although several EC did express low levels of HIV-specific perforin, only 20% of all EC in the cohort failed to achieve 30% perforin for the CD8+ T-cell response to at least one of the antigen pools (data not shown). In contrast, only 15% of CP demonstrated even one HIV antigen-specific CD8+ T-cell response comprised of 30% perforin (data not shown). Thus, our data suggests that EC are not simply a homogenous group of HIV-infected individuals and do demonstrate some variability, which is in agreement with previous findings [7], [29].
Next, we examined the functional profile of the average Nef-specific CD8+ T-cell response among the EC, VC, and CP groups (Fig. 2A and 2B; the other HIV antigens are not shown but yielded similar results). Only the functional combinations that were significantly different between at least two of the groups are shown in Figure 2A; all 64 combinations are shown in Figure S5. We rarely observed simultaneous expression of all six functions because perforin and IL-2 are generally not co-expressed by the same cell [30]. The average Nef-specific functional profile in EC and VC was composed of more CD8+ T-cells than in CP that simultaneously expressed five functions (Fig. 2B). Additionally, the percentage of the Nef-specific response that was perforin-positive (black arcs in Fig. 2B) was significantly higher among EC (44%) compared to VC (27%; p<0.05) or CP (14%; p<0.001). Similar findings were observed for Gag-, Pol-, Env-, and TRVVV-specific responses (data not shown).
(A) The functionality of the average Nef-specific CD8+ T-cell response is shown; only the functional permutations that varied significantly between at least two of the groups are shown. ** denotes a p value <0.01 based on a Lachenbruch's Two-part Wilcoxon test as described in the Methods. All bars represent the mean and error bars indicate the standard deviation. (B) The average Nef-specific CD8+ T-cell functional profile is shown for EC, VC, and CP. Responses are grouped according to the number of positive functions. The relative amount of perforin positivity within each functional group (i.e. each pie slice) is depicted as black arcs. The relative contribution of perforin (mean value) to the entire response is represented by the percentage in the center of each pie.
The majority of perforin was produced by cells expressing only a single other function: CD107a or MIP1α (Fig. 2B). The CD8+ T-cells that co-expressed CD107a and perforin likely upregulated perforin de novo since a cell that was CD107a+ presumably lost all (or nearly all) of its granule-associated perforin through the process of degranulation. As shown in Figure S6, the proportion of the HIV-specific response in EC that was both CD107a+ and perforin+ was significantly higher than CP for all HIV antigens. The second major population of perforin+ cells co-expressed only MIP1α. The relevance of this population is unclear. However, we have previously shown that activated CD8+ T-cells can transport newly synthesized perforin directly to the immunological synapse without trafficking first through cytolytic granules [23]. Thus, despite the absence of apparent degranulation, MIP1α+ perforin+ cells may potentially be involved in ongoing cytolytic activity.
Perforin expression is not restricted to the presence of protective HLA-B alleles
One consistent host factor associated with durable control of HIV is the presence of certain HLA class I alleles, particularly HLA-B27 and B57 [1], [4], [31], [32], [33]. Other HLA-B alleles have also been associated with delayed disease progression or lower viral loads, including HLA-B13, B15, B51, and B58 [5], [6]. Among EC in our cohort, 54% of the subjects expressed HLA-B27 or B57, while 32% of VC carried these alleles (data not shown). Additionally, 43% of EC in the study cohort expressed either HLA-B13, B15, B51, or B58, while 32% of VC carried these alleles (data not shown). As shown in Figures 3A and S7, we found no association between protective HLA-B status and perforin expression to any HIV peptide pool in either EC or VC (Gag shown in Fig. 3A, Nef shown in Fig. S7, and data not shown), or when perforin expression to all HIV peptide pools was averaged within each subject (Fig. 3B). Thus, there was no apparent relationship between protective HLA-B alleles and the capacity of HIV-specific CD8+ T-cells to express perforin after stimulation.
EC were stratified based on the expression of HLA-B alleles previously shown to be associated with improved clinical outcomes. The relative amount of perforin expression is shown for the (A) Gag-specific and (B) average HIV-specific CD8+ T-cell responses among all EC. Each symbol represents an individual study subject. Some of the symbols are colored to denote the presence of another protective HLA-B allele: blue, HLA-B13; green, HLA-B15; orange, HLA-B51; red, HLA-B58. No statistically significant differences were found between the groups using a one-way ANOVA test (nonparametric; Kruskal-Wallis) followed by a Dunns test for multiple comparisons. The error bars represent the mean and standard deviation.
Distinct expansion of HIV-specific effector CD8+ T-cells in EC
We next examined the memory phenotype, based on surface expression of CD27, CD45RO, and CD57, of HIV-specific CD8+ T-cells in each group. The majority of HIV-specific CD8+ T-cells that expressed perforin in EC, VC, and CP were CD27-CD45RO-CD57+/- (Fig. 4A and 4B and data not shown), commonly considered an effector-type profile, which is in agreement with previous reports that examined the presence of perforin in various human CD8+ T-cell memory subsets [34], [35]. This phenotype was common to virtually all perforin+ HIV-specific CD8+ T-cells regardless of their specificity for Gag, Pol, Nef, Env or TRVVV (Fig. 4A and data not shown). HIV-specific CD8+ T-cells among many CP subjects were skewed toward a CD27+CD45RO+/- memory phenotype (Fig. 4C), as previously shown [8], [36], [37]. However, a higher proportion of HIV-specific CD8+ T-cells in EC than in CP displayed a memory phenotype consistent with highly differentiated effector cells (Fig. 4C). Overall, the presence of CD27-CD45RO- HIV-specific CD8+ T-cells was less common among CP than EC (Fig. S8) in agreement with a previous study [14]. The absence of effector-like HIV-specific CD8+ T-cells in CP is not, however, reflective of the total CD8+ T-cell pool in these individuals. A substantial fraction of CD8+ T-cells in CP that responded to CEF stimulation were CD27-CD45RO- (Fig. 4D). However, responding Gag-specific CD8+ T-cells within the same subjects were primarily CD27+CD45RO+ (Fig. 4D).
(A) Gag-, Pol-, and Nef-specific perforin+ functional subsets (red events) were overlaid onto a density plot (black shading) of the memory phenotype, as determined by CD27, CD45RO, and CD57, of the total CD8+ T-cell population in three representative EC subjects. (B) The memory phenotype of Gag-, Pol-, and Nef-specific perforin+ functional subsets, as determined by CD27, CD45RO, and CD57, was determined for all EC. Bars represent the mean and error bars indicate the standard deviation. (C) Gag-, Pol-, and Nef-specific CD8+ T-cells, as defined by the production of IFN-γ or TNFα (green events), were overlaid onto a density plot (black shading) of the memory phenotype, as determined by CD27 and CD45RO, of the total CD8+ T-cell population in three separate EC and CP subjects. (D) Gag- and CEF-specific CD8+ T-cells, as defined by the production of IFN-γ or TNFα (green events), were overlaid onto a density plot (black shading) of the memory phenotype, as determined by CD27 and CD45RO, of the total CD8+ T-cell population in two separate CP subjects. (A, C, D) Percentages represent the fraction of overlaid cells that fall within each quadrant.
Inverse relationship between HIV-specific perforin expression and viral load
Having observed higher perforin expression in HIV-specific CD8+ T-cells in EC, we next examined the relationship between perforin expression and viral load. We found a significant inverse correlation between the average HIV-specific perforin expression within each subject and HIV viral load (Fig. 5A). This inverse relationship was found for every individual HIV antigen specificity (data not shown) and when only considering subjects with detectable viremia (EC subjects excluded; Fig. S9). We also found a statistically significant positive correlation between CD4+ T-cell counts in the blood and HIV-specific perforin expression by CD8+ T-cells across all subjects (Fig. S10), a finding most likely driven by the high CD4+ T-cell counts among the EC subjects (Table 1). Furthermore, when we examined the other functional parameters in a similar manner, we only found a statistically significant inverse relationship between IL-2 expression and viral load (Fig. S11), which is an expected result based upon previous studies.
(A) The average proportion of HIV-specific perforin expression within each subject was plotted against the HIV viral load from each respective subject. The most proximal viral load measurement to the time point of the PBMC sample was used in the analysis. Spearman correlation tests (nonparametric; two-tailed) were performed to determine statistical significance. (B) The relative contribution of perforin to the Gag-, Pol-, and Nef-specific CD8+ T-cell responses is shown for all EC, CP, VNP, and HAART-suppressed subjects. Each symbol represents an individual study subject. One-way ANOVA tests (nonparametric; Kruskal-Wallis test) were performed followed by a Dunns test for multiple comparisons. * denotes a p value <0.05, ** denotes a p value <0.01, and *** denotes a p value <0.001. The error bars represent the mean and standard deviation.
To better understand the relationship between viral load and perforin expression, we next compared HIV-specific CD8+ T-cell responses among EC to viremic nonprogressors (VNP), who maintain stable CD4+ T-cell counts in the face of consistently high viral loads (median 35,000 viral RNA copies/mL plasma; Table 1) without progressing to AIDS. The infection duration in both groups was similar (17 vs. 20 years in the absence of therapy; Table 1). Therefore, by comparing these two groups, we can control for the rate of CD4+ T-cell decline, progression rate, and duration of infection. As shown in Figure 5B, perforin expression by HIV-specific CD8+ T-cells in VNP is significantly lower than EC and actually closely resembles the perforin levels observed in CP. Together, these data indicate that the degree of HIV-specific CD8+ T-cell perforin expression is predictive of the ability to control viral load independent of the rate of CD4+ T-cell decline, progression status, or infection duration.
HIV-specific perforin expression is not recovered by HAART
In order to determine whether the low perforin expression associated with progression was reversible, we examined HIV-specific perforin expression by CD8+ T-cells in HAART-treated individuals with undetectable HIV viremia (Table 1). Compared to EC, the total CD8+ T cell response magnitude was lower in HAART-treated subjects to Gag, Pol, and Nef stimulation; however, only the difference in the total Gag-specific magnitude reached statistical significance (Fig. S12). Despite some differences in total magnitude, there were no substantive differences in the relative contribution of degranulation, IFN-γ, TNFα, or MIP1α production (Fig. S13). However, HIV-specific perforin expression in HAART-suppressed subjects was considerably lower than EC, and was similar to the levels observed in CP (Fig. 5B). Thus, the ability to express and rapidly upregulate perforin by HIV-specific CD8+ T-cells in chronic HIV infection is not recovered following HAART.
While many cell surface markers, activation profiles, and functional parameters of both ex vivo HIV-specific CD8+ and CD4+ T-cells have been shown to correlate with control of viremia [8], [38], [39], [40], [41], [42], few, if any, can potentially mediate direct control of HIV replication through the lysis of infected cells. Here we have shown that perforin expression by ex vivo HIV-specific CD8+ T-cells is significantly higher in EC compared to patients with uncontrolled viral replication. HIV-specific CD8+ T-cells that express perforin bear predominantly an effector phenotype, indicating that effector populations, in addition to central memory populations [43], [44], may be critically important to the control of HIV infection. We also find an inverse correlation between perforin expression by HIV-specific CD8+ T-cells and viral load. Together, these results represent an unique assessment of HIV-specific immunity and provide a novel platform for measuring potential vaccine efficacy in clinical trials.
There is little question regarding the crucial importance of perforin in the control of infectious pathogens. Indeed, mutation or dysregulation of perforin in humans results in compromised cellular immunity and enhanced susceptibility to viral infections [45]. Previous reports on ex vivo HIV-specific CD8+ T-cells have uniformly found low or absent perforin expression in both CP and EC and no detectable differences in perforin levels between the groups [13], [25], [27], [37], [46]. However, these studies have in retrospect only defined the level of granule-associated perforin within resting HIV-specific CD8+ T-cells due to unforeseen limitations in the anti-perforin antibody employed in these studies [23], [24]. Due to chronic activation and continual presence of viral antigen - albeit extremely low levels in EC [47] - HIV-specific CD8+ T-cells are unlikely to reach a true resting state; therefore, it is unlikely these cells accumulate cytolytic granules containing perforin in vivo. However, our results indicate that this does not preclude their ability to upregulate new perforin upon antigen-specific stimulation, a killing mechanism that we have recently shown potentiates the cytotoxic ability of human CD8+ T-cells [23].
We have shown previously that both the commonly used anti-perforin antibody (δG9 clone) and the anti-perforin antibody used in this study (B-D48 clone) stain resting CD8+ T-cells equivalently [24]. Thus, previous research that found no difference in the levels of perforin within resting HIV-specific CD8+ T-cells between EC and CP [13], [25], [27], [37], [46] were not necessarily incorrect. Here, we have shown using a perforin antibody that can detect both granule-associated and granule-independent forms of perforin that HIV-specific CD8+ T-cells from EC express this protein to a higher degree than patients with uncontrolled viremia. It is important to note, though, that the B-D48 clone cannot specifically distinguish pre-formed from newly upregulated perforin using flow cytometric-based assays. Nevertheless, to identify the potential contribution of perforin produced de novo, we examined the proportion of the HIV-specific CD8+ T-cell response that both degranulated (CD107a+) yet remained perforin+ after six hours of stimulation. These CD8+ T-cells that co-expressed CD107a and perforin likely upregulated new perforin; they have presumably lost most or all of their pre-formed perforin through the process of degranulation. By analyzing this specific population, we found that the proportion of the HIV-specific CD8+ T-cell response in EC that co-expressed CD107a+ and perforin+ was significantly higher than CP to all HIV antigens. However, we have also shown that newly synthesized perforin largely bypasses cytotoxic granules [23]; therefore, we are almost certainly underestimating the levels of perforin upregulation by focusing only on cells that have degranulated.
The capacity of unstimulated CD8+ T-cells from EC to begin to eliminate HIV-infected autologous CD4+ T-cell targets within several hours of co-incubation has been previously reported [14]. The results from this study suggested that HIV-specific CD8+ T-cells were responsible for the elimination of infected CD4+ T-cells through a mechanism dependent on cell-to-cell contact and MHC-I restriction. Our findings on perforin upregulation by HIV-specific CD8+ T-cells shortly after stimulation are consistent with the results of Saez-Cirion and colleagues [14] and may even be a mechanism to explain their findings. Moreover, another previously published report indicated that HIV-specific CD8+ T-cells kill targets through the use of cytotoxic granules and not by the Fas/FasL pathway [48]. Therefore, available evidence indicates that the perforin/granzyme pathway of cytotoxicity is likely the primary means by which HIV-specific CD8+ T-cells kill infected cells in vivo.
Our findings here suggest that HIV-specific CD8+ T-cells in EC have a superior cytotoxic potential by expressing higher levels of perforin. This supposition is supported by recent work from Migueles and colleagues [17]. These authors showed that HIV-specific CD8+ T-cells from EC accumulate more granule-associated perforin as a result of their superior ability to proliferate in vitro compared to CD8+ T-cells from progressors. They also found that higher amounts of perforin (and granzyme B) in HIV-specific cells translate into an enhanced ability to lyse infected targets. Thus, together with the previous work of Migueles et al., our results show that EC have an enhanced ability to upregulate perforin either directly ex vivo or after in vitro proliferation. Given what is known about the importance of perforin in orchestrating cytotoxicity, we can conclude that HIV-specific CD8+ T-cells from EC certainly have the potential to elicit elimination of infected targets to a greater degree than progressors, which may directly impact viral load. Furthermore, we know that newly synthesized perforin traffics directly to the immunological synapse - the site of action of cytotoxicity [23].
Besides differences in cytotoxic capabilities, HIV-specific CD8+ T-cells from EC have also been shown to be more polyfunctional in nature; they can simultaneously degranulate and produce multiple functional molecules, such as IL-2, IFN-γ, and TNFα, to a greater extent than CD8+ T-cells from progressors [8], [49]. Our results here confirm and extend these findings. Polyfunctional HIV-specific CD8+ T-cells were also found in this study to comprise a greater fraction of the response in EC than in CP. Interestingly, we rarely observed HIV-specific CD8+ T-cells capable of producing all six functions simultaneously. This results from a dichotomous relationship between perforin and IL-2 production from the same cell [30]. The implications of this dichotomy are profound for our understanding of effective HIV-specific CD8+ T-cell responses: IL-2 producing CD8+ T-cells will presumably not have immediate cytolytic activity; conversely, perforin producing CD8+ T-cells may be inherently reliant upon production of IL-2 from cells in their surrounding environment for maintenance or modulation. Both cell types are most likely crucial to maintaining protective immunity. The IL-2 producing cells may be part of a population of CD8+ T-cells that can maintain itself through autocrine production of IL-2. This ability may be important in the setting of diminished CD4+ T-cell help in HIV infection [10]. Alternatively, these cells may represent a self-renewing memory population of CD8+ T-cells responsible for long-term maintenance of effector cells. IL-2 producing cells likely do not display any direct anti-viral capability directly after activation [30] but may be able to differentiate into perforin producing effector cells. The increased IL-2 production observed by both HIV-specific CD8+ T-cells and CD4+ T-cells [42] in EC may also directly increase cytotoxic potential, as has recently been reported [50], [51].
Interestingly, we found that a substantial fraction of the total perforin production by HIV-specific CD8+ T-cells among EC comes not from polyfunctional populations but instead from cells that elicit only a single other measured functional parameter: specifically MIP1α or CD107a. In previous studies, where perforin upregulation was not measured, the potential importance and cytotoxic capabilities of these populations was not appreciated. On this note, the degree of functionality of a CD8+ T-cell response is only reflective of what functional parameters are actually being measured. For example, we find that most CD8+ T-cells that upregulate perforin also produce granzyme B upon stimulation [30]. Therefore, many of the CD8+ T-cells found in this study to co-express perforin with MIP1α and/or CD107a, may actually be highly "polyfunctional" if we had also examined the expression of other parameters critical for cytotoxicity, such as granzyme B.
Our data show that perforin expressing cells bear effector-like phenotypic markers. Thus, while a central memory phenotype is often considered a protective phenotype in HIV infected individuals, our results suggest that effector cells are also of significance. It should be noted, however, that simply achieving effector status does not guarantee the expression of perforin. Indeed, some HIV-specific CD8+ T-cells in both EC and CP were CD27-CD45RO- yet did not express perforin. Our results suggest that effector status is necessary but not sufficient for perforin upregulation. The importance of effector cells in the control of HIV infection is further supported by recent observations by Picker and colleagues who found that a rhesus-CMV-based SIV vaccine vector could stimulate protective effector SIV-specific CD8+ T-cells [52].
Our results suggest that perforin expression by HIV-specific CD8+ T-cells is not readily recovered by inhibition of viral replication or reduction in chronic immune activation by HAART - a finding which is consistent with a previous report showing that HAART treatment does not restore other functional parameters, such as proliferative capacity, polyfunctionality, or cytotoxic capacity [53]. We also found that perforin production does not appear to be directly influenced by beneficial HLA-B haplotypes or the relative maintenance of CD4+ T-cell levels over time. Whether perforin expression is lost early, late, or progressively during infection remains unclear. Further studies are necessary to identify the mechanism(s) underlying the relative absence of perforin upregulation in progressive HIV infection, and, if possible, to discover a means by which this critical function can be regained or elicited through therapeutic intervention.
Materials and Methods
Ethics statement
Blood specimens were acquired with the written informed consent of all study patients and with the approval of the institutional review board at each respective institution where patient materials were collected: University of Pennsylvania (IRB# 809316), University Hospitals Case Western Medical Center (IRB# FWA00003937), University of Alabama at Birmingham (IRB# X090708004), University of Toronto and St. Michael's Hospital (IRB# 07-106), and Harvard University (IRB# 2003-P-001894 and IRB# 2003-P-001678/75). The study was conducted following the principles stipulated in the Declaration of Helsinki.
Human subjects
We examined ex vivo HIV-specific CD8+ T-cell responses from 35 elite controllers (EC), 29 viremic controllers (VC), 27 chronic progressors (CP), and 6 viremic nonprogressors (VNP). Most EC and VC were recruited from outpatient clinics at local Boston hospitals as well as from providers throughout the United States [54]. Several EC were also recruited from clinics associated with the University of Toronto. PBMC samples from CP were from clinics associated with the University of Pennsylvania Center for AIDS Research, the University of Toronto, Case Western Reserve University, and the University of Alabama at Birmingham. VNP samples were obtained from the University of Toronto and Case Western Reserve University. PBMC samples from 15 HAART-suppressed patients were obtained from Harvard University and the University of Toronto.
EC were defined by consistent plasma HIV RNA levels below the limit of detection (e.g. <75 copies/mL by bDNA or <50 copies/mL by ultrasensitive PCR) in a minimum of three determinations of plasma HIV RNA spanning at least a 12-month period. VC consistently maintained viral load between 50 and 2,000 copies/mL, while the majority of viral load measurements of CP were above 10,000 copies/mL. CD4+ T-cell counts were not considered for inclusion criteria in the EC, VC, or CP groups. VNP were identified as subjects with consistently high viremia (above 10,000 copies/mL on average) but with relatively stable CD4+ T-cell counts after long-term infection. It is the relative preservation of CD4+ T-cell numbers in spite of sustained high level HIV replication that was used to distinguish the VNP group clinically from CP. All subjects from the EC, VC, CP, and VNP groups were off antiretroviral therapy for at least 6 months prior to the sampling date; yet most subjects were treatment-naive. Refer to Table 1 and Table S1 for more detailed information on the study cohort.
The following antibodies were used in this study: anti-CD4 PE Cy5.5, anti-CD14 APC Alexa 750, anti-CD19 APC Alexa 750, anti-CD8 Texas Red-PE, anti-IFN-γ Alexa 700 (Invitrogen, Carlsbad, CA), anti-CD107a FITC, anti-IL-2 APC, anti-TNFα PE Cy7 (BD Pharmingen, San Diego, CA), anti-MIP1α PE (R&D Systems, Minneapolis, MN), anti-CD27 PE Cy5 (Beckman Coulter, Fullerton, CA), anti-CD57 Qdot 565, anti-CD3 Qdot 585, and anti-CD45RO Qdot 605 or 705 (custom). Custom conjugations to Quantum (Q) dot nanocrystals were performed in our laboratory with reagents purchased from Invitrogen. The anti-perforin antibody (B-D48 clone) was purchased from Diaclone (Besancon, France) and conjugated to Pacific Blue (Invitrogen) in our laboratory.
PBMC stimulation assays
Cryopreserved PBMC were thawed and subsequently rested overnight at 37°C, 5% CO2 in complete medium (RPMI supplemented with 10% FBS and 1% L-glutamine). The following morning, the cells were washed with complete medium and resuspended at a concentration of 2×106 cells/mL if sufficient cell numbers were available. Costimulatory antibodies (anti-CD28 and anti-CD48d; each at 1 µg/ml final concentration; BD Biosciences; San Jose, California), monensin (1 µg/ml final concentration; BD Biosciences; San Jose, California) and Brefeldin A (1 µg/ml final concentration; Sigma-Aldrich; St. Louis, Missouri) were also added to each condition. Anti-CD107a was added at the start of all stimulation periods, as described previously [28]. PBMC were incubated at 37°C, 5% CO2 for six hours with overlapping 15-mer peptide pools encompassing HIV-1 (clade B) Gag, Pol, Env, Nef, and the viral accessory proteins (TRVVV) [as 5 separate conditions]. PBMC from many of the subjects were also stimulated with a CEF peptide pool, which contains peptides derived from CMV, EBV, and Influenza virus. Each individual peptide in the pools was at a final concentration of 2 µg/mL for all stimulations.
At the end of six hours, cells were stained with Aqua amine-reactive dye (Invitrogen; Carlsbad, California) for 15 minutes in the dark at room temperature in order to later identify viable cells. A cocktail of antibodies was then added to the cells to stain for surface markers for an additional 20 minutes. Following staining for cell surface molecules, cells were permeabilized using the Cytofix/Cytoperm kit (BD Biosciences; San Jose, California) according to the manufacturer's instructions. A cocktail of antibodies against intracellular markers was then added to the cells and allowed to incubate for one hour in the dark at room temperature. Finally, cells were fixed in 1x PBS containing 1% paraformaldehyde (Sigma-Aldrich; St. Louis, Missouri) before being stored in the dark at 4°C until the time of collection on the flow cytometer.
Flow cytometric analysis
For each stimulation condition, at least 500,000 total events were acquired using a modified LSRII (BD Immunocytometry Systems, San Jose, California). Data analysis was performed using FlowJo (version 8.8.4; TreeStar, Ashland, Oregon) and Spice (version 4.2.3, Dr. Mario Roederer, NIH, Bethesda, Maryland). Reported data have been corrected for background, and only responses with a total frequency above 0.25% of memory CD8+ T-cells (after background subtraction) were considered for analysis. Boolean gating analysis was carried out once positive gates were established for each functional parameter. This analysis resulted in 64 possible combinations of the 6 measured functions. Importantly, two combinations were ignored in all analyses: (1) events negative for all measured functional parameters and (2) perforin single-positive cells. By analyzing the data in such a manner, we only examined perforin expression resulting from HIV-specific stimulation. For this reason, perforin expression was only considered within activated, HIV-specific CD8+ T-cells expressing at least one other functional parameter. Refer to Figure S1A for further information on the gating strategy. As indicated by the gating strategy, naïve cells (CD27+CD45RO-) were excluded when performing all analyses except for the memory phenotyping data presented in Figure 4.
Statistical analysis
All graphing and statistical analysis was performed using R (version 2.8.1), JMP (version 7), or GraphPad Prism software (version 5.0a). Functionality was compared between study groups using nonparametric tests (Mann-Whitney test for two groups; Kruskal-Wallis test followed by a Dunns test for multiple comparisons when comparing three or more groups). Correlations between viral load or CD4+ T-cell counts and perforin expression were based on Spearman correlation coefficients. Comparisons between groups of specific functional permutations were based on a Lachenbruch's Two-part Wilcoxon test. This analysis simultaneously tests for a difference in the proportion of subjects who have an above zero response and a difference in the magnitude of the response [55], [56]. Only those functional combinations for which the average response was greater than zero were considered to be relevant for consideration. Functional permutations were considered significantly different if the p value was below 0.01. In all figures, * denotes a p value <0.05, ** denotes a p value <0.01, and *** denotes a p value <0.001. Unless otherwise noted, error bars represent the standard deviation.
Supporting Information
Figure S1.
Perforin upregulation can be detected using a polychromatic flow cytometric staining panel. (A) The gating strategy from a representative subject: PBMC from an EC were stimulated with SEB for six hours and then stained for six CD8+ T-cell functions (perforin, CD107a, IFN-γ, IL-2, TNFα, and MIP1α) along with lineage (CD14, CD19, CD3, CD4, CD8) and memory (CD27, CD45RO, and CD57) markers. The no stimulation control is also shown. (B) PBMC were stimulated with SEB for six hours in the presence of BFA and monensin. Perforin was stained either using the δG9 (left) or B-D48 (right) antibody clones. The red box denotes granule-associated perforin within the population of CD8+ T-cells that did not respond to SEB stimulation (i.e. resting CD8+ T-cells not producing IFN-γ). The black box denotes a population of CD8+ T-cells expressing both perforin and IFN-γ that can be detected using the B-D48 clone in a conventional ICS assay.
Figure S2.
EC demonstrate higher perforin magnitude than CP. In addition to the relative contribution of perforin to the HIV-specific CD8+ T-cell response, EC also demonstrate higher perforin magnitude. Total perforin production induced by each HIV antigen pool is represented as the frequency of CD8+ T-cells (excluding naïve cells). One-way ANOVA tests (nonparametric; Kruskal-Wallis test) were performed followed by a Dunns test for multiple comparisons. * denotes a p value < 0.05, ** denotes a p value < 0.01, and *** denotes a p value < 0.001. All bars represent the mean and error bars indicate the standard deviation.
Figure S3.
There is no association between HIV response magnitude and corresponding perforin expression. The Gag-, Pol-, and Nef-specific response magnitude (as the frequency of CD8+ T-cells; excluding naïve cells) is plotted against the corresponding proportion of perforin expression for each CD8+ T-cell response among all EC subjects. Spearman correlation tests (nonparametric; two-tailed) revealed no statistically significant relationship.
Figure S4.
EC demonstrate some variability in HIV-specific perforin expression. The relative contribution of perforin for the CD8+ T-cell response to each HIV antigen pool is shown for a selected subset of EC. Each symbol represents a different EC subject, and symbols of the same color represent responses from the same individual. These subjects were chosen partly because they mounted a positive response to all five HIV peptide pools.
Figure S5.
Breakdown of the average Nef-specific response from EC, VC, and CP into all 64 possible functional permutations. The entire response was broken down into the contribution of each functional combination for the average Nef-specific CD8+ T-cell response. Note that two functional permutations are ignored in the analysis: perforin single positive and all negative. All bars represent the mean and error bars indicate the standard deviation.
Figure S6.
EC have an increased capacity for de novo perforin synthesis. The proportion of the CD8+ T-cell response comprised of every CD107a+perforin+ functional subset was calculated for all HIV antigens in EC, VC, and CP. One-way ANOVA tests (nonparametric; Kruskal-Wallis test) were performed followed by a Dunns test for multiple comparisons. * denotes a p value < 0.05, ** denotes a p value < 0.01, and *** denotes a p value < 0.001. All bars represent the mean and error bars indicate the standard deviation.
Figure S7.
Perforin expression is not restricted to the presence of protective HLA-B alleles. EC were stratified based on the expression of HLA-B alleles previously shown to be associated with improved clinical outcomes. The relative amount of perforin expression is shown for the Nef-specific CD8+ T-cell responses among all EC. Each symbol represents an individual study subject. Some of the symbols are colored to denote the presence of another protective HLA-B allele: blue, HLA-B13; green, HLA-B15; orange, HLA-B51; red, HLA-B58. No statistically significant differences were found between the groups using a one-way ANOVA test (nonparametric; Kruskal-Wallis) followed by a Dunns test for multiple comparisons. The error bars represent the mean and standard deviation.
Figure S8.
EC display an expansion of CD27-CD45RO- effector HIV-specific CD8+ T-cells. The memory phenotype, based on the surface expression of CD27 and CD45RO, was determined for the average HIV-specific CD8+ T-cell response, as defined by the production of IFN-γ or TNFα, among EC and CP. Mann-Whitney tests (nonparametric; two-tailed) were performed for each phenotypic combination. ** denotes a p value < 0.01. All bars represent the mean and error bars indicate the standard deviation.
Figure S9.
Negative correlation between HIV-specific perforin expression and viral load when considering only VC, CP, and VNP subjects. The average percentage of HIV-specific perforin expression from CD8+ T-cells within each subject was plotted against the HIV viral load among all subjects excluding EC. The most proximal viral load measurement to the time point of the PBMC sample was used in the analysis. Spearman correlation tests (nonparametric; two-tailed) were performed to determine statistical significance.
Figure S10.
Positive correlation between HIV-specific perforin expression and peripheral blood CD4+ T-cell counts. The percentage of Gag-, Pol-, and Nef-specific perforin expression within each subject was plotted against CD4+ T-cell counts. The average percentage of HIV-specific perforin expression within each individual was also plotted against CD4+ T-cell counts. The most proximal CD4+ T-cell count to the time point of the PBMC sample was used in the analysis. Spearman correlation tests (nonparametric; two-tailed) were performed to determine statistical significance.
Figure S11.
Not all functional parameters are correlated with control of HIV replication. The proportion of each measured functional parameter (except perforin) comprising the average HIV-specific CD8+ T-cell response in each subject was plotted against the HIV viral load from each respective subject. The most proximal viral load measurement to the time point of the PBMC sample was used in the analysis. Spearman correlation tests (nonparametric; two-tailed) were performed to determine statistical significance.
Figure S12.
HIV-specific CD8+ T-cell response magnitude is slightly higher in EC than HAART-treated individuals. The CD8+ T-cell response magnitude to Gag, Pol, and Nef peptide pools was calculated for EC and HAART-treated subjects and plotted as percent of CD8+ T-cells (excluding naïve cells). The total magnitude was calculated by summing across all functional combinations. Mann-Whitney tests (nonparametric; two-tailed) were performed for each HIV antigen. ** denotes a p value < 0.01. All bars represent the mean and error bars indicate the standard deviation.
Figure S13.
The HIV-specific CD8+ T-cell response between EC and HAART-treated subjects does not vary greatly in degranulation, cytokine production, or chemokine expression. The proportion of the average HIV-specific CD8+ T-cell response comprised of each single functional parameter (except perforin) is shown among EC and HAART-treated subjects. Mann-Whitney tests (nonparametric; two-tailed) were performed for each functional parameter. * denotes a p value < 0.05. All bars represent the mean and error bars indicate the standard deviation.
Table S1.
Complete study cohort with relevant clinical parameters.
We would like to thank Jay Gardner for performing Qdot conjugations in our laboratory, the International HIV Controllers Study for providing a patient sample network, and finally the patients themselves for donating materials for this work.
Author Contributions
Conceived and designed the experiments: ARH GM MRB. Performed the experiments: ARH KD. Analyzed the data: ARH MN. Contributed reagents/materials/analysis tools: FP PS LYS CMK BR SFS LTJ DG PAG MML IF RK BDW. Wrote the paper: ARH MRB. Intellectual support: GM BDW.
- 1. Lambotte O, Boufassa F, Madec Y, Nguyen A, Goujard C, et al. (2005) HIV controllers: a homogeneous group of HIV-1-infected patients with spontaneous control of viral replication. Clin Infect Dis 41: 1053–1056.
- 2. Lefrere JJ, Mariotti M, Morand-Joubert L, Thauvin M, Roudot-Thoraval F (1999) Plasma human immunodeficiency virus RNA below 40 Copies/mL is rare in untreated persons even in the first years of infection. J Infect Dis 180: 526–529.
- 3. Deeks SG, Walker BD (2007) Human immunodeficiency virus controllers: mechanisms of durable virus control in the absence of antiretroviral therapy. Immunity 27: 406–416.
- 4. Migueles SA, Sabbaghian MS, Shupert WL, Bettinotti MP, Marincola FM, et al. (2000) HLA B*5701 is highly associated with restriction of virus replication in a subgroup of HIV-infected long term nonprogressors. Proc Natl Acad Sci U S A 97: 2709–2714.
- 5. Frahm N, Kiepiela P, Adams S, Linde CH, Hewitt HS, et al. (2006) Control of human immunodeficiency virus replication by cytotoxic T lymphocytes targeting subdominant epitopes. Nat Immunol 7: 173–178.
- 6. Honeyborne I, Prendergast A, Pereyra F, Leslie A, Crawford H, et al. (2007) Control of human immunodeficiency virus type 1 is associated with HLA-B*13 and targeting of multiple gag-specific CD8+ T-cell epitopes. J Virol 81: 3667–3672.
- 7. Emu B, Sinclair E, Hatano H, Ferre A, Shacklett B, et al. (2008) HLA class I-restricted T-cell responses may contribute to the control of human immunodeficiency virus infection, but such responses are not always necessary for long-term virus control. J Virol 82: 5398–5407.
- 8. Betts MR, Nason MC, West SM, De Rosa SC, Migueles SA, et al. (2006) HIV nonprogressors preferentially maintain highly functional HIV-specific CD8+ T cells. Blood 107: 4781–4789.
- 9. Boaz MJ, Waters A, Murad S, Easterbrook PJ, Vyakarnam A (2002) Presence of HIV-1 Gag-specific IFN-gamma+IL-2+ and CD28+IL-2+ CD4 T cell responses is associated with nonprogression in HIV-1 infection. J Immunol 169: 6376–6385.
- 10. Zimmerli SC, Harari A, Cellerai C, Vallelian F, Bart PA, et al. (2005) HIV-1-specific IFN-gamma/IL-2-secreting CD8 T cells support CD4-independent proliferation of HIV-1-specific CD8 T cells. Proc Natl Acad Sci U S A 102: 7239–7244.
- 11. Almeida JR, Price DA, Papagno L, Arkoub ZA, Sauce D, et al. (2007) Superior control of HIV-1 replication by CD8+ T cells is reflected by their avidity, polyfunctionality, and clonal turnover. J Exp Med 204: 2473–2485.
- 12. Horton H, Frank I, Baydo R, Jalbert E, Penn J, et al. (2006) Preservation of T cell proliferation restricted by protective HLA alleles is critical for immune control of HIV-1 infection. J Immunol 177: 7406–7415.
- 13. Migueles SA, Laborico AC, Shupert WL, Sabbaghian MS, Rabin R, et al. (2002) HIV-specific CD8+ T cell proliferation is coupled to perforin expression and is maintained in nonprogressors. Nat Immunol 3: 1061–1068.
- 14. Saez-Cirion A, Lacabaratz C, Lambotte O, Versmisse P, Urrutia A, et al. (2007) HIV controllers exhibit potent CD8 T cell capacity to suppress HIV infection ex vivo and peculiar cytotoxic T lymphocyte activation phenotype. Proc Natl Acad Sci U S A 104: 6776–6781.
- 15. O'Connell KA, Han Y, Williams TM, Siliciano RF, Blankson JN (2009) Role of natural killer cells in a cohort of elite suppressors: low frequency of the protective KIR3DS1 allele and limited inhibition of human immunodeficiency virus type 1 replication in vitro. J Virol 83: 5028–5034.
- 16. Chen H, Piechocka-Trocha A, Miura T, Brockman MA, Julg BD, et al. (2009) Differential neutralization of human immunodeficiency virus (HIV) replication in autologous CD4 T cells by HIV-specific cytotoxic T lymphocytes. J Virol 83: 3138–3149.
- 17. Migueles SA, Osborne CM, Royce C, Compton AA, Joshi RP, et al. (2008) Lytic granule loading of CD8+ T cells is required for HIV-infected cell elimination associated with immune control. Immunity 29: 1009–1021.
- 18. Shiver JW, Henkart PA (1991) A noncytotoxic mast cell tumor line exhibits potent IgE-dependent cytotoxicity after transfection with the cytolysin/perforin gene. Cell 64: 1175–1181.
- 19. Shiver JW, Su L, Henkart PA (1992) Cytotoxicity with target DNA breakdown by rat basophilic leukemia cells expressing both cytolysin and granzyme A. Cell 71: 315–322.
- 20. Russell JH, Ley TJ (2002) Lymphocyte-mediated cytotoxicity. Annu Rev Immunol 20: 323–370.
- 21. Meng Y, Harlin H, O'Keefe JP, Gajewski TF (2006) Induction of cytotoxic granules in human memory CD8+ T cell subsets requires cell cycle progression. J Immunol 177: 1981–1987.
- 22. Sandberg JK, Fast NM, Nixon DF (2001) Functional heterogeneity of cytokines and cytolytic effector molecules in human CD8+ T lymphocytes. J Immunol 167: 181–187.
- 23. Makedonas G, Banerjee PP, Pandey R, Hersperger AR, Sanborn KB, et al. (2009) Rapid up-regulation and granule-independent transport of perforin to the immunological synapse define a novel mechanism of antigen-specific CD8+ T cell cytotoxic activity. J Immunol 182: 5560–5569.
- 24. Hersperger AR, Makedonas G, Betts MR (2008) Flow cytometric detection of perforin upregulation in human CD8 T cells. Cytometry A 73: 1050–1057.
- 25. Appay V, Nixon DF, Donahoe SM, Gillespie GM, Dong T, et al. (2000) HIV-specific CD8(+) T cells produce antiviral cytokines but are impaired in cytolytic function. J Exp Med 192: 63–75.
- 26. Andersson J, Behbahani H, Lieberman J, Connick E, Landay A, et al. (1999) Perforin is not co-expressed with granzyme A within cytotoxic granules in CD8 T lymphocytes present in lymphoid tissue during chronic HIV infection. AIDS 13: 1295–1303.
- 27. Zhang D, Shankar P, Xu Z, Harnisch B, Chen G, et al. (2003) Most antiviral CD8 T cells during chronic viral infection do not express high levels of perforin and are not directly cytotoxic. Blood 101: 226–235.
- 28. Betts MR, Brenchley JM, Price DA, De Rosa SC, Douek DC, et al. (2003) Sensitive and viable identification of antigen-specific CD8+ T cells by a flow cytometric assay for degranulation. J Immunol Methods 281: 65–78.
- 29. Saez-Cirion A, Sinet M, Shin SY, Urrutia A, Versmisse P, et al. (2009) Heterogeneity in HIV suppression by CD8 T cells from HIV controllers: association with Gag-specific CD8 T cell responses. J Immunol 182: 7828–7837.
- 30. Makedonas G, Hutnick N, Haney D, Amick AC, Gardner J, et al. (0798) Perforin and IL-2 Upregulation Define Qualitative Differences among Highly Functional Virus-Specific Human CD8 T Cells. PLoS Pathog.
- 31. Kiepiela P, Leslie AJ, Honeyborne I, Ramduth D, Thobakgale C, et al. (2004) Dominant influence of HLA-B in mediating the potential co-evolution of HIV and HLA. Nature 432: 769–775.
- 32. Kiepiela P, Ngumbela K, Thobakgale C, Ramduth D, Honeyborne I, et al. (2007) CD8+ T-cell responses to different HIV proteins have discordant associations with viral load. Nat Med 13: 46–53.
- 33. Goulder PJ, Phillips RE, Colbert RA, McAdam S, Ogg G, et al. (1997) Late escape from an immunodominant cytotoxic T-lymphocyte response associated with progression to AIDS. Nat Med 3: 212–217.
- 34. Takata H, Takiguchi M (2006) Three memory subsets of human CD8+ T cells differently expressing three cytolytic effector molecules. J Immunol 177: 4330–4340.
- 35. Chattopadhyay PK, Betts MR, Price DA, Gostick E, Horton H, et al. (2009) The cytolytic enzymes granyzme A, granzyme B, and perforin: expression patterns, cell distribution, and their relationship to cell maturity and bright CD57 expression. J Leukoc Biol 85: 88–97.
- 36. Precopio ML, Betts MR, Parrino J, Price DA, Gostick E, et al. (2007) Immunization with vaccinia virus induces polyfunctional and phenotypically distinctive CD8(+) T cell responses. J Exp Med 204: 1405–1416.
- 37. Appay V, Dunbar PR, Callan M, Klenerman P, Gillespie GM, et al. (2002) Memory CD8+ T cells vary in differentiation phenotype in different persistent virus infections. Nat Med 8: 379–385.
- 38. Day CL, Kaufmann DE, Kiepiela P, Brown JA, Moodley ES, et al. (2006) PD-1 expression on HIV-specific T cells is associated with T-cell exhaustion and disease progression. Nature 443: 350–354.
- 39. Day CL, Kiepiela P, Leslie AJ, van der Stok M, Nair K, et al. (2007) Proliferative capacity of epitope-specific CD8 T-cell responses is inversely related to viral load in chronic human immunodeficiency virus type 1 infection. J Virol 81: 434–438.
- 40. Hunt PW, Brenchley J, Sinclair E, McCune JM, Roland M, et al. (2008) Relationship between T cell activation and CD4+ T cell count in HIV-seropositive individuals with undetectable plasma HIV RNA levels in the absence of therapy. J Infect Dis 197: 126–133.
- 41. Deeks SG, Kitchen CM, Liu L, Guo H, Gascon R, et al. (2004) Immune activation set point during early HIV infection predicts subsequent CD4+ T-cell changes independent of viral load. Blood 104: 942–947.
- 42. Younes SA, Yassine-Diab B, Dumont AR, Boulassel MR, Grossman Z, et al. (2003) HIV-1 viremia prevents the establishment of interleukin 2-producing HIV-specific memory CD4+ T cells endowed with proliferative capacity. J Exp Med 198: 1909–1922.
- 43. Pantaleo G, Harari A (2006) Functional signatures in antiviral T-cell immunity for monitoring virus-associated diseases. Nat Rev Immunol 6: 417–423.
- 44. Betts MR, Harari A (2008) Phenotype and function of protective T cell immune responses in HIV. Curr Opin HIV AIDS 3: 349–355.
- 45. Molleran Lee S, Villanueva J, Sumegi J, Zhang K, Kogawa K, et al. (2004) Characterisation of diverse PRF1 mutations leading to decreased natural killer cell activity in North American families with haemophagocytic lymphohistiocytosis. J Med Genet 41: 137–144.
- 46. Lieberman J, Shankar P, Manjunath N, Andersson J (2001) Dressed to kill? A review of why antiviral CD8 T lymphocytes fail to prevent progressive immunodeficiency in HIV-1 infection. Blood 98: 1667–1677.
- 47. Hatano H, Delwart EL, Norris PJ, Lee TH, Dunn-Williams J, et al. (2009) Evidence for persistent low-level viremia in individuals who control human immunodeficiency virus in the absence of antiretroviral therapy. J Virol 83: 329–335.
- 48. Shankar P, Xu Z, Lieberman J (1999) Viral-specific cytotoxic T lymphocytes lyse human immunodeficiency virus-infected primary T lymphocytes by the granule exocytosis pathway. Blood 94: 3084–3093.
- 49. Ferre AL, Hunt PW, Critchfield JW, Young DH, Morris MM, et al. (2009) Mucosal immune responses to HIV-1 in elite controllers: a potential correlate of immune control. Blood 113: 3978–3989.
- 50. Pipkin ME, Sacks JA, Cruz-Guilloty F, Lichtenheld MG, Bevan MJ, et al. Interleukin-2 and inflammation induce distinct transcriptional programs that promote the differentiation of effector cytolytic T cells. Immunity 32: 79–90.
- 51. Kalia V, Sarkar S, Subramaniam S, Haining WN, Smith KA, et al. Prolonged interleukin-2Ralpha expression on virus-specific CD8+ T cells favors terminal-effector differentiation in vivo. Immunity 32: 91–103.
- 52. Hansen SG, Vieville C, Whizin N, Coyne-Johnson L, Siess DC, et al. (2009) Effector memory T cell responses are associated with protection of rhesus monkeys from mucosal simian immunodeficiency virus challenge. Nat Med 15: 293–299.
- 53. Migueles SA, Weeks KA, Nou E, Berkley AM, Rood JE, et al. (2009) Defective human immunodeficiency virus-specific CD8+ T-cell polyfunctionality, proliferation, and cytotoxicity are not restored by antiretroviral therapy. J Virol 83: 11876–11889.
- 54. Pereyra F, Addo MM, Kaufmann DE, Liu Y, Miura T, et al. (2008) Genetic and immunologic heterogeneity among persons who control HIV infection in the absence of therapy. J Infect Dis 197: 563–571.
- 55. Lachenbruch PA (2001) Comparisons of two-part models with competitors. Stat Med 20: 1215–1234.
- 56. Nason M (2006) Patterns of immune response to a vaccine or virus as measured by intracellular cytokine staining in flow cytometry: hypothesis generation and comparison of groups. J Biopharm Stat 16: 483–498.


text:
Town Square
Sort by: Most recent topic/comment Most viewed Most comments
Navigation tip: Clicking on any category label will display all recent posts in that category
AROUND TOWNBuilding permits
Palo Alto Read the full story here http://www.paloaltoonline.com/print/story/2015/11/20/building-permits posted Friday,...Original post made on Nov. 20, 2015
There are no comments yet. 684 Views
AROUND TOWNHome Front
ROSE KNOWLEDGE ... Learn all about rose hips on Friday, Nov. 20, at 7:30 p.m. at the Veterans Memorial Senior...Original post made on Nov. 20, 2015
There are no comments yet. 4135 Views
AROUND TOWNBeyond good lookin'
A lush green front lawn lined with tidy floral beds just didn't seem right to Marsha and Art Grantz in this fourth drought...Original post made on Nov. 20, 2015
There are no comments yet. 8923 Views
AROUND TOWNRent Watch
Q Read the full story here http://www.paloaltoonline.com/print/story/2015/11/20/rent-watch posted Friday, November 20, 2015,...Original post made on Nov. 20, 2015
There are no comments yet. 4342 Views
AROUND TOWNReal Estate Matters: Behind the hype: An objective look at the Silicon Valley market
Recent television shows and online documentaries paint quite a sensational portrait of Bay Area real estate, with over-the-top...Original post made on Nov. 20, 2015
There are no comments yet. 5127 Views
AROUND TOWNSales at a glance
Atherton Read the full story here http://www.paloaltoonline.com/print/story/2015/11/20/sales-at-a-glance posted Friday,...Original post made on Nov. 20, 2015
There are no comments yet. 3408 Views
ISSUES BEYOND PALO ALTOStanford responds to sexual-assault criticisms
Close to two months after the release of a Stanford University climate survey with controversial results on campus sexual...Original post made on Nov. 18, 2015
Last comment by Stanford '78, on Nov 19, 2015 at 11:15 pm | 6 comments | 6996 Views
PALO ALTO ISSUESPalo Alto utilities director to retire
Utilities Director Valerie Fong, who has spent the past nine years overseeing the city-owned electricity, gas, water and...Original post made on Nov. 19, 2015
Last comment by Bites, on Nov 19, 2015 at 9:58 pm | 4 comments | 4302 Views
AROUND TOWNReal Estate Matters
The price paid for single-family homes in Palo Alto took a huge leap in September, when the median price reached $3,337,500....Original post made on Nov. 19, 2015
There are no comments yet. 5473 Views
BOOKSCommunity Notebook: Palo Alto library system's book-borrowing service suspended
The Palo Alto library system will be transitioning to a new online services platform and will suspend its inter-library book-borrowing...Original post made on Nov. 19, 2015
Last comment by Digitize-All-Books-Now!, on Nov 19, 2015 at 2:01 pm | 2 comments | 3539 Views
PALO ALTO ISSUESPalo Alto officials host first 'town hall' with neighborhoods
Palo Alto officials held the first in a series of town hall-style meetings last week at Duveneck Elementary School to listen...Original post made on Nov. 17, 2015
Last comment by Off CPNA, on Nov 19, 2015 at 6:57 am | 15 comments | 5087 Views
SCHOOLS & KIDSPalo Alto school district named in lawsuit over physical education
The Palo Alto Unified School District was named as a defendant in a lawsuit challenging reduced physical education hours...Original post made on Sep. 17, 2015
Last comment by Tina, on Nov 18, 2015 at 9:04 pm | 15 comments | 5392 Views
SPORTSStanford women garners top Pac-12 soccer honors
Alana Cook was named the Pac-12 Freshman-Newcomer of the Year, Jane Campbell earned Goalkeeper of the Year honors and Paul...Original post made on Nov. 18, 2015
Last comment by Joel, on Nov 18, 2015 at 11:34 am | 1 comment | 2816 Views
SPORTSStanford men sweep top awards on All-Pac-12 soccer team
The Stanford men's soccer team was rewarded for winning the Pac-12 Conference title as the Cardinal swept all the top honors...Original post made on Nov. 18, 2015
Last comment by Joel, on Nov 18, 2015 at 11:29 am | 1 comment | 3368 Views
SPORTSSHP girls reach CCS finals, but M-A and Gunn boys knocked out
==BI Water polo== After one night of semifinals in the Central Coast Section water polo playoffs, this is what has been...Original post made on Nov. 18, 2015
Last comment by WP Fan, on Nov 18, 2015 at 10:39 am | 1 comment | 3373 Views
CRIMES & INCIDENTSPalo Alto officials brace for story in The Atlantic magazine
Palo Alto school and city officials, with the help of local mental health professionals, are bracing for the release of a...Original post made on Nov. 16, 2015
Last comment by Michael O., on Nov 17, 2015 at 9:58 pm | 48 comments | 22587 Views
SCHOOLS & KIDSThe Cubberley plan: Isn't the issue over-crowded schools?
Like many in our community, I am excited by the Enrollment Management Advisory Committee (EMAC) proposal presented at the...Original post made on Nov. 13, 2015
Last comment by Sense, on Nov 17, 2015 at 6:26 pm | 29 comments | 4974 Views
AROUND TOWN5th Annual flowers for Vets program
Nature's Alley florist in Midtown is proud to announce the 5th annual flowers for Vets program on Sunday December 13th at...Original post made by firstname.lastname@example.com on Nov. 17, 2015
There are no comments yet. 471 Views
RESTAURANTSC'est magnifique
Mademoiselle Colette, the elegant French patisserie that opened in Menlo Park last month, has quickly proven popular. Read...Original post made on Nov. 12, 2015
Last comment by Hmmmm, on Nov 17, 2015 at 12:36 pm | 17 comments | 7362 Views
SPORTSFootball teams face a tough road in new CCS playoffs
The second season of high school football gets under way this weekend with four local teams competing in one of the five...Original post made on Nov. 17, 2015
Last comment by Sam G, on Nov 17, 2015 at 11:05 am | 1 comment | 3918 Views
Opening alert: Go Fish Poke Bar in Redwood City
By Elena Kadvany | 2 comments | 20,045 views
It's President's Day. Why Not Butter Up the Boss?
By Laura Stec | 4 comments | 8,067 views
Affordable Housing: Complexities
By Douglas Moran | 12 comments | 1,644 views
Common Application's 2017-2018 Essay Prompts
By John Raftrey and Lori McCormick | 0 comments | 1,384 views
Checklist before baby arrives
By Cheryl Bac | 2 comments | 798 views
Short story writers wanted!
The 31st Annual Palo Alto Weekly Short Story Contest is now accepting entries for Adult, Young Adult (15-17) and Teen (12-14) categories. Send us your short story (2,500 words or less) and entry form by April 13, 2017. First, Second and Third Place prizes awarded in each category.

subset: commoncrawl


text:
Web Print (driver-less printing via a web browser)
Web PrintWeb Print enables printing from user-owned devices without the need to install printer drivers and manage server authentication. is a driver-less printing service that allows users to print by uploading documents from a web browser. No client software or driver installation is required.
With the rise in popularity of BYOD, the demand for printing solutions for unmanaged devices continues to increase. Educating users about how to configure these devices can be inconvenient and complicated, due to issues such as drivers and authentication, and in some situations might not be possible at all. Due to this complexity, many organizations do not allow printing from user-owned systems.
Web Print provides a simple way to enable printing for smart phones, tablets, and laptop computers, without the overhead of installing printer drivers and managing server authentication. It is a proven and popular solution for occasional printing, allowing users to print their Microsoft Office, PDF, and image files directly from the browser on their own devices.
Your Web Print deployment can be scaled to meet the needs of your organization, removing bottlenecks and improving reliability. Web Print scaling through the use of multiple Web Print servers, increases throughput and minimizes users' wait time for print jobs. Using multiple servers also provides resilience against possible network and server outages.
With Web Print, users are authenticated when they log in to the PaperCut NG User web interfaceThe User web interface provide a range of services for users, including a summary of usage and balance history, a list of the shared accounts that the user can use for printing, the current costs for printing usage, ability to add balance by using a TopUp/Pre-Paid Card or an external payment system (when using the payment gateway module), transfer funds to other users, view a history of balance transactions, view a list of the user's recent printing, and view print jobs pending release (when using a Release Station).. Any documents they upload can then be tracked against their user name and the selected shared accountA shared account is an account that is shared by multiple users. For example, in business, shared accounts can be used to track printing costs by business unit, project, or client. Organizations like legal firms, engineering firms, or accounting offices often have long lists of accounts, projects, clients, or matters. In a school or university, shared accounts can be used to track printing by departments, classes, or subjects..
Web Print is not available on direct print queues. To offer this service to your users, set up a server queue for this device/printer.
Key features
Some of the key features of PaperCut's Web Print solution include:
Simple wizard style interface, accessed from any web browser.
Users authenticate with their regular (network / domain) logins.
100% web based. No drivers, client software, or browser plugins required.
File uploads with progress indicator.
Supports popular document formats including PDF, DOC/DOCX (and other Microsoft Office Word formats), XLS/XLSX (and other Microsoft Office Excel Formats), PPT/PPTX (and other Microsoft Office PowerPoint formats) and Microsoft XPS (XML Paper Specification). Web Print also supports common image formats including JPG, GIF, PNG, TIFF and BMP.
Users select printers from an auto-generated list or a clickable printer map, which you can design or import using open standards and free software.
Introduction to Web Print
You can use Web Print in one of two possible modes: .
- Default Mode—involves running the Web Print software on the same system as the PaperCut NG Application ServerAn Application Server is the primary server program responsible for providing the PaperCut user interface, storing data, and providing services to users. PaperCut uses the Application Server to manage user and account information, manage printers, calculate print costs, provide a web browser interface to administrators and end users, and much more.. On Windows, it runs as a Service. This is the fastest and easiest way to get Web Print working. However, only printing of PDF documents (and picture files on Windows) is supported in this mode. See Set up Web Print: Default mode).
Sandbox Mode—uses a sandboxed or virtualized system, isolated and dedicated to the task of processing Web Print jobs or converting documents for Email to PrintEmail to Print allows any device to print documents by sending an email to your network's print devices.. Sandbox Mode takes a little more time to configure, but offers several advantages, including improved security, higher throughput, and more supported document formats.
This mode accepts popular file formats and converts them to print jobs using common external applications. This is done by orchestrating applications such as Adobe Reader
TM, Microsoft Office TM, and the Microsoft XPS Viewer as background server-side tasks.
|Primary server type
|Default mode
|Sandbox mode
|Microsoft Windows
|Yes (PDF and picture files only)
|Yes. All formats supported
|Apple Mac
|Yes (PDF only)
|Yes. All formats supported
|Linux running CUPSCommon User Printing System (CUPS) is a printing system for Unix operating systems that allows a computer to act as a print server. A computer running CUPS is a host that can accept print jobs from client computers, process them, and send them to the appropriate printer.
|Yes (PDF only)
|Yes. All formats supported
|Novell OES Linux
|No. Default Mode not supported
|Yes. All formats supported
Adobe Reader, Microsoft Office and XPS Viewer are not supplied with PaperCut. It is your responsibility to purchase and conform to the licensing requirements of any third party software.
Supported applications and file formats
The following table lists the supported document types and associated applications that Web Print can use to render and print jobs. Before some file formats can be accepted as an upload, you must install its supporting application.
|Document Type
|File Format(s)
|Direct PrintingDirect Printing allows you to print directly from a desktop to a printer, without the need for a print server.
|Supported External Applications
|Default Mode
|Sandbox Mode
|Portable Document Format
|Support built-in (all platforms)
|Adobe Reader 9, Adobe Reader X (10), Adobe Reader XI (11)
|Picture File
|Support built-in (Windows only)
|Word Document
|DOC, DOCX, etc.
|External application required
|Microsoft Office Word 2007, 2010, 2013, 2016
|XLS, XLSX, etc.
|External application required
|Microsoft Office Excel 2007, 2010, 2013, 2016
|PPT, PPTX, etc.
|External application required
|Microsoft Office PowerPoint 2007, 2010, 2013, 2016
|Microsoft XPS
|External application required
|Microsoft XPS Standalone Viewer (Essentials Pack) - For more information see Installing XPS Viewer.
* Picture files are not supported for Mac and Linux Application Servers.
Security considerations
Before setting up Web Print it is worth considering any security implications. Because Web Print allows any user with access to the PaperCut NG user web interface the ability to upload a document for printing, it naturally increases surface area for attack.
More specifically, security vulnerabilities that might usually be considered local, because they are triggered by opening a document in a Microsoft Office application or Adobe Reader can become a remote vulnerability. This is because these same applications are used to render print jobs on the server after the user has uploaded their document.
You can mitigate much of the security risk through security best practice, such as regularly applying security updates to the orchestrated applications. Organizations that are very security conscious might consider the sandbox approach. Sandboxing the Web Print server provides an extra layer of protection/isolation.
Share your findings and experience with other PaperCut users. Feel free to add comments and suggestions about this Knowledge Base article. Please don't use this for support requests.


text:
Dedicated Pet Professionals
Our DogWatch dealership proudly services Southeastern Ontario and the surrounding area. We've lived in Sydenham, Ontario and can't imagine living anywhere else. We chose DogWatch because DogWatch had a superior product offering with the FM Safelink design, a 2 year battery life vs. the 3 to 4 month battery life of the competitors, and a user friendly transmitter. We love working with animals and we hope to have the opportunity to help keep your pet safe. Read More
Customer Testimonial
I love our Dogwatch fence! I was worried it would not work with my escape artists but it has kept them safe for over a year now. I would recommend it to anyone. They also have the best service ever! They always get back to me immediately even on weekends and in the evenings. Thanks Dogwatch.
Beverly Booth
Freedom and Safety for Your Pet
The most important reason to choose an underground dog fence from DogWatch® is because we care as much about your pet as you do. Our PetFriendly™ products and owner-friendly service are designed to give you freedom and flexibility while keeping your dog (or cat!) safe at home.
If you want the best pet containment products for your furry companion, be sure to ask for DogWatch by name. And, don't forget, a DogWatch Hidden Dog Fence works great for cat containment, too (indoors and outside)!
DogWatch® is not Invisible®
DogWatch "hidden fences" are often mistakenly referred to generically as "invisible fences". Invisible Fence® and Invisible Fencing® are Brand names, products and registered trademarks of Radio Systems, Inc. Explore the links below to learn more.
Compare DogWatch Hidden Fences® to Invisible Fence®
Compare DogWatch® batteries to other systems
Read an independent review of DogWatch® and Invisible Fence®


text:
This Divided State (2005)
Plot Summary
The film carefully examines the divisive nature of politics in an overwhelmingly conservative mid-western community. In September 2004, the student body representatives of Utah Valley State College invited controversial filmmaker Michael Moore to speak on campus two weeks before the Presidential election. An unanticipated uproar from the students and community ensued. Moore protestors claimed university funds should not pay for Moore's visit, while those in support of Moore fought to defend free speech. A community once considered politically passive was stirred to action, and the conflict played out in the media and several public forums. Those opposed to Moore's visit, in an effort to have the invitation rescinded, resorted to death threats, petitions, law suits, and bribery. Moore supporters, living in the high concentrate of Mormon conservatism, struggled to be heard, to defend new ideas, and to keep plans for his visit on track. Steven Greenstreet, the film's director, tracks the personal stories of the key figures embroiled in this controversy, as well as opinions of the community at large. By delving into the personal motives and expectations of those involved, Greenstreet effectively presents the causes and effects of this unprecedented debate. The result of his efforts is a documentary full of candor, conflict, and humor that stands as a fascinating commentary on the current "divided state" of both the nation and the small town of "Family City, USA."- Written by Michelle Pate
This Divided State follows the controversy surrounding Utah Valley State College's invitation to liberal filmmaker Michael Moore to speak on campus. Though UVSC is located in one of the most conservative counties in the United States, vehement opposition to Moore's visit was much greater than anticipated. Equally surprising, however, was the overwhelming support for Moore, vocalized by students and community members previously considered "apathetic." Debate between Moore supporters and Moore protestors raged openly in the media and public forums. Death threats, hate mail, bribes, and lawsuits were all candidly captured on film.- Written by email@example.com
The film follows Micheal Moore's controversial decision to speak at the Utah Valley State College, where a heated debate between protestors and supporters argue Moore's First Amendment freedom of speech rights.- Written by email@example.com
Be the first to contribute! Just click the "Edit page" button at the bottom of the page or learn more in the Synopsis submission guide.


text:
Words Galore Game
Words Galore Game
Ages 9+
Grades 4th+
Words Galore Game Prefixes * Roots * Suffixes
Develop literacy and expand vocabulary by combining prefixes, roots, and suffixes to form words. The object of Words Galore! is to combine prefixes, root, and suffixes tiles to form words horizontally or vertically.
What's in the Box?
Game Board, Instructions, Resource Lists, 186 Prefixes, Roots, and Suffixes Tiles


text:
Find Gifts for all Horse Lovers on our site
Horsey Gifts founded in 2004 specialises in offering Unique Horsey Gifts to Horse Lovers all over the World.
We have the largest selection of horse only items available to buy online, offering good service and value for money. All items are in stock and orders are dispatched as soon as possible.
Our online store offers Great Gifts for all Horsey people of all ages....
We are always pleased to hear from our Horsey Gifts Customers, you can contact us by Email or Telephone us.
You can get all the latest news and & our latest products by following us on Facebook, Instagram & Twitter.


text:
Are you looking for Footwear in Cook IL? Hotfrog showcases 56 popular businesses related to Footwear near Cook IL! Find a specific suburb using the left navigation.
Hickory Hills, IL
Defining style for all occasions. Shoes for the entire bridal party in 100 percent silk with leather soles. Chose from a wide selection of colors and cutting edge high fashion styles. A full service ladies boutique for …
Bridal Party ShoesSalon ShoesBridesmaid ShoesWedding Shoes
Alsip, IL
We have everything for ALL your PROFESSIONAL FLORAL needs We recommend these Floral Industry Programs and Sites Through partnering for quality and strategic positioning, we are allied as marketing partners w…
Shoe Stores
Berwyn, IL
XSoccer - Welcome you to your Soccer Specialty Store,We specialize in soccer jerseys and official soccer products from around the world. Authentic player size name and number sets
ApparelSoccer T-shirtsJerseys
chicago ridge, il
Santos Sport Store features all the equipment to satisfy the needs of the competitive athletes, from the young to the old. We are known to have that hard to find article and have a very extensive selection
ShoesSocksGolf ClothingPants
glencoe, il
A fresh look for a classic pump. Soft leather accented with a suede cap toe and heel for a whimsical look. Black leather and patent pump Small silver logo stud at heel Leather lined with padd
Shoe StoresFashion FootwearWomen's Shoessneakers
Palos Hills, IL
Thompson's Saddle Shop has been serving the Equestrian community of the midwest for over 25 years providing quality English and Western tack and equipment as well as English riding gear and horse care products. Located i…
BootsRiding BootsTall BootsHorse Boots
Oak Forest, IL
Flying Tigers is your Military Surplus and Army / Navy Surplus Home on the web! We have everything from patches, medals and insignia to combat boots, BDU's, hats, jackets and more! Whatever it is you're looking for, you'…
BootsBomber JacketsArmy Navy SurplusNavy Surplus
Check out our galleries for a wide selection of unique one of a kind costumes for sale or rent. Also available are a large selection of wigs, makeup and accessories. We are located in Holland Michigan
BootsDance CostumesAdult Costumes
tinley park, il
Beverly Manufacturing specializes in metal stamping, wire EDM, tool and die engineering and much more. Also specializing in communication & coaxial cable components such as standoffs, hangers, boots & entry ports…
Hillside, IL
Hotfrog US provides information regarding Reed's Dresswear in Hillside IL. Reed's Dresswear is located at 4842 Butterfield Rd and provides Retail services. Contact them on (708) 449-1122.
dresswearShoesClothing And Shoes SecondhandClothing
Lansing, IL
Hotfrog US provides information regarding Eel & Sole Quick in Lansing IL. Eel & Sole Quick is located at 18158 Henry St and provides Retail,Fashion,Shoe services. Contact them on (708) 474-5127.
Shoes & Shoe RepairsFootwear And Leater Goods RepairShoeShoe Repair Shop
Maywood, IL
Hotfrog US provides information regarding Feetstreet in Maywood IL. Feetstreet is located at 811 S 5th Ave and provides Personal Care,Beauty Salons and Barber services. Contact them on (708) 344-9453.
Shoe StoresShoes
Blue Island, IL
Hotfrog US provides information regarding Mario's Shoe Repair in Blue Island IL. Mario's Shoe Repair is located at 2235 Vermont St and provides Retail,Fashion,Shoe services. Contact them on (708) 396-1316.
Shoes & Shoe RepairsShoe StoresFootwear And Leater Goods RepairShoe
For over ninety five years, we've held a solid commitment to four basic principles: Quality, Craftsmanship, Durability and Comfort
ShoeShoe Store
Niles, IL
In 2001, we expanded and relocated into our big and beautiful new store in Niles, IL Some of our Product Brands
Shoe StoresShoeShoesDiabetic Shoes
Schiller Park, IL
Galaxy tool supply.com is a distributor of Ticor undermount sink,apron over-mount & faucet for bathrooms and kitchens, under-mount kitchen sink, Free tax for a non local customers
evergreen park, il
Inside every shoe beats the heart of a genuine Red Wing work boot. Unparalleled all-day comfort. On the clock or off
Outdoor FootwearWork BootsShoesClothing
River Forest, IL
Leos Dancewear - The First Name in Dance: Maker of quality dancewear, dance costumes, bodywear, jazz shoes, pointe shoes, ballet slippers
ShoesDiscount Dance WearDance SuppliesJazz Shoes
Winnetka, IL
Body and Sole offers adult and childrens dancewearapparel and shoes. We also carry apparel for gymnastics, exercise and ice skating
Shoesballet shoesDance ShoesJazz Pants
Tinley Park, IL
An unembarrassing stylish or decorative way to ask guest to cover their shoes in your home. Don't track what's on the bottom of your shoes indoors
Homewood, IL
Shoe StoresFootwear OffersDress BootsHosiery & Stockings
Lincolnwood, IL
Shoe StoresFOOTWEAR GROUP
Palos Heights, IL
franklin park, IL
Brand Name ShoesBootsSandalsCloseouts
Matteson, IL
Shop Kids Shoes & Kids Clothing from Nike, Jordan, adidas, Reebok & more. The coolest selection of Kids Shoes with great deals & our 100% Fit Guarantee
Kids Athletic ShoesChildren's ShoesKids Basketball ShoesKids Jordan Shoes
Morton Grove, IL
Shoe StoresSHOE CARNIVALSandalsflats
Calumet City, IL
Nike Casual ShoesCasual BootsShoe StoresBasketball Shoes
Wilmette, IL
Hunter BootsDress ShoesShoesSlipper
Western Springs, IL
Shoe StoresShoesGait Analysis
Shoe StoresApparel And AccessoriesSporting Goods And Bicycle Shops
Richton Park, IL
Women's ShoesShoesClothingClothing & Accessories
Prospect Heights, IL
ShoesFashion ShoppingSocksClothing
Footwear ManufacturersShoes
Shoe StoresSHOE CARNIVALShoes
Can't find Footwear company near near Cook IL? Let us know by adding the missing business here.
No results available
Small Business Hub
Sharing tips, ideas and advice to help grow your small business
Hotfrog AdVantage
Hotfrog AdVantage ads appear above the rest in Hotfrog feature pages. By upgrading today your ad will appear in front of potential customers before they notice your competitors.
Create your free Hotfrog business profile
Follow Hotfrog on:
Share on:
Hotfrog Small Business Hub


text:
Buy Online Cafergot Tablet Rx
Looking for a cafergot? Not a problem! http://company-article.info/med/cafergot If you would like to receive additional info regarding cafergot kindly go to http://company-article.info/med/cafergot Guaranteed Worldwide Shipping Discreet Package Low Prices 24/7/365 Customer Support 100% Satisfaction Guaranteed. Tags: how to buy cafergot order cheapest diners club orlando how to get cafergot ach pharmaceutical usa low cost cafergot online shop no prescription mexico cafergot migraine headache without prescription check buy brand cafergot sale free shipping tabs huntingdonshire cafergot no prescription pharmaceutical donde puedo comprar cafergot generico mexico buy online cafergot tablet rx can buy cafergot spain nebenwirkungen champagne price waar kan ik kopen cafergot for ear infection cheap cafergot buy shop cafergot online pharmaceutical fast delivery germany buy cafergot tablet no doctors price cafergot 250 cheapest migraine headache medication whats need cafergot sale fast delivery price code cafergot rideshop online jersey cost min #cafergot best cheap cafergot no script required express delivery generic cafergot migraine headache want to buy no prescription cafergot online internet sale best buy cafergot cafergot cluster headaches for cafergot money order at portland price cafergot american express sale legally otc cafergot jcb want to buy without prescription cafergot migraine headache fast delivery fedex cafatine 100mg unconstituted cafergot store cheap cafergot alternatives inyectable comprar tabletas para sirve price cafergot wire transfer american express order edinburgh cafergot ergotamine la migraine need cafergot online western union no script california buy cod cafergot check visa priority mail low price cafergot overnight price uk cafergot sale canada preston caffeine 100mg discount cafergot 100mg inf buy mt12 tucson can i buy cafergot caffeine pharmaceutical without prescription austria patch online pharmacy cafergot lancaster buy maestro als pdf kaufen best buy need cafergot drug amex medication at athens cafergot 1mg how to order netdoctor sleep cost retail tana cafergot shop purchase nutrition order cafetrate 100mg synflex can i purchase cafergot pills on sale online http://imgur.com/Q2kS2Ni cafergot first order kinetics sat delivery online fda buy brand cafergot overnight delivery tab cheap effect cafergot online check fedex beliz cheap cafergot shop no script delivery cafergot no doctors oakland no script cafergot cheapest boston High blood pressure levels medications like Beta-blockers (propranolol [Inderal]) and calcium channel blockers (verapamil [Covera]). There are lots of medicines that create severe unwanted side effects when used in addition to Norvir. We deserve your respect and, first and foremost; we deserve your help. Grapes are a extremely great, tasty and natural manner to help you relief from your headache or possibly a migraine. Richard Lipton, professor of Neurology at Albert Einstein College of Medicine, explaining the real difference between Migraine & headache. However, you can find cases where an the migraine episode injures the retina and also the veins in it. The norepinephrine reuptake inhibitor (SNRI) Effexor can be considered effective. There are two different ways of curing the pain caused by headaches. Abortive medication is often a medication that will help to prevent a migraine headache. It is best when taken right after the migraine starts. This is usually in pill for but many people will become so nauseated that they is going to be unable to go ahead and take medication orally and definately will need a rectal suppository. There's no cure for migraine and hence the most reliable approach to take care of chronic migraine is always to stop its occurrence. The abortive headache treatment you might take to your headache pain is generally the non-prescription type. Luckily, the symptoms went away right after the drug worked its way through my system. - Headache worsens or recurs (repetitive) more often at small time intervals;. To stop a migraine attack you would really like to recognize migraine triggers by keeping a headache diary and making efforts to prevent or alter these triggers.