Immune checkpoint inhibitor (ICI) therapy continues to revolutionize melanoma treatment, but only a subset of patients respond. Major efforts are underway to develop minimally invasive predictive assays of ICI response. Using single-cell transcriptomics, we discovered a unique CD8 T cell blood/tumor-shared subpopulation in melanoma patients with high levels of oxidative phosphorylation (OXPHOS), the ectonucleotidases CD38 and CD39, and both exhaustion and cytotoxicity markers. We called this population with high levels of OXPHOS “CD8+ TOXPHOS cells.” We validated that higher levels of OXPHOS in tumor- and peripheral blood–derived CD8+ TOXPHOS cells correlated with ICI resistance in melanoma patients. We then developed an ICI therapy response predictive model using a transcriptomic profile of CD8+ TOXPHOS cells. This model is capable of discerning responders from nonresponders using either tumor or peripheral blood CD8 T cells with high accuracy in multiple validation cohorts. In sum, CD8+ TOXPHOS cells represent a critical immune population to assess ICI response with the potential to be a new target to improve outcomes in melanoma patients.

The development of immune checkpoint inhibitor (ICI) therapies, including anti-programmed cell death 1 (PD-1)/programmed death-ligand 1 (PD-L1) and anti-cytotoxic T lymphocyte antigen 4 (CTLA4), represents a major advance in treating patients with melanoma. However, not all patients respond to these therapies (Garon et al., 2019; Garon et al., 2015; Larkin et al., 2019; Ribas and Wolchok, 2018), indicating that additional strategies are needed to improve responses. Among the immune repertoire, CD8 T cells play critical roles in ICI therapies and thus are an important cell type to focus on to improve immunotherapy (Wei et al., 2017).

We and others showed that tumor-infiltrating lymphocytes (TILs), including CD8 T cells, express high levels of immune checkpoint receptors that include PD-1, which can suppress cytotoxic T cell effector function (Maybruck et al., 2017; Pfannenstiel et al., 2019; Wherry, 2011; Wherry and Kurachi, 2015; Zhang et al., 2011). These TILs often display so-called exhausted behaviors characterized by antigen unresponsiveness and reduced cytotoxic effector function (Sharma et al., 2017; Wherry, 2011; Wherry and Kurachi, 2015). While therapeutic blockade of PD-1/PD-L1 and/or CTLA4 can revive effector T cell function, this is not always complete and may explain the lack of anti-tumor therapeutic efficacy (Larkin et al., 2019; Wei et al., 2018; Zimmer et al., 2017).

Importantly, CD8 T cell tumor infiltration remains one of the most correlated factors for anti-PD-1/PD-L1 immunotherapy response across cancer types, as well as tumor mutational burden and high PD-1/PD-L1 expression levels (Gros et al., 2014; Lee and Ruppin, 2019; Samstein et al., 2019). Today, no predictive model of ICI response exists that is robust enough to implement in the treatment algorithm for melanoma patients (Agur et al., 2016; Kogan et al., 2012; Liu et al., 2019). Other studies have focused on gene expression and transcriptomic data of T cells to predict patient response to anti-PD-1 therapy (Auslander et al., 2018; Gide et al., 2019; Hugo et al., 2016; Sade-Feldman et al., 2018a); these strategies required invasive biopsies and resulted in moderate prognostic value (Auslander et al., 2018; Hugo et al., 2016; Topalian et al., 2016).

Data from the National Cancer Institute (NCI) surgery branch indicate that there are overlapping CD8 subpopulations both in the TIL and in the periphery, which was recently corroborated at the transcriptomic level (Fairfax et al., 2020; Gros et al., 2016; Wu et al., 2020). Comparing our studies of tumor-associated dysfunctional CD8 T cells with suppressor cell function and those from the NCI surgery branch (both studies identified PD-1 expression as critical) led us to hypothesize that this population exists in both the tumor and peripheral blood (Gros et al., 2016; Gros et al., 2019; Pfannenstiel et al., 2019; Zhang et al., 2011). We further hypothesized that identification of such a subpopulation would elucidate new genetic mechanisms that could be used to not only monitor treatment outcome but also identify future therapeutic targets. Indeed, our single-cell transcriptome comparisons between purified CD8 T cells from TILs and peripheral blood lymphocytes (PBLs) from melanoma patients identified several CD8 subpopulations and underlying genetic programs. Specifically, we identified three overlapping populations in TILs and PBLs. One of the populations displayed unexpectedly high levels of cytotoxic and exhausted markers (e.g., PD-1), as well as increased levels of metabolic activities, specifically oxidative phosphorylation (OXPHOS). These high-OXPHOS CD8 T cells also have elevated levels of CD38/CD39 ectonucleotidases (we coin these CD8+ TOXPHOS cells). To further validate our findings, we isolated PBL and TIL CD8+ TOXPHOS cells from melanoma patients and confirmed that they are more pronounced in ICI-resistant patients with elevated bioenergetics, including increased glucose metabolism, ATP production, and mitochondria activity. We then generated a predictive ICI therapy response model using these CD8+ TOXPHOS cells that can be assessed by either TILs or PBLs. Ultimately, we generated a gene expression profile (GEP), which was validated using both published clinically annotated transcriptomic data of CD8 TILs and a new cohort of our patients, including interrogating their CD8 PBLs. Thus, through comprehensive and careful gene expression analysis of individual CD8 T cells, we establish an ICI response GEP that can be employed via a blood-based approach. Our work establishes an ICI-predictive platform, and the CD8 subpopulation that forms the basis of this assay illustrates new targetable pathways to potentially enhance immunotherapy and improve outcomes of melanoma patients.

High heterogeneity of CD8 T cells with shared clusters in CD8 PBLs and TILs in melanoma

To develop a noninvasive method to predict effective immunotherapeutic responses, we carefully characterized individual CD8 T cells from tumors and peripheral blood of melanoma patients. We performed single-cell RNA sequencing (scRNaseq) on isolated CD8 T cells from both melanoma PBLs (CD8-mPBLs) and TILs (CD8-mTILs) from eight advanced melanoma patients (Fig. 1 and Table S1). Compared with recent scRNaseq studies of melanoma (Sade-Feldman et al., 2018b), our dataset is uniquely tailored to capture data from CD8 T cells with paired PBLs and TILs from the same patient. Through barcoding and combined analyses, we ensured matched processing and efficient downstream deconvolution of both samples. CD8-mPBLs and CD8-mTILs from the same patient were set as pairs and analyzed with flow cytometry for their proportion correlation analyses, and consistent with previous reports, the proportions of total CD8 T cells in PBLs were moderately correlated with those in TILs (R = 0.29) among the examined patients (Fig. 2 A and Fig. S1; Shao et al., 2014).

Next, we combined scRNaseq results of 173,061 CD8-mPBL/mTILs and performed transcriptomic analysis. Using t-distributed stochastic neighbor embedding (t-SNE) visualization, we uncovered a high level of heterogeneity of CD8 T cells in CD8-mPBL/mTIL, with a total of 20 clusters (clusters with <1% of cells in all samples were removed for further analysis; Fig. 2, B–D; Fig. S1; Fig. S2; and Table S2). Interestingly, both CD8-mTILs and CD8-mPBLs appeared activated in TCR signaling, components of the phosphatidylinositol 3-kinase pathway, CD28 and OX40 signaling, MHC II and NF-κB signaling, and the NRF2-mediated oxidative stress response (Fig. 2 E, Table S3, and Table S4), based on the significant differential expression of genes (false discovery rate [FDR]–adjusted t test, P < 0.05) between CD8-mTILs and CD8-mTILs. In addition to enhanced pathways for T cell activation, CD8-mTILs exhibited traits of T cell exhaustion, stress responses, apoptosis, and suppressed immune checkpoint and PPAR signaling pathways (Fig. 2 E and Table S3). These observations are a testament to scRNaseq, showing that tumor-bearing conditions impart a systemic impact on circulating immune cells in addition to tumor-infiltrating cells (Bai et al., 2015; Lee et al., 1999; Manjarrez-Orduño et al., 2018).

CD8-mPBLs and CD8-mTILs were quite distinct, with only three clusters shared between them (Fig. 2 D and Fig. 3 A). These three CD8-mPBL/mTIL shared clusters (clusters 2, 6, and 15) may permit tracking of CD8 T cells and help decipher their intracellular programming when exposed to the tumor environment, thus facilitating identification of important factors that dictate patient responsiveness to immunotherapy. To test this, we first analyzed the transcriptomic correlation of clusters 2, 6, and 15 with all other clusters and found that cluster 2 showed similarity with most other clusters, with the exception of clusters 6 and 15 (Fig. 3 B). Cluster 6 showed similarity with clusters 5, 12, 14, 18, and 20, whereas cluster 15 was similar to clusters 4, 9, 16, and 19. This nonoverlapping correlation of these three clusters supports their unique cellular programs and potential functions. Indeed, the 3D plot of all cells clearly depicts their distinct transcriptional profiles (Fig. S2, A–C). Next, we extracted signature genes (FDR-adjusted t test, P < 0.05) of the clusters (Fig. 3, C and D; and Table S5) that were found in all eight patients (Fig. S2, E and F) and performed a pathway analysis (Fig. 3 E, Table S6, and Table S7).

Cluster 2 expressed genes consistent with naive or resting T cell behavior, such as similar activation levels of DNA damage checkpoint regulation. Housekeeping RhoGDI (Rho GDP–dissociation inhibitor) pathways that are necessary to inhibit T cell activation were also highly active in cluster 2 cells (Allenspach et al., 2001; Burkhardt et al., 2008; Lin et al., 2003; Fig. 3 E). Interestingly, HIPPO signaling was activated in cluster 2 (Fig. 3 E), which includes the key inhibitor MOB1A, subunits of protein phosphatase, and 14–3-3, confirming the housekeeping function of these genes is consistent with that of naive or resting CD8 T cells. In addition, cluster 2 also contained suppressed Cdc42 signaling and T cell exhaustion signaling pathways that would ensure normal cell cycle and prevention of apoptosis (Fig. S2 F and Table S4).

Cluster 15 displayed pathway signatures mostly opposite to clusters 2 and 6, with prominent activation of OXPHOS, as well as activated glycolysis and NER (nucleotide excision repair) pathway (Fig. 3 E). Contrary to clusters 2 and 6, inhibition of HIPPO and RhoGDI pathways were also observed in cluster 15 (Fig. 3 E). Not surprisingly, T cell exhaustion markers were highly up-regulated in cluster 15, including the immune checkpoint molecules PD-1, TIM-3, LAG3 (Fig. 3, D and F), LAYN, and CXCL13 (Fig. 3 F). Remarkably, ectonucleotidases CD38 and CD39, which are involved in NAD+ and ATP regulation, were also significantly up-regulated in cluster 15 (Fig. 3 F). These characteristics of having not only expression of exhaustion markers but also clear metabolic activities add to our previous work of functionally suppressive CD8 T cells with high levels of checkpoints (Pfannenstiel et al., 2019).

Compared with clusters 2 and 15, cells in cluster 6 were transcriptionally suppressed, with fewer than 100 genes (out of 11,000 total detected gene IDs in the whole dataset) up-regulated compared with all other clusters. Furthermore, most signaling pathways were inhibited or had low activation, and only a few pathways remained relatively active, such as the enhanced Sirtuin, RhoGDI, and sumoylation pathways. These analyses suggested that some CD8 T cells in mPBLs resemble CD8 T cells in mTILs, with three similar populations that are transcriptionally distinct from each other. To examine the potential bias effect of different numbers of T cells from different patients, we also analyzed our dataset with a t-SNE process using an equal number of cells from each patient. Consistently, we not only observed comparable cluster distributions but also were able to identify the three PBL/TIL shared clusters with similar phenotypes and properties (Fig. S3). Thus, we show that that these three overlapping clusters are not due to an artifact of sample selection, a multidimensional reduction process, or a unique effect of a limited number of patients but are a phenomenon of the whole melanoma cohort in this study.

Identification of three transciptomically distinct shared PBL/TIL clusters

To further evaluate the cell state transition, we randomly selected equal number of cells (1,000 cells from each sample) to perform the trajectory analysis using the Monocle package (Qiu et al., 2017) to reveal cell fate differentiation along the branch point trajectories. The overall distribution of CD8-mPBLs and CD8-mTILs formed a three-branched plot, with cluster 2, 6, or 15 at the tip of each branch (Fig. 4, A and B). Interestingly, CD8-mPBL continuously span from cluster 2 to cluster 15, with few isolated cells extending toward cluster 6, suggesting that cluster 2→15 is a tumor-specific pattern (Fig. 4, B and C). Further, CD8-mTILs are located along all three branches (cluster 2→15, cluster 2→6, and cluster 15→6), suggesting that CD8-mPBLs in cluster 6 are likely those migrating to and from tumors and the periphery. Since cell trajectory is calculated based on overall transcriptome profiles of each cell and assigned their relative position based on relative simulation, the location of clusters 2, 6, and 15 on the plot further confirms that these clusters represent the three most distinct transcriptomic patterns, suggesting three distinct function types. This adds to the importance of clusters 2, 6, and 15 as the only clusters that have overlapping populations between TILs and PBLs. Setting the branch of cluster 2 as root in Monocle, we tracked whole-transcriptome gene expression changes along the trajectory branches and identified gene clusters that were altered along the pseudotime progression from cluster 2→6 or cluster 2→15 (Fig. 4 D). Interestingly, immune checkpoint genes, including CTLA4, PD-1, and LAG3, were highly expressed at the cluster 15 branch, whereas the PIK3IP1 gene, which is important for suppressing T cell activation, displayed an increased expression pattern in the cluster 2→6 direction (Uche et al., 2018). In contrast, genes contributing to apoptosis and T cell exhaustion pathways (CALM1, HLA-DQA1, HLA-DRA, CTLA4, PD-1, LAG3, TIGIT, and TIM-3) were highly enriched in cluster 15, but not in cluster 2 or 6 (Fig. 4, D and E; and Fig. S4).

By pseudotemporal trajectory analysis, we discovered three distinct programs that influence the gradual transition between the PBL/TIL shared clusters 2, 6, and 15 (Fig. 5 A). In CD8-mTILs, program 1 progressively transforms naive T cells (cluster 2) into a more “exhausted” CD8 T cell state (clusters 13, 20, and 19) along the trajectory and eventually transition to cluster 15 at the most distal of the trajectory branch (Fig. 5 A). While program 2 drives the transition of naive CD8 T cells to cluster 6, program 3 transforms cluster 15 to cluster 6 (Fig. 5 A). However, in CD8-mPBLs, only one program induces CD8 T cell transition, where program 1 is shown to trigger the transition of naive CD8 T cells (cluster 2) to cluster 15 (Fig. 5 A). Of note, only program 1 significantly fosters the transition of naive CD8 T cells (cluster 2) into an exhausted CD8 T cell state (cluster 15) in both PBLs and TILs, with other clusters distributed along the program transitional states, indicating that CD8-mPBLs display certain molecular and gene profiles resembling CD8-mTILs (Fig. 5 A).

Subsequently, we further analyzed the expression patterns of cell surface proteins and cytokines, which are vital in dictating CD8 T cell characteristics and functions in all the three programs (1, 2, and 3). Cytokines or secreted polypeptides that are known to maintain a resting T cell state, such as NOG and LTB, are enriched in cluster 2, whereas secreted molecules associated with T cell activation, such as CD40LG, CCL28, FLT3LG, TNFSF8, and NRG2, displayed an extended pattern along program 1 (cluster 2→15). Cytokines important for a strong inflammatory response in tumors are enriched at the cluster 15 end of program 1 (Fig. 5 B). Further, dynamic changes of cell surface receptors also displayed similar patterns (Fig. 5 B). Overall, cluster 15 CD8 T cells expressed high levels of genes for MHC II (HLA-DRB1, HLA-DKA, HLA-DPA1, and CD74), receptors for cell-to-cell interaction (CD2, CD47, CD27, IL2RG, and CXCR3), and dysfunctional markers and immune checkpoints such as PD-1, CTLA4, LAG3, and CXCL13. A recent review reported that CXCL13 was overexpressed in terminal dysfunctional CD8 T cells, suggesting a positive correlation between CXCL13 and dysfunctional anti-tumor efficacy (van der Leun et al., 2020). Interestingly, IL6R, IL7R, and CCR7 were down-regulated from resting/naive cells (cluster 2) to cluster 15 CD8 T cells (Fig. 5 B). More importantly, we identified key immune checkpoint genes and transcription factors along the three program directions in CD8-mPBLs and CD8-mTILs (Fig. 5 C). For example, in these programs, we identified TOX, which is a critical transcriptional factor that reprograms and drives CD8 T cells into an exhausted state during cancer progression and chronic infection (Mann and Kaech, 2019). We found that TOX increases along program 1, along with multiple checkpoints, and is highest in cluster 15 CD8 T cells (Fig. 5 C).

Trajectory analysis of PBL/TIL CD8 T cells illustrates how metabolic pathways like OXPHOS differentiate cluster 15 compared with classic exhausted T cells

By transcriptomic analysis, we next investigated the metabolic signaling in all clusters. Strikingly, we observed a clear pattern of cell metabolic shifting during cell transition from naive or effector state to a dysfunctional exhaustion state (Fig. 6). Among all clusters, cluster 15 displayed elevated OXPHOS, glycolysis, glucose, and lipid transportation activity (Fig. 6 A). Genes involved in metabolic pathways, including OXPHOS, glycolysis, glucose, and lipid metabolism, were up-regulated in multiple clusters leading to cluster 15, such as PGK1, ATP5F1A, SLC2A1, and LDLR (Fig. 6 A). In fact, cluster 15 had the highest cell metabolic rate, with the most pronounced activation of glycolysis and OXPHOS pathways (previously shown in Fig. 3 E; see also Fig. 6, B–D). Remarkably, the OXPHOS pathway underwent a more significant change relative to glycolysis that enabled cells to transition from the state represented by cluster 2 to the state represented by cluster 15 (Fig. 6 E). There is visible segregation of a high OXPHOS and glycolysis activation state in clusters 4 (TILs), 15 (shared PBLs/TILs), and 16 (PBLs) from the other clusters, with cluster 15 having the maximal activation of both OXPHOS and glycolysis (Fig. S4 A).

Cluster 15, enriched with exhaustion markers (shown in Fig. 4 D), has prominent levels of both OXPHOS and exhausted markers (Fig. 6 F). Similar to cluster 15, we also observed high OXPHOS and exhaustion levels in both clusters 4 and 16 (Fig. 6 F). On the other hand, clusters 14 and 9 in TILs have high exhaustion levels but low OXPHOS activity (Fig. 6 F), thus indicating that they are classical exhausted TILs (van der Leun et al., 2020; Wherry and Kurachi, 2015). Commonly, exhausted T cells have low or mild expression of cytotoxic genes, which is very similar to clusters 4 and 9 (Fig. S4 B). However, we unexpectedly observed that clusters 4, 15, and 16 are enriched with cytotoxic genes (e.g., PRF1 and GZMB); in particular, IFN-γ is elevated in cluster 15 (Fig. 3 D), suggesting that these three clusters are distinctly different from classic exhausted T cells. Overall, our data demonstrate that clusters 4, 15, and 16 conglomerate into a unique T cell subset characterized by high exhaustion and OXPHOS states as well as increased cytotoxic gene expression (Fig. 6 F; and Fig. S4, A–C).

We next examined the biological progression of the various clusters based on their metabolic and transcriptional programs using pseudotime trajectory analysis. Consistent with the data shown in Fig. 3, we noticed a trifurcation of CD8 T cells into three distinct branches: resting/naive (cluster 2 branch, including clusters 1, 2, 12, 17, and 18), high OXPHOS with exhaustion markers (cluster 15 branch, including distal and related clusters 4, 15, and 16 [circled in Fig. 6 G]), or inactive dormant (cluster 6) cells. Other clusters are distributed along the program transitional states (Fig. 6 H). These results suggest that transcriptional programs in CD8-mPBLs have features similar to those found in CD8-mTILs, specifically in the formation of cluster 15, with clusters 4 and 16 having the closest proximity to cluster 15 (Fig. 6 H).

To functionally identify these unique subset of T cells, we looked for potential cell surface markers that could differentiate the transcriptionally related clusters 4, 15, and 16 from other clusters. By trajectory plot, we observed a gradual enrichment of PD-1, CD38, and CD39 expression leading toward cluster 15, inferring that these markers could be used for stratification (Fig. S4 D). We indeed found that both CD38 and CD39 are able to distinguish clusters 4 and 15 from other clusters, but not in cluster 16, which is found in PBLs (Fig. 6 H). Consistently, clusters 4 (TILs) and 15 (shared PBLs and TILs) also have high levels of combined expression of PD-1 and CD38/CD39, but not cluster 16, which may have to do with not being under the direct influence of the tumor microenvironment (Fig. S4, E and F). Together, clusters 4, 15 and 16 form a unique spectrum of CD8 T cells defined transcriptionally by their distinct features of high OXPHOS, exhaustion (e.g., PD-1), and cytotoxic gene expression, which we coin CD8+ TOXPHOS. However, for cellular-level evaluation, to validate these transcriptional findings, the ability to identify PD-1, CD38, and CD39 expression will at least allow for studies of CD8+ TOXPHOS clusters 4 and 15.

High-bioenergy CD8 T cells in refractory melanoma patients

We reported that many melanoma patients have a significant number of CD8 TILs expressing high levels of immune checkpoints and that these same cells have active immune suppression of autologous healthy lymphocytes (Pfannenstiel et al., 2019). In our single-cell transcriptomic analysis, we found that CD8+ TOXPHOS cells have the strongest metabolic signal within CD8 TILs. These findings led us to explore whether purified CD8 TILs from patients enriched with CD8 T cell subsets expressing high levels of immune checkpoints have a metabolic rate. Due to the limitations of the Seahorse glucose oxidation assay, which requires a large number of cells, we did a simple comparison as a starting point with healthy T cells.

We first performed the Seahorse assay to validate the involvement of glucose oxidation during glycolysis by determining the oxygen consumption rate (OCR) of healthy CD8 PBLs and CD8+PD-1+ TILs (Fig. 6 A shows that CD8+ TOXPHOS cells account for the largest signal of glucose transportation in melanoma patients’ CD8 T cells). Melanoma CD8 TILs were indeed fueled by glucose oxidation as validated by higher OCR compared with healthy PBLs (Fig. 7 A). Of note, these CD8 TILs not only depended on glucose oxidation but also had high initial OCRs (Fig. 7 A). Interestingly, CD8 TILs had strong dependency on oxidation of glucose, as demonstrated by increased glucose dependency rate (Fig. 7 B). Glycolysis, in concert with OXPHOS, generates energy through ATP production. Thus, we measured ATP production in TILs and PBLs of melanoma patients. Using an ATP assay, we validated that peripheral CD8 T cells of ICI-nonresponder melanoma patients produced significantly higher ATP as compared with responders (Fig. 7 C), although we do note that the changes are not as striking in PBLs (P < 0.01) compared with TILs (P < 0.0001). Our biobank of surgical specimens contains TILs mainly from two sources: (1) ICI nonresponders and (2) patients who have not yet undergone systemic therapy (naive). CD8 TILs from nonresponders produced significantly higher ATP compared with naive patients (Fig. 7 C). The reduction of differential membrane potential is equivalent to a reduced capacity for ATP production and other related mitochondria functions (Little et al., 2018). Hence, to answer whether these high-bioenergy-state CD8 T cells were generated by the CD8+ TOXPHOS cell subpopulation within them, we performed flow cytometry combined with metabolic analyses using tetramethylrhodamine methyl ester (TMRM), a fluorescent dye that accumulates in the functional mitochondria caused by differential membrane potential, as a marker of OXPHOS (Davis et al., 2020; Scaduto and Grotyohann, 1999). PBL and TIL CD8 T cells were costained with enriched-surface markers identified in our scRNaseq analysis, including PD-1, CD38, and CD39 (Fig. S5 D), and MitoTracker to determine the mitochondrial membrane potential relative to mitochondrial total mass.

Although expression of CD38 and CD39 in CD8+PD-1+ T cells does help characterize the CD8+ TOXPHOS cells, additional transcriptional assays are required for exact determination of this immune population. We compared CD8+ TOXPHOS cells to other CD8 subpopulations; they expressed a unique transcriptomic signature, even when compared with effector and central memory cells as well as exhausted CD8 T cells (Fig. S5 A). Still, within this PD-1+ subgroup (that have high CD38/39), we observed increased levels of OXPHOS (Fig. 7 D), consistent with our CD8+ TOXPHOS cells designation, which is distinct from the classically defined PD-1+ exhausted T cells, which have been shown to have impaired mitochondrial function (Schurich et al., 2016; Vardhana et al., 2020). Within this population of CD8+PD-1+CD38+CD39+ T cells, we illustrate two levels of TMRM: (1) high TMRM (TMRMhi) and (2) low TMRM (TMRMlo; for a schematic representation of flow cytometry in TILs, see Fig. 7 D). Nonresponder patients mainly have TMRMhi and negligible TMRMlo levels, while naive patients have higher TMRMlo but lower TMRMhi in TILs (Fig. 7 D). Although nonresponders have higher TMRMtotal in PBLs, no obvious difference was observed in CD8+PD-1+CD39+ and CD8+PD-1+CD38+CD39+ TILs (Fig. S5 B). TMRMlo in CD8+PD-1+CD39+ and CD8+PD-1+CD38+CD39+ T cells in both PBLs and TILs do not stratify for nonresponders (Fig. S5 C). Most importantly, significantly higher mitochondrial membrane potential was observed in PBL CD8+PD-1+CD39+ and CD8+PD-1+CD38+CD39+ T cells of nonresponders of melanoma patients (Fig. 7 E). However, CD38 as a marker did not correlate with high mitochondrial membrane potential in PBLs (data not shown). In TILs, nonresponders have elevated mitochondrial membrane potential in both CD8+PD-1+CD39+ and CD8+PD-1+CD38+CD39+ cells, but not in CD8+PD-1+CD38+ T cells, compared with naive melanoma patients (Fig. 7 F).

Importantly, our data suggest the high possibility of stratifying responders and nonresponders using PBL-based metabolic activity assays (ATP and TMRM). However, we did not observe significant stratification between patients before therapy (naive) and after failed ICI therapy (nonresponders). The likely reason is that the naive group contains both responders and nonresponders, masking the stratifying effect. With longer follow-up, we will compare naive patients who did or did not respond to ICI; this is part of an ongoing and distinct effort. Further, these findings highlight the possibility that these metabolic pathways are not only phenotypic but also functional. Therefore, targeting them to modulate CD8+ TOXPHOS cells could be a novel way to improve ICI therapy.

High-accuracy predictive model for immunotherapy response

Based on the association between CD8+ TOXPHOS cells and ICI resistance, we further developed a predictive model of immunotherapy responses using signature genes enriched in cluster 15–like cells, which include not only clusters 4 and 15 but also PBL cluster 16. To screen for a predictive immunotherapy response gene signature, we first performed whole-transcriptome gene coexpression analyses in the three unique PBL/TIL shared populations (clusters 2, 6, and 15). Genes that displayed significant positive correlation with PD-1 expression were highly expressed in clusters 4 and 16 but were most pronounced in cluster 15 (Fig. 8 A and Fig. S5 D). By gene ontology analyses, genes coexpressed with PD-1 in CD8+ TOXPHOS cell clusters were enhanced in the mitochondrial dysfunction pathway, Cdc42 signaling, and CTLA4 signaling (Fig. 8 B). Interestingly, OXPHOS was the most activated pathway in cluster 15–like cells, further substantiating the importance of immune metabolism in checkpoint-based immunotherapy.

To develop a GEP predictive of immunotherapy response, we selected the most significantly elevated top 20 coexpressed with PD-1 (Fig. 8 A). One of these is the immune checkpoint LAG3, which binds to MHC II and is associated with exhausted CD8 T cells in human tumors (Chen and Mellman, 2017). Another, GAPDH, a key enzyme of glucose metabolism, was overexpressed in CD8+ TOXPHOS cells. We also identified several genes less known for their roles in cancer ICI therapy (including serglycin, a small proteoglycan important for cytotoxic T cell secretory function, and cystatin F [CST7], a cysteine peptidase inhibitor) that may regulate immune cell function in tumors (Grujic et al., 2005; Perišić Nanut et al., 2017). Besides CST7, CD74 and HLA genes (HLA-A and HLA-C) known to be crucial for CD8 T cell function were also found to be up-regulated in both CD8 PBLs and TILs with high PD-1 coexpression.

Using the 21-gene GEP (including PD-1), we built a logistic regression model using a training cohort from a published study with scRNaseq dataset of TILs from melanoma patients undergoing immunotherapy (GSE120575; Sade-Feldman et al., 2018b). Our model is designed to predict the status of each T cell in a patient. Then, the proportion of nonresponding cells in each patient was rescaled to 0∼10, depicting the nonresponse score (NRS; see Materials and methods for details). A median NRS of 5 was selected as the threshold score, and patients with an NRS >5.0 were considered nonresponders. Using the training dataset, we predicted the ICI response in 11 of the 12 patients, yielding an accuracy of 92%, with nonresponders having significantly higher NRSs than responders (t test, P = 0.02; Fig. 8 C).

To further validate our model, we applied it to four additional datasets, including one published dataset and three independent validation patient cohorts from our institution. Due to the limited availability of clinical immunotherapy response data from public repositories, we validated our model using a published scRNaseq dataset of TILs from nonmelanoma skin cancer patients receiving anti-PD-1 immunotherapy with only one prediction error (GSE123813; dataset 1; Fig. 8 C; Yost et al., 2019). Next, we went on to further examine the accuracy of our model using patient cohorts from our institution. We first employed scRNaseq of CD8+PD-1+ T cells from five nonresponder patients with matched PBLs–TILs (dataset 2: five PBLs and five TILs; note three of these patients [six samples, paired TILs–PBLs] were from our original discovery set [GSE138720]), and then we performed scRNaseq on two more refractory patients’ TIL and PBL CD8 T cells (GSE153098). In addition, we tested the model using a bulk RNA sequencing (RNaseq) platform. Based on our power calculation, 14 blood samples are required to achieve a power of 0.9 (see Materials and methods for details). To ensure we achieved this, we collected and performed bulk RNaseq on a total of 32 blood samples (15 responders and 17 nonresponders) from melanoma patients (dataset 3; Fig. 8 C) and four lung cancer patients (dataset 4; Fig. S5 E) treated with immunotherapy. Remarkably, combining analysis of validation sets 1–3, our model achieves 88% accuracy (note, in the melanoma, it achieved accuracy of 89% in set 2 and 88% in set 3, Fig. 8 C). Surprisingly, it achieves 100% accuracy in a small cohort of lung cancer patients (not included in the overall accuracy calculation of melanoma; see Fig. S5 E). These results validate our GEP model as an efficient predictor of immunotherapy responses; this algorithm is effective whether the source material is from the tumor or obtained less invasively using blood-based approaches. In all of the validation cohorts, our model assigned significantly higher NRSs to nonresponders than responders (t test, P = 1.56 × 10−8; Fig. 8 C) and effectively discriminated them with an area under the receiver-operating characteristic curve (ROC-AUC) of 0.90 (Fig. 8 D). Given that blood-based approaches have greater potential for utility in oncology, as they do not require invasive acquisition of CD8 TILs, we termed our prediction platform, for simplicity, the noninvasive circulating T cells model (NiCir). Collectively, our validation data demonstrate that NiCir has high predictive accuracy in TILs or PBLs and can be applied to multiplatform datasets. Of note, given NiCir’s ability to predict ICI responses from peripheral blood CD8 T cells, it can now be used as a noninvasive tool to predict immunotherapy responses in the clinical setting.

For a number of years, our group has defined tumor-induced dysfunctional changes in infiltrating T cells (Maybruck et al., 2017; Montes et al., 2008; Pfannenstiel et al., 2019; Pfannenstiel et al., 2018; Zhang et al., 2011). Our recent work showed that in cancers like melanoma, a large percentage of tumor-associated CD8 T cells express high levels of checkpoints like PD-1, and these same cells can actively suppress other immune effectors (Pfannenstiel et al., 2019). Thus, expressing classical exhaustion markers (e.g., checkpoints) does not necessarily define a CD8 T cell as anergic and can be associated with a form of active dysfunction; little is known about this phenomenon outside of nonmalignant pathologies (Flippe et al., 2019; Van Kaer, 2010). Instead, targeting suppressor cells like CD4 T regulatory cells, myeloid-derived suppressor cells, and M2-macrophages remains the main focus in the majority of cancer studies (Klug et al., 2013; Liu et al., 2018; Ugel et al., 2015). CD8 T cells, a critical player in immunotherapy effectiveness, have been extensively studied, but mainly in terms of their exhaustiveness or inefficiency of tumor infiltration (Huang et al., 2017; Jansen et al., 2019; Mariathasan et al., 2018). Thus, if additional TIL CD8 T cell heterogeneity exists within the population targeted by checkpoint inhibitors, then this should prompt additional investigation to improve this line of immunotherapeutics.

Interestingly, CD8+PD-1+ T cells in the periphery of cancer patients were found to contain overlapping TCRs with CD8 T cells in the tumor and are also the most likely to yield (after expansion and adoptive transfer) an anti-tumor response (Gros et al., 2016). The NCI surgery branch that made this discovery surmised that the peripheral and intratumoral TCR sharing CD8+PD-1+ T cells could be interrelated (Gros et al., 2016). If this peripheral blood–intratumoral relationship exists, then it may provide insight into the same tumor-derived CD8 T cells expressing checkpoints that we have been studying and were found to be affected by ICIs (Pfannenstiel et al., 2019). We hypothesized that we can leverage this PBL–TIL relationship to gauge the status of immunotherapy resistance and learn from the related biochemical pathways within CD8 T cell subpopulations.

Using scRNaseq, we discovered that only three unique transcriptionally shared/overlapping clusters in PBL-CD8 and TIL-CD8 T cells exist, two of which we determined spawn from naive CD8 T cells through specific reprogramming, as illustrated in our trajectory analysis; we defined them above as inert dormant and CD8+ TOXPHOS cells. Unlike classic exhausted CD8 T cells, CD8+ TOXPHOS cells in particular appear to contain many of the hallmarks of exhausted CD8 T cells that we previously studied, including checkpoint expression (e.g., PD-1), but they also expressed cytotoxic markers (e.g., IFN-γ and GZMB), corroborating recent reports illustrating that exhausted T cells are not homogeneous but a gradual transition (van der Leun et al., 2020; Yost et al., 2019). This is not completely surprising, as we and others had already identified that suppressor CD8 T cells (which we later found express multiple checkpoints) regulate other cells via expression of IFN-γ (Hidalgo and Halloran, 2002; Mele et al., 2003; Montes et al., 2008; Robb and Hill, 2012; Robb et al., 2011). In fact, studies show that IFN-γ, depending on the conditions, can act as an effector or suppressor immune mediator, and the ramifications of our findings are under investigation (Lee and Ashkar, 2018). These CD8+ TOXPHOS cells also have up-regulated metabolic pathways, consistent with the fact that dysfunctional CD8 T cells are functionally diverse (van der Leun et al., 2020). Our discovery of metabolically active CD8+ TOXPHOS cells supports recent work that CD8 T cells in TILs with PD-1 expression have two distinct states, low and high metabolism (Hartmann et al., 2021). Interestingly, in their study, which used CYTOF (cytometry by time of flight), Hartmann et al. (2021) found that cells that, based on our work, would likely be CD8+ TOXPHOS cells interface directly with the tumor, whereas the more classical exhausted CD8 T cells were found in the peripheral areas of the tumor, thus supporting a unique role for CD8+ TOXPHOS cells in tumor immunology.

Recent scRNAseq studies have shown that TIL CD8 T cells with hallmarks of exhaustion (e.g., expression of PD-1) contain subpopulations that are actively cycling and proliferating (Li et al., 2019). However, few studies have focused on identifying the mechanistic drivers of these active dysfunctional cells. Most reports study lymphocytes in general and not solely lymphocytes on CD8 T cells (Li et al., 2019; Sade-Feldman et al., 2018b; Tirosh et al., 2016; van der Leun et al., 2020). Despite recent attempts by using scRNaseq to investigate and identify CD8 T cells in the peripheral blood and TILs, only Wu et al. and Fairfax et al. have reported the identification of shared populations (and only within cytotoxic CD8 T cells; they did not identify the CD8+ TOXPHOS cells found in our study; Fairfax et al., 2020; Wu et al., 2020). By focusing on enriched CD8 T cells in both TILs and PBLs, with sufficient cell numbers from individualized paired patient samples, we had greater sensitivity and resolution compared with most previous studies, allowing us to better analyze these underexplored CD8 subpopulations.

Recent studies have explored the role of TIL T cell metabolism in regulating immunotherapy, where metabolic properties of T cells exert an essential role in anti-tumor immunity (Guerra et al., 2020; Hartmann et al., 2021; Leone and Emens, 2018; Leone et al., 2019; Scharping et al., 2021). The metabolic state of peripheral blood CD8 T cells is an even more immature field (Hatae et al., 2020; Varanasi et al., 2020; Voss et al., 2021). Remarkably, our data indicate that higher metabolic activity, including up-regulation of OXPHOS and glycolysis within CD8+ TOXPHOS cells in TILs and PBLs, is associated with ICI resistance. To translate this work for both potential immunotherapeutic targeting and cellular validation, we identified uniquely high expression of the cell surface molecules CD38 and CD39 on CD8+ TOXPHOS cells, whose inhibitors are being assessed in current ongoing clinical trials targeting solid cancers like melanoma (Allard et al., 2017; Lokhorst et al., 2015; Perrot et al., 2019; van der Leun et al., 2020). Both CD38 and CD39 are ectonucleotidases that play a role in NAD+/ATP regulation, which is connected to several metabolic pathways (Kishton et al., 2017; Sukumar et al., 2017; Thommen and Schumacher, 2018). Based on these findings, it is possible that these ectonucleotidases are associated with the high metabolic state that we observed in CD8+ TOXPHOS cells.

Another group demonstrated that activation of PBL Ki-67+PD-1+CD8+ T cells (where Ki-67 represents increased proliferation capacity and assumedly increased metabolism) before anti-PD-1 therapy correlates with poor ICI response (Huang et al., 2017). The same group later reported that patients with sustained high levels of Ki-67 in PD-1+CD8+ T cells in blood have better outcomes after a single dose of neoadjuvant anti-PD-1 therapy (Huang et al., 2019). To understand this discrepancy, they hypothesized that these proliferating T cells likely convert to a more reinvigorated and functional state after treatment with anti-PD-1 therapy (Huang et al., 2019). Whether these cells in PBLs represent CD8+ TOXPHOS cells or other populations that can contain these makers is unknown. However, if these Ki-67+PD-1+CD8+ exhausted T cells are CD8+ TOXPHOS cells, then it would imply that patients whose CD8+ TOXPHOS cells become reinvigorated by anti-PD-1 therapy have better outcomes, and identifying why this does not occur ubiquitously could create strategies to improve survival in all melanoma patients. Our study, which illuminates many of the mechanisms found to be activated in CD8+ TOXPHOS cells, offers many targets that may become new therapeutic avenues.

Anti-PD-1–based ICI has revolutionized the care of melanoma; unfortunately, a correlative assay that reliably aids clinicians in predicting who will respond continues to be an unmet need (Halim, 2015; Masucci et al., 2016). Currently, only three predictive biomarkers were approved by the US Food and Drug Administration for ICI therapies for any cancer: protein expression of PD-L1 by immunohistochemistry, microsatellite instability status by PCR phenotyping, and tumor mutation burden (Boyiadzis et al., 2018; Davis and Patel, 2019; Prasad and Addeo, 2020). In recent years, most biomarker exploration has been focused on searching for methods that use minimally invasive approaches (Hofman et al., 2019; Nixon et al., 2019). To date, despite a large amount of effort, whether it be with tumor tissue or PBLs, and using various “omic” technologies or immunohistochemistry-based studies, there is no standard correlative assay used for ICI therapy in the treatment of melanoma (Auslander et al., 2018; Fattore et al., 2021; Havel et al., 2019).

Based on our discovery set, we developed a GEP-coined NiCir that we validated with a published dataset (Yost et al., 2019) and four independent datasets, including from TILs and PBLs from our own patients. NiCir had an average accuracy of 88% in the validation datasets, indicating good prediction value across a spectrum of different sequencing platforms. NiCir showed excellent predictive power, with an area under the curve (AUC) of 0.90, as compared with several previously reported immunotherapy response predictions; for example, IMPRES (immunopredictive score) achieved an AUC of 0.83 for overall accuracy (Auslander et al., 2018); a radiographical characteristic in non–small cell lung cancer patients using artificial intelligence with an AUC of up to 0.76 (Trebeschi et al., 2019); and tumor mutational burden in non–small cell lung cancer predicting ICI response with an AUC range of 0.554–0.755 (Wang et al., 2019). We plan to translate this work into an assay that can be easily applied in a clinical setting for more timely decision making.

In summary, our results increase the field’s knowledge of the heterogeneity of dysfunctional CD8 T cells in cancer patients. Our work implicates the potential of manipulating the immunometabolism of T cell populations like CD8+ TOXPHOS cells to regulate and improve anti-tumor immunity. Moreover, the presence of CD8+ TOXPHOS cells in particular can be exploited even with blood-based approaches for a rapid predictive ICI efficacy assay to improve clinical outcomes in melanoma patients.

Study approval

All human tissue was obtained at the Cleveland Clinic under a protocol approved by Cleveland Clinic’s institutional review board, and written informed consent was obtained from each patient. All patient samples used for scRNaseq were immunotherapy nonresponders. Peripheral blood samples of immunotherapy responders were used as additional validation cohort for the predictive model (NiCir).

Isolation of PBLs and TILs

Peripheral blood mononuclear cells were purified from buffy coats by centrifugation over a Ficoll-Hypaque gradient according to the manufacturer’s protocol (GE Healthcare). Matched PBLs and tumor specimens were obtained from patients with melanoma. PBLs were obtained by venipuncture and isolated by centrifugation over a Ficoll-Hypaque gradient. After surgical resection, tumor specimens were rinsed with antibiotic-containing media and minced with crossed scalpels under sterile conditions. Enzymatic digestion was then used to dissociate tumor tissue using 1,500 U/ml collagenase IV (Gibco/Life Technologies), 1,000 U/ml hyaluronidase (Sigma), and 0.05 mU/ml DNase IV (Gibco) in RPMI for 1 h at 37°C followed by mechanical agitation. The resulting single-cell suspensions were separated from debris by centrifugation over a Ficoll-Hypaque gradient followed by being immediately gated and sorted for LIVE > CD3+ > CD8+ using LIVE/DEAD (Invitrogen; #L10119) CD3 (BioLegend; #300406) and CD8 (BioLegend #300912). The negative population was dumped using dump channel PE-Cy7 (YG) for CD4 (BioLegend; #300454), CD19 (BioLegend; #302215), and CD56 (BioLegend; #302215). On average, sorted cell counts were between 18,605 and 297,000, with an average of 91% efficiency for scRNaseq. Sorted cells were analyzed with flow cytometry to ensure over 90% purity (data not shown).

Seahorse assay

The oxygen consumption and glucose dependency of healthy donor PBLs and melanoma TILs were determined using the Seahorse XF Mito Fuel Flex Test (Agilent; 103260–100) with the XFe96 Bioanalyzer (Agilent) according to the manufacturer’s instructions. Briefly, enriched CD8 T cells of PBLs and sorted CD8+PD-1+ T cell TILs were plated into Agilent Seahorse XF96 microplate in triplicate (75,000 cells/well) overnight, followed by 1-h incubation at 37°C in a non-CO2 incubator on the day of the assay. The pyruvate inhibitor UK5099 (2 mM) was injected into the microplates to determine the glucose oxidation dependency. Baseline OCR was monitored at 24 min, followed by sequential pyruvate inhibitor UK5099 (2 mM) injections, and the OCR readings were recorded for a duration of 2 h at 8-min intervals. Glucose OCR and dependency were calculated using the precent dependency equation based on the instructions, and graphs were plotted with GraphPad Prism software.

ATP assay

The ATP bioluminescence assay was used to quantify ATP levels. TIL and PBL samples were labeled with CD8 microbeads (Miltenyi Biotec; #130-045-201, MACS) and then positively selected for CD8 T cells by passing them through the LS column (Miltenyi Biotec; #130-042-401, MACS) according to the manufacturer’s instructions. ATP levels of the positive-selection CD8 T cells were determined using a Luminescent ATP Detection Assay kit (Abcam; ab113849) following the manufacturer’s instructions. Briefly, CD8 T cells were incubated with detergent for 5 min, followed by incubation with substrate solution for 10 min at room temperature in the dark with agitation. Then, luminescence was quantified on a microplate reader (Molecular Devices; SpectraMax M2). The luminescence values of ATP standards were determined in a similar manner. ATP concentration was calculated according to an ATP-standard curve.

Flow cytometry

Human-specific antibodies and key reagents used are tabulated in Table S7. Cell viability was determined using LIVE/DEAD Fixable DEAD Cells Stain Kit (Thermo Fisher Scientific). Human PBLs (naive, n = 4; responders, n = 5; nonresponders, n = 7) and TILs (naive, n = 5; nonresponders, n = 6) from melanoma patients were stained with CD3, CD8, PD-1, CD38, CD39 (all from BioLegend), TMRM (Thermo Fisher Scientific), and MitoTracker Green (Thermo Fisher Scientific; for details, refer to Table S8). Cells were incubated for 20 min at 37°C with TMRM and MitoTracker Green according to the manufacturer’s instructions. Next, the cells were stained with antibodies for 13 min at 4°C in FACS buffer, followed by flow cytometry analysis. Compensation controls and fluorescence minus one controls were used to determined cell populations. Flow cytometry was performed using a BD LSRFortessa and analyzed with FlowJo software, and normalized mean fluorescence intensity (MFI) graphs were plotted with GraphPad Prism software.

scRNaseq library preparation and data processing

All cells were resuspended in DPBS with 0.04% BSA, and immediately processed for scRNaseq as follows. Cell count and viability were determined using trypan blue on a Countess FL II, and ∼12,000 cells were loaded for capture onto the Chromium system using the v2 single-cell reagent kit according to the manufacturer’s protocol (10x Genomics). Following capture and lysis, cDNA was synthesized and amplified (12 cycles) as per the manufacturer’s protocol (10x Genomics). The amplified cDNA from each channel of the Chromium system was used to construct an Illumina sequencing library and sequenced on an Illumina NovaSeq with 150-cycle sequencing (asymmetric reads per 10x Genomics). Illumina basecall files (*.bcl) were converted to FASTQs using CellRanger v3.0, which uses bcl2fastq for FASTQ file generation. FASTQ files were then aligned to GRCh38 human reference genome and transcriptome using the CellRanger v3.0 software pipeline with default parameters as reported previously (Larkin et al., 2019); this demultiplexes the samples and generates a gene versus cell expression matrix based on the barcodes and assigns unique molecular identifiers (UMIs) that enable determination of the individual cell from which the RNA molecule originated.

Bulk RNaseq library preparation and data processing

PBLs were sorted for CD8 T cells using a selective gating strategy based on staining with the following monoclonal antibodies: negative gating for staining with LIVE/DEAD Aqua (Invitrogen; #L34957), CD14 (BD Biosciences; #564444), CD19 (BioLegend; #302242), CD56 (BD Biosciences; #564058), and CD4 (Invitrogen; #Q10008) to exclude all dead cells and monocytes, B cells, natural killer cells, and CD4 T cells, followed by positive gating on CD3 (BD Biosciences; #557943) and CD8 (Invitrogen; #MHCD0817) to selectively sort 15,000 cells from a pure CD8 population. Purity tests for sorting were performed routinely. RNA was purified from CD8 T cells using RNeasy Micro Kits (Qiagen). Libraries of T cell RNA samples were prepared using Illumina’s Nextera XT DNA Library Prep Kit and sequenced on Illumina NovaSeq 6000. The libraries were generated following the Library Prep Kit manual. The libraries were pooled and prepared for sequencing following the “Standard Normalization Method” within the Illumina Novaseq6000 System Denature and Dilute Libraries Guide. The BCL files were demultiplexed using Illumina’s bcl2fastq v2.20.0.422. Reads in FASTQ files were aligned to GRCh38 human reference genome and transcriptome with Hisat2. Tags per million reads were calculated from aligned reads using StringTie.

Dimensionality reduction and clustering

t-SNE dimensionality reduction of cells based on whole transcriptomes was generated by 10x Genomics Cell Ranger pipeline (version 3.0), as reported previously (Larkin et al., 2019). Dimensionality of gene-barcode matrices was first reduced to 10 principal components using principal-component analysis (PCA). PCA-reduced data were further reduced to 2D space using the t-SNE method and visualized in the Loupe Cell Browser (10× Genomics) and/or R. Graph-based clustering of cells was conducted in the PCA space; a sparse nearest-neighbor graph of the cells was built first, and Louvain modularity optimization was then applied. The number of nearest neighbors was logarithmically in accordance with the number of cells. In the last step, repeated cycles of hierarchical clustering and merging of cluster pairs that had no significant differential expression were performed until no more cluster pairs could merge.

3D t-SNEs of cells were calculated using the “cellranger reanalyze” command with modified parameters and visualized using R plotly package (https://plot.ly).

Gene differential expression of clusters

Gene differential expression analyses of each cluster were conducted by cellranger (10x Genomics). The log2 fold change of a certain gene’s expression (UMIs) in one cluster compared with all other clusters, and the corresponding adjusted P values, were calculated for each cluster.

Transcriptional similarity of clusters

To compare similarity between the three shared clusters (2, 6, and 15) and other clusters, Pearson correlations were calculated between each pair using the clusters’ average gene expressions (mean UMIs of genes). The results were visualized using Circos Table Viewer (http://mkweb.bcgsc.ca/tableviewer/), with ribbons connecting two clusters representing significant similarity (50th percentile of all Pearson distances) between them (Krzywinski et al., 2009).

PD-1 coexpression analyses

Coexpression patterns of genes with PD-1 (PDCD1) were calculated in T cells of the three shared clusters (clusters 2, 6, and 15). Pearson correlations of expression levels were calculated between PD-1 and 13,411 genes that were expressed (UMI >1) in more than 0.1% of the total cells using R and the following formula:
where n is total number of cells in the three shared clusters; pi is expression (UMI) of PD-1 in the cell i; gi is expression (UMI) of the query gene in cell i;p¯ and g¯ are mean expression of PD-1 and the query gene in the total n cells, respectively; and rpg is the Pearson correlation coefficient between PD-1 and the query gene.
The t statistics of Pearson correlation were calculated by the following formula:
where rpg is correlation coefficient of PD-1 and the query gene and n is the number of samples (cells).

P values of Pearson correlation were probabilities of T > t or < −t, where T follows a t distribution with n − 2 degrees of freedom.

The P values were adjusted with FDR correction, and the genes of significant adjusted P values (< 0.05) were then ranked by their Pearson correlation coefficient r calculated in the three shared clusters from the most significant to the least significant correlation.

Cell signaling enrichment analyses

Signaling pathway enrichment and upstream regulator prediction were analyzed using Ingenuity Pathway Analysis (IPA; Qiagen), unless indicated specifically.

Cell trajectory analysis

Single-cell trajectories of cells were built using the Monocle package (version 2.8.0) as previously reported (Larkin et al., 2019). Briefly, whole-transcriptome trajectories of T cells were built using 9,080 genes that were expressed (UMI >1) in more than 1% of the total T cells. Dimensionality reduction was conducted using the DDRTree method, and the minimum spanning tree was plotted using the plot_cell_trajectory function.

Expression levels of the signature genes along trajectories (i.e., from the cluster 2 end to the cluster 6 or cluster 15 end) were visualized using the plot_genes_branched_heatmap function; on the generated heatmap, gene expression levels were smoothened using the VGAM package, rescaled to a −3 to 3 range, and hierarchically clustered.

Prognosis model building and validating

The prognosis model to predict response of patients to ICI therapy was built using PD-1 and the top 20 genes of the PD-1 coexpression genes (21 predictor genes in total) that were mostly correlated (most significant P values) with PD-1. Responders/nonresponders were defined following the RECIST criteria (i.e., complete response and partial response for responders or stable disease and progressive disease for nonresponders; Eisenhauer et al., 2009).

The Gene Expression Omnibus (GEO) database was surveyed for all available data that were provided with both T cell transcriptomics and matching patient treatment response records to immune checkpoint therapy. A total of two published datasets, GSE120575 (Sade-Feldman et al., 2018b) and GSE123813 (Yost et al., 2019), were returned from this survey, and both were used for this study. We randomly assigned GSE120575 as training data, and GSE123813, along with our two additional datasets, were used as independent validation sets.

Model training and testing were conducted using R. The training data (GSE120575; Sade-Feldman et al., 2018b) provided scRNaseq of immune cells collected before and after immune from melanoma patients treated with checkpoint inhibitors. We used all 1,802 tumor-infiltrating CD8 T cells (as identified in the article of that dataset) that were collected before ICI therapy for model training. The 21 predictor genes identified by our coexpression analyses were used as independent variables, and the response to ICI was applied as the dependent variable (1, responder; 0, nonresponder). Logistic regression was performed using these independent variables and dependent variables from the dataset based on the following equation to calculate β0 and βi for the model:
where Y is the dependent variable, Xi is the independent variable, k is the number of independent variables, P is probability of a 1 value of Y, and β0 and βi are model parameters to be determined in the regression.

The model with β0and βi determined from the regression test were applied to calculate P (probability) for each individual CD8 T cells from the dataset and returned with a predicted status (1, responder; 0, nonresponder). Subsequently, the proportions of all calculated CD8 T cells in one sample were calculated and presented for each patient with the scored output using the abovementioned formula.

The model was then further validated in two additional datasets. Dataset 1 was from a previously published study (GSE123813; Yost et al., 2019), in which CD8 tumor-infiltrating T cells were collected before ICI therapy from three and six patients who responded or did not respond to anti-PD-1 therapy, respectively. The response status of each T cell was predicted, and the percentage of predicted responding/nonresponding T cells in each patient was calculated. NRSs of patients were calculated by scaling the percentage of predicted nonresponding T cells to a 0∼10 range. Patients that had NRSs higher than 5.0 (more than 50% of T cells are predicted to respond) were considered responders to ICI therapy; otherwise, patients were predicted as nonresponders. Dataset 2 was collected in the present study, including peripheral CD8 T cells of 32 melanoma patients (15 responders and 17 nonresponders) profiled by RNaseq. Patients’ gene expression levels were input into out prediction model. For CD8 T cell scRNaseq data, the model predicted status of each T cells, and the ratio of nonresponding T cells in a patient was rescaled to 0∼10 as the patient’s NRS. For bulk RNaseq data, the output values of our logistic regression model (ranging 0∼1) were rescaled to 0∼10 as patients’ NRSs. Patients that had NRSs higher than 5.0 were considered responders to ICI therapy. The P values comparing the NRSs between true responders and true nonresponders were calculated by t test. A P value < 0.05 is considered significant.

Statistics

Unless otherwise stated, P values of gene differential expression were determined by two-tailed Welch’s t test. P values of enrichment of pathways, upstream regulators, and gene ontology terms were generated by the corresponding bioinformatics tools. All statistics calculations were conducted using R unless otherwise stated.

To determine the size of samples for validating our NiCir model, we conducted power calculation to determine the required sample size for NiCir using the rocr package in R. Power calculation suggested that in a balanced feature model (kappa = 1), with a power of 0.9 and a significance level of 0.05 for the logistic regression prediction model, a proper sample size should be at least 14 samples (seven responders and seven nonresponders), as shown in this case of NiCir for a AUC of 0.9 (as indicated in our training set, Fig. 8 B), a proper sample size should be at least 14 samples (seven responders and seven nonresponders). We validated the NiCir model using nine previously published samples (Yost et al., 2019) and 32 samples collected in the present study (Fig. 8 C). We collected samples from both responders and nonresponders to ensure a proper kappa = 1 for the model evaluation.

Online supplemental material

Fig. S1 shows scRNaseq data of melanoma patients’ PBLs and TILs. Fig. S2 shows clusters of CD8 T cell profiles from melanoma patients. Fig. S3 shows the characteristics of three clusters containing equal numbers of CD8 PBLs and TILs from each patient. Fig. S4 shows the characterization of CD8 T cells. Fig. S5 shows a heatmap of CD8 T cell state depicted by signature genes, a heatmap of the top 1,000 PD-1–coexpressing genes, MFI of TMRMtotal and TMRMlow in both CD8 PBLs and TILs, and the performances of NiCir’s prediction in the validation dataset (GSE152590) of PBL samples from lung cancer patients collected at Cleveland Clinic core. Table S1 shows the patient characteristics. Table S2 shows scRNaseq data of CD8 T cells from melanoma patients. Table S3 lists the pathways in CD8 PBLs and TILs from melanoma patients. Table S4 lists genes enriched in pathways in CD8 PBLs and TILs. Table S5 lists the signature genes for each cluster. Table S6 lists the enriched pathways in clusters 2, 6, and 15. Table S7 lists the genes enriched in pathways in clusters 2, 6, and 15. Table S8 lists the antibodies and reagents used for flow cytometry.

T cell scRNaseq and RNaseq data generated during this study are available through National Center for Biotechnology Information GEO accession numbers GSE138720, GSE153098, and GSE171256. The other T cell scRNaseq data used in this study are from previously published studies and are available through GEO accession numbers GSE120575 (Sade-Feldman et al., 2018b) and GSE123813 (Yost et al., 2019).

We are grateful to Drs. Andrew Henry Lichtman (Brigham and Women’s Hospital), Pramod K. Srivastava (UConn Health), Stephen Safe (Texas A&M University), and Xiaoxia Li (Lerner Research Institute, Cleveland Clinic) for valuable advice and comments on this project. We are very thankful for Dr. Tomas Radivoyevitch for his contribution in power calculation. We thank the Genomics Core at the Lerner Research Institute of Cleveland Clinic for 10× Genomics single-cell library preparation.

This research is supported by Cleveland Clinic internal funding.

Author contributions: B.R. Gastman and B. Zhou conceived and designed the project; B.R. Gastman, P. Funchain, J.M. Song, C.M. Diaz-Montero, Y.P. Phoon, Y.F. Tian, C. Cameron, and S. Thapaliya collected patient samples and prepared or designed cell sorting for scRNAseq; C. Li performed computational processing of scRNAseq and RNAseq data. C. Li and B. Zhou developed analytic strategies and the prediction model; Y.P. Phoon performed flow cytometry; A. Thongkum performed the ATP assay; L. Qu, A.J. Matz, B. Tamilselvan, J.B. Golden, and M. Cartwright prepared library and conducted RNAseq of the validation dataset; C. Li, B. Zhou, B.R. Gastman, A. Vella, A. Rodriguez, K. Karlinsey, L. Qu, S. Thapaliya, Y.P. Phoon, M. Cameron, and C. Cameron interpreted data and conducted omic or functional analyses; B. Zhou, C. Li, K. Karlinsey, B.R. Gastman, and Y.P. Phoon wrote the manuscript; and C. Bonin, A. Vella, A. Rodriguez, A. Menoret, A. Rodriguez, K. Karlinsey, L. Qu, S. Thapaliya, M. Cameron, C. Cameron, Y.P. Phoon, B. Zhou, and B.R. Gastman revised the manuscript.

Agur
,
Z.
,
K.
Halevi-Tobias
,
Y.
Kogan
, and
O.
Shlagman
.
2016
.
Employing dynamical computational models for personalizing cancer immunotherapy
.
Expert Opin. Biol. Ther.
16
:
1373
1385
.
Allard
,
B.
,
M.S.
Longhi
,
S.C.
Robson
, and
J.
Stagg
.
2017
.
The ectonucleotidases CD39 and CD73: Novel checkpoint inhibitor targets
.
Immunol. Rev.
276
:
121
144
.
Allenspach
,
E.J.
,
P.
Cullinan
,
J.
Tong
,
Q.
Tang
,
A.G.
Tesciuba
,
J.L.
Cannon
,
S.M.
Takahashi
,
R.
Morgan
,
J.K.
Burkhardt
, and
A.I.
Sperling
.
2001
.
ERM-dependent movement of CD43 defines a novel protein complex distal to the immunological synapse
.
Immunity.
15
:
739
750
.
Auslander
,
N.
,
G.
Zhang
,
J.S.
Lee
,
D.T.
Frederick
,
B.
Miao
,
T.
Moll
,
T.
Tian
,
Z.
Wei
,
S.
Madan
,
R.J.
Sullivan
, et al
.
2018
.
Robust prediction of response to immune checkpoint blockade therapy in metastatic melanoma
.
Nat. Med.
24
:
1545
1549
.
Bai
,
X.
,
Q.
Zhang
,
S.
Wu
,
X.
Zhang
,
M.
Wang
,
F.
He
,
T.
Wei
,
J.
Yang
,
Y.
Lou
,
Z.
Cai
, and
T.
Liang
.
2015
.
Characteristics of Tumor Infiltrating Lymphocyte and Circulating Lymphocyte Repertoires in Pancreatic Cancer by the Sequencing of T Cell Receptors
.
Sci. Rep.
5
:
13664
.
Boyiadzis
,
M.M.
,
J.M.
Kirkwood
,
J.L.
Marshall
,
C.C.
Pritchard
,
N.S.
Azad
, and
J.L.
Gulley
.
2018
.
Significance and implications of FDA approval of pembrolizumab for biomarker-defined disease
.
J. Immunother. Cancer.
6
:
35
.
Burkhardt
,
J.K.
,
E.
Carrizosa
, and
M.H.
Shaffer
.
2008
.
The actin cytoskeleton in T cell activation
.
Annu. Rev. Immunol.
26
:
233
259
.
Chen
,
D.S.
, and
I.
Mellman
.
2017
.
Elements of cancer immunity and the cancer-immune set point
.
Nature.
541
:
321
330
.
Davis
,
A.A.
, and
V.G.
Patel
.
2019
.
The role of PD-L1 expression as a predictive biomarker: an analysis of all US Food and Drug Administration (FDA) approvals of immune checkpoint inhibitors
.
J. Immunother. Cancer.
7
:
278
.
Davis
,
R.T.
,
K.
Blake
,
D.
Ma
,
M.B.I.
Gabra
,
G.A.
Hernandez
,
A.T.
Phung
,
Y.
Yang
,
D.
Maurer
,
A.E.Y.T.
Lefebvre
,
H.
Alshetaiwi
, et al
.
2020
.
Transcriptional diversity and bioenergetic shift in human breast cancer metastasis revealed by single-cell RNA sequencing
.
Nat. Cell Biol.
22
:
310
320
.
Eisenhauer
,
E.A.
,
P.
Therasse
,
J.
Bogaerts
,
L.H.
Schwartz
,
D.
Sargent
,
R.
Ford
,
J.
Dancey
,
S.
Arbuck
,
S.
Gwyther
,
M.
Mooney
, et al
.
2009
.
New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1)
.
Eur. J. Cancer.
45
:
228
247
.
Fairfax
,
B.P.
,
C.A.
Taylor
,
R.A.
Watson
,
I.
Nassiri
,
S.
Danielli
,
H.
Fang
,
E.A.
Mahé
,
R.
Cooper
,
V.
Woodcock
,
Z.
Traill
, et al
.
2020
.
Peripheral CD8+ T cell characteristics associated with durable responses to immune checkpoint blockade in patients with metastatic melanoma
.
Nat. Med.
26
:
193
199
.
Fattore
,
L.
,
C.F.
Ruggiero
,
D.
Liguoro
,
V.
Castaldo
,
A.
Catizone
,
G.
Ciliberto
, and
R.
Mancini
.
2021
.
The Promise of Liquid Biopsy to Predict Response to Immunotherapy in Metastatic Melanoma
.
Front. Oncol.
11
:645069.
Flippe
,
L.
,
S.
Bézie
,
I.
Anegon
, and
C.
Guillonneau
.
2019
.
Future prospects for CD8+ regulatory T cells in immune tolerance
.
Immunol. Rev.
292
:
209
224
.
Garon
,
E.B.
,
N.A.
Rizvi
,
R.
Hui
,
N.
Leighl
,
A.S.
Balmanoukian
,
J.P.
Eder
,
A.
Patnaik
,
C.
Aggarwal
,
M.
Gubens
,
L.
Horn
, et al.
KEYNOTE-001 Investigators
.
2015
.
Pembrolizumab for the treatment of non-small-cell lung cancer
.
N. Engl. J. Med.
372
:
2018
2028
.
Garon
,
E.B.
,
M.D.
Hellmann
,
N.A.
Rizvi
,
E.
Carcereny
,
N.B.
Leighl
,
M.J.
Ahn
,
J.P.
Eder
,
A.S.
Balmanoukian
,
C.
Aggarwal
,
L.
Horn
, et al
.
2019
.
Five-Year Overall Survival for Patients With Advanced Non‒Small-Cell Lung Cancer Treated With Pembrolizumab: Results From the Phase I KEYNOTE-001 Study
.
J. Clin. Oncol.
37
:
2518
2527
.
Gide
,
T.N.
,
C.
Quek
,
A.M.
Menzies
,
A.T.
Tasker
,
P.
Shang
,
J.
Holst
,
J.
Madore
,
S.Y.
Lim
,
R.
Velickovic
,
M.
Wongchenko
, et al
.
2019
.
Distinct Immune Cell Populations Define Response to Anti-PD-1 Monotherapy and Anti-PD-1/Anti-CTLA-4 Combined Therapy
.
Cancer Cell.
35
:
238
255.e6
.
Gros
,
A.
,
P.F.
Robbins
,
X.
Yao
,
Y.F.
Li
,
S.
Turcotte
,
E.
Tran
,
J.R.
Wunderlich
,
A.
Mixon
,
S.
Farid
,
M.E.
Dudley
, et al
.
2014
.
PD-1 identifies the patient-specific CD8+ tumor-reactive repertoire infiltrating human tumors
.
J. Clin. Invest.
124
:
2246
2259
.
Gros
,
A.
,
M.R.
Parkhurst
,
E.
Tran
,
A.
Pasetto
,
P.F.
Robbins
,
S.
Ilyas
,
T.D.
Prickett
,
J.J.
Gartner
,
J.S.
Crystal
,
I.M.
Roberts
, et al
.
2016
.
Prospective identification of neoantigen-specific lymphocytes in the peripheral blood of melanoma patients
.
Nat. Med.
22
:
433
438
.
Gros
,
A.
,
E.
Tran
,
M.R.
Parkhurst
,
S.
Ilyas
,
A.
Pasetto
,
E.M.
Groh
,
P.F.
Robbins
,
R.
Yossef
,
A.
Garcia-Garijo
,
C.A.
Fajardo
, et al
.
2019
.
Recognition of human gastrointestinal cancer neoantigens by circulating PD-1+ lymphocytes
.
J. Clin. Invest.
129
:
4992
5004
.
Grujic
,
M.
,
T.
Braga
,
A.
Lukinius
,
M.L.
Eloranta
,
S.D.
Knight
,
G.
Pejler
, and
M.
Abrink
.
2005
.
Serglycin-deficient cytotoxic T lymphocytes display defective secretory granule maturation and granzyme B storage
.
J. Biol. Chem.
280
:
33411
33418
.
Guerra
,
L.
,
L.
Bonetti
, and
D.
Brenner
.
2020
.
Metabolic Modulation of Immunity: A New Concept in Cancer Immunotherapy
.
Cell Rep.
32
:107848.
Halim
,
A.B.
2015
.
Some imminent but overlooked preanalytical and analytical challenges currently facing biomarkers and companion diagnostics
.
Ann. N. Y. Acad. Sci.
1346
:
63
70
.
Hartmann
,
F.J.
,
D.
Mrdjen
,
E.
McCaffrey
,
D.R.
Glass
,
N.F.
Greenwald
,
A.
Bharadwaj
,
Z.
Khair
,
S.G.S.
Verberk
,
A.
Baranski
,
R.
Baskar
, et al
.
2021
.
Single-cell metabolic profiling of human cytotoxic T cells
.
Nat. Biotechnol.
39
:
186
197
.
Hatae
,
R.
,
K.
Chamoto
,
Y.H.
Kim
,
K.
Sonomura
,
K.
Taneishi
,
S.
Kawaguchi
,
H.
Yoshida
,
H.
Ozasa
,
Y.
Sakamori
,
M.
Akrami
, et al
.
2020
.
Combination of host immune metabolic biomarkers for the PD-1 blockade cancer immunotherapy
.
JCI Insight.
5
:e133501.
Havel
,
J.J.
,
D.
Chowell
, and
T.A.
Chan
.
2019
.
The evolving landscape of biomarkers for checkpoint inhibitor immunotherapy
.
Nat. Rev. Cancer.
19
:
133
150
.
Hidalgo
,
L.G.
, and
P.F.
Halloran
.
2002
.
Role of IFN-gamma in allograft rejection
.
Crit. Rev. Immunol.
22
:
317
349
.
Hofman
,
P.
,
S.
Heeke
,
C.
Alix-Panabières
, and
K.
Pantel
.
2019
.
Liquid biopsy in the era of immuno-oncology: is it ready for prime-time use for cancer patients?
Ann. Oncol.
30
:
1448
1459
.
Huang
,
A.C.
,
M.A.
Postow
,
R.J.
Orlowski
,
R.
Mick
,
B.
Bengsch
,
S.
Manne
,
W.
Xu
,
S.
Harmon
,
J.R.
Giles
,
B.
Wenz
, et al
.
2017
.
T-cell invigoration to tumour burden ratio associated with anti-PD-1 response
.
Nature.
545
:
60
65
.
Huang
,
A.C.
,
R.J.
Orlowski
,
X.
Xu
,
R.
Mick
,
S.M.
George
,
P.K.
Yan
,
S.
Manne
,
A.A.
Kraya
,
B.
Wubbenhorst
,
L.
Dorfman
, et al
.
2019
.
A single dose of neoadjuvant PD-1 blockade predicts clinical outcomes in resectable melanoma
.
Nat. Med.
25
:
454
461
.
Hugo
,
W.
,
J.M.
Zaretsky
,
L.
Sun
,
C.
Song
,
B.H.
Moreno
,
S.
Hu-Lieskovan
,
B.
Berent-Maoz
,
J.
Pang
,
B.
Chmielowski
,
G.
Cherry
, et al
.
2016
.
Genomic and Transcriptomic Features of Response to Anti-PD-1 Therapy in Metastatic Melanoma
.
Cell.
165
:
35
44
.
Jansen
,
C.S.
,
N.
Prokhnevska
,
V.A.
Master
,
M.G.
Sanda
,
J.W.
Carlisle
,
M.A.
Bilen
,
M.
Cardenas
,
S.
Wilkinson
,
R.
Lake
,
A.G.
Sowalsky
, et al
.
2019
.
An intra-tumoral niche maintains and differentiates stem-like CD8 T cells
.
Nature.
576
:
465
470
.
Kishton
,
R.J.
,
M.
Sukumar
, and
N.P.
Restifo
.
2017
.
Metabolic Regulation of T Cell Longevity and Function in Tumor Immunotherapy
.
Cell Metab.
26
:
94
109
.
Klug
,
F.
,
H.
Prakash
,
P.E.
Huber
,
T.
Seibel
,
N.
Bender
,
N.
Halama
,
C.
Pfirschke
,
R.H.
Voss
,
C.
Timke
,
L.
Umansky
, et al
.
2013
.
Low-dose irradiation programs macrophage differentiation to an iNOS+/M1 phenotype that orchestrates effective T cell immunotherapy
.
Cancer Cell.
24
:
589
602
.
Kogan
,
Y.
,
K.
Halevi-Tobias
,
M.
Elishmereni
,
S.
Vuk-Pavlović
, and
Z.
Agur
.
2012
.
Reconsidering the paradigm of cancer immunotherapy by computationally aided real-time personalization
.
Cancer Res.
72
:
2218
2227
.
Krzywinski
,
M.
,
J.
Schein
,
I.
Birol
,
J.
Connors
,
R.
Gascoyne
,
D.
Horsman
,
S.J.
Jones
, and
M.A.
Marra
.
2009
.
Circos: an information aesthetic for comparative genomics
.
Genome Res.
19
:
1639
1645
.
Larkin
,
J.
,
V.
Chiarion-Sileni
,
R.
Gonzalez
,
J.J.
Grob
,
P.
Rutkowski
,
C.D.
Lao
,
C.L.
Cowey
,
D.
Schadendorf
,
J.
Wagstaff
,
R.
Dummer
, et al
.
2019
.
Five-Year Survival with Combined Nivolumab and Ipilimumab in Advanced Melanoma
.
N. Engl. J. Med.
381
:
1535
1546
.
Lee
,
A.J.
, and
A.A.
Ashkar
.
2018
.
The Dual Nature of Type I and Type II Interferons
.
Front. Immunol.
9
:
2061
.
Lee
,
J.S.
, and
E.
Ruppin
.
2019
.
Multiomics Prediction of Response Rates to Therapies to Inhibit Programmed Cell Death 1 and Programmed Cell Death 1 Ligand 1
.
JAMA Oncol.
5
:
1614
1618
.
Lee
,
P.P.
,
C.
Yee
,
P.A.
Savage
,
L.
Fong
,
D.
Brockstedt
,
J.S.
Weber
,
D.
Johnson
,
S.
Swetter
,
J.
Thompson
,
P.D.
Greenberg
, et al
.
1999
.
Characterization of circulating T cells specific for tumor-associated antigens in melanoma patients
.
Nat. Med.
5
:
677
685
.
Leone
,
R.D.
, and
L.A.
Emens
.
2018
.
Targeting adenosine for cancer immunotherapy
.
J. Immunother. Cancer.
6
:
57
.
Leone
,
R.D.
,
L.
Zhao
,
J.M.
Englert
,
I.M.
Sun
,
M.H.
Oh
,
I.H.
Sun
,
M.L.
Arwood
,
I.A.
Bettencourt
,
C.H.
Patel
,
J.
Wen
, et al
.
2019
.
Glutamine blockade induces divergent metabolic programs to overcome tumor immune evasion
.
Science.
366
:
1013
1021
.
Li
,
H.
,
A.M.
van der Leun
,
I.
Yofe
,
Y.
Lubling
,
D.
Gelbard-Solodkin
,
A.C.J.
van Akkooi
,
M.
van den Braber
,
E.A.
Rozeman
,
J.B.A.G.
Haanen
,
C.U.
Blank
, et al
.
2019
.
Dysfunctional CD8 T Cells Form a Proliferative, Dynamically Regulated Compartment within Human Melanoma
.
Cell.
176
:
775
789.e18
.
Lin
,
Q.
,
R.N.
Fuji
,
W.
Yang
, and
R.A.
Cerione
.
2003
.
RhoGDI is required for Cdc42-mediated cellular transformation
.
Curr. Biol.
13
:
1469
1479
.
Little
,
D.
,
C.
Luft
,
O.
Mosaku
,
M.
Lorvellec
,
Z.
Yao
,
S.
Paillusson
,
J.
Kriston-Vizi
,
S.
Gandhi
,
A.Y.
Abramov
,
R.
Ketteler
, et al
.
2018
.
A single cell high content assay detects mitochondrial dysfunction in iPSC-derived neurons with mutations in SNCA
.
Sci. Rep.
8
:
9033
.
Liu
,
Y.
,
G.
Wei
,
W.A.
Cheng
,
Z.
Dong
,
H.
Sun
,
V.Y.
Lee
,
S.C.
Cha
,
D.L.
Smith
,
L.W.
Kwak
, and
H.
Qin
.
2018
.
Targeting myeloid-derived suppressor cells for cancer immunotherapy
.
Cancer Immunol. Immunother.
67
:
1181
1195
.
Liu
,
D.
,
B.
Schilling
,
D.
Liu
,
A.
Sucker
,
E.
Livingstone
,
L.
Jerby-Arnon
,
L.
Zimmer
,
R.
Gutzmer
,
I.
Satzger
,
C.
Loquai
, et al
.
2019
.
Integrative molecular and clinical modeling of clinical outcomes to PD1 blockade in patients with metastatic melanoma
.
Nat. Med.
25
:
1916
1927
.
Lokhorst
,
H.M.
,
T.
Plesner
,
J.P.
Laubach
,
H.
Nahi
,
P.
Gimsing
,
M.
Hansson
,
M.C.
Minnema
,
U.
Lassen
,
J.
Krejcik
,
A.
Palumbo
, et al
.
2015
.
Targeting CD38 with Daratumumab Monotherapy in Multiple Myeloma
.
N. Engl. J. Med.
373
:
1207
1219
.
Manjarrez-Orduño
,
N.
,
L.C.
Menard
,
S.
Kansal
,
P.
Fischer
,
B.
Kakrecha
,
C.
Jiang
,
M.
Cunningham
,
D.
Greenawalt
,
V.
Patel
,
M.
Yang
, et al
.
2018
.
Circulating T Cell Subpopulations Correlate With Immune Responses at the Tumor Site and Clinical Response to PD1 Inhibition in Non-Small Cell Lung Cancer
.
Front. Immunol.
9
:
1613
.
Mann
,
T.H.
, and
S.M.
Kaech
.
2019
.
Tick-TOX, it’s time for T cell exhaustion
.
Nat. Immunol.
20
:
1092
1094
.
Mariathasan
,
S.
,
S.J.
Turley
,
D.
Nickles
,
A.
Castiglioni
,
K.
Yuen
,
Y.
Wang
,
E.E.
Kadel
III
,
H.
Koeppen
,
J.L.
Astarita
,
R.
Cubas
, et al
.
2018
.
TGFβ attenuates tumour response to PD-L1 blockade by contributing to exclusion of T cells
.
Nature.
554
:
544
548
.
Masucci
,
G.V.
,
A.
Cesano
,
R.
Hawtin
,
S.
Janetzki
,
J.
Zhang
,
I.
Kirsch
,
K.K.
Dobbin
,
J.
Alvarez
,
P.B.
Robbins
,
S.R.
Selvan
, et al
.
2016
.
Validation of biomarkers to predict response to immunotherapy in cancer: Volume I - pre-analytical and analytical validation
.
J. Immunother. Cancer.
4
:
76
.
Maybruck
,
B.T.
,
L.W.
Pfannenstiel
,
M.
Diaz-Montero
, and
B.R.
Gastman
.
2017
.
Tumor-derived exosomes induce CD8+ T cell suppressors
.
J. Immunother. Cancer.
5
:
65
.
Mele
,
T.S.
,
N.M.
Kneteman
,
L.F.
Zhu
,
V.
Ramassar
,
J.
Urmson
,
B.
Halloran
,
T.A.
Churchill
,
L.
Jewell
,
K.
Kane
, and
P.F.
Halloran
.
2003
.
IFN-gamma is an absolute requirement for spontaneous acceptance of liver allografts
.
Am. J. Transplant.
3
:
942
951
.
Montes
,
C.L.
,
A.I.
Chapoval
,
J.
Nelson
,
V.
Orhue
,
X.
Zhang
,
D.H.
Schulze
,
S.E.
Strome
, and
B.R.
Gastman
.
2008
.
Tumor-induced senescent T cells with suppressor function: a potential form of tumor immune evasion
.
Cancer Res.
68
:
870
879
.
Nixon
,
A.B.
,
K.A.
Schalper
,
I.
Jacobs
,
S.
Potluri
,
I.M.
Wang
, and
C.
Fleener
.
2019
.
Peripheral immune-based biomarkers in cancer immunotherapy: can we realize their predictive potential?
J. Immunother. Cancer.
7
:
325
.
Perišić Nanut
,
M.
,
J.
Sabotič
,
U.
Švajger
,
A.
Jewett
, and
J.
Kos
.
2017
.
Cystatin F Affects Natural Killer Cell Cytotoxicity
.
Front. Immunol.
8
:
1459
.
Perrot
,
I.
,
H.A.
Michaud
,
M.
Giraudon-Paoli
,
S.
Augier
,
A.
Docquier
,
L.
Gros
,
R.
Courtois
,
C.
Déjou
,
D.
Jecko
,
O.
Becquart
, et al
.
2019
.
Blocking Antibodies Targeting the CD39/CD73 Immunosuppressive Pathway Unleash Immune Responses in Combination Cancer Therapies
.
Cell Rep.
27
:
2411
2425.e9
.
Pfannenstiel
,
L.W.
,
C.
McNeilly
,
C.
Xiang
,
K.
Kang
,
C.M.
Diaz-Montero
,
J.S.
Yu
, and
B.R.
Gastman
.
2018
.
Combination PD-1 blockade and irradiation of brain metastasis induces an effective abscopal effect in melanoma
.
OncoImmunology.
8
:e1507669.
Pfannenstiel
,
L.W.
,
C.M.
Diaz-Montero
,
Y.F.
Tian
,
J.
Scharpf
,
J.S.
Ko
, and
B.R.
Gastman
.
2019
.
Immune-Checkpoint Blockade Opposes CD8+ T-cell Suppression in Human and Murine Cancer
.
Cancer Immunol. Res.
7
:
510
525
.
Prasad
,
V.
, and
A.
Addeo
.
2020
.
The FDA approval of pembrolizumab for patients with TMB >10 mut/Mb: was it a wise decision? No
.
Ann. Oncol.
31
:
1112
1114
.
Qiu
,
X.
,
A.
Hill
,
J.
Packer
,
D.
Lin
,
Y.A.
Ma
, and
C.
Trapnell
.
2017
.
Single-cell mRNA quantification and differential analysis with Census
.
Nat. Methods.
14
:
309
315
.
Ribas
,
A.
, and
J.D.
Wolchok
.
2018
.
Cancer immunotherapy using checkpoint blockade
.
Science.
359
:
1350
1355
.
Robb
,
R.J.
, and
G.R.
Hill
.
2012
.
The interferon-dependent orchestration of innate and adaptive immunity after transplantation
.
Blood.
119
:
5351
5358
.
Robb
,
R.J.
,
E.
Kreijveld
,
R.D.
Kuns
,
Y.A.
Wilson
,
S.D.
Olver
,
A.L.
Don
,
N.C.
Raffelt
,
N.A.
De Weerd
,
K.E.
Lineburg
,
A.
Varelias
, et al
.
2011
.
Type I-IFNs control GVHD and GVL responses after transplantation
.
Blood.
118
:
3399
3409
.
Sade-Feldman
,
M.
,
K.
Yizhak
,
S.L.
Bjorgaard
,
J.P.
Ray
,
C.G.
de Boer
,
R.W.
Jenkins
,
D.J.
Lieb
,
J.H.
Chen
,
D.T.
Frederick
,
M.
Barzily-Rokni
, et al
.
2018
a
.
Defining T Cell States Associated with Response to Checkpoint Immunotherapy in Melanoma
.
Cell.
175
:
998
1013.e20
.
Sade-Feldman
,
M.
,
K.
Yizhak
,
S.L.
Bjorgaard
,
J.P.
Ray
,
C.G.
de Boer
,
R.W.
Jenkins
,
D.J.
Lieb
,
J.H.
Chen
,
D.T.
Frederick
,
M.
Barzily-Rokni
, et al
.
2018
b
.
Defining T Cell States Associated with Response to Checkpoint Immunotherapy in Melanoma
.
Cell.
175
:
998
1013.e20
.
Samstein
,
R.M.
,
C.H.
Lee
,
A.N.
Shoushtari
,
M.D.
Hellmann
,
R.
Shen
,
Y.Y.
Janjigian
,
D.A.
Barron
,
A.
Zehir
,
E.J.
Jordan
,
A.
Omuro
, et al
.
2019
.
Tumor mutational load predicts survival after immunotherapy across multiple cancer types
.
Nat. Genet.
51
:
202
206
.
Scaduto
,
R.C.
Jr
., and
L.W.
Grotyohann
.
1999
.
Measurement of mitochondrial membrane potential using fluorescent rhodamine derivatives
.
Biophys. J.
76
:
469
477
.
Scharping
,
N.E.
,
D.B.
Rivadeneira
,
A.V.
Menk
,
P.D.A.
Vignali
,
B.R.
Ford
,
N.L.
Rittenhouse
,
R.
Peralta
,
Y.
Wang
,
Y.
Wang
,
K.
DePeaux
, et al
.
2021
.
Mitochondrial stress induced by continuous stimulation under hypoxia rapidly drives T cell exhaustion
.
Nat. Immunol.
22
:
205
215
.
Schurich
,
A.
,
L.J.
Pallett
,
D.
Jajbhay
,
J.
Wijngaarden
,
I.
Otano
,
U.S.
Gill
,
N.
Hansi
,
P.T.
Kennedy
,
E.
Nastouli
,
R.
Gilson
, et al
.
2016
.
Distinct Metabolic Requirements of Exhausted and Functional Virus-Specific CD8 T Cells in the Same Host
.
Cell Rep.
16
:
1243
1252
.
Shao
,
H.
,
Y.
Ou
,
T.
Wang
,
H.
Shen
,
F.
Wu
,
W.
Zhang
,
C.
Tao
,
Y.
Yuan
,
H.
Bo
,
H.
Wang
, and
S.
Huang
.
2014
.
Differences in TCR-Vβ repertoire and effector phenotype between tumor infiltrating lymphocytes and peripheral blood lymphocytes increase with age
.
PLoS One.
9
:e102327.
Sharma
,
P.
,
S.
Hu-Lieskovan
,
J.A.
Wargo
, and
A.
Ribas
.
2017
.
Primary, Adaptive, and Acquired Resistance to Cancer Immunotherapy
.
Cell.
168
:
707
723
.
Sukumar
,
M.
,
R.J.
Kishton
, and
N.P.
Restifo
.
2017
.
Metabolic reprograming of anti-tumor immunity
.
Curr. Opin. Immunol.
46
:
14
22
.
Thommen
,
D.S.
, and
T.N.
Schumacher
.
2018
.
T Cell Dysfunction in Cancer
.
Cancer Cell.
33
:
547
562
.
Tirosh
,
I.
,
B.
Izar
,
S.M.
Prakadan
,
M.H.
Wadsworth
II
,
D.
Treacy
,
J.J.
Trombetta
,
A.
Rotem
,
C.
Rodman
,
C.
Lian
,
G.
Murphy
, et al
.
2016
.
Dissecting the multicellular ecosystem of metastatic melanoma by single-cell RNA-seq
.
Science.
352
:
189
196
.
Topalian
,
S.L.
,
J.M.
Taube
,
R.A.
Anders
, and
D.M.
Pardoll
.
2016
.
Mechanism-driven biomarkers to guide immune checkpoint blockade in cancer therapy
.
Nat. Rev. Cancer.
16
:
275
287
.
Trebeschi
,
S.
,
S.G.
Drago
,
N.J.
Birkbak
,
I.
Kurilova
,
A.M.
Cǎlin
,
A.
Delli Pizzi
,
F.
Lalezari
,
D.M.J.
Lambregts
,
M.W.
Rohaan
,
C.
Parmar
, et al
.
2019
.
Predicting response to cancer immunotherapy using noninvasive radiomic biomarkers
.
Ann. Oncol.
30
:
998
1004
.
Uche
,
U.U.
,
A.R.
Piccirillo
,
S.
Kataoka
,
S.J.
Grebinoski
,
L.M.
D’Cruz
, and
L.P.
Kane
.
2018
.
PIK3IP1/TrIP restricts activation of T cells through inhibition of PI3K/Akt
.
J. Exp. Med.
215
:
3165
3179
.
Ugel
,
S.
,
F.
De Sanctis
,
S.
Mandruzzato
, and
V.
Bronte
.
2015
.
Tumor-induced myeloid deviation: when myeloid-derived suppressor cells meet tumor-associated macrophages
.
J. Clin. Invest.
125
:
3365
3376
.
van der Leun
,
A.M.
,
D.S.
Thommen
, and
T.N.
Schumacher
.
2020
.
CD8+ T cell states in human cancer: insights from single-cell analysis
.
Nat. Rev. Cancer.
20
:
218
232
.
Van Kaer
,
L.
2010
.
Comeback kids: CD8(+) suppressor T cells are back in the game
.
J. Clin. Invest.
120
:
3432
3434
.
Varanasi
,
S.K.
,
S.V.
Kumar
, and
B.T.
Rouse
.
2020
.
Determinants of Tissue-Specific Metabolic Adaptation of T Cells
.
Cell Metab.
32
:
908
919
.
Vardhana
,
S.A.
,
M.A.
Hwee
,
M.
Berisa
,
D.K.
Wells
,
K.E.
Yost
,
B.
King
,
M.
Smith
,
P.S.
Herrera
,
H.Y.
Chang
,
A.T.
Satpathy
, et al
.
2020
.
Impaired mitochondrial oxidative phosphorylation limits the self-renewal of T cells exposed to persistent antigen
.
Nat. Immunol.
21
:
1022
1033
.
Voss
,
K.
,
H.S.
Hong
,
J.E.
Bader
,
A.
Sugiura
,
C.A.
Lyssiotis
, and
J.C.
Rathmell
.
2021
.
A guide to interrogating immunometabolism
.
Nat. Rev. Immunol.
21
:
637
652
.
Wang
,
S.
,
J.
Zhang
,
Z.
He
,
K.
Wu
, and
X.S.
Liu
.
2019
.
The predictive power of tumor mutational burden in lung cancer immunotherapy response is influenced by patients’ sex
.
Int. J. Cancer.
145
:
2840
2849
.
Wei
,
S.C.
,
J.H.
Levine
,
A.P.
Cogdill
,
Y.
Zhao
,
N.A.S.
Anang
,
M.C.
Andrews
,
P.
Sharma
,
J.
Wang
,
J.A.
Wargo
,
D.
Pe’er
, and
J.P.
Allison
.
2017
.
Distinct Cellular Mechanisms Underlie Anti-CTLA-4 and Anti-PD-1 Checkpoint Blockade
.
Cell.
170
:
1120
1133.e17
.
Wei
,
S.C.
,
C.R.
Duffy
, and
J.P.
Allison
.
2018
.
Fundamental Mechanisms of Immune Checkpoint Blockade Therapy
.
Cancer Discov.
8
:
1069
1086
.
Wherry
,
E.J.
2011
.
T cell exhaustion
.
Nat. Immunol.
12
:
492
499
.
Wherry
,
E.J.
, and
M.
Kurachi
.
2015
.
Molecular and cellular insights into T cell exhaustion
.
Nat. Rev. Immunol.
15
:
486
499
.
Wu
,
T.D.
,
S.
Madireddi
,
P.E.
de Almeida
,
R.
Banchereau
,
Y.J.
Chen
,
A.S.
Chitre
,
E.Y.
Chiang
,
H.
Iftikhar
,
W.E.
O’Gorman
,
A.
Au-Yeung
, et al
.
2020
.
Peripheral T cell expansion predicts tumour infiltration and clinical response
.
Nature.
579
:
274
278
.
Yost
,
K.E.
,
A.T.
Satpathy
,
D.K.
Wells
,
Y.
Qi
,
C.
Wang
,
R.
Kageyama
,
K.L.
McNamara
,
J.M.
Granja
,
K.Y.
Sarin
,
R.A.
Brown
, et al
.
2019
.
Clonal replacement of tumor-specific T cells following PD-1 blockade
.
Nat. Med.
25
:
1251
1259
.
Zhang
,
Y.
,
L.W.
Pfannenstiel
,
E.
Bolesta
,
C.L.
Montes
,
X.
Zhang
,
A.I.
Chapoval
,
R.B.
Gartenhaus
,
S.E.
Strome
, and
B.R.
Gastman
.
2011
.
Interleukin-7 inhibits tumor-induced CD27-CD28- suppressor T cells: implications for cancer immunotherapy
.
Clin. Cancer Res.
17
:
4975
4986
.
Zimmer
,
L.
,
S.
Apuri
,
Z.
Eroglu
,
L.A.
Kottschade
,
A.
Forschner
,
R.
Gutzmer
,
M.
Schlaak
,
L.
Heinzerling
,
A.M.
Krackhardt
,
C.
Loquai
, et al
.
2017
.
Ipilimumab alone or in combination with nivolumab after progression on anti-PD-1 therapy in advanced melanoma
.
Eur. J. Cancer.
75
:
47
55
.

Competing Interests

Disclosures: P. Funchain reported grants from Pfizer and Bristol Myers Squibb and personal fees from Eisai outside the submitted work. A. Rodriguez reported non-financial support from Lipid Genomics during the conduct of the study and non-financial support from Lipid Genomics outside the submitted work; in addition, A. Rodriguez had a patent to LAG3 issued (Lipid Genomics). No other disclosures were reported.

This article is distributed under the terms of an Attribution–Noncommercial–Share Alike–No Mirror Sites license for the first six months after the publication date (see http://www.rupress.org/terms/). After six months it is available under a Creative Commons License (Attribution–Noncommercial–Share Alike 4.0 International license, as described at https://creativecommons.org/licenses/by-nc-sa/4.0/).