Preprint
Article

From Immunosenescence to Aging Types – Establishing Reference Intervals for Immune Age Biomarkers by Centile Estimation

Altmetrics

Downloads

96

Views

64

Comments

0

A peer-reviewed article of this preprint also exists.

Submitted:

03 August 2023

Posted:

07 August 2023

You are already at the latest version

Alerts
Abstract
Immunological aging type definition requires establishing reference intervals from the distribution of immunosenescence biomarkers conditional on age. For 1,605 individuals (18–97 years), we determined the comprehensive IMMmune Age indeX IMMAX from flow cytometry-based blood cell sub-populations, and identified age-specific centiles by fitting generalized additive models for location, scale and shape. The centiles were uncorrelated with age, and facilitated the categorization of individuals as immunologically slow or fast aging types. Using its 50th percentile as reference, we rescaled IMMAX to equivalent years-of-life (EYOL), and computed the immunological age gap as difference between EYOL and chronological age. Applied to preliminary baseline and follow-up measurements from 53 participants of the Dortmund Vital Study (Clinical-Trials.gov Identifier: NCT05155397), the averaged changes in IMMAX and EYOL conformed to the 5-year follow-up period, whereas no significant changes occurred concerning IMMAX centiles and age gap. This suggested that the participants immunologically adapted to aging, and kept their relative positions within the cohort. Sex was non-significant. Methodical comparisons indicated that future confirmatory analyses with the completed follow-up examinations could rely on percentile curves estimated by simple linear quantile regression, while the selection of the immunosenescence biomarker will greatly influence the outcome, with IMMAX representing the preferable choice.
Keywords: 
Subject: Biology and Life Sciences  -   Immunology and Microbiology

1. Introduction

Molecular biomarkers have their role besides other markers in characterizing biological age [1], and in particular the aging immune system [2]. The latter process, termed immunosenescence, describes the age-related deterioration of the immune system, which does not necessarily parallel chronological age [3]. Several simple markers, based on cell type frequencies of, e.g., natural killer (NK) and T-cells, total and memory/naïve sub-populations of CD4pos and CD8pos T-cells, or CD8pos CD28neg T-cells were proposed as immunosenescence biomarkers [4,5,6,7,8,9,10], while composite scores combine several markers for a comprehensive evaluation of immunological aging [11,12,13]. Among those, the immune age metric IMM-AGE [11] is considered as one of the most advanced immunosenescence biomarkers [14,15,16,17,18]. IMM-AGE was developed from individual longitudinal profiles of composite multi-omics data on blood cell phenotypes, functional tests with stimulated cells, and gene-expression analyses. In clinical and non-clinical settings, it has demonstrated its predictive capacity concerning cardiovascular disease and mortality [11], the risk of sepsis in trauma patients [19], the age-related decline in cardiorespiratory fitness [20] and work ability [21], and the efficacy of vaccination against SARS-CoV-2 [22]. Notably, all these application studies had to approximate the original IMM-AGE metric by a compatible set of gene expression or blood cell type data. Recently, we had established an approximation termed IMMAX (IMMune Age indeX) based on a small set of blood cell frequencies measured by flow cytometry, which enabled the estimation of IMM-AGE with reasonable accuracy in application studies [20,21].
Aging biomarkers, also termed aging clocks [1], are usually constructed in relation to or as predictors of chronological age, employing a variety of methods like simple linear regression, multivariate statistical models or machine learning algorithms [23]. For comparison to chronological age, they can be expressed as equivalent years-of-live (EYOL), defined as the chronological age of a reference exhibiting the same aging clock level [24]. The reference value is commonly chosen as typical for the population under consideration, e.g. as the age-specific mean or median (50th percentile), which in a simple approach could be derived by regressing the biomarker on chronological age [11]. Notably, this is analogous to the established concept of expressing multivariate indices of the thermal environment on an equivalent temperature scale [25]. Rescaling to commonly known units, i.e. years for biological or immunological aging similarly to using temperature concerning thermal stress, will not only facilitate the communication of research output to the public. It also allows for the categorization of individuals’ aging types (ageotypes) by defining age-specific reference intervals [26], and for the easy calculation of the age gap as the difference in years between the biological and chronological age [1]. Thus, when calculated with a biomarker of immune age, the age gap will represent the rate of immunological aging compared to a population reference, where positive age gap values indicate fast or accelerated aging, and negative values mark a slow or decelerated aging of an individual’s immune system independently from chronological age [1]. This could also ameliorate methodical issues regarding the multicollinearity induced by the correlation of immunosenescence biomarkers with chronological age in the analysis and design of aging studies [21]. However, corresponding data and schemes for deriving aging types from immunological biomarkers are lacking, specifically concerning the comprehensive metric IMMAX.
Therefore, in analogy to pediatric growth standards [27], we established age-adjusted reference centiles covering the adult age range for the immunosenescence biomarker IMMAX by fitting generalized additive models for location, scale and shape (GAMLSS) [28] and quantile regression models [29,30] to 1,605 observations. The data were pooled from the original IMM-AGE study [11], the Dortmund Vital Study (DVS) [20,31], and a study on the efficacy of vaccination against SARS-CoV-2 (VAC) [22]. With these IMMAX centiles, which were uncorrelated to chronological age by definition, we could define different levels of slow and fast aging types, rescale IMMAX as equivalent years-of-life (EYOL) and calculate immunological age gap values. We carried out methodical comparisons suggesting that the categorization into immunological aging types was independent from the different centile estimation algorithms, but heavily affected by the choice of the immunosenescence biomarker. While EYOL represents a rescaled version of the IMMAX biomarker, the age gap could be considered as a replacement for the IMMAX centiles expressed on a years-of-live scale, as both variables correlated almost perfectly and shared the independence from chronological age. When applied to preliminary longitudinal data from the ongoing Dortmund Vital Study (ClinicalTrials.gov Identifier: NCT05155397) [31], we observed changes from the baseline examinations after 5-years follow-up in IMMAX and EYOL, which were consistent in magnitude with the follow-up period length. The non-significant changes of the IMMAX centiles and the age gaps suggest that the participants kept their position within the cohort during follow-up. These preliminary results will require future confirmatory analyses with the completed follow-up examinations.

2. Results

As recently reported [20], the comprehensive immune age metric IMM-AGE was reasonably well approximated by IMMAX (Figure 1a). Although the age distributions were very heterogeneous between the three studies, the age-dependent increase in IMMAX was quite similar (Figure 1b), with our data filling the blank interval in the bimodal age distribution of the original IMM-AGE study [11], which had enrolled two distinct groups of young and very old adults. This justified pooling the three datasets for the subsequent centile estimation.

2.1. IMMAX Centile Estimation, Immunological Aging Types and Age Gap

Figure 1c visualizes the IMMAX distributions estimated by GAMLSS for selected values of chronological age. They did not only vary by location, as indicated by the curvilinear increase of the medians with age, but also by shape and spread. Whereas the IMMAX centiles correlated with the biomarker values via the age-dependent cumulative distribution functions (Figure 1d, right panel), they were uncorrelated with age by construction (Figure 1d, left panel). The resulting percentile curves in Figure 1e, with centiles chosen at intervals approximately 1 SD apart for a Gaussian distribution [27], provided reference intervals defining ordered categories of fast (or accelerated) and slow (or decelerated) immunological aging, respectively. Immune age on an equivalent years-of-life (EYOL) scale for given values of age and immune age biomarker IMMAX could then be defined as the chronological age yielding the identical IMMAX value on the reference curve, chosen as P50 (Figure 1e). Immunological age gap was then calculated as the difference between immune age and chronological age. Scatterplots in Figure 1f showed a perfect correlation between IMMAX and EYOL following the non-linear course of the reference curve P50, which had to be extrapolated to very high and even negative age for mapping the whole zero-to-one range of IMMAX to EYOL values (Figure A1 in Appendix A). IMMAX centiles almost perfectly correlated with the age gap, while the correlation of age gap with IMMAX mirrored the relation of IMMAX with the IMMAX centiles from Figure 1d. Thus, while EYOL is a re-scaled version of the biomarker IMMAX, the age gap almost perfectly substituted the IMMAX centiles, with negative values representing slow aging and positive age gaps indicating fast or accelerated immunological aging, respectively. Both the centiles and the age gap were uncorrelated with chronological age (Figure 1d, Figure 4b), confirming the independence of this characterization of immunological aging from chronological age.

2.2. Sensitivity to Centile Estimation Modelling Strategy

Individual centile values are not necessarily required for the determination of aging type and age gap, which rely on pre-specified percentile curves only (Figure 1e). Such curves defining reference intervals can be fitted by different modelling strategies in addition to GAMLSS, e.g., by linear quantile regression (LQR) [29] or non-parametric quantile regression (NQR) employing regression splines [30]. Figure 2a compares the resulting percentile curves for the three algorithms, which showed quite a similar trend in the low to median age range. At old age, the GAMLSS curves for high and low percentiles wriggled compared to the smooth curves for LQR and NQR, probably due to higher sensitivity of the GAMLSS algorithm to data sparsity at high age. These differences only had negligible consequences on aging type classification, as shown by Figure 2b, indicating that the different models classified the overwhelming proportion of individuals to identical aging types, with misclassifications only occurring between neighbored categories. Figure 2c quantifies this excellent agreement by values of Krippendorff’s α [32] above 0.9 for all comparisons. The corresponding results for the test data in Figure 2b&c corroborated the outcome for the more comprehensive training data.
The high agreement between the three modelling strategies for estimating percentile curves was confirmed when repeating the analyses for the five immune age biomarkers used for the calculation of IMMAX (Figure 3). On the other hand, concerning inter-biomarker agreement, Krippendorff’s α comparing aging type classification by the six biomarkers dropped to values below 0.2 independently from the chosen algorithm (Figure 3c, right panel), towards zero, which marks the expected coincidence of the ratings due to chance [32]. Bivariate correlation analysis (Figure 3b) revealed considerable heterogeneity between the rating algorithms, with ratings based on the memory-to-naïve ratio of CD8 cells similar to those using IMMAX, whereas close to zero, or even negative correlations with IMMAX based ratings occurred for the NK:T-cell and CD4:CD8-ratios, respectively.
Similarly to aging type rating, the alternative models could also be applied for defining reference curves, usually taken as the median (P50), when calculating EYOL and age gap. Figure A1 presents the resulting curves for linear quantile regression (LQR) additional to GAMLSS showing that with both approaches, the P50 curve needed extrapolation beyond the limits of adult age for determining EYOL over the whole zero-to-one range of the immune age biomarker IMMAX. For NQR, the extrapolation was not feasible due to the class of spline functions utilized by this model [30]. In search for an algorithm keeping EYOL values in the adult age range, we defined a hypothetical reference curve based on the IMMAX centiles calculated by GAMLSS (GAMLSS-HYP). Here, we assumed a percentile profile progressively increasing with age starting with the 0.5%-percentile at age of 19 years rising to the 99.5%-percentile at 99 years by 1.24% per year, with the minimum value (0) assigned to 18 years and the maximum (1) to 100 years of age (Figure A1). The resulting age gaps based on P50 from GAMLSS and LQR were almost perfectly correlated and exhibited a coinciding switch from negative to positive values (Figure 4a), while correlations for GAMLSS-HYP were lowered accompanied by a blurred transition from negative to positive age gaps (Figure 4a). In addition, the progressively increasing profile of reference percentiles in GAMLSS-HYP reduced the range of the corresponding age gap values compared to GAMLSS-P50 and LQR-P50, but induced a negative correlation with age (Figure 4b). On the other hand, similarly to the IMMAX centiles (Figure 1d), age gaps based on GAMLSS-P50 and LQR-P50 were uncorrelated with chronological age (Figure 4b). In any case, the outcomes for the test data matched and supported the results from the training data.

2.3. Application to Longitudinal Data from the Dortmund Vital Study

We applied our modelling to preliminary data from 53 participants (28 females, Table A2 in Appendix A) of the ongoing longitudinal Dortmund Vital Study (DVS, ClinicalTrials.gov Identifier: NCT05155397) [31], who had completed the baseline examinations and the first follow-up five years later. Longitudinal effects were expressed by the changes from baseline (Δ) in IMMAX, IMMAX centiles, EYOL and age gap, as summarized in Table A2. Notably, for a given follow-up period length (FPL in years), the changes from baseline in EYOL and age gap are algebraically linked by ΔEYOL= ΔAge gap + FPL.
IMMAX increased significantly after 5-years follow-up, whereas no significant change was observed for the centiles (Figure 5a, Table A2). These outcomes were mirrored on the years-of-life scale (Figure 5b) by significantly positive ΔEYOL and no significant change of the age gap. For 50th percentile reference curves (GAMLSS-P50, LQR-P50), values of ΔEYOL conformed to the 5-years follow-up period (Table A2). Although the corresponding changes for the hypothetical reference (GAMLSS-HYP) were lower compared to the other reference curves, these differences were not statistically significant (Figure 5b). In addition to the algebraic identity between ΔEYOL and ΔAge gap, changes from baseline (Δ) of IMMAX, IMMAX centiles, EYOL and age gap were highly correlated (Figure 5c). No significant sex effects could be established, neither concerning the correlation (Figure 5c), nor between the distributions of the longitudinal changes, which might be related to sample size limitations of these preliminary data (Figure 5d).

3. Discussion

By adopting concepts from pediatric growth-chart modelling [27], the age-adjusted centile estimation for the pooled molecular immunosenescence biomarker data enabled the characterization of the comprehensive immune age metric IMMAX in terms of fast or slow aging types covering the adult age range from 18 to 97 years. As the IMMAX centiles are uncorrelated with age by construction, they cannot be regarded as immune age biomarker, which have to correlate with age by definition [1,23]. Instead, the centiles represent the rate of aging of the individual immune system compared to a population reference independent of age [1], which helps mitigating issues concerning multicollinearity in analysis and design of prospective studies involving both immunosenescence biomarkers and chronological age [21]. In addition, the comparison of the biomarker values to a reference curve, commonly chosen as median curve P50 [1,11,23], facilitated rescaling of IMMAX as equivalent years-of-live EYOL and calculating the immunological age gap [1]. While EYOL is a rescaled version of the biomarker IMMAX, the age gap did not correlate with age, as did the IMMAX centiles, which in turn were almost perfectly correlated with the age gap. Thus, EYOL and age gap, both employing age as commonly known scale, may help communicating study outcomes concerning the biomarker IMMAX and the IMMAX centiles, respectively, to other researchers or to the public and policy makers. Notably, this is consistent with the established concept of expressing multivariate indices of the thermal environment on an equivalent temperature scale [25].
The preliminary longitudinal data from the DVS featured the complemental use of these metrics with the observed change in IMMAX corresponding to the 5-year follow-up period when expressed as EYOL, facilitating the interpretation that, immunologically, the sample aged as expected given the length of the follow-up period. On the other hand, the non-significant changes in the values of the IMMAX centiles and age gap indicate that, with respect to immunological aging, the individuals kept their relative positions in the cohort. Summarized, this might suggest the interpretation of the observed changes as an adaptation to the aging process during the follow-up period, rather than as dysregulation of the immune system, which might be associated with individual excessive alterations contributing to the observed inter-individual variability [33,34].
However, due to the limited sample size these preliminary findings will require confirmatory analyses with the completed follow-up examinations, which might also aim at explaining the considerable inter-individual variability in immunological aging in relation to the personal, behavioral, environmental and work-related data gathered in the DVS [31]. The methodological comparisons performed in our study suggest that such future analyses could rely on the simpler approach involving linear quantile regression (LQR), while the selection of the immune age biomarker will require careful consideration, where the comprehensive IMMAX metric deems preferable to single molecular immunosenescence biomarkers.

4. Materials and Methods

4.1. Data Sets

Aiming at a comprehensive database for estimating age-depending centiles of immunosenescence biomarkers, we combined the published raw data from the IMM-AGE study (N=434) [11] with corresponding own measurements from the baseline examinations of the ongoing longitudinal Dortmund Vital Study (DVS, N=597) [20] and a recent study concerning the efficacy of vaccination against SARS-CoV-2 (VAC, N=574) [22]. The pooled sample comprised 1,605 participants aged 18 to 97 years of age. We did not consider sex as modifying factor because it was not available for the IMM-AGE data. For evaluating the centile estimation models, another independent set of 125 observations, mostly from firefighters [35], was augmented by 25 observations obtained from the pooled data by age-stratified subsampling. Thus, the training data for model development comprised N=1,580 participants, while the test data sample size was 150. Table A1 in Appendix A presents the characteristics of the training and test data concerning the distribution of age and immunosenescence biomarkers determined by flow cytometry as described below.

4.2. Molecular Biomarkers of Immunosenescence by Flow Cytometry

A set of relative blood cell frequencies related to aging and senescence (NK- and T-cells, total and memory/naïve sub-populations of CD4pos and CD8pos T-cells, CD8pos CD28neg T-cells) had been published as supplemental data to the IMM-AGE study [11]. For both the DVS and VAC sample, we determined those parameters by flow cytometry as detailed elsewhere [20,36]. All antibodies were individually titrated to determine the optimal dilution, as shown in Table 1. Briefly, for the DVS sample, we collected peripheral venous blood from the participants in heparinized monovettes (Sarstedt, Nümbrecht, Germany), isolated peripheral blood mononuclear cells (PBMC) by Ficoll density gradient centrifugation (PAN-Biotech, Aidenbach, Germany), and stored the cells at −170 °C for up to 6 months. Immediately after thawing for analysis, PBMC were kept on ice during the entire staining procedure. We stained 0.2 × 106 cells with the indicated antibody cocktails for 20 min in the dark at 4 °C and subsequently washed them with FACS buffer (PBS/2% FCS). Cells were resuspended in FACS buffer. For the VAC sample, peripheral venous blood was taken in EDTA-monovettes (Sarstedt, Nümbrecht, Germany) and 100 µl whole blood were stained directly for the markers indicated in Table 1. Subsequently, samples were subjected to erythrocyte lysis, washed and resuspended in FACS buffer. All samples were kept on ice until analysis at the same day on a BD LSRFortessa. Figure 6 displays the gating strategy with antibody panels for analyzing the lymphocytes for NK:T cell ratio, CD4:CD8 T cell ratio, memory:naïve sub-populations of CD4pos and CD8pos T cells, and CD28neg CD8pos T cells. Relative cell frequencies were determined using the FlowJo software (FlowJo LLC, Ashland, OR, USA).

4.3. Data Analysis and Statistics

As described previously [20], we approximated the comprehensive immune age metric IMM-AGE by IMMAX (IMMune Age indeX), which was estimated by principal component regression utilizing as predictors the flow cytometry-based relative blood cell frequencies (Table A1). With the training data, we estimated age-specific IMMAX centiles by fitting generalized additive models for location, scale and shape (GAMLSS) [28,37]. From the centiles, we calculated reference curves PXX, with XX (=03, 15, 50, 85, 97) denoting the XXth percentiles chosen at intervals approximately 1 SD apart, thus covering in range the mean ± 2 SD for a Gaussian distribution [27]. For comparison, we computed the reference percentile curves PXX applying linear quantile regression (LQR) [29,38] and nonparametric quantile regression (NQR) utilizing penalized regression splines [30,39]. The reference intervals defined by the resulting PXX curves were utilized to classify the individuals to different levels of slow (below the median curve P50) or fast (above P50) immunological aging. The agreement between the different aging type rating algorithms in relation to the modelling strategies (GAMLSS, LQR, NQR) and the immune age biomarkers was evaluated by Spearman’s correlation coefficient (ρ), and by Krippendorff’s α [32,40]. The latter is defined as α=1-Do/De, with Do denoting the proportion of disagreement observed in the sample and De the corresponding proportion expected by chance assignments of aging types. Thus, α=1 will indicate perfect agreement, while α=0 represents the agreement due to chance. Finally, we rescaled the immune age biomarker IMMAX as equivalent years-of-life (EYOL), defined as the chronological age, for which the reference curve, commonly chosen as P50, exhibits the identical IMMAX value. We calculated EYOL utilizing different reference population, i.e., P50 calculated with GAMLSS and LQR, and in comparison to a hypothetical reference (HYP) characterized by the GAMLSS percentiles progressively increasing from the minimum to maximum with age. The difference between EYOL and chronological age then defines the immunological age gap, with positive values indicating fast or accelerated aging, and negative values referring to slow or decelerated aging.

4.4. Preliminary Longitudinal Data from the Dortmund Vital Study

We illustrate the application of our modelling approach using preliminary longitudinal data comprising the immune age IMMAX from the first 53 participants of the DVS [31], who had completed the baseline examinations and the first follow-ups five years later. Wilcoxon paired sample tests and correlation analyses were utilized to assess the change from baseline of IMMAX and IMMAX centiles, as well as of EYOL and age gap determined by different reference curves (GAMLSS-P50, LQR-P50, GAMLSS-HYP). In addition, we compared the distribution of these quantities between the 28 female and 25 male participants by Wilcoxon tests for independent samples.
All calculations were performed using the R version 4.3.1 (R Core Team, Vienna, Austria) [41]. The analysis scripts and data for reproducing the results of this study are available at the source provided below in the ‘Data Availability Statement’.

Supplementary Materials

Not applicable.

Author Contributions

Conceptualization, P.B., C.W. and E.W.; methodology, P.B.; software, P.B.; validation, C.M., P.G. and S.G.; formal analysis, P.B.; investigation, C.M.; resources, E.W. and C.W.; data curation, P.B., C.M., and P.G.; writing—original draft preparation, P.B., C.M. and C.W.; writing—review and editing, P.G., S.G. and E.W.; visualization, P.B. and C.M.; supervision, E.W. and C.W.; project administration, P.G. and S.G.; funding acquisition, E.W. and C.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The IfADo studies (DVS, VAC) were conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Ethics Committee of IfADo as detailed in the published study protocol [31].

Informed Consent Statement

Informed consent was obtained from all subjects involved in the IfADo studies (DVS, VAC) as detailed in the published study protocol [31].

Data Availability Statement

The data and analysis scripts for reproducing the results presented in this study are stored in a repository for download. The private link provided for peer review will be replaced by a public permanent identifier (doi) following acceptance of the manuscript for publication.

Acknowledgments

We like to thank the authors of the original IMM-AGE study [11] for publishing their raw data as valuable data source.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

The appendix provides Figure A1: Rescaling IMMAX to equivalent-years-of-life (EYOL) utilizing different reference curves; Table A1: Characteristics of the training and test data; Table A2: Preliminary longitudinal data from 53 participants of the Dortmund Vital Study (DVS).
Figure A1. Rescaling IMMAX to equivalent-years-of-life (EYOL) utilizing different reference curves; defined as 50th percentile (P50) estimated by GAMLSS and LQR, respectively, or assuming a hypothetical reference with percentiles gradually progressing with age (GAMLSS-HYP), on rescaling IMMAX to equivalent-years-of-life. Question marks (‘?’) in the left panel indicate the potential need for extrapolating GAMLSS-P50 and LQR-P50 curves for finding such values, resulting for these references in unnatural ranges of equivalent-years of life in the grey-shaded regions of the right panel.
Figure A1. Rescaling IMMAX to equivalent-years-of-life (EYOL) utilizing different reference curves; defined as 50th percentile (P50) estimated by GAMLSS and LQR, respectively, or assuming a hypothetical reference with percentiles gradually progressing with age (GAMLSS-HYP), on rescaling IMMAX to equivalent-years-of-life. Question marks (‘?’) in the left panel indicate the potential need for extrapolating GAMLSS-P50 and LQR-P50 curves for finding such values, resulting for these references in unnatural ranges of equivalent-years of life in the grey-shaded regions of the right panel.
Preprints 81527 g0a1
Table A1. Characteristics of the training and test data. Mean ± SD (range in brackets) of age and of molecular biomarkers of immune age utilized in calculating IMMAX (IMMune Age indeX).
Table A1. Characteristics of the training and test data. Mean ± SD (range in brackets) of age and of molecular biomarkers of immune age utilized in calculating IMMAX (IMMune Age indeX).
Characteristic Training data
N = 1,580
Test data
N = 150
Age (years) 51 ± 20
(18, 97)
45 ± 16
(21, 93)
IMMAX 0.47 ± 0.14
(0.12, 0.98)
0.44 ± 0.13
(0.17, 0.85)
log (%memory / %naive) CD8 -1.51 ± 0.77
(-8.17, 0.87)
-1.44 ± 0.68
(-4.23, 0.03)
log (%memory / %naive) CD4 1.17 ± 0.60
(-1.22, 4.32)
1.11 ± 0.50
(0.06, 2.84)
logit (%CD8 CD28neg) 0.55 ± 1.40
(-4.23, 13.81)
0.31 ± 1.16
(-2.30, 4.48)
log (%NK / %T) 0.57 ± 0.84
(-2.08, 5.43)
0.43 ± 0.73
(-1.40, 3.42)
log (%CD4 / %CD8) -1.05 ± 1.09
(-5.26, 1.94)
-1.28 ± 1.00
(-3.80, 1.07)
CD8: CD8+ T-cells; CD4: CD4+ T-cells; CD8 CD28neg: CD28 CD8+T-cells; NK: natural killer cells; T: T-cells.
Table A2. Preliminary longitudinal data from 53 participants of the Dortmund Vital Study (DVS). Distribution of sex and age at baseline as well as changes from baseline after 5-years follow-up (Δ) of the immune age index IMMAX, IMMAX centiles, immune age as equivalent years of life (EYOL), and immunological age gap. EYOL and age gap were derived from IMMAX with different reference curves defined as 50th percentile (P50) estimated by GAMLSS and LQR, respectively, or assuming a hypothetical reference with gradually progressing percentiles (GAMLSS-HYP). Categorical data are summarized by n (%), continuous data by mean ± SD, with 95%-confidence intervals (CI).
Table A2. Preliminary longitudinal data from 53 participants of the Dortmund Vital Study (DVS). Distribution of sex and age at baseline as well as changes from baseline after 5-years follow-up (Δ) of the immune age index IMMAX, IMMAX centiles, immune age as equivalent years of life (EYOL), and immunological age gap. EYOL and age gap were derived from IMMAX with different reference curves defined as 50th percentile (P50) estimated by GAMLSS and LQR, respectively, or assuming a hypothetical reference with gradually progressing percentiles (GAMLSS-HYP). Categorical data are summarized by n (%), continuous data by mean ± SD, with 95%-confidence intervals (CI).
Preprints 81527 i001

References

  1. Rutledge, J.; Oh, H.; Wyss-Coray, T. Measuring biological age using omics data. Nature Reviews Genetics 2022. [CrossRef]
  2. Miller, R.A. The Aging Immune System: Primer and Prospectus. Science 1996, 273, 70-74. [CrossRef]
  3. Fulop, T.; Larbi, A.; Dupuis, G.; Le Page, A.; Frost, E.H.; Cohen, A.A.; Witkowski, J.M.; Franceschi, C. Immunosenescence and Inflamm-Aging As Two Sides of the Same Coin: Friends or Foes? Frontiers in Immunology 2018, 8, 1960. [CrossRef]
  4. Gayoso, I.; Sanchez-Correa, B.; Campos, C.; Alonso, C.; Pera, A.; Casado, J.G.; Morgado, S.; Tarazona, R.; Solana, R. Immunosenescence of human natural killer cells. J Innate Immun 2011, 3, 337-343. [CrossRef]
  5. Ligotti, M.E.; Aiello, A.; Accardi, G.; Aprile, S.; Bonura, F.; Bulati, M.; Gervasi, F.; Giammanco, G.M.; Pojero, F.; Zareian, N., et al. Analysis of T and NK cell subsets in the Sicilian population from young to supercentenarian: The role of age and gender. Clin Exp Immunol 2021, 205, 198-212. [CrossRef]
  6. Pangrazzi, L.; Weinberger, B. T cells, aging and senescence. Experimental Gerontology 2020, 134, 110887. [CrossRef]
  7. Huff, W.X.; Kwon, J.H.; Henriquez, M.; Fetcko, K.; Dey, M. The Evolving Role of CD8+CD28− Immunosenescent T Cells in Cancer Immunology. International Journal of Molecular Sciences 2019, 20, 2810. [CrossRef]
  8. Zhang, H.; Weyand, C.M.; Goronzy, J.J. Hallmarks of the aging T-cell system. The FEBS Journal 2021. [CrossRef]
  9. Fagnoni, F.F.; Vescovini, R.; Passeri, G.; Bologna, G.; Pedrazzoni, M.; Lavagetto, G.; Casti, A.; Franceschi, C.; Passeri, M.; Sansoni, P. Shortage of circulating naive CD8+ T cells provides new insights on immunodeficiency in aging. Blood 2000, 95, 2860-2868. [CrossRef]
  10. Garrido-Rodríguez, V.; Herrero-Fernández, I.; Castro, M.J.; Castillo, A.; Rosado-Sánchez, I.; Galvá, M.I.; Ramos, R.; Olivas-Martínez, I.; Bulnes-Ramos, Á.; Cañizares, J., et al. Immunological features beyond CD4/CD8 ratio values in older individuals. Aging (Albany NY) 2021, 13, 13443-13459. [CrossRef]
  11. Alpert, A.; Pickman, Y.; Leipold, M.; Rosenberg-Hasson, Y.; Ji, X.; Gaujoux, R.; Rabani, H.; Starosvetsky, E.; Kveler, K.; Schaffert, S., et al. A clinically meaningful metric of immune age derived from high-dimensional longitudinal monitoring. Nature Medicine 2019, 25, 487-495. [CrossRef]
  12. Sayed, N.; Huang, Y.; Nguyen, K.; Krejciova-Rajaniemi, Z.; Grawe, A.P.; Gao, T.; Tibshirani, R.; Hastie, T.; Alpert, A.; Cui, L., et al. An inflammatory aging clock (iAge) based on deep learning tracks multimorbidity, immunosenescence, frailty and cardiovascular aging. Nature Aging 2021, 1, 598-615. [CrossRef]
  13. Rizzo, L.B.; Swardfager, W.; Maurya, P.K.; Graiff, M.Z.; Pedrini, M.; Asevedo, E.; Cassinelli, A.C.; Bauer, M.E.; Cordeiro, Q.; Scott, J., et al. An immunological age index in bipolar disorder: A confirmatory factor analysis of putative immunosenescence markers and associations with clinical characteristics. International Journal of Methods in Psychiatric Research 2018, 27, e1614. [CrossRef]
  14. Ramasubramanian, R.; Meier, H.C.S.; Vivek, S.; Klopack, E.; Crimmins, E.M.; Faul, J.; Nikolich-Žugich, J.; Thyagarajan, B. Evaluation of T-cell aging-related immune phenotypes in the context of biological aging and multimorbidity in the Health and Retirement Study. Immunity & Ageing 2022, 19, 33. [CrossRef]
  15. Guerville, F.; De Souto Barreto, P.; Ader, I.; Andrieu, S.; Casteilla, L.; Dray, C.; Fazilleau, N.; Guyonnet, S.; Langin, D.; Liblau, R., et al. Revisiting the Hallmarks of Aging to Identify Markers of Biological Age. The Journal of Prevention of Alzheimer's Disease 2020, 7, 56-64. [CrossRef]
  16. Frasca, D.; Diaz, A.; Romero, M.; Garcia, D.; Blomberg, B.B. B Cell Immunosenescence. Annual Review of Cell and Developmental Biology 2020, 36, 551-574. [CrossRef]
  17. Xu, W.; Wong, G.; Hwang, Y.Y.; Larbi, A. The untwining of immunosenescence and aging. Seminars in Immunopathology 2020, 42, 559-572. [CrossRef]
  18. Pawelec, G. The human immunosenescence phenotype: does it exist? Seminars in Immunopathology 2020, 42, 537-544. [CrossRef]
  19. Foster, M.A.; Bentley, C.; Hazeldine, J.; Acharjee, A.; Nahman, O.; Shen-Orr, S.S.; Lord, J.M.; Duggal, N.A. Investigating the potential of a prematurely aged immune phenotype in severely injured patients as predictor of risk of sepsis. Immunity & Ageing 2022, 19, 60. [CrossRef]
  20. Bröde, P.; Claus, M.; Gajewski, P.D.; Getzmann, S.; Golka, K.; Hengstler, J.G.; Wascher, E.; Watzl, C. Calibrating a Comprehensive Immune Age Metric to Analyze the Cross Sectional Age-Related Decline in Cardiorespiratory Fitness. Biology (Basel) 2022, 11, 1576. [CrossRef]
  21. Gajewski, P.D.; Rieker, J.A.; Athanassiou, G.; Bröde, P.; Claus, M.; Golka, K.; Hengstler, J.G.; Kleinsorge, T.; Nitsche, M.A.; Reinders, J., et al. A Systematic Analysis of Biological, Sociodemographic, Psychosocial, and Lifestyle Factors Contributing to Work Ability Across the Working Life Span: Cross-sectional Study. JMIR Form Res 2023, 7, e40818. [CrossRef]
  22. Claus, M.; Bröde, P.; Urlaub, D.; Wolfsdorff, N.; Watzl, C. Investigation of the relationship between Immune Age and Vaccination against SARS-CoV-2. European Journal of Immunology 2022, 52, 168.
  23. Bafei, S.E.C.; Shen, C. Biomarkers selection and mathematical modeling in biological age estimation. npj Aging 2023, 9, 13. [CrossRef]
  24. Verschoor, C.P.; Belsky, D.W.; Andrew, M.K.; Haynes, L.; Loeb, M.; Pawelec, G.; McElhaney, J.E.; Kuchel, G.A. Advanced biological age is associated with improved antibody responses in older high-dose influenza vaccine recipients over four consecutive seasons. Immunity & Ageing 2022, 19, 39. [CrossRef]
  25. Bröde, P.; Fiala, D.; Blazejczyk, K.; Holmér, I.; Jendritzky, G.; Kampmann, B.; Tinz, B.; Havenith, G. Deriving the operational procedure for the Universal Thermal Climate Index (UTCI). International Journal of Biometeorology 2012, 56, 481-494. [CrossRef]
  26. Ahadi, S.; Zhou, W.; Schüssler-Fiorenza Rose, S.M.; Sailani, M.R.; Contrepois, K.; Avina, M.; Ashland, M.; Brunet, A.; Snyder, M. Personal aging markers and ageotypes revealed by deep longitudinal profiling. Nature Medicine 2020, 26, 83-90. [CrossRef]
  27. WHO Multicentre Growth Reference Study Group; de Onis, M. WHO Child Growth Standards based on length/height, weight and age. Acta Paediatrica 2006, 95, 76-85. [CrossRef]
  28. Rigby, R.A.; Stasinopoulos, D.M. Generalized additive models for location, scale and shape. Journal of the Royal Statistical Society: Series C (Applied Statistics) 2005, 54, 507-554. [CrossRef]
  29. Koenker, R.W.; D'Orey, V. Computing Regression Quantiles. Journal of the Royal Statistical Society. Series C (Applied Statistics) 1987, 36, 383-393. [CrossRef]
  30. Muggeo, V.M.R.; Torretta, F.; Eilers, P.H.C.; Sciandra, M.; Attanasio, M. Multiple smoothing parameters selection in additive regression quantiles. Statistical Modelling 2021, 21, 428-448. [CrossRef]
  31. Gajewski, P.D.; Getzmann, S.; Bröde, P.; Burke, M.; Cadenas, C.; Capellino, S.; Claus, M.; Genç, E.; Golka, K.; Hengstler, J.G., et al. Impact of Biological and Lifestyle Factors on Cognitive Aging and Work Ability in the Dortmund Vital Study: Protocol of an Interdisciplinary, Cross-sectional, and Longitudinal Study. JMIR Res Protoc 2022, 11, e32352. [CrossRef]
  32. Hayes, A.F.; Krippendorff, K. Answering the Call for a Standard Reliability Measure for Coding Data. Communication Methods and Measures 2007, 1, 77-89. [CrossRef]
  33. Pawelec, G. Hallmarks of human “immunosenescence”: adaptation or dysregulation? Immunity & Ageing 2012, 9, 15. [CrossRef]
  34. Ogrodnik, M.; Gladyshev, V.N. The meaning of adaptation in aging: insights from cellular senescence, epigenetic clocks and stem cell alterations. Nature Aging 2023, 3, 766-775. [CrossRef]
  35. Bröde, P.; Claus, M.; Urlaub, D.; Wolfsdorff, N.; Watzl, C. Immune age: the feminine side of firemen? In Proceedings of 10th European Conference on Protective Clothing, Arnhem, The Netherlands, 9–12 May 2023; pp. 156-157.
  36. Claus, M.; Dychus, N.; Ebel, M.; Damaschke, J.; Maydych, V.; Wolf, O.T.; Kleinsorge, T.; Watzl, C. Measuring the immune system: a comprehensive approach for the analysis of immune functions in humans. Archives of Toxicology 2016, 90, 2481-2495. [CrossRef]
  37. Stasinopoulos, M.D.; Rigby, R.A.; Bastiani, F.D. GAMLSS: A distributional regression approach. Statistical Modelling 2018, 18, 248-273. [CrossRef]
  38. Koenker, R.W. quantreg: Quantile Regression. R package version 5.95. 2023. Availabe online: https://CRAN.R-project.org/package=quantreg (accessed on 2023-07-19).
  39. Muggeo, V.M.R.; Sciandra, M.; Tomasello, A.; Calvo, S. Estimating growth charts via nonparametric quantile regression: a practical framework with application in ecology. Environmental and Ecological Statistics 2013, 20, 519-531. [CrossRef]
  40. Krippendorff, K. Computing Krippendorff's Alpha Reliability; Penn collection, Departmental Papers (ASC) 43; University of Pennsylvania: Philadelphia, 2011. Availabe online: https://repository.upenn.edu/handle/20.500.14332/2089 (accessed on 2023-07-15).
  41. R Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing: Vienna, Austria, 2023. Availabe online: https://www.R-project.org/ (accessed on 2023-07-09).
Figure 1. Moving from immune age biomarkers to aging type and age gap definition. (a) Approximation of the comprehensive IMM-AGE metric [11] by the IMMune Age indeX IMMAX [20], with dashed line of identity, Pearson correlation coefficient (R) and root-mean-squared prediction error (RMSE). (b) IMMAX related to age with regression lines in the IMM-AGE study, Dortmund Vital Study (DVS) and vaccination study (VAC), respectively, and with the age distributions from the three study groups overlaid on top. (c) IMMAX distribution conditional on age with the line connecting the median values estimated for the pooled training data (N=1,580) by a generalized additive model for location, scale and shape (GAMLSS). (d) IMMAX centiles estimated by GAMLSS in relation to age and IMMAX, respectively. (e) Percentile curves (PXX, XX denoting the percentile) estimated by GAMLSS for the rating of IMMAX values into six aging type categories and for re-scaling IMMAX to equivalent years of life (EYOL) with the median curve (P50) as reference, and the immunological age gap defined by the difference between EYOL and chronological age. (f) Spearman rank correlations (ρ) of IMMAX and IMMAX centiles with EYOL and age gap, respectively.
Figure 1. Moving from immune age biomarkers to aging type and age gap definition. (a) Approximation of the comprehensive IMM-AGE metric [11] by the IMMune Age indeX IMMAX [20], with dashed line of identity, Pearson correlation coefficient (R) and root-mean-squared prediction error (RMSE). (b) IMMAX related to age with regression lines in the IMM-AGE study, Dortmund Vital Study (DVS) and vaccination study (VAC), respectively, and with the age distributions from the three study groups overlaid on top. (c) IMMAX distribution conditional on age with the line connecting the median values estimated for the pooled training data (N=1,580) by a generalized additive model for location, scale and shape (GAMLSS). (d) IMMAX centiles estimated by GAMLSS in relation to age and IMMAX, respectively. (e) Percentile curves (PXX, XX denoting the percentile) estimated by GAMLSS for the rating of IMMAX values into six aging type categories and for re-scaling IMMAX to equivalent years of life (EYOL) with the median curve (P50) as reference, and the immunological age gap defined by the difference between EYOL and chronological age. (f) Spearman rank correlations (ρ) of IMMAX and IMMAX centiles with EYOL and age gap, respectively.
Preprints 81527 g001
Figure 2. Influence of centile estimation models on the rating of immune aging types. (a) Age-depending percentile curves (PXX, with XX denoting the percentile) for IMMAX with corresponding aging types estimated by GAMLSS, linear (LQR) and non-parametric quantile regression (NQR), respectively. (b) Confusion matrices with the proportion (prop) of immune aging type combinations rated by GAMLSS compared to the quantile regression models LQR and NQR, respectively, for the training (upper panel) and test data (lower panel). (c) Krippendorff’s α with error bars indicating 95%-CI for assessing the agreement between the immune aging types rated by pairwise and triple combinations of the different models for both training and test data.
Figure 2. Influence of centile estimation models on the rating of immune aging types. (a) Age-depending percentile curves (PXX, with XX denoting the percentile) for IMMAX with corresponding aging types estimated by GAMLSS, linear (LQR) and non-parametric quantile regression (NQR), respectively. (b) Confusion matrices with the proportion (prop) of immune aging type combinations rated by GAMLSS compared to the quantile regression models LQR and NQR, respectively, for the training (upper panel) and test data (lower panel). (c) Krippendorff’s α with error bars indicating 95%-CI for assessing the agreement between the immune aging types rated by pairwise and triple combinations of the different models for both training and test data.
Preprints 81527 g002
Figure 3. Influence of centile estimation models and choice of biomarker on immune aging types. (a) Age-depending percentile curves (PXX, with XX denoting the percentile) estimated by GAMLSS, linear (LQR) and non-parametric quantile regression (NQR) for the five immunosenescence biomarkers predicting IMMAX: the cell frequency ratios of memory to naïve CD4 and CD8 T-cells, respectively, of NK- to T-cells, of CD4pos to CD8pos T-cells, and the frequency of CD28neg-CD8pos T-cells. (b) Bivariate Spearman rank correlations (ρ) between the immune aging types rated by 18 algorithms R1-R18 (6 biomarkers × 3 models) for the training data (upper triangular matrix) and test data (lower triangular matrix). (c) Krippendorff’s α assessing the agreement between the immune aging type rating by the different models for the six biomarkers (left panel), as well as by the different biomarkers in relation to the three models (right panel), for both training and test data.
Figure 3. Influence of centile estimation models and choice of biomarker on immune aging types. (a) Age-depending percentile curves (PXX, with XX denoting the percentile) estimated by GAMLSS, linear (LQR) and non-parametric quantile regression (NQR) for the five immunosenescence biomarkers predicting IMMAX: the cell frequency ratios of memory to naïve CD4 and CD8 T-cells, respectively, of NK- to T-cells, of CD4pos to CD8pos T-cells, and the frequency of CD28neg-CD8pos T-cells. (b) Bivariate Spearman rank correlations (ρ) between the immune aging types rated by 18 algorithms R1-R18 (6 biomarkers × 3 models) for the training data (upper triangular matrix) and test data (lower triangular matrix). (c) Krippendorff’s α assessing the agreement between the immune aging type rating by the different models for the six biomarkers (left panel), as well as by the different biomarkers in relation to the three models (right panel), for both training and test data.
Preprints 81527 g003
Figure 4. Influence of reference curves, defined as 50th percentile (P50) estimated by GAMLSS and LQR, respectively, or assuming a hypothetical reference with percentiles gradually progressing with age (GAMLSS-HYP), on immunological age gap. Spearman rank correlations (ρ) for training and test data (a) between age gaps defined by three reference curves, and (b) of age gap vs. chronological age with overlaid smoothing splines.
Figure 4. Influence of reference curves, defined as 50th percentile (P50) estimated by GAMLSS and LQR, respectively, or assuming a hypothetical reference with percentiles gradually progressing with age (GAMLSS-HYP), on immunological age gap. Spearman rank correlations (ρ) for training and test data (a) between age gaps defined by three reference curves, and (b) of age gap vs. chronological age with overlaid smoothing splines.
Preprints 81527 g004
Figure 5. Preliminary longitudinal data from the DVS. (a) Baseline and follow-up values from 53 participants of IMMAX (upper panel) and IMMAX centiles (lower panel) with statistical significance assessed by the Wilcoxon paired sample test. (b) Change from baseline of equivalent years of life (ΔEYOL) derived from IMMAX with different reference curves defined as 50th percentile estimated by GAMLSS and LQR, respectively, or assuming a hypothetical reference with percentiles gradually progressing with age (GAMLSS-HYP). Triangles and error bars indicate means with 95%-CI, the dashed horizontal line marks the 5 years follow-up period, corresponding to the zero-value for the change in age gap (ΔAge gap). Pairwise statistical comparison by Wilcoxon paired sample test adjusted for multiple testing. (c) Pairwise scatterplots with Spearman correlation coefficients (ρ) for the change from baseline (Δ) in IMMAX, IMMAX centile, and EYOL calculated with the GAMLSS-P50 reference; (d) Density plots comparing the female and male distributions of ΔIMMAX (left panel, with upper horizontal axis showing the linearly rescaled equivalent years of life ΔEYOLLQR-P50), and ΔIMMAX centiles (right panel). Vertical dot-dashed lines indicate medians by sex; solid lines mark zero effects. Statistical comparisons by independent-sample Wilcoxon test.
Figure 5. Preliminary longitudinal data from the DVS. (a) Baseline and follow-up values from 53 participants of IMMAX (upper panel) and IMMAX centiles (lower panel) with statistical significance assessed by the Wilcoxon paired sample test. (b) Change from baseline of equivalent years of life (ΔEYOL) derived from IMMAX with different reference curves defined as 50th percentile estimated by GAMLSS and LQR, respectively, or assuming a hypothetical reference with percentiles gradually progressing with age (GAMLSS-HYP). Triangles and error bars indicate means with 95%-CI, the dashed horizontal line marks the 5 years follow-up period, corresponding to the zero-value for the change in age gap (ΔAge gap). Pairwise statistical comparison by Wilcoxon paired sample test adjusted for multiple testing. (c) Pairwise scatterplots with Spearman correlation coefficients (ρ) for the change from baseline (Δ) in IMMAX, IMMAX centile, and EYOL calculated with the GAMLSS-P50 reference; (d) Density plots comparing the female and male distributions of ΔIMMAX (left panel, with upper horizontal axis showing the linearly rescaled equivalent years of life ΔEYOLLQR-P50), and ΔIMMAX centiles (right panel). Vertical dot-dashed lines indicate medians by sex; solid lines mark zero effects. Statistical comparisons by independent-sample Wilcoxon test.
Preprints 81527 g005
Figure 6. Gating strategy for derivation of immunosenescence biomarkers by flow cytometry. EDTA blood was stained with a Fixable Viability Dye (FVD) and for the indicated markers, which were calculated from relative cell frequencies: ratios of NK- to T-cells, of CD4pos to CD8pos T-cells, of memory to naïve CD4 and CD8 T-cells, respectively, and the frequency of CD28neg-CD8pos T-cells.
Figure 6. Gating strategy for derivation of immunosenescence biomarkers by flow cytometry. EDTA blood was stained with a Fixable Viability Dye (FVD) and for the indicated markers, which were calculated from relative cell frequencies: ratios of NK- to T-cells, of CD4pos to CD8pos T-cells, of memory to naïve CD4 and CD8 T-cells, respectively, and the frequency of CD28neg-CD8pos T-cells.
Preprints 81527 g006
Table 1. Materials for PBMC staining, including antigens, antibody clones and coupled fluorochromes, distributors and antibody dilution used to stain 0.2 × 106 PBMC (DVS) or 100 µl whole blood (VAC).
Table 1. Materials for PBMC staining, including antigens, antibody clones and coupled fluorochromes, distributors and antibody dilution used to stain 0.2 × 106 PBMC (DVS) or 100 µl whole blood (VAC).
Sample Antigen Clone Fluorochrome Company Dilution 1/x
DVS live / dead zombie Yellow Biolegend 1000
CD3 UCHT1 BV510 BD Horizon™ 400
CD56 B159 PE-CF594 BD Pharmingen™ 100
CD4 RPA-T4 APC-H7 BD Pharmingen™ 100
CD8 RPA-T8 FITC BD Pharmingen™ 200
CD197 (CCR7) 150503 Alexa Fluor® 647 BD Pharmingen™ 50
CD45RA HI100 Alexa Fluor® 700 BD Pharmingen™ 400
CD28 CD28.2 PerCP-Cy™5.5 BD Pharmingen™ 100
VAC live / dead Fixable Viability Dye eFluor™ 780 ThermoFisher Scientific 400
CD3 UCHT1 BV510 BD Horizon™ 100
CD56 B159 PE-Cy™5 BD Pharmingen™ 50
CD4 RPA-T4 BV421 BD Horizon™ 100
CD8 RPA-T8 BB515 BD Horizon™ 400
CD197 (CCR7) 3D12 PE BD Pharmingen™ 100
CD45RA HI100 Alexa Fluor® 700 BD Pharmingen™ 100
CD28 CD28.2 PerCP-Cy™5.5 BD Pharmingen™ 100
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.
Prerpints.org logo

Preprints.org is a free preprint server supported by MDPI in Basel, Switzerland.

Subscribe

© 2024 MDPI (Basel, Switzerland) unless otherwise stated