Survival analysis : from basic concepts to open research questions
Ecole d’été, Villars-sur-Ollon, 2-5 September 2018 Ingrid Van Keilegom
ORSTAT – KU Leuven
Survival analysis : from basic concepts to open research questions - - PowerPoint PPT Presentation
Survival analysis : from basic concepts to open research questions Ecole dt, Villars-sur-Ollon, 2-5 September 2018 Ingrid Van Keilegom ORSTAT KU Leuven Table of Contents Basic concepts 1 Basic concepts Cure models Introduction
ORSTAT – KU Leuven
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
1 Basic concepts 2 Cure models
3 Dependent censoring
4 Measurement errors
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
the data into account.
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
disease
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
∆t→0
∆t→0
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
5 10 15 20 2 4 6 8 10
Hazard functions of different shapes
Time Hazard Exponential Weibull, rho=0.5 Weibull, rho=1.5 Bathtub
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
– end of study – lost to follow up – competing event (e.g. death due to some cause other than the cause of interest) – patient withdrawing from the study, change of treatment, ...
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Table: Data of first 6 patients in HIV study
Patient id Entry Date Date last seen Status Time Censoring 1 18 March 2005 20 June 2005 Dropped out 3 2 19 Sept 2006 20 March 2007 Dead due to AIDS 6 1 3 15 May 2006 16 Oct 2006 Dead due to accident 5 4 01 Dec 2005 31 Dec 2008 Alive 37 5 9 Apr 2005 10 Feb 2007 Dead due to AIDS 22 1 6 25 Jan 2005 24 Jan 2006 Dead due to AIDS 12 1
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
T1, . . . , Tn (latent) survival times C1, . . . , Cn (latent) censoring times
f(·) and F(·) for the density and distribution of T g(·) and G(·) for the density and distribution of C
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
n
n
n
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
n
n
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
r
j:Y(j)≤t(1 − h(j))
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
S(t) does not attain 0
S(t) = 0 for t ≥ Yn
S(t) = ˆ S(Yn) for t ≥ Yn
S(t) be undefined for t ≥ Yn
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
d
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
immediately after the censoring time : ˆ µYn = Yn ˆ S(t)dt
interval [0, tmax] and consider ˆ S(t) = ˆ S(Yn) for Yn ≤ t ≤ tmax : ˆ µtmax = tmax ˆ S(t)dt
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
mean is often influenced by outliers, whereas the median is not
censoring is not too heavy)
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Table: Data on schizophrenia patients
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
schizo <- read.table("c://...//Schizophrenia.csv", header=T,sep=";") KM_schizo_g <- survfit(Surv(Time,Censor)∼1,data=schizo, type="kaplan-meier", conf.type="plain") plot(KM_schizo_g, conf.int=T, xlab="Estimated survival", ylab="Time", yscale=1) mtext("Kaplan-Meier estimate of the survival function for Schizophrenic patients", 3,-3) mtext("(confidence interval based on Greenwood formula)", 3,-4)
title1 ’Kaplan-Meier estimate of the survival function for Schizophrenic patients’; proc lifetest method=km width=0.5 data=schizo; time Time*Censor(0); run;
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
500 1000 1500 0.0 0.2 0.4 0.6 0.8 1.0 Estimated survival Time Kaplan−Meier estimate of the survival function for Schizophrenic patients (confidence interval based on Greenwood formula)
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
> KM_schizo_g Call: survfit(formula = Surv(Time, Censor) ~ 1, data = schizo, type = "kaplan-meier", conf.type = "plain") n events median 0.95LCL 0.95UCL 280 163 933 766 1099 > summary(KM_schizo_g) Call: survfit(formula = Surv(Time, Censor) ~ 1, data = schizo, type = "kaplan-meier", conf.type = "plain") time n.risk n.event survival std.err lower 95% CI upper 95% CI 1 280 1 0.996 0.00357 0.9894 1.000 3 279 1 0.993 0.00503 0.9830 1.000 4 277 1 0.989 0.00616 0.9772 1.000 … 1770 13 1 0.219 0.03998 0.1409 0.298 1773 12 1 0.201 0.04061 0.1214 0.281 1784 8 2 0.151 0.04329 0.0659 0.236 1785 6 2 0.100 0.04092 0.0203 0.181 1794 1 1 0.000 NA NA NA
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
(larger) than the hazard of the control group at any time
cross each other
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
subject with xij = 0, j = 1, . . . , p)
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
r
(j)β
k β
corresponding covariate vectors
risk set at time Y(j)
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
hh
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
HIV/AIDS patients
HAART for the last 4 years
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Table: Data of HAART Study Pat Time Censo- Gen- Age Weight Func. Clin. CD4 ART ID ring der Status Status 1 699 1 42 37 2 4 3 1 2 455 1 2 30 50 1 3 111 1 3 705 1 32 57 3 165 1 4 694 2 50 40 1 3 95 1 5 86 2 35 37 4 34 1 . . . 97 101 1 39 37 2 . . 1 98 709 2 35 66 2 3 103 1 99 464 1 27 37 . . . 2 100 537 1 2 30 76 1 4 1 1
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
βagecat = 0.226 (HR=1.25)
βgender = 1.120 (HR=3.06)
I−1(ˆ β) = 0.4645 0.1476 0.1476 0.4638
βagecat : [-1.11, 1.56] 95% CI for HR of old vs. young : [0.33, 4.77]
βgender : [-0.21, 2.45] 95% CI for HR of female vs. male : [0.81, 11.64]
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
0 h0(s)ds
k ˆ
βtxi)
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Time Estimated survival 0.2 0.4 0.6 0.8 1 500 1000 1500 2000 Single Married Alone again
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
levels
⇒ ˆ H1(t), ˆ H2(t), . . . , ˆ Hr(t) should be constant multiples
Plot PH assumption holds if log( ˆ H1(t)), ..., log( ˆ Hr(t)) vs t parallel curves log( ˆ Hj(t)) − log( ˆ H1(t)) vs t constant lines ˆ Hj(t) vs ˆ H1(t) straight lines through origin
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Time Cumulative hazard 0.0 0.5 1.0 1.5 2.0 2.5 3.0 500 1000 1500 Male Female Time log(Cumulative hazard) −5 −4 −3 −2 −1 1 500 1000 1500 Male Female Time log(ratio cumulative hazards) −0.5 0.0 0.5 1.0 500 1000 1500 Cumulative hazard Male Cumulative hazard Female 0.0 0.5 1.0 1.5 0.0 0.2 0.4 0.6 0.8 1.0 1.2
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
0.0 0.5 1.0 1.5 2.0 Time 0.25 0.5 0.75 1 Survival function Control Treated M C M T
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
and the mean and variance of W are fixed to identify the model
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
n
n
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
µ, ˆ γ, ˆ σ) is asymptotically unbiased and normal
any other equivalent model) and their asymptotic distribution can be obtained from the Delta-method
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
t→∞ S(t) = 0
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
unemployment
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
t→∞ S(t) > 0
t→∞ S(t)
1000 2000 3000 4000 5000 0.0 0.2 0.4 0.6 0.8 1.0 Time to distant metastasis (in days) Survival probability
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
number of data points, we can be confident that (almost) all observations in the plateau correspond to cured observations’
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
susceptible (incidence part)
conditional survival function of the susceptibles (latency part)
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
survival function S(t | x)
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
(209 pts)
1 = postmenopausal (157 pts)
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Var number Description Type v1 The gender of the customer (1=M, 0=F) categorical v2 Amount of the loan continuous v3 Number of years at current address continuous v4 Number of years at current employer continuous v5 Amount of insurance premium continuous v6 Homephone or not (1=N, 0=Y) categorical v7 Own house or not (1=N, 0=Y) categorical v8 Frequency of payment (1=low/unknown, 0=high) categorical
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
incidence : p(z) = g(γTz) where g(·) is unspecified
model in the latency
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
t→∞ H(t) = θ
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
intercept)
survival function S(t | x)
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
n
i α)H{Yi}eX T
i βe−H(Yi) exp(X T i β)∆i
i α) + π(Z T i α)e−H(Yi) exp(X T
i β)1−∆i
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
2 (
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
S1,S2(g), 0
S1,S2(1)(˜
S1,S2(2)(˜
S1,S2(g), 0
S1,S2(1)(g)
S1,S2(2)(g), 0
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
exp(α0+α1z) 1+exp(α0+α1z), with α0 = α1 = 2
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
logistic Cox Estimated MSE (×103) True MSE (×103) X Z X Z µ1 µ2 µ3 µ1 µ2 µ3 1 1 1 1 1 1.62 7.30 29.9 1.56 6.45 36.0 2 1 1 1 1.57 6.73 26.1 1.57 6.13 33.6 3 1 1 1 22.2 20.2 37.4 25.0 27.5 56.7 4 1 1 1 1.72 8.31 36.8 1.78 8.16 50.2 5 1 1 1.55 6.66 25.9 1.63 6.59 35.9 6 1 1 15.5 9.50 68.8 17.6 14.2 83.5 7 1 1 1 1.50 6.62 26.9 1.42 5.80 34.7 8 1 1 1.47 6.26 24.3 1.43 5.54 32.4 9 1 1 12.4 5.46 100.1 14.1 10.9 124.2
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
FIC model selection prob.
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Var number Description Type v1 The gender of the customer (1=M, 0=F) categorical v2 Amount of the loan continuous v3 Number of years at current address continuous v4 Number of years at current employer continuous v5 Amount of insurance premium continuous v6 Homephone or not (1=N, 0=Y) categorical v7 Own house or not (1=N, 0=Y) categorical v8 Frequency of payment (1=low/unknown, 0=high) categorical
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
are showing side effects which need alternative treatments (positive relation between T and C)
they no longer follow the treatment (negative relation between T and C)
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
U = A(T) for some increasing function A
individual : A(T) = RT, where R is the cost accumulation rate
A(C) = RC, and so we observe min(RT, RC)
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research 1 2 3 4 5 0.0 0.2 0.4 0.6 0.8 1.0
rho = 0
1 2 3 4 0.0 0.2 0.4 0.6 0.8 1.0
rho = 0.3
1 2 3 4 5 0.0 0.2 0.4 0.6 0.8 1.0
rho = 0.6
2 4 6 8 10 0.0 0.2 0.4 0.6 0.8 1.0
rho = 0.9
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research 1 2 3 4 5 0.0 0.2 0.4 0.6 0.8 1.0
rho = 0
1 2 3 4 5 0.0 0.2 0.4 0.6 0.8 1.0
rho = −0.3
1 2 3 0.0 0.2 0.4 0.6 0.8 1.0
rho = −0.6
0.0 0.5 1.0 1.5 2.0 0.0 0.2 0.4 0.6 0.8 1.0
rho = −0.9
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
50 55 60 65 70 75 500 1000 1500
UKELD score Time
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
distribution of T and C by means of a known copula function, and estimation of the marginal distribution of T nonparametrically under this copula model
copulas
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
T
C
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
n
i η − ρ σC σT (Λθ(Yi) − X T i β)
i β
θ(Yi)
i β − ρ σT σC (Λθ(Yi) − W T i η)
i η
θ(Yi)
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
T, σ∗ C, ρ∗) be the parameter vector that
P
T, σ∗ C, ρ∗)
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
T, σ∗ C, ρ∗)
i,j=1
i,j=1
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
θ 1.5 Par. Bias RMSE CR Bias RMSE CR Dependent censoring model β0
0.144 0.947
0.169 0.948 β1
0.182 0.944
0.188 0.940 β2
0.169 0.940
0.183 0.931 σ1 0.004 0.097 0.944
0.109 0.940 ρ
0.208 0.956
0.215 0.954 θ
0.031 0.949
0.101 0.944 Independent censoring model β0 0.207 0.249 0.709 0.156 0.234 0.880 β1 0.201 0.268 0.812 0.169 0.255 0.867 β2 0.111 0.212 0.904 0.074 0.214 0.924 σ1
0.095 0.906
0.115 0.871 θ
0.038 0.881
0.130 0.858
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
θ 1.5 Par. Bias RMSE CR Bias RMSE CR Dependent censoring model β0 0.032 0.159 0.945 0.056 0.190 0.938 β1 0.035 0.207 0.928 0.048 0.218 0.929 β2 0.037 0.187 0.930 0.058 0.206 0.923 σ1 0.012 0.113 0.928 0.033 0.126 0.922 ρ
0.240 0.938
0.223 0.942 θ 0.004 0.034 0.917 0.028 0.103 0.902 Independent censoring model β0 0.242 0.283 0.631 0.247 0.307 0.735 β1 0.229 0.300 0.781 0.244 0.320 0.770 β2 0.140 0.235 0.881 0.156 0.260 0.871 σ1
0.106 0.907
0.115 0.913 θ
0.038 0.861
0.107 0.895
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Dependent model Independent model var. Est. SE BSE p-value Est. SE BSE p-value Age
0.096 0.108 0.084
0.109 0.104 0.014 Gender 0.915 0.895 0.957 0.307 0.988 1.318 1.460 0.456 BMI
0.065 0.063 0.181
0.085 0.082 0.155 UKELD
0.214 0.181 0.005
0.237 0.186 0.004 θ 1.764 0.196 0.158 0.000 1.680 0.195 0.156 0.000 ρ 0.730 0.250 0.249 0.004
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
200 400 600 800 0.0 0.2 0.4 0.6 0.8 1.0
Days from registration Survival function
Dependent model Independent model
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
0.0 0.2 0.4 0.6 0.8 1.0 1.0 1.2 1.4 1.6 1.8 2.0 X Y
0.0 0.5 1.0 1.0 1.2 1.4 1.6 1.8 2.0 W Y
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
are given
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Wb,i(λ) = Wi + √ λ σZb,i where Zb,i ∼iid N(0, 1), for b = 1, . . . , B and λ = λ1, . . . , λK. The variance of these contaminated data is Var(Wb,i(λ)|Xi) = (1 + λ)σ2
under consideration using a naive estimation procedure, i.e. a method that does not take into account the measurement error ⇒ βb(λ).
B
b=1
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Figure: Visual representation of the SIMEX approach.
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Table: Simulation results for n = 300
Naive Simex Simex Simex (no correction) (true σ) (0.75σ) (1.25σ) fX σ β1 β2 β1 β2 β1 β2 β1 β2 2 Beta(1,1)-1 .144 Bias
.012
.050
SD .136 .164 .150 .165 .144 .165 .156 .166 MSE .021 .027 .023 .027 .021 .027 .027 .028 .289 Bias
.001
.059
SD .139 .168 .182 .172 .163 .170 .199 .175 MSE .066 .028 .034 .030 .040 .029 .043 .031 .433 Bias
.026
.010
.016
.003 SD .112 .162 .168 .173 .147 .169 .190 .179 MSE .162 .027 .050 .030 .082 .029 .038 .032 2 Beta(.7,.5)-1 .166 Bias
.017
.059
SD .131 .164 .147 .167 .140 .165 .155 .169 MSE .021 .027 .022 .028 .020 .027 .028 .029 .332 Bias
.008
.050
SD .124 .161 .165 .168 .148 .164 .185 .172 MSE .070 .026 .029 .028 .038 .027 .037 .030 .499 Bias
.028
.004
.014
SD .101 .157 .155 .169 .133 .163 .176 .175 MSE .169 .025 .048 .029 .084 .027 .033 .031 N(0,1,-2,2) .440 Bias
.023
.009 .060
SD .088 .173 .123 .187 .108 .180 .139 .195 MSE .064 .030 .017 .035 .028 .032 .023 .038 .880 Bias
.056
.025
.037
.012 SD .071 .160 .1209 .184 .103 .173 .137 .194 MSE .316 .029 .117 .034 .181 .031 .071 .038 1.32 Bias
.081
.061
.068
.054 SD .054 .175 .097 .194 .082 .185 .110 .202 MSE .549 .037 .327 .041 .402 .039 .267 .044
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
β1 is biased, and this bias increases with the value of σ
disappear, because
conservative corrections (see Carroll et al, 2006)
variance, but the MSE is usually smaller with Simex than with the Naive method
Bias(ˆ β1|1.25σ) < Bias(ˆ β1|σ) < Bias(ˆ β1|0.75σ) (due to conservative behavior of Simex method)
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
m
m→∞ sup 0≤s≤1
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
m
m
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0
m=0
density 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.5 1.0 1.5 2.0
m=1
density 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.5 1.0 1.5 2.0 2.5 3.0
m=2
density 0.0 0.2 0.4 0.6 0.8 1.0 1 2 3 4
m=3
density
Figure: Representation of the Beta densities appearing in the Bernstein polynomials of degree m = 0, 1, 2 and 3.
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
m
m→∞ sup w
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
iid
n
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
m, a∗ m, b∗ m, θ∗ m) be the parameter vector that minimizes
m, a∗ m, b∗ m, θ∗ m).
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
m, a∗ m, b∗ m, θ∗ m)
m, a∗ m, b∗ m, θ∗ m).
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
(α, β) = (1, 1), (1, 2), (0.7, 0.5), (3, 2)
with (µ, tU) = (0.5, 4), (10, 20)
σ σX = 0.25, 0.50, 0.75
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Figure: Representation of the densities fX considered in the simulation.
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Figure: Representation of the densities fX considered in the simulation.
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Table: Simulation results for n = 300 (RB: relative bias; SD: standard deviation; MSE: mean squared error)
Estimation of σ Distribution (in %) of the selected m fX σ Bias RB SD MSE 1 2 3 4 5 6 2 Beta(1, 1)-1 .144
.064 .004 90.0 2.4 6.2 0.8 0.0 0.2 0.4 .289
.076 .006 92.4 3.6 3.0 0.6 0.2 0.0 0.2 .433
.092 .009 93.2 3.0 1.0 1.2 1.2 0.2 0.2 2 Beta(1, 2) -1 .118
.053 .003 0.2 90.8 2.0 4.6 1.8 0.6 0.0 .236
.072 .005 7.8 85.2 2.2 3.2 0.4 0.6 0.6 .354 .014 .040 .101 .010 44.8 50.0 1.6 0.8 1.2 1.0 0.6 2 Beta(.7, .5)-1 .166
.063 .005 10.4 28.4 55.6 4.8 0.6 0.0 0.2 .332
.077 .010 44.2 49.2 4.2 2.2 0.0 0.0 0.2 .499
.102 .013 74.2 22.8 1.0 0.8 1.0 0.2 0.0 2 Beta(3, 2)-1 .100 .073 .727 .083 .012 35.4 49.2 1.0 10.8 2.0 1.2 0.4 .200 .065 .326 .072 .009 65.2 29.2 1.6 1.2 1.4 1.4 0.0 .300 .059 .196 .078 .010 84.2 12.0 0.8 0.6 1.2 0.4 0.8 N(0,1,-2,2) .440 .209 .475 .137 .063 93.6 1.6 1.8 0.6 1.0 1.0 0.4 .880 .116 .132 .177 .045 94.2 3.2 0.4 0.8 0.6 0.0 0.8 1.32 .032 .024 .229 .053 93.0 2.6 0.4 1.0 1.4 0.6 1.0 N(0,1,-1.5,1.5) .371 .088 .238 .127 .024 92.4 1.4 2.4 1.6 1.2 0.2 0.8 .743 .053 .071 .154 .027 96.0 2.6 0.2 0.2 0.4 0.2 0.4 1.11 .006 .005 .189 .036 97.6 2.0 0.2 0.0 0.2 0.0 0.0 Exp(.5, 4)-1 .124
.058 .003 0.4 0.2 1.2 30.8 41.8 19.4 6.2 .247
.037 .002 0.2 0.4 8.6 52.2 27.8 10.0 0.8 .371
.064 .005 3.2 2.0 27.6 46.6 18.4 1.4 0.8 Exp(10, 20)-1 1.31 .001 .001 .947 .897 0.8 70.8 25.0 1.0 1.4 0.6 0.4 2.63
1.02 1.04 3.4 84.4 8.2 2.0 0.6 1.0 0.4 3.94 .121 .031 1.14 1.32 25.8 64.6 5.2 1.6 1.2 0.4 1.2
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Note that the true value of m is 0 for Beta(1, 1) 1 for Beta(1, 2) 3 for Beta(3, 2) The other densities are not a mixture of Bernstein polynomials. The table shows that ⋄ The BIC criterion recovers well the value of m for Beta(1,1) and Beta(1,2), but not for Beta(3, 2). ⋄ The selected m tends to decrease with the SNR. ⋄ Smallest relative biases are found for 2 Beta(1,1)-1, 2 Beta(1,2)-1 and both exponential distributions. ⋄ 2 Beta(3,2)-1 and N(0,1,-2,2) yield the worst results, but bias decreases when σ increases. ⋄ Although the model is theoretically identifiable, there appears some practical identifiability problems especially for large values of m, which disappear when a and b are set to their true values.
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Table: Simulation results for n = 300
Naive Simex Simex (estimated σ) (true σ) fX σ β1 β2 β1 β2 β1 β2 2 Beta(1,1)-1 .144 Bias
.013
.012
SD .136 .164 .163 .165 .150 .165 MSE .021 .027 .027 .027 .023 .027 .289 Bias
.001
SD .139 .168 .197 .173 .182 .172 MSE .066 .028 .040 .030 .034 .030 .433 Bias
.026
.011
.010 SD .112 .162 .186 .173 .168 .173 MSE .162 .027 .056 .030 .050 .030 2 Beta(.7,.5)-1 .166 Bias
.017
SD .131 .164 .160 .166 .147 .167 MSE .021 .027 .026 .028 .022 .028 .332 Bias
.008
SD .124 .161 .166 .165 .165 .168 MSE .070 .026 .040 .027 .029 .028 .499 Bias
.028
.009
.004 SD .101 .157 .160 .167 .155 .169 MSE .169 .025 .064 .028 .048 .029 N(0,1,-2,2) .220 Bias
.302
.007
SD .102 .170 .236 .204 .115 .176 MSE .015 .029 .146 .045 .013 .031 .440 Bias
.023 .157
SD .088 .173 .186 .202 .123 .187 MSE .064 .030 .060 .042 .017 .035 .660 Bias
.041
.001
.011 SD .081 .160 .163 .188 .129 .179 MSE .183 .027 .033 .035 .047 .032
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Hemoglobin level m = 1 m = 2 m=3 m = 4 m = 5 BIC·10−3 5.7986 5.8053 5.7770 5.7834 5.7904
1.2351 1.4911 1.3616 1.2798 1.3385 Creatinine log-level m = 9 m = 10 m=11 m = 12 m = 13 BIC·10−3 0.7345 0.7284 0.7265 0.7271 0.7294
0.1836 0.1871 0.1907 0.1944 0.1975 Monoclonal spike m = 7 m = 8 m=9 m = 10 m = 11 BIC·10−3 2.2785 2.2810 2.2749 2.2755 2.2792
0.1743 0.1731 0.1780 0.1685 0.1706
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Hemo- Log- Age Gender globin creatinine Spike No correction Estim. .055
.367 .037 SE .003 .070 .018 .079 .060 SIMEX Estim. .053
.349 .030 SE .003 .081 .027 .132 .068
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research
Basic concepts Cure models
Introduction Ongoing research
Dependent censoring
Introduction Ongoing research
Measurement errors
Introduction Ongoing research