Performs stability selection based on gradient boosting.

stabsel(formula, data, family = "gaussian",
  q, maxit, B = 100, thr = .9, fraction = 0.5, seed = NULL, ...)

## Plot selection frequencies.
# S3 method for stabsel
plot(x, show = NULL,
  pal = function(n) gray.colors(n, start = 0.9, end = 0.3), ...)

Arguments

formula

A formula or extended formula.

data

A data.frame.

family

A bamlss.family object.

q

An integer specifying how many terms to select in each boosting run.

maxit

An integer specifying the maximum number of boosting iterations. See opt_boost. Either choose q or maxit as hyper-parameter for regularization.

B

An integer. The boosting is run B times.

thr

Cut-off threshold of relative frequencies (between 0 and 1) for selection.

fraction

Numeric between 0 and 1. The fraction of data to be used in each boosting run.

seed

A seed to be set before the stability selection.

x

A object of class stabsel.

show

Number of terms to be shown.

pal

Color palette for different model terms.

...

Not used yet in stabsel.

Value

A object of class stabsel.

Details

stabsel performs stability selection based on gradient boosting (opt_boost): The boosting algorithm is run B times on a randomly drawn fraction of the data. Each boosting run is stopped either when q terms have been selected, or when maxit iterations have been performed, i.e. either q or maxit can be used to tune the regularization of the boosting. After the boosting the relative selection frequencies are evaluated. Terms with a relative selection frequency larger then thr are suggested for a final regression model.

If neither q nor maxit has been specified, q will be set to the square root of the number of columns in data.

Gradient boosting does not depend on random numbers. Thus, the individual boosting runs differ only in the subset of data which is used.

Author

Thorsten Simon

Examples

if (FALSE) ## Simulate some data.
set.seed(111)
d <- GAMart()
n <- nrow(d)

## Add some noise variables.
for(i in 4:9)
  d[[paste0("x",i)]] <- rnorm(n)

f <- paste0("~ ", paste("s(x", 1:9, ")", collapse = "+", sep = ""))
f <- paste(f, "+ te(lon,lat)")
f <- as.formula(f)
f <- list(update(f, num ~ .), f)

## Run stability selection.
sel <- stabsel(f, data = d, q = 6, B = 10)
#> Stability selection boosting run 1 / 10 

#> logLik -109.394 eps 0.2858 iteration     2 qsel 1
#> logLik -103.099 eps 1.1910 iteration     3 qsel 1
#> logLik -97.7278 eps 0.5996 iteration     4 qsel 2
#> logLik -92.6573 eps 0.5210 iteration     5 qsel 2
#> logLik -88.3274 eps 5.6043 iteration     6 qsel 2
#> logLik -84.2425 eps 0.4284 iteration     7 qsel 2
#> logLik -80.7511 eps 0.3439 iteration     8 qsel 2
#> logLik -77.4595 eps 0.4116 iteration     9 qsel 2
#> logLik -74.6429 eps 0.2220 iteration    10 qsel 2
#> logLik -71.9899 eps 0.2961 iteration    11 qsel 2
#> logLik -69.3811 eps 0.1421 iteration    12 qsel 3
#> logLik -67.0991 eps 0.3339 iteration    13 qsel 3
#> logLik -64.6375 eps 0.0131 iteration    14 qsel 3
#> logLik -62.3882 eps 0.1084 iteration    15 qsel 3
#> logLik -60.1139 eps 0.0122 iteration    16 qsel 3
#> logLik -57.7490 eps 0.2223 iteration    17 qsel 3
#> logLik -55.6312 eps 0.0114 iteration    18 qsel 3
#> logLik -53.4869 eps 0.1279 iteration    19 qsel 3
#> logLik -51.4915 eps 0.1755 iteration    20 qsel 3
#> logLik -49.3342 eps 0.0113 iteration    21 qsel 3
#> logLik -47.1980 eps 0.1382 iteration    22 qsel 3
#> logLik -45.2085 eps 0.0106 iteration    23 qsel 3
#> logLik -43.2976 eps 0.1942 iteration    24 qsel 3
#> logLik -41.4797 eps 0.0098 iteration    25 qsel 3
#> logLik -39.6360 eps 0.1425 iteration    26 qsel 3
#> logLik -37.7132 eps 0.1958 iteration    27 qsel 3
#> logLik -35.8780 eps 0.0097 iteration    28 qsel 3
#> logLik -34.1834 eps 0.1890 iteration    29 qsel 3
#> logLik -32.5219 eps 0.0090 iteration    30 qsel 3
#> logLik -30.9031 eps 0.1226 iteration    31 qsel 3
#> logLik -29.1749 eps 0.1147 iteration    32 qsel 3
#> logLik -25.8945 eps 0.1778 iteration    33 qsel 4
#> logLik -23.9390 eps 0.0097 iteration    34 qsel 4
#> logLik -22.3231 eps 0.0086 iteration    35 qsel 4
#> logLik -20.8212 eps 0.0677 iteration    36 qsel 4
#> logLik -19.3692 eps 0.0079 iteration    37 qsel 4
#> logLik -17.8964 eps 0.0766 iteration    38 qsel 4
#> logLik -16.2914 eps 0.0846 iteration    39 qsel 4
#> logLik -13.1244 eps 0.1050 iteration    40 qsel 4
#> logLik -11.4217 eps 0.0085 iteration    41 qsel 4
#> logLik -10.0167 eps 0.0075 iteration    42 qsel 4
#> logLik  -8.7285 eps 0.0961 iteration    43 qsel 4
#> logLik  -7.4142 eps 0.0532 iteration    44 qsel 4
#> logLik  -5.9794 eps 0.1356 iteration    45 qsel 4
#> logLik  -3.0792 eps 0.1267 iteration    46 qsel 4
#> logLik  -1.3632 eps 0.0083 iteration    47 qsel 4
#> logLik   0.0530 eps 0.0073 iteration    48 qsel 4
#> logLik   1.2196 eps 0.0065 iteration    49 qsel 4
#> logLik   2.3770 eps 0.0591 iteration    50 qsel 4
#> logLik   3.7007 eps 0.0535 iteration    51 qsel 4
#> logLik   4.8663 eps 0.0702 iteration    52 qsel 4
#> logLik   7.5897 eps 0.0688 iteration    53 qsel 4
#> logLik   9.0064 eps 0.0071 iteration    54 qsel 4
#> logLik  10.1735 eps 0.0063 iteration    55 qsel 4
#> logLik  11.3669 eps 0.1895 iteration    56 qsel 4
#> logLik  12.4045 eps 0.0059 iteration    57 qsel 4
#> logLik  13.4327 eps 0.0395 iteration    58 qsel 4
#> logLik  14.4524 eps 0.2408 iteration    59 qsel 4
#> logLik  16.9654 eps 0.0801 iteration    60 qsel 4
#> logLik  18.1142 eps 0.0061 iteration    61 qsel 4
#> logLik  19.1861 eps 0.0463 iteration    62 qsel 4
#> logLik  20.1998 eps 0.0057 iteration    63 qsel 4
#> logLik  21.0790 eps 0.0396 iteration    64 qsel 4
#> logLik  21.9643 eps 0.0052 iteration    65 qsel 4
#> logLik  22.8522 eps 0.0391 iteration    66 qsel 4
#> logLik  25.1400 eps 0.0678 iteration    67 qsel 4
#> logLik  26.1031 eps 0.0606 iteration    68 qsel 4
#> logLik  27.0738 eps 0.0054 iteration    69 qsel 4
#> logLik  27.8711 eps 0.0048 iteration    70 qsel 4
#> logLik  28.6400 eps 0.0324 iteration    71 qsel 4
#> logLik  29.3895 eps 0.0234 iteration    72 qsel 4
#> logLik  30.2532 eps 0.0299 iteration    73 qsel 4
#> logLik  32.2706 eps 0.0361 iteration    74 qsel 4
#> logLik  33.1710 eps 0.0051 iteration    75 qsel 4
#> logLik  33.9101 eps 0.0045 iteration    76 qsel 4
#> logLik  34.5609 eps 0.0179 iteration    77 qsel 4
#> logLik  35.3330 eps 0.0312 iteration    78 qsel 4
#> logLik  36.0105 eps 0.0043 iteration    79 qsel 4
#> logLik  36.6672 eps 0.0188 iteration    80 qsel 4
#> logLik  38.4784 eps 0.0402 iteration    81 qsel 4
#> logLik  39.1548 eps 0.0042 iteration    82 qsel 4
#> logLik  39.7092 eps 0.0038 iteration    83 qsel 4
#> logLik  40.2702 eps 0.0149 iteration    84 qsel 4
#> logLik  40.9850 eps 0.0284 iteration    85 qsel 4
#> logLik  42.5766 eps 0.0242 iteration    86 qsel 4
#> logLik  43.1578 eps 0.0039 iteration    87 qsel 4
#> logLik  43.7105 eps 0.0141 iteration    88 qsel 4
#> logLik  44.3460 eps 0.0256 iteration    89 qsel 4
#> logLik  44.8739 eps 0.0036 iteration    90 qsel 4
#> logLik  45.3436 eps 0.0121 iteration    91 qsel 4
#> logLik  46.7365 eps 0.0308 iteration    92 qsel 4
#> logLik  47.2472 eps 0.0035 iteration    93 qsel 4
#> logLik  47.7155 eps 0.0129 iteration    94 qsel 4
#> logLik  48.2927 eps 0.0174 iteration    95 qsel 4
#> logLik  48.7530 eps 0.0033 iteration    96 qsel 4
#> logLik  49.1999 eps 0.0120 iteration    97 qsel 5
#> logLik  49.5932 eps 0.0030 iteration    98 qsel 5
#> logLik  50.1021 eps 0.0030 iteration    99 qsel 6
#> 
#>  elapsed time:  0.26sec
#> Stability selection boosting run 2 / 10 

#> logLik -104.738 eps 0.1836 iteration     2 qsel 1
#> logLik -99.2944 eps 0.4672 iteration     3 qsel 2
#> logLik -94.3653 eps 0.6652 iteration     4 qsel 2
#> logLik -89.9353 eps 0.2707 iteration     5 qsel 2
#> logLik -85.9195 eps 2.1208 iteration     6 qsel 2
#> logLik -82.3124 eps 0.1743 iteration     7 qsel 2
#> logLik -79.0380 eps 0.3705 iteration     8 qsel 2
#> logLik -76.0994 eps 0.6650 iteration     9 qsel 2
#> logLik -73.4271 eps 0.2648 iteration    10 qsel 2
#> logLik -70.7598 eps 0.2988 iteration    11 qsel 3
#> logLik -68.3665 eps 0.1559 iteration    12 qsel 3
#> logLik -66.2069 eps 0.1990 iteration    13 qsel 3
#> logLik -64.0339 eps 0.1327 iteration    14 qsel 3
#> logLik -61.9304 eps 0.0117 iteration    15 qsel 3
#> logLik -59.8860 eps 0.4870 iteration    16 qsel 3
#> logLik -57.9536 eps 0.0109 iteration    17 qsel 3
#> logLik -56.0396 eps 25.097 iteration    18 qsel 3
#> logLik -54.0953 eps 0.1432 iteration    19 qsel 3
#> logLik -52.1430 eps 0.0107 iteration    20 qsel 3
#> logLik -50.3186 eps 0.1232 iteration    21 qsel 3
#> logLik -48.5418 eps 0.0100 iteration    22 qsel 3
#> logLik -46.8508 eps 0.1375 iteration    23 qsel 3
#> logLik -45.1136 eps 0.1621 iteration    24 qsel 3
#> logLik -43.3486 eps 0.0097 iteration    25 qsel 3
#> logLik -41.7263 eps 0.1560 iteration    26 qsel 3
#> logLik -40.1331 eps 0.0090 iteration    27 qsel 3
#> logLik -38.6452 eps 0.1342 iteration    28 qsel 3
#> logLik -36.0532 eps 0.1893 iteration    29 qsel 4
#> logLik -34.4031 eps 0.0090 iteration    30 qsel 4
#> logLik -32.8187 eps 0.5787 iteration    31 qsel 4
#> logLik -31.3298 eps 0.0084 iteration    32 qsel 4
#> logLik -29.8833 eps 0.0839 iteration    33 qsel 4
#> logLik -28.5470 eps 0.0078 iteration    34 qsel 4
#> logLik -27.1858 eps 0.1163 iteration    35 qsel 4
#> logLik -24.5987 eps 0.1538 iteration    36 qsel 4
#> logLik -23.2056 eps 0.0078 iteration    37 qsel 4
#> logLik -21.7701 eps 0.0967 iteration    38 qsel 4
#> logLik -20.5184 eps 0.0073 iteration    39 qsel 4
#> logLik -19.2407 eps 0.1151 iteration    40 qsel 4
#> logLik -18.0455 eps 0.0941 iteration    41 qsel 4
#> logLik -15.5643 eps 0.0934 iteration    42 qsel 4
#> logLik -14.1739 eps 0.0076 iteration    43 qsel 4
#> logLik -12.9171 eps 0.2016 iteration    44 qsel 4
#> logLik -11.6811 eps 0.0070 iteration    45 qsel 4
#> logLik -10.5909 eps 0.0494 iteration    46 qsel 4
#> logLik  -9.5007 eps 0.0065 iteration    47 qsel 4
#> logLik  -8.4138 eps 0.1517 iteration    48 qsel 4
#> logLik  -5.9707 eps 0.2631 iteration    49 qsel 4
#> logLik  -4.8433 eps 0.0065 iteration    50 qsel 4
#> logLik  -3.7030 eps 0.1097 iteration    51 qsel 4
#> logLik  -2.7034 eps 0.0060 iteration    52 qsel 4
#> logLik  -1.7469 eps 0.0498 iteration    53 qsel 4
#> logLik  -0.7953 eps 0.0700 iteration    54 qsel 4
#> logLik   1.4815 eps 0.0715 iteration    55 qsel 4
#> logLik   2.5669 eps 0.0062 iteration    56 qsel 4
#> logLik   3.5724 eps 1.0108 iteration    57 qsel 4
#> logLik   4.5271 eps 0.0057 iteration    58 qsel 4
#> logLik   5.3559 eps 0.0790 iteration    59 qsel 4
#> logLik   6.1876 eps 0.0053 iteration    60 qsel 4
#> logLik   7.0302 eps 0.1691 iteration    61 qsel 4
#> logLik   9.1722 eps 0.0962 iteration    62 qsel 4
#> logLik  10.0627 eps 0.4475 iteration    63 qsel 4
#> logLik  10.9647 eps 0.0054 iteration    64 qsel 4
#> logLik  11.7052 eps 0.0048 iteration    65 qsel 4
#> logLik  12.4490 eps 0.0423 iteration    66 qsel 4
#> logLik  13.1647 eps 0.0425 iteration    67 qsel 4
#> logLik  13.9191 eps 0.0427 iteration    68 qsel 5
#> logLik  15.8327 eps 0.0595 iteration    69 qsel 5
#> logLik  16.6606 eps 0.0051 iteration    70 qsel 5
#> logLik  17.3398 eps 0.0045 iteration    71 qsel 5
#> logLik  17.9888 eps 0.0308 iteration    72 qsel 5
#> logLik  18.7972 eps 0.0357 iteration    73 qsel 5
#> logLik  19.4238 eps 0.0043 iteration    74 qsel 5
#> logLik  20.0577 eps 0.0539 iteration    75 qsel 5
#> logLik  20.7229 eps 0.0439 iteration    76 qsel 5
#> logLik  22.4640 eps 0.0382 iteration    77 qsel 5
#> logLik  23.1222 eps 0.0044 iteration    78 qsel 5
#> logLik  23.6831 eps 0.0561 iteration    79 qsel 5
#> logLik  24.3838 eps 0.0390 iteration    80 qsel 5
#> logLik  24.9824 eps 0.0041 iteration    81 qsel 5
#> logLik  25.5680 eps 0.0026 iteration    82 qsel 6
#> 
#>  elapsed time:  0.23sec
#> Stability selection boosting run 3 / 10 

#> logLik -119.180 eps 0.2197 iteration     2 qsel 1
#> logLik -112.951 eps 0.5653 iteration     3 qsel 1
#> logLik -107.276 eps 0.6298 iteration     4 qsel 2
#> logLik -102.236 eps 0.9305 iteration     5 qsel 2
#> logLik -97.6372 eps 0.3587 iteration     6 qsel 2
#> logLik -93.5574 eps 0.7314 iteration     7 qsel 2
#> logLik -89.8282 eps 0.6548 iteration     8 qsel 2
#> logLik -86.4030 eps 0.5157 iteration     9 qsel 3
#> logLik -83.1456 eps 0.6224 iteration    10 qsel 3
#> logLik -80.1649 eps 0.2083 iteration    11 qsel 3
#> logLik -77.5260 eps 1.7653 iteration    12 qsel 3
#> logLik -74.8425 eps 0.2006 iteration    13 qsel 3
#> logLik -72.1512 eps 0.0143 iteration    14 qsel 3
#> logLik -69.6338 eps 0.2360 iteration    15 qsel 3
#> logLik -67.1221 eps 0.0134 iteration    16 qsel 3
#> logLik -64.7792 eps 0.1435 iteration    17 qsel 3
#> logLik -62.4046 eps 0.1358 iteration    18 qsel 3
#> logLik -59.8039 eps 0.0133 iteration    19 qsel 3
#> logLik -57.5640 eps 0.3531 iteration    20 qsel 3
#> logLik -55.1656 eps 0.0124 iteration    21 qsel 3
#> logLik -53.0880 eps 0.0900 iteration    22 qsel 3
#> logLik -50.8888 eps 0.0115 iteration    23 qsel 3
#> logLik -48.6832 eps 0.2867 iteration    24 qsel 3
#> logLik -46.6492 eps 0.0108 iteration    25 qsel 3
#> logLik -44.5718 eps 0.1004 iteration    26 qsel 3
#> logLik -42.6984 eps 0.0101 iteration    27 qsel 3
#> logLik -40.7884 eps 0.0777 iteration    28 qsel 3
#> logLik -38.8556 eps 0.0987 iteration    29 qsel 3
#> logLik -36.9606 eps 0.0099 iteration    30 qsel 3
#> logLik -35.1366 eps 0.4520 iteration    31 qsel 3
#> logLik -33.4106 eps 0.0093 iteration    32 qsel 3
#> logLik -31.7408 eps 0.1287 iteration    33 qsel 3
#> logLik -30.0474 eps 0.0754 iteration    34 qsel 3
#> logLik -28.3358 eps 0.0090 iteration    35 qsel 3
#> logLik -26.7386 eps 0.0597 iteration    36 qsel 3
#> logLik -25.1945 eps 0.0084 iteration    37 qsel 3
#> logLik -23.7396 eps 0.0776 iteration    38 qsel 3
#> logLik -22.2573 eps 0.0526 iteration    39 qsel 3
#> logLik -20.7514 eps 0.0081 iteration    40 qsel 3
#> logLik -19.3578 eps 0.0516 iteration    41 qsel 3
#> logLik -16.1703 eps 0.4953 iteration    42 qsel 4
#> logLik -14.5608 eps 0.0083 iteration    43 qsel 4
#> logLik -13.2334 eps 0.0074 iteration    44 qsel 4
#> logLik -11.9231 eps 0.1041 iteration    45 qsel 4
#> logLik  -8.9205 eps 0.0822 iteration    46 qsel 4
#> logLik  -7.5069 eps 0.0075 iteration    47 qsel 4
#> logLik  -6.2806 eps 0.0984 iteration    48 qsel 4
#> logLik  -5.0267 eps 0.0069 iteration    49 qsel 4
#> logLik  -3.7303 eps 0.0679 iteration    50 qsel 4
#> logLik  -2.6010 eps 0.0528 iteration    51 qsel 4
#> logLik  -1.4005 eps 0.0067 iteration    52 qsel 4
#> logLik  -0.3376 eps 0.1436 iteration    53 qsel 4
#> logLik   2.5317 eps 0.2107 iteration    54 qsel 4
#> logLik   3.7932 eps 0.0068 iteration    55 qsel 4
#> logLik   4.8315 eps 0.0060 iteration    56 qsel 4
#> logLik   5.8409 eps 0.1047 iteration    57 qsel 4
#> logLik   6.9442 eps 0.1079 iteration    58 qsel 4
#> logLik   7.9281 eps 0.0058 iteration    59 qsel 4
#> logLik   8.8635 eps 0.0645 iteration    60 qsel 4
#> logLik  11.5240 eps 0.0911 iteration    61 qsel 4
#> logLik  12.5546 eps 0.0058 iteration    62 qsel 4
#> logLik  13.4109 eps 0.0697 iteration    63 qsel 4
#> logLik  14.3307 eps 0.0990 iteration    64 qsel 4
#> logLik  15.2864 eps 0.0055 iteration    65 qsel 4
#> logLik  16.0843 eps 0.0378 iteration    66 qsel 4
#> logLik  18.4313 eps 0.0656 iteration    67 qsel 4
#> logLik  19.4058 eps 0.0055 iteration    68 qsel 4
#> logLik  20.2062 eps 0.0049 iteration    69 qsel 4
#> logLik  20.9512 eps 0.1535 iteration    70 qsel 4
#> logLik  21.7482 eps 0.0365 iteration    71 qsel 4
#> logLik  22.4862 eps 0.0047 iteration    72 qsel 4
#> logLik  23.1859 eps 0.0280 iteration    73 qsel 4
#> logLik  25.2864 eps 0.0461 iteration    74 qsel 4
#> logLik  26.0367 eps 0.0047 iteration    75 qsel 4
#> logLik  26.6622 eps 0.0748 iteration    76 qsel 4
#> logLik  27.3085 eps 0.0043 iteration    77 qsel 4
#> logLik  27.9872 eps 0.0031 iteration    78 qsel 5
#> logLik  28.6800 eps 0.0354 iteration    79 qsel 5
#> logLik  29.2735 eps 0.0041 iteration    80 qsel 5
#> logLik  29.8638 eps 0.0274 iteration    81 qsel 5
#> logLik  31.6968 eps 0.0874 iteration    82 qsel 5
#> logLik  32.2933 eps 0.0040 iteration    83 qsel 5
#> logLik  32.8369 eps 0.0424 iteration    84 qsel 5
#> logLik  33.3492 eps 0.0037 iteration    85 qsel 5
#> logLik  33.9218 eps 0.0028 iteration    86 qsel 5
#> logLik  35.5074 eps 0.0426 iteration    87 qsel 5
#> logLik  36.0169 eps 0.0036 iteration    88 qsel 5
#> logLik  36.5157 eps 0.0274 iteration    89 qsel 5
#> logLik  36.9803 eps 0.0272 iteration    90 qsel 5
#> logLik  37.5742 eps 0.3686 iteration    91 qsel 5
#> logLik  38.0551 eps 0.0035 iteration    92 qsel 5
#> logLik  38.4716 eps 0.0208 iteration    93 qsel 5
#> logLik  39.8392 eps 0.0465 iteration    94 qsel 5
#> logLik  40.3041 eps 0.0034 iteration    95 qsel 5
#> logLik  40.6922 eps 0.0301 iteration    96 qsel 5
#> logLik  41.2078 eps 0.0391 iteration    97 qsel 5
#> logLik  41.6227 eps 0.0032 iteration    98 qsel 5
#> logLik  42.1556 eps 0.0025 iteration    99 qsel 6
#> 
#>  elapsed time:  0.28sec
#> Stability selection boosting run 4 / 10 

#> logLik -112.112 eps 0.2157 iteration     2 qsel 1
#> logLik -106.515 eps 0.2876 iteration     3 qsel 2
#> logLik -101.911 eps 0.4989 iteration     4 qsel 2
#> logLik -97.3061 eps 0.3894 iteration     5 qsel 2
#> logLik -93.5041 eps 0.2549 iteration     6 qsel 2
#> logLik -89.7127 eps 0.4788 iteration     7 qsel 2
#> logLik -86.2257 eps 0.3622 iteration     8 qsel 3
#> logLik -83.1251 eps 0.3355 iteration     9 qsel 3
#> logLik -80.0463 eps 0.3024 iteration    10 qsel 3
#> logLik -77.2603 eps 0.1968 iteration    11 qsel 3
#> logLik -74.7293 eps 0.1598 iteration    12 qsel 3
#> logLik -72.2273 eps 0.1557 iteration    13 qsel 3
#> logLik -70.1337 eps 0.1459 iteration    14 qsel 3
#> logLik -67.9227 eps 0.2817 iteration    15 qsel 3
#> logLik -65.4943 eps 0.0130 iteration    16 qsel 3
#> logLik -63.3531 eps 0.1711 iteration    17 qsel 3
#> logLik -61.1202 eps 0.0121 iteration    18 qsel 3
#> logLik -59.2322 eps 0.1309 iteration    19 qsel 3
#> logLik -57.2002 eps 0.0112 iteration    20 qsel 3
#> logLik -55.2605 eps 0.1591 iteration    21 qsel 3
#> logLik -53.2267 eps 0.1866 iteration    22 qsel 3
#> logLik -51.1683 eps 0.0110 iteration    23 qsel 3
#> logLik -49.4665 eps 0.0097 iteration    24 qsel 3
#> logLik -47.7014 eps 2.6650 iteration    25 qsel 3
#> logLik -45.9785 eps 0.0927 iteration    26 qsel 3
#> logLik -44.1828 eps 0.1599 iteration    27 qsel 3
#> logLik -42.3163 eps 0.0100 iteration    28 qsel 3
#> logLik -40.7748 eps 0.0089 iteration    29 qsel 3
#> logLik -39.2042 eps 0.0791 iteration    30 qsel 3
#> logLik -35.9207 eps 0.1598 iteration    31 qsel 4
#> logLik -34.2522 eps 0.0091 iteration    32 qsel 4
#> logLik -32.7356 eps 0.1806 iteration    33 qsel 4
#> logLik -31.0976 eps 0.0760 iteration    34 qsel 4
#> logLik -29.4581 eps 0.0088 iteration    35 qsel 4
#> logLik -28.0521 eps 0.0975 iteration    36 qsel 4
#> logLik -24.9374 eps 0.1108 iteration    37 qsel 4
#> logLik -23.2033 eps 0.0090 iteration    38 qsel 4
#> logLik -21.7720 eps 0.0079 iteration    39 qsel 4
#> logLik -20.4384 eps 0.0772 iteration    40 qsel 4
#> logLik -18.9448 eps 0.0628 iteration    41 qsel 4
#> logLik -17.5518 eps 0.0077 iteration    42 qsel 4
#> logLik -16.2443 eps 0.1071 iteration    43 qsel 4
#> logLik -13.2143 eps 0.1163 iteration    44 qsel 4
#> logLik -11.7351 eps 0.0078 iteration    45 qsel 4
#> logLik -10.4176 eps 0.0774 iteration    46 qsel 4
#> logLik  -9.0997 eps 0.0072 iteration    47 qsel 4
#> logLik  -7.9443 eps 0.1203 iteration    48 qsel 4
#> logLik  -6.7759 eps 0.0640 iteration    49 qsel 4
#> logLik  -3.9909 eps 0.1368 iteration    50 qsel 4
#> logLik  -2.5221 eps 0.0076 iteration    51 qsel 4
#> logLik  -1.3116 eps 0.0067 iteration    52 qsel 4
#> logLik  -0.2725 eps 0.2325 iteration    53 qsel 4
#> logLik   0.7922 eps 0.0062 iteration    54 qsel 4
#> logLik   1.8299 eps 0.0634 iteration    55 qsel 4
#> logLik   3.0508 eps 0.0552 iteration    56 qsel 4
#> logLik   5.6527 eps 0.0913 iteration    57 qsel 4
#> logLik   6.8499 eps 0.0065 iteration    58 qsel 4
#> logLik   7.8347 eps 0.0058 iteration    59 qsel 4
#> logLik   8.7904 eps 0.0788 iteration    60 qsel 4
#> logLik   9.6650 eps 0.0530 iteration    61 qsel 4
#> logLik  10.7351 eps 0.0585 iteration    62 qsel 4
#> logLik  13.0474 eps 0.0764 iteration    63 qsel 4
#> logLik  14.1896 eps 0.0062 iteration    64 qsel 4
#> logLik  15.1288 eps 0.0055 iteration    65 qsel 4
#> logLik  16.0131 eps 0.0034 iteration    66 qsel 5
#> logLik  16.8679 eps 0.0540 iteration    67 qsel 5
#> logLik  17.7902 eps 0.0520 iteration    68 qsel 5
#> logLik  18.7188 eps 0.0054 iteration    69 qsel 5
#> logLik  19.4813 eps 0.0048 iteration    70 qsel 5
#> logLik  20.2252 eps 0.0388 iteration    71 qsel 5
#> logLik  20.9681 eps 0.2632 iteration    72 qsel 5
#> logLik  23.1166 eps 0.0890 iteration    73 qsel 5
#> logLik  23.9373 eps 0.0050 iteration    74 qsel 5
#> logLik  24.6106 eps 0.0044 iteration    75 qsel 5
#> logLik  25.3538 eps 0.0033 iteration    76 qsel 5
#> logLik  26.0108 eps 0.0689 iteration    77 qsel 5
#> logLik  27.9003 eps 0.0796 iteration    78 qsel 5
#> logLik  28.7254 eps 0.0410 iteration    79 qsel 5
#> logLik  29.4862 eps 0.0047 iteration    80 qsel 5
#> logLik  30.1101 eps 0.0042 iteration    81 qsel 5
#> logLik  30.7439 eps 0.0359 iteration    82 qsel 5
#> logLik  31.3241 eps 0.0500 iteration    83 qsel 5
#> logLik  32.9731 eps 0.0896 iteration    84 qsel 5
#> logLik  33.7067 eps 0.0647 iteration    85 qsel 5
#> logLik  34.3911 eps 0.0043 iteration    86 qsel 5
#> logLik  34.9519 eps 0.0039 iteration    87 qsel 5
#> logLik  35.6041 eps 0.0034 iteration    88 qsel 5
#> logLik  36.1224 eps 0.0357 iteration    89 qsel 5
#> logLik  36.6377 eps 0.0513 iteration    90 qsel 5
#> logLik  38.0800 eps 0.0816 iteration    91 qsel 5
#> logLik  38.7244 eps 0.0414 iteration    92 qsel 5
#> logLik  39.3561 eps 0.0041 iteration    93 qsel 5
#> logLik  39.8735 eps 0.0036 iteration    94 qsel 5
#> logLik  40.3215 eps 0.0496 iteration    95 qsel 5
#> logLik  40.7690 eps 0.0353 iteration    96 qsel 5
#> logLik  42.0368 eps 0.1407 iteration    97 qsel 5
#> logLik  42.5512 eps 0.0036 iteration    98 qsel 5
#> logLik  43.1263 eps 0.0033 iteration    99 qsel 5
#> logLik  43.5704 eps 0.0033 iteration   100 qsel 5
#> logLik  43.9706 eps 0.0380 iteration   101 qsel 5
#> logLik  44.4095 eps 0.0420 iteration   102 qsel 6
#> 
#>  elapsed time:  0.27sec
#> Stability selection boosting run 5 / 10 

#> logLik -107.777 eps 0.1842 iteration     2 qsel 1
#> logLik -102.541 eps 0.2629 iteration     3 qsel 2
#> logLik -97.7032 eps 0.4275 iteration     4 qsel 2
#> logLik -93.4226 eps 0.3070 iteration     5 qsel 2
#> logLik -89.4628 eps 1.6385 iteration     6 qsel 2
#> logLik -85.9622 eps 0.3274 iteration     7 qsel 2
#> logLik -82.7200 eps 0.2817 iteration     8 qsel 2
#> logLik -79.6351 eps 0.3620 iteration     9 qsel 3
#> logLik -76.7540 eps 0.2124 iteration    10 qsel 3
#> logLik -74.1020 eps 0.5110 iteration    11 qsel 3
#> logLik -71.5660 eps 0.2479 iteration    12 qsel 3
#> logLik -69.1941 eps 0.5268 iteration    13 qsel 3
#> logLik -67.0237 eps 0.1974 iteration    14 qsel 3
#> logLik -64.9296 eps 0.0118 iteration    15 qsel 3
#> logLik -62.7422 eps 0.1862 iteration    16 qsel 3
#> logLik -60.6954 eps 0.2660 iteration    17 qsel 3
#> logLik -58.5510 eps 0.0117 iteration    18 qsel 3
#> logLik -56.5985 eps 0.1701 iteration    19 qsel 3
#> logLik -54.6387 eps 0.0108 iteration    20 qsel 3
#> logLik -52.6608 eps 0.1444 iteration    21 qsel 3
#> logLik -50.8113 eps 0.1119 iteration    22 qsel 3
#> logLik -48.8361 eps 0.0107 iteration    23 qsel 3
#> logLik -47.0850 eps 0.1639 iteration    24 qsel 3
#> logLik -45.2947 eps 0.0099 iteration    25 qsel 3
#> logLik -43.5110 eps 0.1085 iteration    26 qsel 3
#> logLik -41.8462 eps 0.0885 iteration    27 qsel 3
#> logLik -40.0666 eps 0.0097 iteration    28 qsel 3
#> logLik -38.5026 eps 0.0850 iteration    29 qsel 3
#> logLik -35.5267 eps 0.1194 iteration    30 qsel 4
#> logLik -33.6548 eps 0.0097 iteration    31 qsel 4
#> logLik -32.1087 eps 0.0086 iteration    32 qsel 4
#> logLik -30.6066 eps 0.1604 iteration    33 qsel 4
#> logLik -28.9854 eps 0.0881 iteration    34 qsel 4
#> logLik -27.4621 eps 0.0084 iteration    35 qsel 4
#> logLik -26.0104 eps 0.0790 iteration    36 qsel 4
#> logLik -23.0301 eps 0.0878 iteration    37 qsel 4
#> logLik -21.4166 eps 0.0085 iteration    38 qsel 4
#> logLik -20.0859 eps 0.0075 iteration    39 qsel 4
#> logLik -18.7325 eps 0.0933 iteration    40 qsel 4
#> logLik -17.2820 eps 0.0657 iteration    41 qsel 4
#> logLik -15.9833 eps 0.0073 iteration    42 qsel 4
#> logLik -14.6499 eps 0.0475 iteration    43 qsel 4
#> logLik -11.6982 eps 0.0727 iteration    44 qsel 4
#> logLik -10.3146 eps 0.0075 iteration    45 qsel 4
#> logLik  -9.1441 eps 0.0529 iteration    46 qsel 4
#> logLik  -7.9204 eps 0.0069 iteration    47 qsel 4
#> logLik  -6.7440 eps 0.0619 iteration    48 qsel 4
#> logLik  -5.4557 eps 0.0526 iteration    49 qsel 4
#> logLik  -2.6834 eps 0.0461 iteration    50 qsel 4
#> logLik  -1.2984 eps 0.0073 iteration    51 qsel 4
#> logLik  -0.1577 eps 0.0065 iteration    52 qsel 4
#> logLik   0.8910 eps 0.0343 iteration    53 qsel 4
#> logLik   1.9247 eps 0.0922 iteration    54 qsel 4
#> logLik   3.0347 eps 0.0497 iteration    55 qsel 4
#> logLik   5.5839 eps 0.0420 iteration    56 qsel 4
#> logLik   6.9241 eps 0.0069 iteration    57 qsel 4
#> logLik   8.0276 eps 0.0062 iteration    58 qsel 4
#> logLik   8.9379 eps 0.0529 iteration    59 qsel 4
#> logLik   9.9022 eps 0.0057 iteration    60 qsel 4
#> logLik  10.8362 eps 0.0356 iteration    61 qsel 4
#> logLik  11.8272 eps 0.0326 iteration    62 qsel 4
#> logLik  12.7330 eps 0.0054 iteration    63 qsel 4
#> logLik  13.5336 eps 0.0333 iteration    64 qsel 4
#> logLik  14.3244 eps 0.0283 iteration    65 qsel 4
#> logLik  16.7413 eps 0.0397 iteration    66 qsel 4
#> logLik  17.7236 eps 0.0056 iteration    67 qsel 4
#> logLik  18.5806 eps 0.0271 iteration    68 qsel 4
#> logLik  19.4376 eps 0.0051 iteration    69 qsel 4
#> logLik  20.6598 eps 0.0055 iteration    70 qsel 5
#> logLik  22.7750 eps 0.0380 iteration    71 qsel 5
#> logLik  23.6674 eps 0.0052 iteration    72 qsel 5
#> logLik  24.3999 eps 0.0046 iteration    73 qsel 5
#> logLik  25.5193 eps 0.0050 iteration    74 qsel 5
#> logLik  26.1945 eps 0.0352 iteration    75 qsel 5
#> logLik  26.8846 eps 0.0044 iteration    76 qsel 5
#> logLik  27.8341 eps 0.0045 iteration    77 qsel 5
#> logLik  28.5003 eps 0.0202 iteration    78 qsel 5
#> logLik  30.2238 eps 0.0453 iteration    79 qsel 5
#> logLik  30.9573 eps 0.0046 iteration    80 qsel 5
#> logLik  31.6500 eps 0.0219 iteration    81 qsel 5
#> logLik  32.2855 eps 0.0042 iteration    82 qsel 5
#> logLik  32.8689 eps 0.0197 iteration    83 qsel 5
#> logLik  33.4478 eps 0.0223 iteration    84 qsel 5
#> logLik  34.1493 eps 0.0356 iteration    85 qsel 6
#> 
#>  elapsed time:  0.23sec
#> Stability selection boosting run 6 / 10 

#> logLik -125.209 eps 0.1975 iteration     2 qsel 1
#> logLik -118.872 eps 0.7340 iteration     3 qsel 1
#> logLik -113.733 eps 0.8081 iteration     4 qsel 1
#> logLik -109.166 eps 1.5446 iteration     5 qsel 2
#> logLik -104.981 eps 0.3652 iteration     6 qsel 2
#> logLik -100.944 eps 0.2234 iteration     7 qsel 3
#> logLik -97.2369 eps 0.2675 iteration     8 qsel 3
#> logLik -93.9443 eps 0.2097 iteration     9 qsel 3
#> logLik -90.7580 eps 0.4263 iteration    10 qsel 3
#> logLik -87.7455 eps 0.1628 iteration    11 qsel 3
#> logLik -85.1540 eps 0.2457 iteration    12 qsel 3
#> logLik -82.6940 eps 0.1710 iteration    13 qsel 3
#> logLik -80.1767 eps 0.4862 iteration    14 qsel 3
#> logLik -77.3836 eps 0.0150 iteration    15 qsel 3
#> logLik -75.0663 eps 0.0131 iteration    16 qsel 3
#> logLik -72.8015 eps 0.2359 iteration    17 qsel 3
#> logLik -70.5808 eps 0.1349 iteration    18 qsel 3
#> logLik -68.1948 eps 0.0130 iteration    19 qsel 3
#> logLik -65.8631 eps 0.1241 iteration    20 qsel 3
#> logLik -63.6480 eps 0.0121 iteration    21 qsel 3
#> logLik -61.6795 eps 0.1291 iteration    22 qsel 3
#> logLik -59.6551 eps 0.0113 iteration    23 qsel 3
#> logLik -57.5666 eps 0.1192 iteration    24 qsel 3
#> logLik -55.5268 eps 0.0999 iteration    25 qsel 3
#> logLik -53.4600 eps 0.0112 iteration    26 qsel 3
#> logLik -51.7512 eps 0.0098 iteration    27 qsel 3
#> logLik -49.9776 eps 0.1070 iteration    28 qsel 3
#> logLik -48.1187 eps 0.0925 iteration    29 qsel 3
#> logLik -46.3375 eps 0.1688 iteration    30 qsel 3
#> logLik -43.3061 eps 0.1057 iteration    31 qsel 4
#> logLik -41.1147 eps 0.0111 iteration    32 qsel 4
#> logLik -39.3016 eps 0.0097 iteration    33 qsel 4
#> logLik -37.7171 eps 0.2346 iteration    34 qsel 4
#> logLik -36.0849 eps 0.0090 iteration    35 qsel 4
#> logLik -34.5172 eps 0.1077 iteration    36 qsel 4
#> logLik -32.9005 eps 0.0937 iteration    37 qsel 4
#> logLik -29.8957 eps 0.9112 iteration    38 qsel 4
#> logLik -28.0129 eps 0.0096 iteration    39 qsel 4
#> logLik -26.4577 eps 0.0085 iteration    40 qsel 4
#> logLik -25.0532 eps 0.2509 iteration    41 qsel 4
#> logLik -23.6621 eps 0.0078 iteration    42 qsel 4
#> logLik -22.3011 eps 0.0776 iteration    43 qsel 4
#> logLik -20.8410 eps 0.1787 iteration    44 qsel 4
#> logLik -17.8991 eps 0.1113 iteration    45 qsel 4
#> logLik -16.3014 eps 0.0083 iteration    46 qsel 4
#> logLik -14.9838 eps 0.0074 iteration    47 qsel 4
#> logLik -13.7529 eps 0.0573 iteration    48 qsel 4
#> logLik -12.5820 eps 0.0068 iteration    49 qsel 4
#> logLik -11.4152 eps 0.0498 iteration    50 qsel 4
#> logLik -10.1010 eps 0.1493 iteration    51 qsel 4
#> logLik  -7.2761 eps 0.0696 iteration    52 qsel 4
#> logLik  -5.9391 eps 0.0072 iteration    53 qsel 4
#> logLik  -4.8381 eps 0.0064 iteration    54 qsel 4
#> logLik  -3.7702 eps 0.0428 iteration    55 qsel 4
#> logLik  -2.7982 eps 0.0059 iteration    56 qsel 4
#> logLik  -1.8099 eps 0.0445 iteration    57 qsel 4
#> logLik  -0.6288 eps 0.0363 iteration    58 qsel 4
#> logLik   2.0187 eps 0.0566 iteration    59 qsel 4
#> logLik   3.1203 eps 0.0063 iteration    60 qsel 4
#> logLik   4.0260 eps 0.0056 iteration    61 qsel 4
#> logLik   4.9444 eps 0.0646 iteration    62 qsel 4
#> logLik   6.0000 eps 0.0394 iteration    63 qsel 4
#> logLik   8.3717 eps 0.0633 iteration    64 qsel 4
#> logLik   9.3759 eps 0.0058 iteration    65 qsel 4
#> logLik  10.2008 eps 0.0052 iteration    66 qsel 4
#> logLik  11.0040 eps 0.0312 iteration    67 qsel 4
#> logLik  11.7689 eps 0.0301 iteration    68 qsel 4
#> logLik  12.6978 eps 0.0372 iteration    69 qsel 4
#> logLik  14.7814 eps 0.0549 iteration    70 qsel 4
#> logLik  15.7205 eps 0.0055 iteration    71 qsel 4
#> logLik  16.4916 eps 0.0049 iteration    72 qsel 4
#> logLik  17.1448 eps 0.0212 iteration    73 qsel 4
#> logLik  17.8103 eps 0.0045 iteration    74 qsel 4
#> logLik  18.4647 eps 0.0280 iteration    75 qsel 4
#> logLik  19.3123 eps 0.0367 iteration    76 qsel 4
#> logLik  19.9969 eps 0.0264 iteration    77 qsel 5
#> logLik  21.8488 eps 0.0408 iteration    78 qsel 5
#> logLik  22.5977 eps 0.0047 iteration    79 qsel 5
#> logLik  23.2496 eps 0.0220 iteration    80 qsel 6
#> 
#>  elapsed time:  0.23sec
#> Stability selection boosting run 7 / 10 

#> logLik -120.464 eps 0.5589 iteration     2 qsel 1
#> logLik -114.199 eps 0.7678 iteration     3 qsel 2
#> logLik -108.665 eps 0.8519 iteration     4 qsel 2
#> logLik -103.625 eps 0.2723 iteration     5 qsel 2
#> logLik -99.1777 eps 0.3607 iteration     6 qsel 2
#> logLik -95.1204 eps 0.9253 iteration     7 qsel 2
#> logLik -91.5425 eps 0.2024 iteration     8 qsel 2
#> logLik -88.2740 eps 0.4820 iteration     9 qsel 2
#> logLik -85.3940 eps 0.2519 iteration    10 qsel 2
#> logLik -82.3944 eps 0.3348 iteration    11 qsel 3
#> logLik -79.7955 eps 1.0365 iteration    12 qsel 3
#> logLik -77.5251 eps 0.2577 iteration    13 qsel 3
#> logLik -75.0900 eps 0.0135 iteration    14 qsel 3
#> logLik -72.5776 eps 0.1769 iteration    15 qsel 3
#> logLik -70.2987 eps 0.0127 iteration    16 qsel 3
#> logLik -68.0127 eps 0.2221 iteration    17 qsel 3
#> logLik -65.8988 eps 0.0119 iteration    18 qsel 3
#> logLik -63.8224 eps 0.2840 iteration    19 qsel 3
#> logLik -61.6120 eps 0.2492 iteration    20 qsel 3
#> logLik -59.4432 eps 0.0118 iteration    21 qsel 3
#> logLik -57.4404 eps 0.2907 iteration    22 qsel 3
#> logLik -55.4539 eps 0.0110 iteration    23 qsel 3
#> logLik -53.6510 eps 0.2135 iteration    24 qsel 3
#> logLik -51.7026 eps 0.1168 iteration    25 qsel 3
#> logLik -49.7097 eps 0.0108 iteration    26 qsel 3
#> logLik -47.9595 eps 0.2108 iteration    27 qsel 3
#> logLik -46.1534 eps 0.0100 iteration    28 qsel 3
#> logLik -44.5917 eps 0.1383 iteration    29 qsel 3
#> logLik -42.8724 eps 0.7644 iteration    30 qsel 3
#> logLik -41.0938 eps 0.0097 iteration    31 qsel 3
#> logLik -39.5699 eps 0.1118 iteration    32 qsel 3
#> logLik -37.9732 eps 0.0090 iteration    33 qsel 3
#> logLik -36.6247 eps 0.2680 iteration    34 qsel 3
#> logLik -35.1061 eps 0.0946 iteration    35 qsel 3
#> logLik -31.7879 eps 0.2005 iteration    36 qsel 4
#> logLik -29.9418 eps 0.0095 iteration    37 qsel 4
#> logLik -28.4173 eps 0.0084 iteration    38 qsel 4
#> logLik -27.0833 eps 0.0774 iteration    39 qsel 4
#> logLik -25.7246 eps 0.0078 iteration    40 qsel 4
#> logLik -24.4767 eps 0.8021 iteration    41 qsel 4
#> logLik -21.3138 eps 0.2076 iteration    42 qsel 4
#> logLik -19.8618 eps 0.0079 iteration    43 qsel 4
#> logLik -18.4854 eps 0.0588 iteration    44 qsel 4
#> logLik -17.1868 eps 0.0074 iteration    45 qsel 4
#> logLik -16.0320 eps 0.1223 iteration    46 qsel 4
#> logLik -14.8831 eps 0.0068 iteration    47 qsel 4
#> logLik -13.7416 eps 0.0523 iteration    48 qsel 4
#> logLik -10.7898 eps 0.1254 iteration    49 qsel 4
#> logLik  -9.5658 eps 0.0069 iteration    50 qsel 4
#> logLik  -8.3367 eps 0.0603 iteration    51 qsel 4
#> logLik  -7.2474 eps 0.0064 iteration    52 qsel 4
#> logLik  -6.2428 eps 0.0519 iteration    53 qsel 4
#> logLik  -5.2540 eps 0.0745 iteration    54 qsel 4
#> logLik  -2.6298 eps 0.0843 iteration    55 qsel 4
#> logLik  -1.4258 eps 0.0067 iteration    56 qsel 4
#> logLik  -0.4352 eps 0.0059 iteration    57 qsel 4
#> logLik   0.4528 eps 0.0559 iteration    58 qsel 4
#> logLik   1.5522 eps 0.0623 iteration    59 qsel 4
#> logLik   3.8883 eps 0.3402 iteration    60 qsel 4
#> logLik   4.9744 eps 0.0062 iteration    61 qsel 4
#> logLik   5.8671 eps 0.0055 iteration    62 qsel 4
#> logLik   6.7143 eps 0.0651 iteration    63 qsel 4
#> logLik   7.4940 eps 0.0050 iteration    64 qsel 4
#> logLik   8.2944 eps 0.0029 iteration    65 qsel 5
#> logLik   9.0815 eps 0.0716 iteration    66 qsel 5
#> logLik  10.0576 eps 0.0455 iteration    67 qsel 5
#> logLik  12.1399 eps 0.0667 iteration    68 qsel 5
#> logLik  13.0377 eps 0.0054 iteration    69 qsel 5
#> logLik  13.7748 eps 0.0048 iteration    70 qsel 5
#> logLik  14.4903 eps 0.0351 iteration    71 qsel 5
#> logLik  15.1700 eps 0.0249 iteration    72 qsel 5
#> logLik  16.0359 eps 0.0333 iteration    73 qsel 5
#> logLik  17.8445 eps 0.0452 iteration    74 qsel 5
#> logLik  18.6656 eps 0.0050 iteration    75 qsel 5
#> logLik  19.3393 eps 0.0045 iteration    76 qsel 5
#> logLik  19.9254 eps 0.0198 iteration    77 qsel 5
#> logLik  20.5206 eps 0.0206 iteration    78 qsel 5
#> logLik  21.2994 eps 0.0491 iteration    79 qsel 5
#> logLik  22.8709 eps 0.0395 iteration    80 qsel 5
#> logLik  23.6000 eps 0.0046 iteration    81 qsel 5
#> logLik  24.1978 eps 0.0041 iteration    82 qsel 5
#> logLik  24.8562 eps 0.0029 iteration    83 qsel 5
#> logLik  25.3746 eps 0.0038 iteration    84 qsel 5
#> logLik  25.8829 eps 0.0170 iteration    85 qsel 5
#> logLik  26.3890 eps 0.0392 iteration    86 qsel 5
#> logLik  26.8569 eps 0.0213 iteration    87 qsel 6
#> 
#>  elapsed time:  0.23sec
#> Stability selection boosting run 8 / 10 

#> logLik -110.594 eps 0.2761 iteration     2 qsel 1
#> logLik -104.450 eps 0.6843 iteration     3 qsel 2
#> logLik -98.6740 eps 0.4498 iteration     4 qsel 2
#> logLik -93.7002 eps 2.9232 iteration     5 qsel 2
#> logLik -89.0265 eps 0.5352 iteration     6 qsel 2
#> logLik -84.9975 eps 0.2713 iteration     7 qsel 2
#> logLik -81.2140 eps 0.7983 iteration     8 qsel 2
#> logLik -77.6927 eps 0.2120 iteration     9 qsel 3
#> logLik -74.4988 eps 0.3665 iteration    10 qsel 3
#> logLik -71.4519 eps 0.4133 iteration    11 qsel 3
#> logLik -68.6537 eps 0.3454 iteration    12 qsel 3
#> logLik -66.1962 eps 0.1569 iteration    13 qsel 3
#> logLik -63.5622 eps 0.0136 iteration    14 qsel 3
#> logLik -60.8926 eps 0.2221 iteration    15 qsel 3
#> logLik -58.4153 eps 0.0128 iteration    16 qsel 3
#> logLik -55.9423 eps 0.1353 iteration    17 qsel 3
#> logLik -53.6295 eps 0.0120 iteration    18 qsel 3
#> logLik -51.3188 eps 0.1492 iteration    19 qsel 3
#> logLik -48.9735 eps 0.1419 iteration    20 qsel 3
#> logLik -46.5727 eps 0.0120 iteration    21 qsel 3
#> logLik -44.3923 eps 1.1939 iteration    22 qsel 3
#> logLik -42.1800 eps 0.0112 iteration    23 qsel 3
#> logLik -40.1229 eps 0.0817 iteration    24 qsel 3
#> logLik -38.0646 eps 0.1687 iteration    25 qsel 3
#> logLik -35.8198 eps 0.0110 iteration    26 qsel 3
#> logLik -33.8984 eps 0.0966 iteration    27 qsel 3
#> logLik -31.8523 eps 0.0102 iteration    28 qsel 3
#> logLik -30.0269 eps 1.2803 iteration    29 qsel 3
#> logLik -28.1669 eps 0.0095 iteration    30 qsel 3
#> logLik -26.2846 eps 0.1824 iteration    31 qsel 3
#> logLik -23.1951 eps 0.2012 iteration    32 qsel 4
#> logLik -21.2025 eps 0.0097 iteration    33 qsel 4
#> logLik -19.5557 eps 0.0086 iteration    34 qsel 4
#> logLik -17.8665 eps 0.0783 iteration    35 qsel 4
#> logLik -16.1198 eps 0.1356 iteration    36 qsel 4
#> logLik -14.4758 eps 0.0084 iteration    37 qsel 4
#> logLik -12.8148 eps 0.0689 iteration    38 qsel 4
#> logLik  -9.8123 eps 0.0936 iteration    39 qsel 4
#> logLik  -8.0606 eps 0.0086 iteration    40 qsel 4
#> logLik  -6.5758 eps 0.1967 iteration    41 qsel 4
#> logLik  -5.0062 eps 0.0079 iteration    42 qsel 4
#> logLik  -3.5791 eps 0.0701 iteration    43 qsel 4
#> logLik  -2.0874 eps 0.0681 iteration    44 qsel 4
#> logLik  -0.5596 eps 0.0077 iteration    45 qsel 4
#> logLik   0.7392 eps 0.0729 iteration    46 qsel 4
#> logLik   3.6400 eps 0.0935 iteration    47 qsel 4
#> logLik   5.2377 eps 0.0078 iteration    48 qsel 4
#> logLik   6.5554 eps 0.0069 iteration    49 qsel 4
#> logLik   7.7943 eps 0.0431 iteration    50 qsel 4
#> logLik   9.0842 eps 0.0883 iteration    51 qsel 4
#> logLik  10.3502 eps 0.0066 iteration    52 qsel 4
#> logLik  11.5275 eps 0.0450 iteration    53 qsel 4
#> logLik  14.3020 eps 0.0912 iteration    54 qsel 4
#> logLik  15.6279 eps 0.0067 iteration    55 qsel 4
#> logLik  16.7196 eps 0.0060 iteration    56 qsel 4
#> logLik  17.7462 eps 0.0549 iteration    57 qsel 4
#> logLik  18.8092 eps 0.0459 iteration    58 qsel 4
#> logLik  21.3283 eps 0.0502 iteration    59 qsel 4
#> logLik  22.5340 eps 0.0062 iteration    60 qsel 4
#> logLik  23.6343 eps 0.0322 iteration    61 qsel 4
#> logLik  24.6990 eps 0.0057 iteration    62 qsel 4
#> logLik  25.5882 eps 0.0946 iteration    63 qsel 4
#> logLik  26.5179 eps 0.0053 iteration    64 qsel 4
#> logLik  27.4238 eps 0.0276 iteration    65 qsel 4
#> logLik  29.7669 eps 0.0398 iteration    66 qsel 4
#> logLik  30.7236 eps 0.0053 iteration    67 qsel 4
#> logLik  31.6712 eps 0.0291 iteration    68 qsel 4
#> logLik  32.5115 eps 0.0049 iteration    69 qsel 4
#> logLik  33.2990 eps 0.0201 iteration    70 qsel 4
#> logLik  35.4003 eps 0.0568 iteration    71 qsel 4
#> logLik  36.2510 eps 0.0049 iteration    72 qsel 4
#> logLik  36.9929 eps 0.0966 iteration    73 qsel 4
#> logLik  37.7877 eps 0.0337 iteration    74 qsel 4
#> logLik  38.5698 eps 0.0046 iteration    75 qsel 4
#> logLik  39.2455 eps 0.0210 iteration    76 qsel 4
#> logLik  40.0616 eps 0.0270 iteration    77 qsel 5
#> logLik  41.9066 eps 0.0429 iteration    78 qsel 5
#> logLik  42.7288 eps 0.0047 iteration    79 qsel 5
#> logLik  43.4693 eps 0.0223 iteration    80 qsel 6
#> 
#>  elapsed time:  0.22sec
#> Stability selection boosting run 9 / 10 

#> logLik -125.595 eps 0.3992 iteration     2 qsel 1
#> logLik -119.793 eps 0.7282 iteration     3 qsel 1
#> logLik -114.758 eps 0.7832 iteration     4 qsel 2
#> logLik -110.010 eps 0.2769 iteration     5 qsel 2
#> logLik -105.887 eps 58.563 iteration     6 qsel 2
#> logLik -102.002 eps 0.2570 iteration     7 qsel 2
#> logLik -98.6247 eps 0.3091 iteration     8 qsel 2
#> logLik -95.4447 eps 0.1572 iteration     9 qsel 2
#> logLik -92.1143 eps 0.3855 iteration    10 qsel 3
#> logLik -89.3596 eps 0.3979 iteration    11 qsel 3
#> logLik -86.8114 eps 0.1706 iteration    12 qsel 3
#> logLik -84.1389 eps 0.2030 iteration    13 qsel 3
#> logLik -81.8385 eps 0.0134 iteration    14 qsel 3
#> logLik -79.4766 eps 0.7750 iteration    15 qsel 3
#> logLik -77.3290 eps 0.2032 iteration    16 qsel 3
#> logLik -74.9568 eps 0.0133 iteration    17 qsel 3
#> logLik -72.5803 eps 1.7943 iteration    18 qsel 3
#> logLik -70.3728 eps 0.0125 iteration    19 qsel 3
#> logLik -68.2445 eps 0.5178 iteration    20 qsel 3
#> logLik -66.2108 eps 0.0116 iteration    21 qsel 3
#> logLik -64.2180 eps 0.3582 iteration    22 qsel 3
#> logLik -62.1080 eps 0.1271 iteration    23 qsel 3
#> logLik -60.0350 eps 0.0115 iteration    24 qsel 3
#> logLik -58.1266 eps 0.1530 iteration    25 qsel 3
#> logLik -56.2346 eps 0.0107 iteration    26 qsel 3
#> logLik -54.4794 eps 0.2160 iteration    27 qsel 3
#> logLik -52.6043 eps 0.0985 iteration    28 qsel 3
#> logLik -50.7122 eps 0.0104 iteration    29 qsel 3
#> logLik -49.0066 eps 0.1487 iteration    30 qsel 3
#> logLik -47.2940 eps 0.0097 iteration    31 qsel 3
#> logLik -45.7529 eps 0.2509 iteration    32 qsel 3
#> logLik -44.2126 eps 0.0090 iteration    33 qsel 3
#> logLik -42.6945 eps 0.3272 iteration    34 qsel 3
#> logLik -40.9640 eps 0.0835 iteration    35 qsel 3
#> logLik -39.4357 eps 0.0088 iteration    36 qsel 3
#> logLik -38.0901 eps 0.0734 iteration    37 qsel 3
#> logLik -36.7271 eps 0.0081 iteration    38 qsel 3
#> logLik -35.3847 eps 0.0983 iteration    39 qsel 3
#> logLik -33.8520 eps 0.0768 iteration    40 qsel 3
#> logLik -30.5082 eps 0.1095 iteration    41 qsel 4
#> logLik -28.8998 eps 0.0087 iteration    42 qsel 4
#> logLik -27.5733 eps 0.0077 iteration    43 qsel 4
#> logLik -26.3432 eps 0.4941 iteration    44 qsel 4
#> logLik -25.1646 eps 0.0071 iteration    45 qsel 4
#> logLik -23.9701 eps 0.0817 iteration    46 qsel 4
#> logLik -22.5902 eps 0.2895 iteration    47 qsel 4
#> logLik -19.4309 eps 0.5418 iteration    48 qsel 4
#> logLik -18.0525 eps 0.0077 iteration    49 qsel 4
#> logLik -16.9173 eps 0.0068 iteration    50 qsel 4
#> logLik -15.8029 eps 0.0825 iteration    51 qsel 4
#> logLik -14.7783 eps 0.0759 iteration    52 qsel 4
#> logLik -11.9517 eps 0.0784 iteration    53 qsel 4
#> logLik -10.6764 eps 0.0071 iteration    54 qsel 4
#> logLik  -9.4467 eps 0.1723 iteration    55 qsel 4
#> logLik  -8.3127 eps 0.0066 iteration    56 qsel 4
#> logLik  -7.3376 eps 0.0418 iteration    57 qsel 4
#> logLik  -6.3429 eps 0.0061 iteration    58 qsel 4
#> logLik  -5.4333 eps 0.0439 iteration    59 qsel 4
#> logLik  -2.8461 eps 0.1011 iteration    60 qsel 4
#> logLik  -1.8119 eps 0.0061 iteration    61 qsel 4
#> logLik  -0.9527 eps 0.0487 iteration    62 qsel 4
#> logLik   0.1605 eps 0.0551 iteration    63 qsel 4
#> logLik   1.1319 eps 0.0058 iteration    64 qsel 4
#> logLik   1.9298 eps 0.0052 iteration    65 qsel 4
#> logLik   2.7329 eps 0.0356 iteration    66 qsel 4
#> logLik   5.0644 eps 0.3721 iteration    67 qsel 4
#> logLik   5.8897 eps 0.0052 iteration    68 qsel 4
#> logLik   6.6537 eps 0.0265 iteration    69 qsel 4
#> logLik   7.6733 eps 0.3503 iteration    70 qsel 4
#> logLik   8.4467 eps 0.0050 iteration    71 qsel 4
#> logLik   9.1349 eps 0.0276 iteration    72 qsel 4
#> logLik  11.1612 eps 0.0695 iteration    73 qsel 4
#> logLik  11.9397 eps 0.0050 iteration    74 qsel 4
#> logLik  12.5985 eps 0.0504 iteration    75 qsel 4
#> logLik  13.5145 eps 0.0450 iteration    76 qsel 4
#> logLik  14.2348 eps 0.0047 iteration    77 qsel 4
#> logLik  14.8613 eps 0.0225 iteration    78 qsel 5
#> logLik  15.4823 eps 0.0043 iteration    79 qsel 5
#> logLik  16.0890 eps 0.0244 iteration    80 qsel 5
#> logLik  17.8805 eps 0.0395 iteration    81 qsel 5
#> logLik  18.5013 eps 0.0043 iteration    82 qsel 5
#> logLik  19.0793 eps 0.0156 iteration    83 qsel 5
#> logLik  19.9104 eps 0.0367 iteration    84 qsel 5
#> logLik  20.4831 eps 0.0041 iteration    85 qsel 5
#> logLik  21.0624 eps 0.0382 iteration    86 qsel 6
#> 
#>  elapsed time:  0.22sec
#> Stability selection boosting run 10 / 10 

#> logLik -124.376 eps 0.2020 iteration     2 qsel 1
#> logLik -118.987 eps 0.5100 iteration     3 qsel 2
#> logLik -113.866 eps 0.6241 iteration     4 qsel 2
#> logLik -109.470 eps 0.6343 iteration     5 qsel 2
#> logLik -105.293 eps 0.7178 iteration     6 qsel 2
#> logLik -101.705 eps 0.6067 iteration     7 qsel 2
#> logLik -98.2963 eps 0.8038 iteration     8 qsel 2
#> logLik -94.7609 eps 0.3064 iteration     9 qsel 3
#> logLik -91.8834 eps 0.2975 iteration    10 qsel 3
#> logLik -89.1459 eps 2.7590 iteration    11 qsel 3
#> logLik -86.3403 eps 0.2020 iteration    12 qsel 3
#> logLik -84.0302 eps 0.2105 iteration    13 qsel 3
#> logLik -81.8280 eps 0.2773 iteration    14 qsel 3
#> logLik -79.5039 eps 0.0134 iteration    15 qsel 3
#> logLik -77.1583 eps 0.1994 iteration    16 qsel 3
#> logLik -74.9976 eps 0.0125 iteration    17 qsel 3
#> logLik -72.9517 eps 0.2246 iteration    18 qsel 3
#> logLik -70.9681 eps 0.0117 iteration    19 qsel 3
#> logLik -68.9214 eps 0.2521 iteration    20 qsel 3
#> logLik -66.8672 eps 0.1343 iteration    21 qsel 3
#> logLik -64.8421 eps 0.0115 iteration    22 qsel 3
#> logLik -63.0387 eps 0.1115 iteration    23 qsel 3
#> logLik -61.1993 eps 0.0107 iteration    24 qsel 3
#> logLik -59.3917 eps 1.0918 iteration    25 qsel 3
#> logLik -57.5930 eps 0.1030 iteration    26 qsel 3
#> logLik -55.7527 eps 0.0105 iteration    27 qsel 3
#> logLik -54.1679 eps 0.0611 iteration    28 qsel 3
#> logLik -52.5117 eps 0.0097 iteration    29 qsel 3
#> logLik -50.9194 eps 0.2067 iteration    30 qsel 3
#> logLik -47.0653 eps 0.1033 iteration    31 qsel 4
#> logLik -45.2287 eps 0.0100 iteration    32 qsel 4
#> logLik -43.6010 eps 0.1576 iteration    33 qsel 4
#> logLik -41.9443 eps 0.0093 iteration    34 qsel 4
#> logLik -40.5667 eps 0.0663 iteration    35 qsel 4
#> logLik -39.0891 eps 0.0086 iteration    36 qsel 4
#> logLik -37.6232 eps 0.0580 iteration    37 qsel 4
#> logLik -33.9604 eps 0.0933 iteration    38 qsel 4
#> logLik -32.3309 eps 0.0089 iteration    39 qsel 4
#> logLik -30.8601 eps 0.0717 iteration    40 qsel 4
#> logLik -29.3987 eps 0.0082 iteration    41 qsel 4
#> logLik -28.1535 eps 0.0455 iteration    42 qsel 4
#> logLik -26.8566 eps 0.0076 iteration    43 qsel 4
#> logLik -25.5712 eps 0.0510 iteration    44 qsel 4
#> logLik -22.1653 eps 0.7235 iteration    45 qsel 4
#> logLik -20.7512 eps 0.0078 iteration    46 qsel 4
#> logLik -19.4253 eps 0.0537 iteration    47 qsel 4
#> logLik -18.1635 eps 0.0073 iteration    48 qsel 4
#> logLik -17.0474 eps 0.0622 iteration    49 qsel 4
#> logLik -15.9329 eps 0.0067 iteration    50 qsel 4
#> logLik -14.8099 eps 0.0385 iteration    51 qsel 4
#> logLik -11.6957 eps 0.2966 iteration    52 qsel 4
#> logLik -10.4947 eps 0.0069 iteration    53 qsel 4
#> logLik  -9.3032 eps 0.0978 iteration    54 qsel 4
#> logLik  -8.2364 eps 0.0064 iteration    55 qsel 4
#> logLik  -7.2448 eps 0.0496 iteration    56 qsel 4
#> logLik  -6.2965 eps 0.0920 iteration    57 qsel 4
#> logLik  -3.5661 eps 0.2209 iteration    58 qsel 4
#> logLik  -2.3806 eps 0.0066 iteration    59 qsel 4
#> logLik  -1.3421 eps 0.0523 iteration    60 qsel 4
#> logLik  -0.2989 eps 0.0061 iteration    61 qsel 4
#> logLik   0.5584 eps 0.0054 iteration    62 qsel 4
#> logLik   1.4353 eps 0.0671 iteration    63 qsel 4
#> logLik   2.3409 eps 0.0437 iteration    64 qsel 5
#> logLik   3.3771 eps 4.6185 iteration    65 qsel 6
#> 
#>  elapsed time:  0.17sec
#> 
plot(sel)


## Estimate selected model.
nf <- formula(sel)
b <- bamlss(nf, data = d)
#> AICc -123.239 logPost  69.3283 logLik  93.6099 edf 30.006 eps 0.5816 iteration   1
#> AICc -263.907 logPost 149.7018 logLik 164.6302 edf 30.610 eps 0.2569 iteration   2
#> AICc -287.393 logPost 162.0310 logLik 180.4552 edf 34.172 eps 0.1674 iteration   3
#> AICc -290.935 logPost 147.4173 logLik 183.1285 edf 34.952 eps 0.1033 iteration   4
#> AICc -293.177 logPost -89.8766 logLik 183.5869 edf 34.380 eps 0.0116 iteration   5
#> AICc -293.821 logPost -2574.92 logLik 183.6353 edf 34.143 eps 0.0040 iteration   6
#> AICc -293.824 logPost -2574.92 logLik 183.6394 edf 34.145 eps 0.0007 iteration   7
#> AICc -293.824 logPost -2574.92 logLik 183.6400 edf 34.145 eps 0.0000 iteration   8
#> AICc -293.824 logPost -2574.92 logLik 183.6400 edf 34.145 eps 0.0000 iteration   8
#> elapsed time:  0.25sec
#> Starting the sampler...
#> 
#> |                    |   0%  5.36sec
#> |*                   |   5%  4.47sec  0.24sec
#> |**                  |  10%  4.16sec  0.46sec
#> |***                 |  15%  4.86sec  0.86sec
#> |****                |  20%  4.38sec  1.10sec
#> |*****               |  25%  4.00sec  1.33sec
#> |******              |  30%  3.69sec  1.58sec
#> |*******             |  35%  3.39sec  1.82sec
#> |********            |  40%  3.10sec  2.07sec
#> |*********           |  45%  2.84sec  2.32sec
#> |**********          |  50%  2.57sec  2.57sec
#> |***********         |  55%  2.30sec  2.81sec
#> |************        |  60%  2.03sec  3.04sec
#> |*************       |  65%  1.77sec  3.28sec
#> |**************      |  70%  1.51sec  3.51sec
#> |***************     |  75%  1.25sec  3.75sec
#> |****************    |  80%  1.00sec  3.99sec
#> |*****************   |  85%  0.75sec  4.23sec
#> |******************  |  90%  0.50sec  4.46sec
#> |******************* |  95%  0.25sec  4.71sec
#> |********************| 100%  0.00sec  4.95sec
plot(b)