# Home Assignment -- 2

Please, write your implementation within the designated blocks:
```python
...
### BEGIN Solution

# >>> your solution here <<<

### END Solution
...
```

Write your theoretical derivations within such blocks:
```markdown
**BEGIN Solution**

<!-- >>> your derivation here <<< -->

**END Solution**
```

## $\LaTeX$ in Jupyter
Jupyter has constantly improving $\LaTeX$ support. Below are the basic methods to
write **neat, tidy, and well typeset** equations in your notebooks:
* to write an **inline** equation use
```markdown
$ you latex equation here $
```
* to write an equation, that is **displayed on a separate line** use
```markdown
$$ you latex equation here $$
```
* to write a **block of equations** use
```markdown
\begin{align}
    left-hand-side
        &= right-hand-side on line 1
        \\
        &= right-hand-side on line 2
        \\
        &= right-hand-side on the last line
\end{align}
```
The **ampersand** (`&`) aligns the equations horizontally and the **double backslash**
(`\\`) creates a new line.

# Part 2 (57 + 2 pt.): Ensemble methods

In this part you are asked to complete  several theoretical tasks as well as
a couple of practical challenges.

```python
import numpy as np

%matplotlib inline
import matplotlib.pyplot as plt
```

## Task 1 (8 pt.):  Some theory of Decision Trees

$$
\begin{aligned}
& R_m := \text{set of train objects at the node m} \\
& N_m := |R_m| \\
& p_{mk} = \frac{1}{N_m}\sum\limits_{(x_i, y_i)\in R_m}[y_i = k] \\
\end{aligned}
$$

### Task 1.1 (2 pt.)

Show that Gini Index can be written as

$$
\sum_{k\neq k'} p_{mk}p_{mk'}
    = ???
    = 1 - \sum_{k}p_{mk}^2.
$$

#### BEGIN Solution

Note that $\sum_{k} p_{mk} = N_m / N_m = 1$, what gives $\sum_{k' \neq k}p_{mk'} = 1 - p_{mk}$. Then
$$
\sum_{k\neq k'} p_{mk}p_{mk'} = \sum_{k=1}^K p_{mk}\sum_{k' \neq k}p_{mk'}=\sum_{k=1}^K p_{mk}(1-p_{mk}) = 1 - \sum_{k=1}^K p_{mk}^2. $$
**END Solution**

### Task 1.2 (6 pt.)

In fact one could view the $K$-mutliclass classification tree as a **piecewise
constant vector function** $x\mapsto T(x)$, where
\begin{equation}
    T(x) = \sum_{m=1}^J p_m [x\in R_m] \,,
\end{equation}
where $[x\in R_m]$ returns $1$ if $x\in R_m$ and $0$ otherwise. Also $(R_m)_{m=1}^J$
is the *tree-partition* of the feature space, induced by the **CART** (or any other)
algorithm, and $p_m = (p_{mq})_{q=1}^K \in [0, 1]^K$ is the vector of the empirical
class probabilities, estimated on the training sample observations, that end up in
the region $R_j$.

For example, for any observed $x$ the vector $T(x)$ represents the estimated class
probabilities in the respective tree-leaf. **Note** that the regions in the partition
do **not overlap**, and $\sum_{k=1}^K p_{mk} = 1$ for any $m$!

Consider a fixed test example $x$ with the true class class label $t\in \{1.. K\}$.
Let $j=1..J$ be some leaf of a tree $T$.

The **default** Decision Tree classifier, $\hat{y}(\cdot)$ **labels** all test
observations $x$, that fall in $R_j$, by the **same class label**, determined
by $\hat{y}(x) = \arg\max_{q=1..K} p_{mq}$.

Let's imagine an alternative rule that **assigns** a label to a test observation
$x$, falling in tree-region $R_m$, **by choosing a label at random** according
to the *estimated* distribution $p_m$:
$$ y(x)
    = \begin{cases}
        1\,, & \text{ with prob. } p_{m1} \,, \\
        \ldots & \\
        K\,, & \text{ with prob. } p_{mK} \,. \\
      \end{cases}
$$

Show that the **new labelling rule** does not improve the theoretical misclassification
error.

#### BEGIN Solution

**END Solution**

#### Solution

## Task 2 (11+2 pt.): Practice with Bootstrap and Trees

In this task you will be asked to make a couple of plots depicting the variance
of the predicted probability of class $1$ by some classification algorithm.

But first generate the toy [Crescent Moons dataset](http://scikit-learn.org/stable/modules/generated/sklearn.datasets.make_moons.html)

```python
from sklearn.datasets import make_moons

X, y = make_moons(n_samples=300, shuffle=True, noise=0.05, random_state=1011)
```

### Task 2.1 (8+2 pt.)

You need to somehow estimate a function $x\mapsto \mathbb{V} T(x)$ for a class of
estimators $T$, defined by
$$ \mathbb{V} T(x) = \mathbb{V}_{S \sim D^m} T(x; S)
    \,, $$
where $T(x; S)$ means "classifier of class $T$ returned by a learning algorithm applied
to the training sample $S$ and evaluated at a point $x$". The notaion $S \sim D^m$ means
"a randomly drawn iid sample of size $m$ from the data distribution $D$". The key problem
is that you **never know** $D$ but you have a ready training sample $(X, y)$ from it...

Please, implement a **procedure** which uses **bootstrap** to construct an estimate of
$\mathbb{V} T(\cdot)$ on a fixed common test dataset for the provided classifier. Please
refer to **Seminar 5** for pictures, **explanation** and examples, and to **scikit's
API** documentation.

**Bonus** You will get an extra $+2$ pt. if instead of re-implementing everything
yourself, you figure out how to use sklearn's `BaggingClassifier`. You are in for a
certain feeling of satisfaction with how **clever** sklearn's API is!

```python
from sklearn.ensemble import BaggingClassifier

def bootstrap_predictions(estimator, X, y, X_test, n_bootstrap=101):
    """Bootstrap a given classifier.

    Parameters
    ----------
    estimator : object
        A classifier instance with sklearn-compatible interface.

    X : array, shape = (n_samples, n_features)
        The X part of the full dataset.

    y : array, shape = (n_samples,)
        The target labels of the full dataset.

    X_test : array, shape(n_test_samples, n_features)
        The test data to measure theoutput of bootstrapped estimators on.

    n_bootstrap : int, nonnegative
        The number of bootstrap replication of `estimator` to make.

    Returns
    -------
    proba : array, shape=(n_test_samples, n_bootstrap), dtype=float
        The matrix of bootstrapped outputs of the classifier.

    bag : list
        The list of bootstrap replications of the classifier.

    Details
    -------
    The `(X, y)` full dataset is used to generate bootstrap samples. Each one
    of `n_bootstrap` samples is used to train a separate copy of the provided
    `estimator`. Each classifier form resulting set of bootstrapped estimators
    is applied to `X_test` and the output is recorded in `proba` array.
    """

    ### BEGIN Solution

    proba = np.zeros((X_test.shape[0],n_bootstrap))

    #bag = []
    #for i in range(n_bootstrap):
    #    idx = np.random.choice(range(X.shape[0]), X.shape[0], replace=True)
    #    bag.append(X[idx,:])
    #    estimator.fit(bag[-1],y[idx])
    #    proba[:,i]= estimator.predict_proba(X_test)[:,1]

    #bag = np.array(bag)
    baggingModel = BaggingClassifier(estimator, n_bootstrap, bootstrap=True, oob_score=False)
    baggingModel.fit(X,y)

    for i in np.arange(len(baggingModel.estimators_)):
        proba[:,i]=baggingModel.estimators_[i].predict_proba(X_test)[:,1]

    bag = baggingModel.estimators_samples_
    ### END Solution

    return proba, bag
```

### Task 2.2 (3 pt.)

Define a regular $2$-D mesh $51 \times 51$ that **covers the box**, within which
the original dataset resides.

```python
def expand(a, b, factor=0.2):
    """Make a wider interval defined by the endpoints."""
    return a - abs(a) * factor, b + abs(b) * factor

X_l, X_h = X.min(axis=0), X.max(axis=0)
xx0, xx1 = np.meshgrid(np.linspace(*expand(X_l[0], X_h[0]), num=51),
                       np.linspace(*expand(X_l[1], X_h[1]), num=51))

X_grid = np.c_[xx0.ravel(), xx1.ravel()]
```

Plot the bootstrap estimate ($101$ replications) of the variance of the predicted
probability of class $1$ at each point of the $2$-d grid. As the base classifiers
use the **Decision Tree Classifier** with different settings for `min_samples_leaf`
* $3$, $10$, $75$.

You must create three separate contour plots. Make sure to properly label your
axes and provide meaningful titles for each [subplot](https://matplotlib.org/api/axes_api.html#axis-labels-title-and-legend).

```python
from sklearn.tree import DecisionTreeClassifier
from sklearn.model_selection import train_test_split
from scipy import interpolate

X_train,X_test,y_train,y_test = train_test_split(X ,y, test_size = 0.33, random_state=5)

fig, axes = plt.subplots(ncols=3, nrows=1, figsize=(16, 9))
for ax, min_samples_leaf in zip(axes, [3, 10, 75]):
    ### BEGIN Solution
    estimator = DecisionTreeClassifier(min_samples_leaf=min_samples_leaf)
    (probas, bag) = bootstrap_predictions(estimator, X, y, X_test, n_bootstrap=101)

    xx, yy = np.meshgrid(np.linspace(-1.2,2.05,100),np.linspace(-0.75,1.2,100))
    zz = interpolate.griddata(X_test, np.var(probas,axis=1), (xx, yy), method='linear')

    #print(np.var(probas,axis=1).shape)
    im=ax.contourf(xx,yy,zz)
    ax.set_title("Variance plot, min_samples_leaf="+str(min_samples_leaf))
    fig.colorbar(im,ax=ax,orientation="horizontal")

    ### END Solution

    ax.scatter(X[:, 0], X[:, 1], c=y, s=4)

plt.tight_layout()

```

## Task 3 (20 pt.):  Boosting and its theory

Minimization of a loss function is an optimization task, and "Gradient Boosting"
is one of the many methods to perform optimization. It shoould be noted that it
uses **greedy** approach and thus, like greedy algorithms in CS, may produce
results that are not *globally* optimal.

$$
\begin{aligned}
    & b_n(x) := \text{the best base model from the family of the algorithms $\mathcal{A}$} \\
    & \gamma_n(x) := \text{scale or weight of the new model} \\
    & a_N(x) = \sum_{n=0}^N \gamma_n b_n(x) := \text{the final composite model}
\end{aligned}
$$

### Gradient Boosting Algorithm

Consider a loss loss function $L(y, z)$ for target $y$ and prediction $z$, and let
$(x_i, y_i)_{i=1}^l$ be out train dataset for a regression task.

1. Initialize $a_0(x) = \hat{z}$ with the **flat constant prediction**
$\hat{z} = \arg\min\limits_{z \in \mathbb{R}} \sum_{i=1}^l L(y_i, z)$;
2. For $n$ from `1` to `n_boost_steps` do:
    * Solve the current subporblem $G_n(b_n, \gamma_n) \to \min\limits_{b_{n}, \gamma_n}$
    where
    $$ G_n(b, \gamma) = \sum_{i=1}^l L\bigl(y_i, a_{n-1}(x_i) + \gamma b(x_i)\bigr) $$
    with the following method:
    \begin{align}
      & s_i = - \frac{\partial}{\partial z} L(y_i, z) \Big\vert_{z=a_{n-1}(x_i)}
          \\
      & b_n(x) = \arg\min\limits_{b\in\mathcal{A}}\sum_{i=1}^l \bigl(b(x_i) - s_i\bigr)^2
          \\
      & \gamma_n = \arg\min_\gamma G_n(b_n, \gamma)
          \\
      & a_n(x) = a_{n-1}(x) + \gamma_n b_n(x)
    \end{align}
3. return $a_N(x) = a_0(x) + \sum_{n=1}^N \gamma_n b_n(x)$

### Task 3.1  (2 pt.)

Consider the *logistic loss* for classification task $L(y,z) = \log\bigl(1 + e^{-y z}\bigr)$,
where $y \in \{-1, +1\}$. Derive the **gradient** for it with respect to $z$.

#### BEGIN Solution

$$
d_z L = -\frac{ye^{-yz}}{1+\text{exp}(-yz)}
$$

**END Solution**

### Task 3.2 (3 pt.)

At the $n$-th step of Garient Boosting ($n \geq 1$ we compute the "residuals"
$(s_i)_{i=1}^l$ and learn $x\mapsto b_n(x)$ with a regression algorithm $\mathcal{A}$
applied to the dataset $(x_i, s_i)_{i=1}^l$. For the next two tasks **assume
that we have already perfomed these substeps**.

Derive the **optimal value** of $\gamma_n$ for *MSE* loss function $L(y, z) = \tfrac12 (y - z)^2$.

#### BEGIN Solution

Recall that $\gamma_n =\text{argmin}_\gamma G_n(b, \gamma)$, where
$$G_n(b, \gamma) = \sum_{i=1}^l L\bigl(y_i, a_{n-1}(x_i) + \gamma b(x_i)\bigr)= \sum_{i=1}^l \frac{1}{2}(y_i - a_{n-1}(x_i) - \gamma b(x_i))^2.$$

This is a convex function (as a combination of convex functions), so all we need is to write down normal equation

$$d_\gamma G_n = -\sum_{i=1}^l b(x_i)(y_i - a_{n-1}(x_i) - \gamma b(x_i))=0$$

which results in

$$
\gamma_n = \frac{\sum_{i=1}^l b(x_i)(y_i-a_{n-1}(x_i))}{\sum_{i=1}^l b(x_i)^2}
$$

**END Solution**

### Task 3.3 (15 pt.)

Let $S = (x_i, y_i)_{i=1}^l$ be a sample for a classification task $y_i \in \{-1, +1\}$.

The **AdaBoost** algorithm can be regarded as a gradient boosting algorithm
with the exponential loss $L(y,z) = e^{-y z}$. Consdier the state of **AdaBoost**
at the $(T-1)$-step
$$ G_{T-1}(b_T, \gamma_T)
    = \sum_{i=1}^l L\bigl(y_i, a_{n-1}(x_i) + \gamma b(x_i)\bigr)
    = \sum_{i=1}^l \underbrace{\exp(- y_i a_{T-1}(x_i))}_{w^{T-1}_i}
        \exp(- y_i \gamma_T b_T(x_i))
    \,.
$$

#### Task 3.3.1 (4 pt.)

Derive the next weights $w^T_i$ used in $G_T$ at the stage $T$ as a function
of the learnt classifier $b_T$ and the current weights $w^{T-1}_i$;

#### BEGIN Solution

The new $a_T(x_i) = a_{T-1}(x_i)+\gamma_{T}b_T(x_i)$, so

$$
w_i^{T}=\text{exp}(-y_ia_T(x_i))=\text{exp}\left( -y_i\left(a_{T-1}(x_i)+\gamma_{T}b_T(x_i)\right) \right) = w_{i}^{T-1}\text{exp}(-y_i \gamma_{T}b_T(x_i))
$$

**END Solution**

#### Task 3.3.2 (9 pt.)

Compute the ratio of weights $(w^T_i)_{i=1}^l$ between the normal and outlier
samples in $S$. Propose a **formal definition of being an outlier**, and reflect
on the value of *margin* for both.

#### BEGIN Solution

**END Solution**

#### Task 3.3.2 (2 pt.)

Conclude about **sensitivity** of Adaboost to outliers.

#### BEGIN Solution

**END Solution**

## Task 4 (18 pt.): Practical Boosting

In this task you are asked to implement a boosting algorithm, compare speed of
different popular boosting libraries, and use boosting to measure feature importance.

### Task 4.1 (9 pt.): Boosting Classification on a toy dataset

Let's generate a toy dataset for classification.

```python
from sklearn.datasets import make_moons
from sklearn.model_selection import train_test_split

X, y = make_moons(n_samples=300, shuffle=True, noise=0.05, random_state=1011)
X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.4, random_state=1011)
```

Your task is:
1. **(5 pt.)** Implement gradient boosting algorithms with **logistic loss**
and labels $y\in \{-1, +1\}$;
2. **(2 pt.)** **Plot the decision boundary** on a $2$-d grid;
3. **(2 pt.)** Estimate the accuracy **score** on the test dataset, as well
as other classification metrics, that you can think of;

For basic implementation please refer to the 6th seminar.

```python
### BEGIN Solution
from scipy.optimize import golden
from copy import deepcopy

def boosting_predict(list_models, list_weights, point):
    prediction = 0
    for k in range(len(list_models)):
        gamma = list_weights[k]
        b = list_models[k]
        if k > 0:
            prediction = prediction + gamma * b.predict(point)
        else:
            prediction = prediction + gamma * np.repeat(b, point.shape[0])
    return prediction

def boosting_fit(N, X_train, y_train, regressor, loss_grad, loss):
    b_0 = np.mean(y_train*2-1) #to set +-1 classes
    gamma_0 = 0.5
    models = []
    weights = []
    models.append(b_0)
    weights.append(gamma_0)

    for n in np.arange(N-1):
        predictions = boosting_predict(models, weights, X_train)
        residuals = loss_grad(y=y_train*2-1, z=predictions)
        regressor.fit(X=X_train, y= - residuals)

        prediction = regressor.predict(X_train)
        weight_func = lambda gamma: loss(y_train, predictions + gamma * prediction )

        gammas=np.linspace(0,100,5000)

        #gamma = golden(weight_func)
        gamma=np.argmax([weight_func(gamma) for gamma in gammas])#scipy.optimize has not liked weight_func
        gamma = gammas[gamma]                              #because of some dimensionality issues

        models.append(deepcopy(regressor))
        weights.append(gamma)

    return models, weights

### END Solution
```

```python
import scipy
from matplotlib import cm

def logLoss(y,z):
    return np.log(1+np.exp(-y*z))

def logLossGrad(y,z):
    return -y*np.exp(-y*z)/ (1+np.exp(-y*z))

from sklearn.tree import DecisionTreeRegressor

(models,weights) = boosting_fit(20,X_train,y_train,DecisionTreeRegressor(),logLossGrad,logLoss)

grid_x = np.linspace(-3, 3, 100)
grid_y = np.linspace(-3, 3, 100)
XX, YY = np.meshgrid(grid_x, grid_y)
grid_test_x = np.c_[XX.ravel(), YY.ravel()]

predictions = boosting_predict(models,weights,X)

#print(predictions)
fig,ax = plt.subplots(figsize=(12,9))
xx, yy = np.meshgrid(np.linspace(-1.2,2.05,100),np.linspace(-0.75,1.2,100))
zz = interpolate.griddata(X, predictions, (xx, yy), method='linear')

#print(np.var(probas,axis=1).shape)
im=ax.contourf(xx,yy,zz,cmap=cm.RdBu)
# plots separating line
ax.contour(xx, yy, zz, colors=['k', 'k', 'k'],
                linestyles=['--'], levels=[0], linewidths=2)

ax.set_title("Decision function contours")
fig.colorbar(im,ax=ax,orientation="horizontal")

ax.scatter(X[:, 0], X[:, 1], c=y, s=4)

```

#### NOTE
Since scipy.optimize failed and I had to use direct grid search to find optimal gamma, the algorithm demands a bit of calibration, but it already predicts accurately if decision threshold is set to 0.

### Task 4.2 (9 pt.): Measuring the Speed and Performance

Please make sure to install the following powerful packages for boosting:
* [xgboost](https://anaconda.org/conda-forge/xgboost)
* [lightgbm](https://anaconda.org/conda-forge/lightgbm)
* [catboost](https://tech.yandex.com/catboost/doc/dg/concepts/python-installation-docpage/)

In this task you are asked to compare the **training time** of the **GBDT**, the
Gradient Boosted Decision Trees, as implemeted by different popular ML libraries.
The dataset you shall use is the [UCI Breast Cancer dataset](https://archive.ics.uci.edu/ml/datasets/Breast+Cancer+Wisconsin+%28Diagnostic%29).
You should study the parameters of each library and establish the **correspondence**
between them.

The plan is as follows:
1. **(3 pt.)** take the **default** parameter settings, measure the training time, and plot
the ROC curves;
2. **(6 pt.)** use grid search with the $3$-fold cross valiadation to choose the best model.
Then measure the training time as a function of (separately) **tree depth** and **the
number of estimators in the ensemble**, finally **plot the ROC** curves of the best
models.

You need to make sure that you are comparing **comparable** classifiers, i.e. with
**the same tree and ensemble hyperparameters**.

Please plot **three** ROC curves, one per library, on the same **one plot**
with a *comprehensible [legend](https://matplotlib.org/users/legend_guide.html)*.

A useful command for timing is IPython's [**timeit** cell magic](http://ipython.readthedocs.io/en/stable/interactive/magics.html#magic-timeit).

```python
from sklearn.datasets import load_breast_cancer
from sklearn.model_selection import train_test_split

data = load_breast_cancer()
X, y = data.data, data.target

X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.4,
                                                    random_state=0x0BADBEEF)
```

```python
#XGBoost not found in package libraries so I analyze only catboost and lightgbm
# ****************************************CATBOOST**********************************
from catboost import Pool, CatBoostClassifier, cv, CatboostIpythonWidget
from sklearn.model_selection import GridSearchCV

catBoostClf = CatBoostClassifier(
    custom_loss=['AUC'],
    random_seed=42,
    logging_level='Silent'
)

%timeit catBoostClf.fit(X_train, y_train, eval_set=(X_test, y_test), plot=False)

```

    11.2 s ± 106 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

```python
#********************************************* LIGHTGBM *******************************
import lightgbm as lgb

train_data = lgb.Dataset(X_train, label=y_train)
test_data = lgb.Dataset(X_test,label=y_test)

param = {'num_leaves':31, 'num_trees':100, 'objective':'binary'} #Some default parameters from docs
param['metric'] = 'auc'

num_round = 10
%timeit bst = lgb.train(param, train_data, num_round, valid_sets=[test_data])

```

    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [11]	valid_0's auc: 0.985973
    [12]	valid_0's auc: 0.985808
    [13]	valid_0's auc: 0.986796
    [14]	valid_0's auc: 0.986425
    [15]	valid_0's auc: 0.986261
    [16]	valid_0's auc: 0.98659
    [17]	valid_0's auc: 0.986754
    [18]	valid_0's auc: 0.987248
    [19]	valid_0's auc: 0.987001
    [20]	valid_0's auc: 0.986754
    [21]	valid_0's auc: 0.987248
    [22]	valid_0's auc: 0.98733
    [23]	valid_0's auc: 0.987988
    [24]	valid_0's auc: 0.988235
    [25]	valid_0's auc: 0.9884
    [26]	valid_0's auc: 0.988564
    [27]	valid_0's auc: 0.988482
    [28]	valid_0's auc: 0.989058
    [29]	valid_0's auc: 0.989223
    [30]	valid_0's auc: 0.989387
    [31]	valid_0's auc: 0.989963
    [32]	valid_0's auc: 0.990128
    [33]	valid_0's auc: 0.989552
    [34]	valid_0's auc: 0.989469
    [35]	valid_0's auc: 0.990045
    [36]	valid_0's auc: 0.99021
    [37]	valid_0's auc: 0.990374
    [38]	valid_0's auc: 0.99021
    [39]	valid_0's auc: 0.99021
    [40]	valid_0's auc: 0.990128
    [41]	valid_0's auc: 0.99021
    [42]	valid_0's auc: 0.990128
    [43]	valid_0's auc: 0.990292
    [44]	valid_0's auc: 0.99021
    [45]	valid_0's auc: 0.990045
    [46]	valid_0's auc: 0.989634
    [47]	valid_0's auc: 0.989881
    [48]	valid_0's auc: 0.989881
    [49]	valid_0's auc: 0.989716
    [50]	valid_0's auc: 0.989469
    [51]	valid_0's auc: 0.989634
    [52]	valid_0's auc: 0.989634
    [53]	valid_0's auc: 0.989716
    [54]	valid_0's auc: 0.989716
    [55]	valid_0's auc: 0.989469
    [56]	valid_0's auc: 0.989963
    [57]	valid_0's auc: 0.989798
    [58]	valid_0's auc: 0.989634
    [59]	valid_0's auc: 0.989798
    [60]	valid_0's auc: 0.989798
    [61]	valid_0's auc: 0.989963
    [62]	valid_0's auc: 0.989716
    [63]	valid_0's auc: 0.989798
    [64]	valid_0's auc: 0.99021
    [65]	valid_0's auc: 0.990045
    [66]	valid_0's auc: 0.990539
    [67]	valid_0's auc: 0.990292
    [68]	valid_0's auc: 0.990539
    [69]	valid_0's auc: 0.990457
    [70]	valid_0's auc: 0.990703
    [71]	valid_0's auc: 0.990786
    [72]	valid_0's auc: 0.990457
    [73]	valid_0's auc: 0.990292
    [74]	valid_0's auc: 0.990621
    [75]	valid_0's auc: 0.990457
    [76]	valid_0's auc: 0.990374
    [77]	valid_0's auc: 0.990374
    [78]	valid_0's auc: 0.990374
    [79]	valid_0's auc: 0.990457
    [80]	valid_0's auc: 0.990374
    [81]	valid_0's auc: 0.990457
    [82]	valid_0's auc: 0.990374
    [83]	valid_0's auc: 0.990292
    [84]	valid_0's auc: 0.990292
    [85]	valid_0's auc: 0.990292
    [86]	valid_0's auc: 0.99021
    [87]	valid_0's auc: 0.990128
    [88]	valid_0's auc: 0.99021
    [89]	valid_0's auc: 0.99021
    [90]	valid_0's auc: 0.990128
    [91]	valid_0's auc: 0.990045
    [92]	valid_0's auc: 0.989798
    [93]	valid_0's auc: 0.990045
    [94]	valid_0's auc: 0.989881
    [95]	valid_0's auc: 0.989881
    [96]	valid_0's auc: 0.989798
    [97]	valid_0's auc: 0.989716
    [98]	valid_0's auc: 0.989634
    [99]	valid_0's auc: 0.989469
    [100]	valid_0's auc: 0.989305
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644

    D:\Programs\Anaconda3\envs\py35\lib\site-packages\lightgbm\engine.py:99: UserWarning: Found `num_trees` in params. Will use it instead of argument
      warnings.warn("Found `{}` in params. Will use it instead of argument".format(alias))

    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    [1]	valid_0's auc: 0.96339
    [2]	valid_0's auc: 0.976553
    [3]	valid_0's auc: 0.981859
    [4]	valid_0's auc: 0.982106
    [5]	valid_0's auc: 0.983834
    [6]	valid_0's auc: 0.985561
    [7]	valid_0's auc: 0.985438
    [8]	valid_0's auc: 0.985603
    [9]	valid_0's auc: 0.98552
    [10]	valid_0's auc: 0.985644
    7.87 ms ± 103 µs per loop (mean ± std. dev. of 7 runs, 100 loops each)

```python
from sklearn.metrics import roc_curve,roc_auc_score
```

```python
#NOW ROC-Curves

yScore_cat = catBoostClf.predict(X_test)
yScore_lgb = bst.predict(X_test)

#for each classifier
#cat
fpr_cat, tpr_cat, _ = roc_curve(y_test[:], yScore_cat[:], drop_intermediate = False)
print(fpr_cat)
roc_auc_cat = roc_auc_score(y_test, yScore_cat)

#kernel
fpr_lgb, tpr_lgb, _ = roc_curve(y_test[:], yScore_lgb[:], drop_intermediate = False)
roc_auc_lgb = roc_auc_score(y_test, yScore_lgb)

f,ax = plt.subplots(figsize=(10,5))

ax.plot(fpr_cat, tpr_cat, color='darkorange',
         lw=1, label='CatBoostDefault (area = %0.2f)' % roc_auc_cat)

ax.plot(fpr_lgb, tpr_lgb, color='red',
         lw=1, label='LGBMDefault (area = %0.2f)' % roc_auc_lgb)

ax.plot([0, 1], [0, 1], color='navy', lw=1, linestyle='--')#coin flip
ax.set_xlim([0.0, 1.0])
ax.set_ylim([0.0, 1.05])

ax.set_xlabel('False Positive Rate')
ax.set_ylabel('True Positive Rate')
ax.set_title('Receiver operating characteristic')
ax.legend(loc="lower right")

```

GridSearchCV can not be used with time measurements, so I implement my own GridSearch.

#### NOTE
Due to time limits I have abandonden the next part, it is not relevant.

```python
from sklearn.model_selection import cross_val_score
import copy
#CatBoost

depths=list(range(5,20,5))
sizes=list(range(50,59,3))
bestCat = 0
bestScore = 0
catTimes=np.zeros((len(depths),len(sizes)))
for depth_id in np.arange(len(depths)):
    for size_id in np.arange(len(sizes)):
        pool = Pool(X_train, label=y_train)

        params = {'iterations': sizes[size_id], 'depth': depths[depth_id], 'logging_level': 'Silent', 'custom_loss': 'AUC'}
        timeConsumed = %timeit -n1 -o scores = cv(params=params, pool=pool)['AUC_test_avg'] # fold_count=3 by default
        catTimes[depth_id,size_id]= timeConsumed.best# time measurement
        score = np.max(scores)
        if(score>bestScore):
            bestScore=score
            bestCat= copy.deepcopy(params)
```

Let us plot the consumed time against training parameters (STOPPED before ending because it is too slow).

```python
#dd,ss = np.meshgrid(depths,sizes)

#f,ax = plt.subplots(figsize=(12,7))
#im=ax.contourf(dd,ss,times)

#f.colorbar(im,axis=ax,orientation="horizontal")
#ax.set_title('Time Complexity(CatBoost)')
```

```python
#LGB

bestLgb = 0
bestLgbScore = 0
lgbTimes=np.zeros((len(depths),len(sizes)))
for depth_id in np.arange(len(depths)):
    for size_id in np.arange(len(sizes)):

        param = {'max_depth':depths[depth_id], 'num_trees':sizes[size_id], 'objective':'binary'} #Some default parameters from docs
        param['metric'] = 'auc'

        timeConsumed = %timeit -n1 -o scores =  lgb.cv(param, train_data, nfold=3)['auc-mean'] # fold_count=3 by default
        lgbTimes[depth_id,size_id]= timeConsumed.best# time measurement
        score = np.max(scores)
        if(score>bestScore):
            bestLgbScore=score
            bestLgb= copy.deepcopy(params)
```

    D:\Programs\Anaconda3\envs\py35\lib\site-packages\lightgbm\engine.py:390: UserWarning: Found `num_trees` in params. Will use it instead of argument
      warnings.warn("Found `{}` in params. Will use it instead of argument".format(alias))

    115 ms ± 6.1 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

    D:\Programs\Anaconda3\envs\py35\lib\site-packages\lightgbm\engine.py:390: UserWarning: Found `num_trees` in params. Will use it instead of argument
      warnings.warn("Found `{}` in params. Will use it instead of argument".format(alias))

    109 ms ± 19.3 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

    D:\Programs\Anaconda3\envs\py35\lib\site-packages\lightgbm\engine.py:390: UserWarning: Found `num_trees` in params. Will use it instead of argument
      warnings.warn("Found `{}` in params. Will use it instead of argument".format(alias))

    109 ms ± 16.1 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

    D:\Programs\Anaconda3\envs\py35\lib\site-packages\lightgbm\engine.py:390: UserWarning: Found `num_trees` in params. Will use it instead of argument
      warnings.warn("Found `{}` in params. Will use it instead of argument".format(alias))

    114 ms ± 20.3 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

    D:\Programs\Anaconda3\envs\py35\lib\site-packages\lightgbm\engine.py:390: UserWarning: Found `num_trees` in params. Will use it instead of argument
      warnings.warn("Found `{}` in params. Will use it instead of argument".format(alias))

    111 ms ± 17.7 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

    D:\Programs\Anaconda3\envs\py35\lib\site-packages\lightgbm\engine.py:390: UserWarning: Found `num_trees` in params. Will use it instead of argument
      warnings.warn("Found `{}` in params. Will use it instead of argument".format(alias))

    113 ms ± 17.5 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

    D:\Programs\Anaconda3\envs\py35\lib\site-packages\lightgbm\engine.py:390: UserWarning: Found `num_trees` in params. Will use it instead of argument
      warnings.warn("Found `{}` in params. Will use it instead of argument".format(alias))

    113 ms ± 20.3 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

    D:\Programs\Anaconda3\envs\py35\lib\site-packages\lightgbm\engine.py:390: UserWarning: Found `num_trees` in params. Will use it instead of argument
      warnings.warn("Found `{}` in params. Will use it instead of argument".format(alias))

    115 ms ± 19.9 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

    D:\Programs\Anaconda3\envs\py35\lib\site-packages\lightgbm\engine.py:390: UserWarning: Found `num_trees` in params. Will use it instead of argument
      warnings.warn("Found `{}` in params. Will use it instead of argument".format(alias))

    114 ms ± 17.1 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

```python
#A very rough estimation
dd,ss = np.meshgrid(depths,sizes)

f,ax = plt.subplots(figsize=(12,7))
im=ax.contourf(dd,ss,lgbTimes)

f.colorbar(im,ax=ax,orientation="horizontal")
ax.set_title('Time Complexity(LGBMBoost)')
ax.set_xlabel("MaxDepth")
ax.set_ylabel("EnsembleSize")
```

```python
#training best models
catBoostClf_opt = CatBoostClassifier()
#catBoostClf_opt.set_params(params=bestCat)
#catBoostClf_opt.fit(X_train,y_train)

bst_opt = lgb.train(bestLgb, train_data, valid_sets=[test_data])
```

```python
#ROC-Curves

yScore_cat = catBoostClf_opt.predict(X_test)
yScore_lgb = bst_opt.predict(X_test)

#for each classifier
#cat
fpr_cat, tpr_cat, _ = roc_curve(y_test[:], yScore_cat[:], drop_intermediate = False)
print(fpr_cat)
roc_auc_cat = roc_auc_score(y_test, yScore_cat)

#kernel
fpr_lgb, tpr_lgb, _ = roc_curve(y_test[:], yScore_lgb[:], drop_intermediate = False)
roc_auc_lgb = roc_auc_score(y_test, yScore_lgb)

f,ax = plt.subplots(figsize=(10,5))

ax.plot(fpr_cat, tpr_cat, color='darkorange',
         lw=1, label='CatBoostDefault (area = %0.2f)' % roc_auc_cat)

ax.plot(fpr_lgb, tpr_lgb, color='red',
         lw=1, label='LGBMDefault (area = %0.2f)' % roc_auc_lgb)

ax.plot([0, 1], [0, 1], color='navy', lw=1, linestyle='--')#coin flip
ax.set_xlim([0.0, 1.0])
ax.set_ylim([0.0, 1.05])

ax.set_xlabel('False Positive Rate')
ax.set_ylabel('True Positive Rate')
ax.set_title('Receiver operating characteristic')
ax.legend(loc="lower right")

```