# 02. Neuralnet Q Learning example

Neuralnet Q Learning을 실습해봅니다.
- 신경망의 parameter(weight)를 업데이트 함에 따라 state에 대한 Q value가 변화합니다.
- Q Learning의 TD error를 loss function으로 하여 학습합니다.

## Colab 용 package 설치 코드

```python
!pip install gym
```

    Requirement already satisfied: gym in /home/khkim/workspace/gym (0.10.5)
    Requirement already satisfied: numpy>=1.10.4 in /home/khkim/anaconda3/lib/python3.6/site-packages (from gym) (1.15.3)
    Requirement already satisfied: requests>=2.0 in /home/khkim/anaconda3/lib/python3.6/site-packages (from gym) (2.14.2)
    Requirement already satisfied: six in /home/khkim/anaconda3/lib/python3.6/site-packages (from gym) (1.10.0)
    Requirement already satisfied: pyglet>=1.2.0 in /home/khkim/anaconda3/lib/python3.6/site-packages (from gym) (1.3.2)
    Requirement already satisfied: future in /home/khkim/anaconda3/lib/python3.6/site-packages (from pyglet>=1.2.0->gym) (0.16.0)

### Package import

```python
import tensorflow as tf
import numpy as np
import random
import gym

import matplotlib.pyplot as plt
%matplotlib inline

np.random.seed(777)
tf.set_random_seed(777)

print("tensorflow version: ", tf.__version__)
print("gym version: ", gym.__version__)
```

    tensorflow version:  1.8.0
    gym version:  0.11.0

## Frozen Lake

**[state]**

        SFFF
        FHFH
        FFFH
        HFFG

    S : starting point, safe
    F : frozen surface, safe
    H : hole, fall to your doom
    G : goal, where the frisbee is located

**[action]**

    LEFT = 0
    DOWN = 1
    RIGHT = 2
    UP = 3

### Frozen Lake (not Slippery)

```python
def register_frozen_lake_not_slippery(name):
    from gym.envs.registration import register
    register(
        id=name,
        entry_point='gym.envs.toy_text:FrozenLakeEnv',
        kwargs={'map_name' : '4x4', 'is_slippery': False},
        max_episode_steps=100,
        reward_threshold=0.78, # optimum = .8196
    )

register_frozen_lake_not_slippery('FrozenLakeNotSlippery-v0')
```

```python
# Load Environment
env = gym.make('FrozenLakeNotSlippery-v0')
state_size = env.observation_space.n
action_size = env.action_space.n
print("State_size : ", state_size)
print("Action_size: ",action_size)
```

    State_size :  16
    Action_size:  4

## Q-Learning using Neural Network
**Update 식**

$J(w) = \mathbb{E}_{\pi}[(target - \hat q(S,A,w))^2]$

$ \begin{align} \Delta w & = - \frac{1}{2} \alpha \nabla_w J(w)
\\ & = \alpha (R_{t+1} + \gamma max(\hat q(S_{t+1},a ,w)) - \hat q(S_{t},A_{t},w))\nabla_w \hat q(S_{t},A_{t},w) \end{align}$

### 학습 순서
1. 초기 state 받음 (env.reset())
2. action 선택 (e - greedy policy)
3. 선택한 action으로 다음 state로 이동 (env.step())
4. 다음 state와 reward를 이용해 update식 작성
5. 신경망 업데이트
6. 반복

## Tensorflow 코드 흐름
1. 각 연산자에 대한 그래프를 구성한다.
2. 실제 데이터를 그래프에 할당하면서 전체 그래프를 실행한다.

### Build graph

```python
layers = tf.contrib.layers

# placeholder 선언
inputs = tf.placeholder(shape=[1], dtype=tf.int32, name="state")
input_action = tf.placeholder(shape=[1], dtype=tf.int32, name="action")
target = tf.placeholder(shape=[1], dtype=tf.float32, name="targetQ")

# 신경망 구성 함수
def build_network(inputs):
    with tf.variable_scope('q_net'):
        input_onehot = tf.one_hot(inputs, state_size, dtype=tf.float32)
        fc1 = layers.fully_connected(inputs=input_onehot,
                                     num_outputs=4,
                                     activation_fn=None)
    return fc1

# 신경망 구성
q_value = build_network(inputs)

# 현재 action에 대한 Q_value 구하는 연산
curr_action = tf.one_hot(input_action, action_size)
curr_q_value = tf.reduce_sum(tf.multiply(q_value, curr_action))

# Loss 함수 구성
loss_op = tf.square(target - curr_q_value)
opt = tf.train.GradientDescentOptimizer(learning_rate=0.1)
train_op = opt.minimize(loss_op)
```

### Executing a graph in a tf.Session

```python
# Session 열기
tf.reset_default_graph()
sess = tf.Session()

# 변수 초기화
sess.run(tf.global_variables_initializer())

# 변수(파라미터) 확인
for var in tf.trainable_variables('q_net'):
    print(var)
    print(sess.run(var))
```

    <tf.Variable 'q_net/fully_connected/weights:0' shape=(16, 4) dtype=float32_ref>
    [[-6.0733646e-02 -3.5827678e-01  4.8103058e-01 -3.7636170e-01]
     [-3.2480127e-01 -5.3931355e-02  2.8314555e-01 -3.4480178e-01]
     [ 4.8399687e-02  2.0780110e-01  1.8425167e-01  3.6608332e-01]
     [-2.3245859e-01 -5.3794265e-01 -9.6173316e-02 -3.3918953e-01]
     [ 2.8697640e-01  2.5819421e-02  1.7191756e-01 -1.5600085e-02]
     [-4.2137003e-01 -4.4634092e-01  3.1198454e-01 -1.4007688e-02]
     [-1.0566205e-01 -3.1236708e-02 -4.6822315e-01 -1.9728965e-01]
     [ 3.0298996e-01 -3.6282149e-01 -3.9720133e-01  2.0609957e-01]
     [-4.4529909e-01  1.6861230e-01  3.8679183e-02  5.2380562e-04]
     [ 4.8956716e-01 -8.1262350e-02 -3.0587435e-02  1.5888274e-01]
     [-2.5100735e-01 -4.3752733e-01  2.5761116e-01  5.2036798e-01]
     [ 1.1219704e-01 -3.5665569e-01  1.9697464e-01  2.5190800e-01]
     [-3.2989496e-01 -3.1735718e-02  1.5875924e-01  5.2931142e-01]
     [ 4.9331117e-01 -4.3476018e-01  3.9276057e-01 -1.5144280e-01]
     [-3.6021417e-01 -3.6626130e-01 -2.1230820e-01  2.4730873e-01]
     [-4.7706664e-02 -3.9519316e-01 -4.4101974e-01 -3.3715653e-01]]
    <tf.Variable 'q_net/fully_connected/biases:0' shape=(4,) dtype=float32_ref>
    [0. 0. 0. 0.]

### Action select using Q value

```python
# 초기 state
state = env.reset()
state = np.reshape(state, [1])
print("current state:", state)

# 현재 state에 대한 Q-value
# 빈칸 {}을 채워보세요.
# 참고) sess.run( "Q-value를 구하는 신경망 그래프", feed_dict={inputs: "신경망 입력"} )
curr_q = sess.run(q_value, feed_dict={inputs: state})
print("Q value of current state:", curr_q)
```

    current state: [0]
    Q value of current state: [[-0.06073365 -0.35827678  0.48103058 -0.3763617 ]]
    choose action:  2

```python
# action 선택 ( greedy )
# 직접 구현해보세요. (hint. np.argmax)
action = sess.run(q_value, feed_dict={inputs: state})
action = np.argmax(action, axis=1)
action = action[0]
print("choose action: ", action)
```

### 선택한 Action으로 다음 State, Reward 받기

```python
# action을 이용해 env.step하기
# 빈칸 {} 을 채워보세요.
next_state, reward, done, _ = env.step(action)
next_state = np.reshape(next_state, [1])
print("next_state", next_state)
```

    next_state [1]
    next_q_value [0.254831]

### update를 위한 (미래)보상 값(target) 계산

```python
gamma = 0.9
if done: # terminal state 이면 reward가 곧 next_q_value
    next_q_value = np.array([reward])
else:
    # 직접 작성해보세요.
    # 위 수식 참고.
    # 참고) R + gamma * next state의 q-value 중 max
    next_q_value = reward + gamma * np.max(sess.run(q_value, feed_dict={inputs: next_state}), axis=1)
print("next_q_value", next_q_value)
```

### Update Neural Net

```python
action = np.reshape(action, [1])

# train_op를 sess.run 하여 학습 실행.
loss, _ = sess.run([loss_op, train_op], feed_dict={inputs: state, target: next_q_value, input_action: action})
print("loss", loss)

for var in tf.trainable_variables('q_net'):
    print(var)
    print(sess.run(var))
```

    loss [0.05116626]
    <tf.Variable 'q_net/fully_connected/weights:0' shape=(16, 4) dtype=float32_ref>
    [[-6.0733646e-02 -3.5827678e-01  4.3579066e-01 -3.7636170e-01]
     [-3.2480127e-01 -5.3931355e-02  2.8314555e-01 -3.4480178e-01]
     [ 4.8399687e-02  2.0780110e-01  1.8425167e-01  3.6608332e-01]
     [-2.3245859e-01 -5.3794265e-01 -9.6173316e-02 -3.3918953e-01]
     [ 2.8697640e-01  2.5819421e-02  1.7191756e-01 -1.5600085e-02]
     [-4.2137003e-01 -4.4634092e-01  3.1198454e-01 -1.4007688e-02]
     [-1.0566205e-01 -3.1236708e-02 -4.6822315e-01 -1.9728965e-01]
     [ 3.0298996e-01 -3.6282149e-01 -3.9720133e-01  2.0609957e-01]
     [-4.4529909e-01  1.6861230e-01  3.8679183e-02  5.2380562e-04]
     [ 4.8956716e-01 -8.1262350e-02 -3.0587435e-02  1.5888274e-01]
     [-2.5100735e-01 -4.3752733e-01  2.5761116e-01  5.2036798e-01]
     [ 1.1219704e-01 -3.5665569e-01  1.9697464e-01  2.5190800e-01]
     [-3.2989496e-01 -3.1735718e-02  1.5875924e-01  5.2931142e-01]
     [ 4.9331117e-01 -4.3476018e-01  3.9276057e-01 -1.5144280e-01]
     [-3.6021417e-01 -3.6626130e-01 -2.1230820e-01  2.4730873e-01]
     [-4.7706664e-02 -3.9519316e-01 -4.4101974e-01 -3.3715653e-01]]
    <tf.Variable 'q_net/fully_connected/biases:0' shape=(4,) dtype=float32_ref>
    [ 0.          0.         -0.04523992  0.        ]

### 학습 시작

```python
rlist = []
slist = []
epsilon_list = []

EPISODE = 2000
gamma = 0.99

update_count = 0
loss_list = []

# Episode 수만큼 반복
for step in range(EPISODE):
    # step마다 epsilon 감소
    epsilon = 1. / ((step/50)+10)
    epsilon_list.append(epsilon)

    state = env.reset()
    state = np.reshape(state, [1])
    print("[Episode {}]".format(step))
    total_reward = 0
    limit = 0
    done = False

    while not done and limit < 99:
        # 현재 state의 Q value불러오기

        # e-greedy policy로 action 선택
        if epsilon > np.random.random():
            # random
            action = env.action_space.sample()
        else:
            # greedy
            curr_q = sess.run(q_value, feed_dict={inputs: state})
            action = np.argmax(curr_q)

        # 선택한 action으로 env.step 하기
        next_state, reward, done, _ = env.step(action)
        next_state = np.reshape(next_state, [1])

        if reward == 1.0:
            print("GOAL")

        # 업데이트를 위한 (미래)보상값 반환
        # episode가 끝났다면
        if done:
            next_q_value = np.array([reward])
        # 끝나지 않았다면
        else:
            next_q_value = reward + gamma * np.max(sess.run(q_value, feed_dict={inputs: next_state}), axis=1)

        # Q update
        action = np.reshape(action, [1])
        loss, _ = sess.run([loss_op, train_op], feed_dict={inputs: state, target: next_q_value, input_action: action})
        loss_list.append(loss)
        update_count += 1

        slist.append(state.item())
        state = next_state
        total_reward += reward
        limit += 1

    print(slist)
    slist = []
    print("total reward: ", total_reward)
    rlist.append(total_reward)

print("Success prob: " + str(sum(rlist) / EPISODE) + "%")
```

    [Episode 0]
    [0, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 6]
    total reward:  0.0
    [Episode 1]
    [0, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 2, 2, 1, 2, 2, 2, 2, 2, 6]
    total reward:  0.0
    [Episode 2]
    [0, 1, 2, 2, 2, 2, 2, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 3, 2, 1, 2, 1, 2, 2, 1, 2, 2, 2, 2, 6]
    total reward:  0.0
    [Episode 3]
    [0, 1, 2, 2, 2, 2, 2, 2, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 2, 1, 2, 1, 2, 2, 1, 2, 2, 1]
    total reward:  0.0
    [Episode 4]
    [0, 1, 2, 2, 1, 2, 2, 2, 2, 2, 2, 1, 2, 3, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 2, 1, 2, 6]
    total reward:  0.0
    [Episode 5]
    [0, 1, 2, 2, 2, 2, 2, 3, 2, 1]
    total reward:  0.0
    [Episode 6]
    [0, 1, 2, 3, 2, 1, 2, 3, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1]
    total reward:  0.0
    [Episode 7]
    [0, 1, 2, 1, 2, 1, 0, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 6]
    total reward:  0.0
    [Episode 8]
    [0, 1, 2, 1, 2, 1]
    total reward:  0.0
    [Episode 9]
    [0, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 6]
    total reward:  0.0
    [Episode 10]
    [0, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 6]
    total reward:  0.0
    [Episode 11]
    [0, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1]
    total reward:  0.0
    [Episode 12]
    [0, 1, 2, 3, 2, 1, 1, 2, 2, 2, 2, 2, 2, 1]
    total reward:  0.0
    [Episode 13]
    [0, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 2, 2, 2, 2, 2, 6]
    total reward:  0.0
    [Episode 14]
    [0, 1, 2, 2, 2, 2, 2, 2, 2, 2, 3, 2, 2, 2, 2, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, 1, 2, 3, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 1, 2, 2, 6]
    total reward:  0.0
    [Episode 15]
    [0, 1, 2, 2, 2, 2, 2, 3, 2, 2, 6]
    total reward:  0.0
    [Episode 16]
    [0, 1, 2, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 6]
    total reward:  0.0
    [Episode 17]
    [0, 1, 2, 2, 2, 2, 2, 6]
    total reward:  0.0
    [Episode 18]
    [0, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 6]
    total reward:  0.0
    [Episode 19]
    [0, 1, 2, 2, 2, 6]
    total reward:  0.0
    [Episode 20]
    [0, 1, 2, 2, 2, 2, 2, 2, 3, 2, 2, 2, 2, 2, 2, 2, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 2, 1, 2, 2, 1]
    total reward:  0.0
    [Episode 21]
    [0, 1, 2, 2, 1]
    total reward:  0.0
    [Episode 22]
    [0, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 6]
    total reward:  0.0
    [Episode 23]
    [0, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 6]
    total reward:  0.0
    [Episode 24]
    [0, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 6]
    total reward:  0.0
    [Episode 25]
    [0, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 2, 1, 2, 1, 0, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 6]
    total reward:  0.0
    [Episode 26]
    [0, 1, 2, 1, 2, 1, 2, 1, 2, 2, 1, 2, 1, 2, 6]
    total reward:  0.0
    [Episode 27]
    [0, 0, 1, 2, 6, 2, 2, 3, 2, 2, 2, 2, 6, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 3, 2, 2, 2, 2, 2, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 6, 2, 2, 2, 2, 2]
    total reward:  0.0
    [Episode 28]
    [0, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 6, 2, 2, 1, 2, 2, 2, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 1]
    total reward:  0.0
    [Episode 29]
    [0, 1, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 3, 2, 2, 2, 2, 2, 2, 2, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1]
    total reward:  0.0
    [Episode 30]
    [0, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 1, 2, 2, 2, 2, 2, 2, 1, 2, 2, 2, 2, 1, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, 1, 2, 2, 2, 1, 2, 2, 1, 2, 2, 1, 0, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 6, 2, 2, 2, 2, 1, 2, 2, 2, 1, 2, 2, 1, 2, 6, 2, 1, 2, 2, 2, 2, 2, 2, 2, 2]
    total reward:  0.0
    [Episode 31]
    [0, 1, 2, 6, 2, 2, 2, 2, 1, 2, 2, 2, 1, 2, 2, 1, 2, 2, 1, 2, 2, 1]
    total reward:  0.0
    [Episode 32]
    [0, 1, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 6, 2, 2, 2, 2, 3, 2, 2, 2, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3]
    total reward:  0.0
    [Episode 33]
    [0, 1, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6]
    total reward:  0.0
    [Episode 34]
    [0, 1, 2, 6, 2, 6, 2, 6, 2, 6, 2, 3, 2, 3, 2, 3, 2, 6, 2, 2, 6, 2, 3, 2, 2, 6, 2, 2, 6, 2, 2, 6, 2, 3, 2, 3, 2, 2, 6, 2, 3, 2, 2, 3, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 14, 10, 6, 10, 9, 8]
    total reward:  0.0
    [Episode 35]
    [0, 1, 0, 1, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6]
    total reward:  0.0
    [Episode 36]
    [0, 0, 1, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 14, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10]
    total reward:  0.0
    [Episode 37]
    [0, 1, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 9, 8, 8]
    total reward:  0.0
    [Episode 38]
    [0, 0, 0, 0, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6]
    total reward:  0.0
    [Episode 39]
    [0, 1, 2, 6, 10, 14, 10, 6, 10, 6, 10, 9, 8]
    total reward:  0.0
    [Episode 40]
    [0, 1, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 9, 8, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 8, 4, 4, 4, 4, 4, 0, 1, 2, 6, 10]
    total reward:  0.0
    [Episode 41]
    [0, 1, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6]
    total reward:  0.0
    [Episode 42]
    [0, 1, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6]
    total reward:  0.0
    [Episode 43]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 44]
    [0, 1, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10]
    total reward:  0.0
    [Episode 45]
    [0, 1, 2, 6, 10, 14, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 2, 6, 10, 9]
    total reward:  0.0
    [Episode 46]
    [0, 1, 2, 3, 2, 6, 10, 9, 8, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 8, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 8, 4, 4, 4, 4, 4, 0, 1, 2, 6, 10, 6, 10, 6]
    total reward:  0.0
    [Episode 47]
    [0, 1, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 14, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 2, 6, 10, 6, 10, 6]
    total reward:  0.0
    [Episode 48]
    [0, 1, 2, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 2, 6, 10, 6, 10, 6, 10, 6]
    total reward:  0.0
    [Episode 49]
    [0, 1, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6]
    total reward:  0.0
    [Episode 50]
    [0, 1, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6]
    total reward:  0.0
    [Episode 51]
    [0, 1, 2, 6, 10, 6, 10, 6, 2, 6, 10, 6, 10]
    total reward:  0.0
    [Episode 52]
    [0, 1, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 9, 8, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 8, 4, 4, 4, 4, 4, 4, 4, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 0, 1, 2, 6, 10, 6, 10, 6, 10]
    total reward:  0.0
    [Episode 53]
    [0, 1, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 2, 6, 2, 6]
    total reward:  0.0
    [Episode 54]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 55]
    [0, 1, 2, 6, 2, 6, 2, 3, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6]
    total reward:  0.0
    [Episode 56]
    [0, 1, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 10, 6, 10, 6, 10, 6]
    total reward:  0.0
    [Episode 57]
    [0, 1, 2, 6, 10, 6, 10, 6, 10, 6, 10, 9, 8, 4, 4, 4, 4, 8, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 0, 1, 2, 6, 2, 6, 2, 6, 2, 6]
    total reward:  0.0
    [Episode 58]
    [0, 1, 2, 6, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 2, 6, 2, 3, 2, 6, 10, 9, 8, 4]
    total reward:  0.0
    [Episode 59]
    [0, 0, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 10, 6, 10, 9, 8, 4, 4, 4, 4, 4, 4]
    total reward:  0.0
    [Episode 60]
    [0, 1, 2, 6, 10, 9, 8, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 8, 4, 8, 4, 8, 8, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4]
    total reward:  0.0
    [Episode 61]
    [0, 1, 2, 6, 10, 9, 8, 4, 8, 4, 0, 1, 2, 3, 2, 6, 10, 9, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 9, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4]
    total reward:  0.0
    [Episode 62]
    [0, 1]
    total reward:  0.0
    [Episode 63]
    [0, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 3, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 1, 2, 3, 2, 6, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3]
    total reward:  0.0
    [Episode 64]
    [0, 1, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 9, 8, 4, 0, 0, 0, 1, 2, 2, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 10, 9]
    total reward:  0.0
    [Episode 65]
    [0, 1, 2, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 3, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6]
    total reward:  0.0
    [Episode 66]
    [0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 8, 4, 4, 4, 4, 4, 0, 1, 2, 1, 2, 1, 2, 1, 2, 1, 0, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 2, 1, 2, 1, 2, 1, 2, 1, 2, 6, 10, 9, 10, 9, 8, 8, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 8, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 0, 1, 2, 3, 2]
    total reward:  0.0
    [Episode 67]
    [0, 1, 0, 1, 2, 3, 2, 3, 3, 2, 2, 2, 2, 2, 2, 3, 2, 2, 2, 3, 2, 3, 2, 2, 3, 2, 2, 3, 2, 2, 3, 2, 2, 3, 2, 6, 2, 3, 2, 3, 2, 2, 3, 2, 2, 3, 2, 2, 3, 2, 2, 3, 3, 3, 2, 1, 2, 3, 2, 3, 2, 2, 2, 3, 2, 2, 3, 2, 2, 1, 2, 2, 2, 2, 3, 3, 2, 2, 6]
    total reward:  0.0
    [Episode 68]
    [0, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 3, 2, 6, 2, 6, 2, 6, 2, 3, 2, 6]
    total reward:  0.0
    [Episode 69]
    [0, 1, 2, 6, 2, 6, 2, 6, 2, 6, 2, 3, 2, 6, 10, 6, 10, 9]
    total reward:  0.0
    [Episode 70]
    [0, 1, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 1, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 0, 0, 1, 2, 1, 2, 1, 2, 1, 2, 6, 2, 1, 2]
    total reward:  0.0
    [Episode 71]
    [0, 1, 2, 6, 10, 9, 8]
    total reward:  0.0
    [Episode 72]
    [0, 1, 0, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 1, 2, 1, 1, 2, 1, 2, 1, 2, 1, 1, 2, 1, 1, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 3, 2, 2, 1, 1]
    total reward:  0.0
    [Episode 73]
    [0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 1, 1, 1, 2, 1, 1, 2, 1, 1, 2, 1, 1, 2, 1, 0, 0, 1, 1, 1, 1, 1, 2, 1, 2, 1, 2, 1, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 3, 2, 3, 2, 3, 2, 1, 2, 1, 2, 6, 2, 1, 2, 1, 2, 1, 2, 1, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1]
    total reward:  0.0
    [Episode 74]
    [0, 1, 1, 1, 1, 1, 2, 1, 2, 2, 1, 1, 1, 2, 1]
    total reward:  0.0
    [Episode 75]
    [0, 1, 1, 1, 1, 2, 2, 1, 1, 2, 1, 2, 1, 1, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3]
    total reward:  0.0
    [Episode 76]
    [0, 1, 1, 1, 1, 1, 2, 2, 3, 2, 3, 2, 3, 2, 2, 3, 2, 2, 3, 2, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 2, 6, 2, 6, 2, 3, 2, 6, 2, 3, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 6, 2, 3, 2, 6, 10, 9, 8, 4, 4, 0, 1, 2, 2, 3, 2, 6, 10, 9]
    total reward:  0.0
    [Episode 77]
    [0, 1, 2, 6, 10, 14, 10, 9, 8, 4, 8, 4, 8, 4, 4, 4, 4, 4, 8, 4, 4, 8, 4, 4, 8, 4, 4, 4, 8, 4, 4, 8, 4, 4, 8, 4, 4, 8, 4, 0, 0, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 4, 8, 4, 4, 8, 4, 4, 8, 4, 4, 8, 4, 4, 4, 8, 4, 4, 8, 4, 4]
    total reward:  0.0
    [Episode 78]
    [0, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 8, 4, 4, 4, 4, 4, 4, 4, 4, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1]
    total reward:  0.0
    [Episode 79]
    [0, 1, 2, 1, 2, 1, 2, 1, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 1, 2, 6, 10, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 13, 14, 10]
    total reward:  0.0
    [Episode 80]
    [0, 0, 0, 0, 1, 2, 6, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 13]
    total reward:  0.0
    [Episode 81]
    GOAL
    [0, 1, 2, 6, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14]
    total reward:  1.0
    [Episode 82]
    [0, 1, 2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3]
    total reward:  0.0
    [Episode 83]
    [0, 1, 2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 6, 10]
    total reward:  0.0
    [Episode 84]
    [0, 1, 1, 2, 6, 10, 6]
    total reward:  0.0
    [Episode 85]
    [0, 1, 2, 6, 10, 6, 10, 6, 10, 6]
    total reward:  0.0
    [Episode 86]
    [0, 1, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 14, 10, 14, 10, 9, 13]
    total reward:  0.0
    [Episode 87]
    [0, 1, 2, 6, 10, 14, 10, 14, 10, 14, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10]
    total reward:  0.0
    [Episode 88]
    [0, 1, 2, 6, 10, 14, 10, 14, 10, 14, 10, 14, 10, 9, 13, 14, 10, 14, 10, 14, 10, 9, 13, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 9, 13, 14, 10, 9, 13]
    total reward:  0.0
    [Episode 89]
    [0, 1, 2, 6, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10]
    total reward:  0.0
    [Episode 90]
    [0, 1, 1, 2, 6, 10, 14, 10, 9, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4]
    total reward:  0.0
    [Episode 91]
    [0, 1, 2, 6, 10, 9, 13, 14, 10, 6, 10, 9, 13, 14, 10, 9]
    total reward:  0.0
    [Episode 92]
    [0, 1, 2, 6, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 6, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 8, 4, 8, 4, 8, 8, 4, 8, 4, 8, 4, 8, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14]
    total reward:  0.0
    [Episode 93]
    [0, 1, 2, 6, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 13, 14, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 13, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 13]
    total reward:  0.0
    [Episode 94]
    [0, 1, 2, 6, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10]
    total reward:  0.0
    [Episode 95]
    [0, 1, 2, 6, 10, 14, 10, 14, 10, 14, 10, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 6, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 13, 14, 10, 9, 8]
    total reward:  0.0
    [Episode 96]
    [0, 1, 2, 6, 10, 9, 13, 14, 10, 9, 13, 14, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9]
    total reward:  0.0
    [Episode 97]
    [0, 1, 2, 6, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 1, 2, 6, 2, 6, 10, 6, 10, 6, 10, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 8, 4, 0, 1, 2, 6]
    total reward:  0.0
    [Episode 98]
    [0, 1, 1, 2, 6, 10, 6, 10, 14, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10]
    total reward:  0.0
    [Episode 99]
    GOAL
    [0, 1, 2, 6, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14]
    total reward:  1.0
    [Episode 100]
    [0, 4, 8]
    total reward:  0.0
    [Episode 101]
    [0, 0, 1, 1, 2, 3, 2, 3, 2, 6, 10]
    total reward:  0.0
    [Episode 102]
    [0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 6, 2, 6, 10, 9, 8, 4, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 6, 10, 9, 8, 4, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
    total reward:  0.0
    [Episode 103]
    [0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 1, 1, 0, 0, 0, 0, 0, 0, 0, 1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
    total reward:  0.0
    [Episode 104]
    [0, 0, 0, 0, 0, 0, 0, 1, 1, 1, 1, 1, 2, 1, 2, 1, 2, 1, 2, 3, 2, 6, 2, 1, 2, 1, 2, 1, 2, 6, 2, 1, 1, 1, 1, 2, 1, 2, 1, 1, 1, 2, 1, 1, 2, 1, 1, 2, 1, 1, 2, 1, 1, 2, 1, 1, 2, 1, 1, 2, 1, 0, 0, 0, 0, 0, 0, 1, 1, 1, 1, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1]
    total reward:  0.0
    [Episode 105]
    [0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 1, 1, 0, 0, 0, 1]
    total reward:  0.0
    [Episode 106]
    [0, 0, 1, 1, 1, 0, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 1, 1, 0, 0, 0, 1, 1]
    total reward:  0.0
    [Episode 107]
    [0, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 1, 1, 1, 0, 1, 0, 0, 1, 1, 1, 0, 0, 1, 1, 0, 1, 1, 0, 0, 0, 1, 1, 0, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 1, 2, 1, 2, 1, 1, 2, 1, 1]
    total reward:  0.0
    [Episode 108]
    [0, 1, 0, 1, 1, 0, 1, 0, 1, 1, 0, 0, 1, 1, 0, 0, 1, 1, 0, 0, 1, 1, 1, 0, 1, 1, 0, 0, 1]
    total reward:  0.0
    [Episode 109]
    [0, 0, 1, 1, 2, 1, 2, 1, 2, 1, 1, 2, 1, 1, 2, 1, 1, 2, 1, 1, 0, 1, 1, 0, 1, 0, 0, 0, 1]
    total reward:  0.0
    [Episode 110]
    [0, 1, 1, 1, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 0, 1, 1, 1, 1, 0, 1, 0, 1, 0, 0, 1, 1, 1, 0, 0, 1, 2, 1, 1, 2, 1, 1, 2, 1, 1, 2, 1, 1, 0, 1, 0, 0, 1, 1, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4]
    total reward:  0.0
    [Episode 111]
    [0, 1, 2, 6, 10, 9, 8, 4, 0, 4]
    total reward:  0.0
    [Episode 112]
    [0, 1, 2, 6, 10, 9, 8, 4, 8, 4, 8, 4, 8, 4, 8]
    total reward:  0.0
    [Episode 113]
    [0, 1, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10]
    total reward:  0.0
    [Episode 114]
    [0, 1, 2, 6, 10, 9, 8, 4, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6]
    total reward:  0.0
    [Episode 115]
    [0, 1, 0, 1, 2, 3, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 6, 10, 9, 8, 4, 0, 1, 2, 6]
    total reward:  0.0
    [Episode 116]
    [0, 1, 2, 6, 10, 14, 10, 9, 8, 4, 0, 1]
    total reward:  0.0
    [Episode 117]
    [0, 1, 2, 6, 10, 9, 10, 9, 8, 9, 8, 9, 8, 8, 4, 0, 1, 2, 1, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 2, 3, 2, 3, 2, 1, 2, 6]
    total reward:  0.0
    [Episode 118]
    [0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 8, 4, 4, 4, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6]
    total reward:  0.0
    [Episode 119]
    [0, 1, 2, 6, 10, 9]
    total reward:  0.0
    [Episode 120]
    [0, 1, 1, 2, 6, 10, 9, 8, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 0, 1, 2, 6, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 13, 14, 10, 9, 13, 14, 10, 9, 10, 9, 8]
    total reward:  0.0
    [Episode 121]
    [0, 1, 2, 1, 2, 6, 10, 9, 8, 4, 4, 4, 4, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 8, 4, 4, 0, 1, 2, 6, 10, 6, 10, 6, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 13, 14, 10, 9, 8, 4]
    total reward:  0.0
    [Episode 122]
    [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 1, 0, 1, 0, 1, 1, 1]
    total reward:  0.0
    [Episode 123]
    [0, 1, 1, 0, 1, 2, 6, 10, 6, 10, 14, 10, 6, 10, 6, 10, 6, 10, 6, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13]
    total reward:  0.0
    [Episode 124]
    [0, 1, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 14, 10, 6, 10, 14, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 9, 13, 9, 13, 14, 10, 6, 2, 6, 2, 6]
    total reward:  0.0
    [Episode 125]
    [0, 1, 2, 6, 2, 6, 2, 6, 2, 2, 6, 2, 3, 2, 6, 2, 6, 2, 6, 2, 2, 6, 2, 6, 2, 2, 6, 2, 2, 6, 2, 2, 6, 2, 2, 3, 2, 6, 2, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10]
    total reward:  0.0
    [Episode 126]
    [0, 1]
    total reward:  0.0
    [Episode 127]
    [0, 1, 2, 3, 2, 3, 2, 6, 10, 6, 10, 9, 13, 14, 10, 9, 13, 14, 10, 14, 10, 9, 8, 4, 0, 1, 2, 6]
    total reward:  0.0
    [Episode 128]
    [0, 1, 2, 6, 10, 6, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13]
    total reward:  0.0
    [Episode 129]
    [0, 1, 2, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 9, 13, 14, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 6, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 14, 10, 9]
    total reward:  0.0
    [Episode 130]
    [0, 1, 2, 6, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13]
    total reward:  0.0
    [Episode 131]
    [0, 1, 2, 1, 2, 6, 10, 9, 13, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 14, 10, 6, 10, 9, 13, 14, 10, 9, 13]
    total reward:  0.0
    [Episode 132]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 133]
    [0, 1, 2, 2, 3, 2, 6, 10]
    total reward:  0.0
    [Episode 134]
    [0, 1, 2, 3, 2, 6, 10]
    total reward:  0.0
    [Episode 135]
    [0, 1, 2, 6, 10, 6, 10, 6, 10, 6, 10, 14, 10, 14, 10, 14, 10, 14, 10, 9, 13, 14, 10, 14, 10, 9, 13, 14, 14, 10, 14, 10, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 6, 10, 9, 13, 14, 10, 6, 10, 6, 10, 9, 13, 14, 10, 6, 10, 9]
    total reward:  0.0
    [Episode 136]
    [0, 1, 2, 6, 10, 6, 10, 9, 13, 14, 10, 6, 10, 9, 13, 14, 10, 14, 10, 9, 13, 14, 10, 6, 10, 6, 10, 9, 13, 14, 10, 14, 14, 10, 14, 10, 6, 10, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 6, 10, 9, 13, 14, 10, 6, 2, 6, 2, 2, 6, 2, 2, 3, 2, 3, 2, 3, 2, 2, 3, 2, 6, 2, 3, 2, 2, 3, 2, 6, 2, 2, 1, 2, 6, 2, 2, 6, 2, 2, 3, 2, 3, 2, 3, 2, 3, 2, 6, 2]
    total reward:  0.0
    [Episode 137]
    [0, 1, 0, 1, 1, 1, 1, 1, 1, 2, 1, 1, 2, 1, 1, 2, 1, 1, 2, 1, 1, 2, 1, 1, 2, 6, 10, 9, 13, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 6]
    total reward:  0.0
    [Episode 138]
    [0, 1, 2, 3, 2, 3, 2, 6, 10, 6, 10, 9, 13, 14, 10, 14, 10, 14, 10, 6, 10, 6, 2, 6, 2, 1]
    total reward:  0.0
    [Episode 139]
    [0, 1, 2, 6, 10, 14, 10, 14, 10, 14, 10, 9, 13, 14, 10, 9, 13, 14, 10, 6, 10, 9, 13, 14, 10, 6, 2, 1, 2, 1, 1, 2, 1, 1, 2, 1, 1, 1, 2, 6, 10, 9, 13, 14, 10, 9, 13, 14, 10, 6, 2, 1, 2, 1, 1, 1, 2, 1, 1, 2, 6, 2, 1, 2, 2, 6, 2, 1, 1, 2, 6, 10, 6, 2, 1, 2, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 6]
    total reward:  0.0
    [Episode 140]
    [0, 0, 1, 0, 1, 0, 1, 0, 1, 1, 1, 0, 1, 1, 0, 1, 1, 0, 1, 1, 0, 1, 1, 0, 1, 1, 0, 1, 1, 0, 1, 1]
    total reward:  0.0
    [Episode 141]
    [0, 1, 0, 1, 1, 1, 0, 1, 1, 0, 1, 1, 0, 1, 1, 0, 1, 1, 0, 1, 1, 0, 1, 1, 0, 1, 1, 0, 1, 1, 0, 1, 1, 2, 1, 2, 2, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 2, 1, 2, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 1, 2, 1, 2, 6, 2, 6, 10, 9, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8, 4, 8]
    total reward:  0.0
    [Episode 142]
    [0, 1, 2, 1, 2, 1, 2, 6, 10, 9, 8, 4, 8, 4, 8, 4, 8, 4, 8, 9, 8, 9, 8, 9, 8, 9, 8, 9, 8, 4, 8, 4, 8, 4, 8, 9, 8, 9, 8]
    total reward:  0.0
    [Episode 143]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 144]
    [0, 1, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 2, 6, 10, 9, 8, 9, 8, 9, 8, 4, 8, 4, 8, 9, 8, 9, 8, 4, 8, 9, 8, 4, 8, 4, 8, 9, 8, 9, 8, 4, 8, 4, 8, 9, 8, 4, 0, 1, 2, 2, 6, 10, 9, 8, 9, 8, 4, 8, 4]
    total reward:  0.0
    [Episode 145]
    [0, 1, 2, 6, 2, 6, 10, 9, 8]
    total reward:  0.0
    [Episode 146]
    GOAL
    [0, 1, 2, 6, 10, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 4, 8, 4, 8, 9, 8, 4, 8, 9, 8, 4, 0, 1, 2, 6, 10, 9, 8, 9, 8, 4, 8, 9, 8, 4, 8, 4, 8, 4, 0, 1, 2, 6, 10, 9, 8, 9, 8, 9, 13, 14]
    total reward:  1.0
    [Episode 147]
    [0, 1, 2, 3, 3, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3]
    total reward:  0.0
    [Episode 148]
    [0, 1, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3, 2, 3]
    total reward:  0.0
    [Episode 149]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 150]
    [0, 1, 2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3]
    total reward:  0.0
    [Episode 151]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 152]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14, 13, 14]
    total reward:  1.0
    [Episode 153]
    GOAL
    [0, 1, 2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 154]
    GOAL
    [0, 1, 2, 3, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 155]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 156]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 157]
    GOAL
    [0, 4, 8, 9, 13, 14]
    total reward:  1.0
    [Episode 158]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 159]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 160]
    GOAL
    [0, 4, 8, 9, 10, 14]
    total reward:  1.0
    [Episode 161]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 162]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 163]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 164]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 165]
    GOAL
    [0, 1, 2, 6, 10, 14, 13, 14]
    total reward:  1.0
    [Episode 166]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 167]
    [0, 1, 2, 3, 3]
    total reward:  0.0
    [Episode 168]
    GOAL
    [0, 1, 2, 6, 10, 14, 14]
    total reward:  1.0
    [Episode 169]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 170]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 171]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 172]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 173]
    GOAL
    [0, 1, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 174]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 175]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 176]
    GOAL
    [0, 1, 2, 6, 10, 14, 13, 14]
    total reward:  1.0
    [Episode 177]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 178]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 179]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 180]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 181]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 182]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 183]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 184]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 185]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 186]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 187]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 188]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 189]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 190]
    [0, 1, 2, 6, 10, 9, 10]
    total reward:  0.0
    [Episode 191]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 192]
    [0, 1]
    total reward:  0.0
    [Episode 193]
    GOAL
    [0, 1, 2, 2, 2, 2, 3, 2, 2, 3, 2, 2, 2, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 194]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 195]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 196]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 197]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 198]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 199]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 200]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 201]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 202]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 203]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 204]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 205]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14, 13, 14]
    total reward:  1.0
    [Episode 206]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 207]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 208]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 209]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 210]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 211]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 212]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 213]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 214]
    GOAL
    [0, 1, 2, 1, 2, 6, 10, 14, 14]
    total reward:  1.0
    [Episode 215]
    GOAL
    [0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 216]
    GOAL
    [0, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 8, 9, 10, 14]
    total reward:  1.0
    [Episode 217]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 218]
    GOAL
    [0, 1, 2, 6, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 219]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 220]
    [0, 4]
    total reward:  0.0
    [Episode 221]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14, 13, 14, 13, 14, 13, 14, 13, 14, 13, 14, 13, 14, 13, 14, 13, 14, 13, 14, 13, 14, 13, 14]
    total reward:  1.0
    [Episode 222]
    GOAL
    [0, 1, 2, 2, 2, 2, 2, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 223]
    GOAL
    [0, 1, 2, 2, 2, 2, 2, 6, 10, 14, 14, 14]
    total reward:  1.0
    [Episode 224]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 225]
    GOAL
    [0, 1, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 226]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 227]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 228]
    GOAL
    [0, 1, 2, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 229]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 230]
    [0, 1, 2, 2, 6]
    total reward:  0.0
    [Episode 231]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 232]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 233]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 234]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 235]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 236]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 237]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 238]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 239]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 240]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 241]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 242]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 243]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 244]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 245]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 246]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 247]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 248]
    [0, 1]
    total reward:  0.0
    [Episode 249]
    GOAL
    [0, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 250]
    GOAL
    [0, 4, 0, 1, 2, 2, 2, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 251]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 252]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 253]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 254]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 255]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 256]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 257]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 258]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 259]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 260]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 261]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 262]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 263]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 264]
    GOAL
    [0, 1, 2, 6, 10, 14, 10, 14]
    total reward:  1.0
    [Episode 265]
    GOAL
    [0, 1, 2, 2, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 266]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 267]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 268]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 269]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 270]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 271]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 272]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 273]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 274]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 275]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 276]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 277]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 278]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 279]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 280]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 281]
    GOAL
    [0, 1, 1, 1, 0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 282]
    GOAL
    [0, 1, 2, 2, 1, 2, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 283]
    GOAL
    [0, 1, 1, 2, 2, 2, 2, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 284]
    GOAL
    [0, 1, 2, 6, 10, 14, 13, 14]
    total reward:  1.0
    [Episode 285]
    GOAL
    [0, 1, 2, 6, 10, 14, 13, 14]
    total reward:  1.0
    [Episode 286]
    [0, 1, 2, 6, 10]
    total reward:  0.0
    [Episode 287]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 288]
    [0, 1, 2, 2, 6]
    total reward:  0.0
    [Episode 289]
    GOAL
    [0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 1, 1, 0, 1, 1, 2, 6, 10, 14, 13, 14]
    total reward:  1.0
    [Episode 290]
    GOAL
    [0, 1, 2, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 291]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 292]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 293]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 294]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 295]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 296]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 297]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 298]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 299]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 300]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 301]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 302]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 303]
    [0, 1]
    total reward:  0.0
    [Episode 304]
    GOAL
    [0, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 305]
    [0, 1, 2, 6, 10]
    total reward:  0.0
    [Episode 306]
    GOAL
    [0, 0, 1, 0, 1, 2, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 307]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 308]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 309]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 310]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 311]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 312]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 313]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 314]
    GOAL
    [0, 1, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 315]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 316]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 317]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 318]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 319]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 320]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 321]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 322]
    GOAL
    [0, 1, 0, 1, 2, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 323]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 324]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 325]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 326]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 327]
    GOAL
    [0, 1, 2, 6, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 328]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 329]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 330]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 331]
    GOAL
    [0, 4, 0, 1, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 332]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 333]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 334]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 335]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 336]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 337]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 338]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 339]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 340]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 341]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 342]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 343]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 344]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 345]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 346]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 347]
    GOAL
    [0, 0, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 348]
    GOAL
    [0, 1, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 349]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 350]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 351]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 352]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 353]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 354]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 355]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 356]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 357]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 358]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 359]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 360]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 361]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 362]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 363]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 364]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 365]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 366]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 367]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 368]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 369]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 370]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 371]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 372]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 373]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 374]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 375]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 376]
    [0, 0, 1, 2, 2, 6]
    total reward:  0.0
    [Episode 377]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 378]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 379]
    GOAL
    [0, 1, 2, 6, 10, 14, 13, 14]
    total reward:  1.0
    [Episode 380]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 381]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 382]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 383]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 384]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 385]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 386]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 387]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 388]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 389]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 390]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 391]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 392]
    [0, 1]
    total reward:  0.0
    [Episode 393]
    GOAL
    [0, 1, 2, 2, 2, 2, 2, 2, 2, 2, 6, 10, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 394]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 395]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 396]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 397]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 398]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 399]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 400]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 401]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 402]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 403]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 404]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 405]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 406]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 407]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 408]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 409]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 410]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 411]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 412]
    GOAL
    [0, 1, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 413]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 414]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 415]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 416]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 417]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 418]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 419]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 420]
    GOAL
    [0, 1, 2, 6, 10, 14, 14]
    total reward:  1.0
    [Episode 421]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 422]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 423]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 424]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 425]
    [0, 0, 1, 2, 6]
    total reward:  0.0
    [Episode 426]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 427]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 428]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 429]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 430]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 431]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 432]
    [0, 1]
    total reward:  0.0
    [Episode 433]
    GOAL
    [0, 1, 2, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 434]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 435]
    GOAL
    [0, 0, 1, 2, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 436]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 437]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 438]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 439]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 440]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 441]
    GOAL
    [0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 442]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 443]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 444]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 445]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 446]
    GOAL
    [0, 1, 2, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 447]
    GOAL
    [0, 1, 2, 6, 10, 9, 13, 14]
    total reward:  1.0
    [Episode 448]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 449]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 450]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 451]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 452]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 453]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 454]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 455]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 456]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 457]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 458]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 459]
    GOAL
    [0, 1, 2, 6, 10, 14, 14]
    total reward:  1.0
    [Episode 460]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 461]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 462]
    GOAL
    [0, 4, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 463]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 464]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 465]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 466]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 467]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 468]
    GOAL
    [0, 4, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 469]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 470]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 471]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 472]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 473]
    [0, 1, 2, 6, 10, 6]
    total reward:  0.0
    [Episode 474]
    GOAL
    [0, 0, 0, 0, 1, 0, 1, 1, 1, 1, 0, 1, 1, 1, 0, 1, 1, 0, 1, 1, 0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 475]
    GOAL
    [0, 4, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 476]
    GOAL
    [0, 1, 2, 6, 10, 9, 10, 14]
    total reward:  1.0
    [Episode 477]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 478]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 479]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 480]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 481]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 482]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 483]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 484]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 485]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 486]
    GOAL
    [0, 1, 2, 6, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 487]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 488]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 489]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 490]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 491]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 492]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 493]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 494]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 495]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 496]
    GOAL
    [0, 0, 4, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 497]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 498]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 499]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 500]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 501]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 502]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 503]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 504]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 505]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 506]
    [0, 1, 2, 6, 10]
    total reward:  0.0
    [Episode 507]
    GOAL
    [0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 508]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 509]
    GOAL
    [0, 1, 2, 6, 10, 14, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 510]
    GOAL
    [0, 1, 2, 2, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 511]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 512]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 513]
    GOAL
    [0, 1, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 514]
    [0, 1]
    total reward:  0.0
    [Episode 515]
    GOAL
    [0, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 516]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 517]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 518]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 519]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 520]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 521]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 522]
    GOAL
    [0, 1, 2, 6, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 523]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 524]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 525]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 526]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 527]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 528]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 529]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 530]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 531]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 532]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 533]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 534]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 535]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 536]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 537]
    GOAL
    [0, 1, 2, 6, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 538]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 539]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 540]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 541]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 542]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 543]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 544]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 545]
    [0, 1]
    total reward:  0.0
    [Episode 546]
    GOAL
    [0, 1, 2, 6, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 547]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 548]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 549]
    GOAL
    [0, 1, 2, 6, 10, 14, 13, 14]
    total reward:  1.0
    [Episode 550]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 551]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 552]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 553]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 554]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 555]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 556]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 557]
    GOAL
    [0, 1, 2, 6, 10, 14, 10, 9, 10, 14]
    total reward:  1.0
    [Episode 558]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 559]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 560]
    GOAL
    [0, 4, 0, 1, 2, 6, 10, 14, 10, 14]
    total reward:  1.0
    [Episode 561]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 562]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 563]
    GOAL
    [0, 1, 2, 3, 2, 6, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 564]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 565]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 566]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 567]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 568]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 569]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 570]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 571]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 572]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 573]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 574]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 575]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 576]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 577]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 578]
    GOAL
    [0, 1, 2, 6, 10, 14, 14]
    total reward:  1.0
    [Episode 579]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 580]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 581]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 582]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 583]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 584]
    GOAL
    [0, 1, 2, 6, 10, 9, 10, 14]
    total reward:  1.0
    [Episode 585]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 586]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 587]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 588]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 589]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 590]
    GOAL
    [0, 1, 2, 6, 10, 9, 10, 14]
    total reward:  1.0
    [Episode 591]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 592]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 593]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 594]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 595]
    GOAL
    [0, 1, 2, 6, 10, 6, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 596]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 597]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 598]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 599]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 600]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 601]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 602]
    GOAL
    [0, 1, 2, 6, 10, 14, 14]
    total reward:  1.0
    [Episode 603]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 604]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 605]
    GOAL
    [0, 1, 2, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 606]
    GOAL
    [0, 0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 607]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 608]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 609]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 610]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 611]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 612]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 613]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 614]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 615]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 616]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 617]
    GOAL
    [0, 1, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 618]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 619]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 620]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 621]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 622]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 623]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 624]
    GOAL
    [0, 1, 1, 2, 6, 10, 9, 10, 14]
    total reward:  1.0
    [Episode 625]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 626]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 627]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 628]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 629]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 630]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 631]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 632]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 633]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 634]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 635]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 636]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 637]
    GOAL
    [0, 1, 2, 6, 10, 14, 14]
    total reward:  1.0
    [Episode 638]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 639]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 640]
    [0, 1, 2, 6, 10]
    total reward:  0.0
    [Episode 641]
    GOAL
    [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 1, 1, 1, 1, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 642]
    GOAL
    [0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 643]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 644]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 645]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 646]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 647]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 648]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 649]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 650]
    GOAL
    [0, 0, 0, 0, 0, 1, 1, 1, 1, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 651]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 652]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 653]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 654]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 655]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 656]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 657]
    GOAL
    [0, 1, 2, 6, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 658]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 659]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 660]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 661]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 662]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 663]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 664]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 665]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 666]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 667]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 668]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 669]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 670]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 671]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 672]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 673]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 674]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 675]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 676]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 677]
    [0, 1]
    total reward:  0.0
    [Episode 678]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 679]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 680]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 681]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 682]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 683]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 684]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 685]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 686]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 687]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 688]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 689]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 690]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 691]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 692]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 693]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 694]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 695]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 696]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 697]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 698]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 699]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 700]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 701]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 702]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 703]
    [0, 1]
    total reward:  0.0
    [Episode 704]
    GOAL
    [0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 705]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 706]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 707]
    GOAL
    [0, 4, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 708]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 709]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 710]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 711]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 712]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 713]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 714]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 715]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 716]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 717]
    [0, 1, 2, 6, 10]
    total reward:  0.0
    [Episode 718]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 719]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 720]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 721]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 722]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 723]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 724]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 725]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 726]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 727]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 728]
    GOAL
    [0, 1, 2, 6, 10, 9, 10, 14]
    total reward:  1.0
    [Episode 729]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 730]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 731]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 732]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 733]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 734]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 735]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 736]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 737]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 738]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 739]
    GOAL
    [0, 1, 2, 6, 10, 9, 10, 14]
    total reward:  1.0
    [Episode 740]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 741]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 742]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 743]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 744]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 745]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 746]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 747]
    GOAL
    [0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 748]
    GOAL
    [0, 1, 2, 6, 10, 14, 14]
    total reward:  1.0
    [Episode 749]
    GOAL
    [0, 1, 2, 6, 10, 14, 14]
    total reward:  1.0
    [Episode 750]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 751]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 752]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 753]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 754]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 755]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 756]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 757]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 758]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 759]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 760]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 761]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 762]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 763]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 764]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 765]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 766]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 767]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 768]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 769]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 770]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 771]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 772]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 773]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 774]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 775]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 776]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 777]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 778]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 779]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 780]
    GOAL
    [0, 4, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 781]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 782]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 783]
    GOAL
    [0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 784]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 785]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 786]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 787]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 788]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 789]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 790]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 791]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 792]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 793]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 794]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 795]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 796]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 797]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 798]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 799]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 800]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 801]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 802]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 803]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 804]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 805]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 806]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 807]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 808]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 809]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 810]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 811]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 812]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 813]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 814]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 815]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 816]
    GOAL
    [0, 1, 2, 6, 10, 9, 10, 14]
    total reward:  1.0
    [Episode 817]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 818]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 819]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 820]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 821]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 822]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 823]
    [0, 1, 2, 6, 10]
    total reward:  0.0
    [Episode 824]
    GOAL
    [0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 825]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 826]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 827]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 828]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 829]
    GOAL
    [0, 1, 2, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 830]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 831]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 832]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 833]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 834]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 835]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 836]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 837]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 838]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 839]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 840]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 841]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 842]
    GOAL
    [0, 1, 2, 6, 10, 14, 10, 14]
    total reward:  1.0
    [Episode 843]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 844]
    GOAL
    [0, 1, 2, 6, 10, 14, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 845]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 846]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 847]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 848]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 849]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 850]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 851]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 852]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 853]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 854]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 855]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 856]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 857]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 858]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 859]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 860]
    GOAL
    [0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 861]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 862]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 863]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 864]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 865]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 866]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 867]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 868]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 869]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 870]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 871]
    GOAL
    [0, 1, 2, 6, 10, 14, 10, 14]
    total reward:  1.0
    [Episode 872]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 873]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 874]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 875]
    [0, 1, 2, 1, 2, 6, 10]
    total reward:  0.0
    [Episode 876]
    GOAL
    [0, 1, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 877]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 878]
    [0, 1, 2, 6, 10, 6]
    total reward:  0.0
    [Episode 879]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 880]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 881]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 882]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 883]
    GOAL
    [0, 1, 2, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 884]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 885]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 886]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 887]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 888]
    GOAL
    [0, 1, 2, 6, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 889]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 890]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 891]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 892]
    GOAL
    [0, 4, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 893]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 894]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 895]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 896]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 897]
    GOAL
    [0, 4, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 898]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 899]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 900]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 901]
    GOAL
    [0, 4, 0, 4, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 902]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 903]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 904]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 905]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 906]
    GOAL
    [0, 1, 2, 6, 10, 14, 14]
    total reward:  1.0
    [Episode 907]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 908]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 909]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 910]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 911]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 912]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 913]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 914]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 915]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 916]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 917]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 918]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 919]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 920]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 921]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 922]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 923]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 924]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 925]
    [0, 1, 2, 6, 10]
    total reward:  0.0
    [Episode 926]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 927]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 928]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 929]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 930]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 931]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 932]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 933]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 934]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 935]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 936]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 937]
    GOAL
    [0, 1, 2, 6, 10, 9, 10, 14]
    total reward:  1.0
    [Episode 938]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 939]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 940]
    [0, 4, 0, 1]
    total reward:  0.0
    [Episode 941]
    GOAL
    [0, 1, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 942]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 943]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 944]
    GOAL
    [0, 1, 2, 6, 10, 14, 14]
    total reward:  1.0
    [Episode 945]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 946]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 947]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 948]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 949]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 950]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 951]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 952]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 953]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 954]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 955]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 956]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 957]
    GOAL
    [0, 0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 958]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 959]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 960]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 961]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 962]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 963]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 964]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 965]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 966]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 967]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 968]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 969]
    GOAL
    [0, 1, 2, 6, 10, 14, 14]
    total reward:  1.0
    [Episode 970]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 971]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 972]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 973]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 974]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 975]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 976]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 977]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 978]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 979]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 980]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 981]
    [0, 1, 1, 2, 6]
    total reward:  0.0
    [Episode 982]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 983]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 984]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 985]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 986]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 987]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 988]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 989]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 990]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 991]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 992]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 993]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 994]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 995]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 996]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 997]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 998]
    GOAL
    [0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 999]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1000]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1001]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1002]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1003]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1004]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1005]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1006]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1007]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1008]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1009]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1010]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1011]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1012]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1013]
    GOAL
    [0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1014]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1015]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1016]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1017]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1018]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1019]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1020]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1021]
    GOAL
    [0, 1, 2, 2, 6, 10, 14, 10, 14]
    total reward:  1.0
    [Episode 1022]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1023]
    GOAL
    [0, 0, 1, 2, 6, 10, 9, 10, 14]
    total reward:  1.0
    [Episode 1024]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1025]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1026]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1027]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1028]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1029]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1030]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1031]
    GOAL
    [0, 1, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1032]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1033]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1034]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1035]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1036]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1037]
    GOAL
    [0, 1, 2, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1038]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1039]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 1040]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1041]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1042]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1043]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1044]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1045]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1046]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1047]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1048]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1049]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1050]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1051]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1052]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1053]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1054]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 1055]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1056]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1057]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1058]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1059]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1060]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1061]
    GOAL
    [0, 1, 2, 6, 10, 14, 10, 14]
    total reward:  1.0
    [Episode 1062]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1063]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1064]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1065]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1066]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1067]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1068]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1069]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 1070]
    [0, 1]
    total reward:  0.0
    [Episode 1071]
    GOAL
    [0, 1, 2, 1, 2, 2, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1072]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1073]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1074]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1075]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1076]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1077]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1078]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1079]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1080]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1081]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1082]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1083]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 1084]
    GOAL
    [0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1085]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1086]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1087]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1088]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1089]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1090]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1091]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1092]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1093]
    GOAL
    [0, 4, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1094]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1095]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1096]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1097]
    [0, 1]
    total reward:  0.0
    [Episode 1098]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1099]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1100]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1101]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1102]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1103]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1104]
    [0, 1, 2, 6, 10]
    total reward:  0.0
    [Episode 1105]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1106]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1107]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1108]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1109]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1110]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1111]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1112]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1113]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1114]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1115]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1116]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1117]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1118]
    GOAL
    [0, 1, 2, 6, 10, 14, 14]
    total reward:  1.0
    [Episode 1119]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1120]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1121]
    GOAL
    [0, 1, 2, 6, 10, 14, 10, 14]
    total reward:  1.0
    [Episode 1122]
    GOAL
    [0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1123]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1124]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1125]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1126]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1127]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1128]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1129]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1130]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1131]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1132]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1133]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1134]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1135]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1136]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1137]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1138]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1139]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1140]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1141]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1142]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1143]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1144]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1145]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 1146]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1147]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1148]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1149]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1150]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 1151]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1152]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1153]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1154]
    [0, 1, 2, 2, 6, 10]
    total reward:  0.0
    [Episode 1155]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1156]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1157]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1158]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1159]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1160]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1161]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1162]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1163]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1164]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1165]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1166]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1167]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1168]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1169]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1170]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1171]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1172]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1173]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1174]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1175]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1176]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1177]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1178]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1179]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1180]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1181]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1182]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1183]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1184]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1185]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1186]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1187]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1188]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1189]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1190]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1191]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1192]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1193]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1194]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1195]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1196]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1197]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1198]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1199]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1200]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1201]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1202]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1203]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1204]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1205]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1206]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1207]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1208]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1209]
    GOAL
    [0, 1, 2, 6, 10, 14, 13, 14]
    total reward:  1.0
    [Episode 1210]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1211]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1212]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1213]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1214]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1215]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1216]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1217]
    GOAL
    [0, 1, 2, 6, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1218]
    GOAL
    [0, 1, 2, 6, 10, 14, 10, 14]
    total reward:  1.0
    [Episode 1219]
    [0, 1]
    total reward:  0.0
    [Episode 1220]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1221]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1222]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1223]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1224]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1225]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1226]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1227]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1228]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1229]
    GOAL
    [0, 1, 2, 6, 10, 14, 10, 14]
    total reward:  1.0
    [Episode 1230]
    GOAL
    [0, 1, 2, 6, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1231]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1232]
    GOAL
    [0, 1, 2, 6, 10, 14, 10, 14]
    total reward:  1.0
    [Episode 1233]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1234]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1235]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1236]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1237]
    [0, 1, 2, 3]
    total reward:  0.0
    [Episode 1238]
    GOAL
    [0, 1, 2, 2, 2, 2, 2, 3, 2, 6, 10, 6, 2, 3, 2, 3, 2, 3, 2, 3, 2, 2, 3, 2, 2, 2, 3, 2, 6, 2, 6, 10, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 1239]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 1240]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 1241]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1242]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1243]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1244]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1245]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1246]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1247]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1248]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1249]
    GOAL
    [0, 1, 2, 6, 10, 14, 10, 14]
    total reward:  1.0
    [Episode 1250]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1251]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1252]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1253]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1254]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1255]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1256]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1257]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1258]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1259]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1260]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1261]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1262]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1263]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1264]
    GOAL
    [0, 1, 2, 6, 10, 14, 13, 14]
    total reward:  1.0
    [Episode 1265]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1266]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1267]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1268]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1269]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1270]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1271]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1272]
    GOAL
    [0, 1, 2, 6, 10, 9, 10, 14]
    total reward:  1.0
    [Episode 1273]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1274]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1275]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1276]
    GOAL
    [0, 1, 2, 6, 10, 14, 13, 14]
    total reward:  1.0
    [Episode 1277]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1278]
    GOAL
    [0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1279]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1280]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1281]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1282]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1283]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1284]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1285]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1286]
    GOAL
    [0, 1, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1287]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1288]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1289]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1290]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1291]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 1292]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1293]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1294]
    GOAL
    [0, 1, 2, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1295]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1296]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1297]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1298]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1299]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1300]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1301]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1302]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1303]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1304]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1305]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1306]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 1307]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1308]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1309]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1310]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1311]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1312]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1313]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1314]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1315]
    GOAL
    [0, 1, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1316]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1317]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1318]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1319]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1320]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1321]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1322]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1323]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1324]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1325]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1326]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1327]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1328]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1329]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1330]
    GOAL
    [0, 1, 2, 6, 10, 14, 14]
    total reward:  1.0
    [Episode 1331]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1332]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1333]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1334]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1335]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1336]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1337]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1338]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1339]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1340]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1341]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1342]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1343]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1344]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1345]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1346]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1347]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1348]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1349]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1350]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1351]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1352]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1353]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1354]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1355]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1356]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1357]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1358]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1359]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1360]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1361]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 1362]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1363]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1364]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1365]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1366]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1367]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1368]
    [0, 1]
    total reward:  0.0
    [Episode 1369]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1370]
    GOAL
    [0, 4, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1371]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1372]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1373]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1374]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1375]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 1376]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1377]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1378]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1379]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1380]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1381]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1382]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1383]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1384]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1385]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1386]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1387]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1388]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1389]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1390]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1391]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1392]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1393]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1394]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1395]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1396]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1397]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1398]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1399]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1400]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1401]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1402]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1403]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1404]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1405]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1406]
    GOAL
    [0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1407]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1408]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1409]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1410]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1411]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1412]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1413]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1414]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1415]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1416]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1417]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1418]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1419]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1420]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1421]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1422]
    GOAL
    [0, 1, 2, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1423]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1424]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1425]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1426]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1427]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1428]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1429]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1430]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 1431]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1432]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1433]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1434]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1435]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1436]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1437]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1438]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1439]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1440]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1441]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1442]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1443]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1444]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1445]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1446]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1447]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1448]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1449]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1450]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1451]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1452]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1453]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1454]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1455]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1456]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1457]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1458]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1459]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1460]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1461]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1462]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1463]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1464]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1465]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1466]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1467]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1468]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1469]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1470]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1471]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1472]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1473]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1474]
    [0, 1]
    total reward:  0.0
    [Episode 1475]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1476]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 1477]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1478]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1479]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1480]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1481]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1482]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1483]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1484]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1485]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 1486]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1487]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1488]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1489]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1490]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1491]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1492]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1493]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1494]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1495]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1496]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1497]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1498]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1499]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1500]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1501]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1502]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1503]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1504]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1505]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1506]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 1507]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1508]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1509]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1510]
    [0, 1, 2, 6, 10]
    total reward:  0.0
    [Episode 1511]
    GOAL
    [0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1512]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1513]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1514]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1515]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1516]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1517]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1518]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1519]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1520]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1521]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1522]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1523]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1524]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1525]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1526]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1527]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1528]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1529]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1530]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1531]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1532]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1533]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1534]
    GOAL
    [0, 1, 2, 6, 10, 9, 10, 14]
    total reward:  1.0
    [Episode 1535]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1536]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1537]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1538]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1539]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1540]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1541]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1542]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1543]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1544]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1545]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1546]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1547]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1548]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1549]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1550]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1551]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1552]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 1553]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1554]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1555]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1556]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1557]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1558]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1559]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1560]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1561]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1562]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1563]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1564]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1565]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1566]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1567]
    GOAL
    [0, 1, 2, 6, 10, 14, 13, 14]
    total reward:  1.0
    [Episode 1568]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1569]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1570]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1571]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1572]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1573]
    [0, 1]
    total reward:  0.0
    [Episode 1574]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1575]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1576]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1577]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1578]
    GOAL
    [0, 1, 2, 6, 10, 14, 13, 14]
    total reward:  1.0
    [Episode 1579]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1580]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1581]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1582]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1583]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1584]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1585]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1586]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1587]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1588]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1589]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1590]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1591]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1592]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1593]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1594]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1595]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1596]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1597]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 1598]
    [0, 1]
    total reward:  0.0
    [Episode 1599]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 1600]
    GOAL
    [0, 0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1601]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1602]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1603]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1604]
    GOAL
    [0, 1, 2, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1605]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1606]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1607]
    [0, 1, 2, 6, 10]
    total reward:  0.0
    [Episode 1608]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1609]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1610]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1611]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1612]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1613]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1614]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1615]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1616]
    GOAL
    [0, 1, 2, 6, 10, 6, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1617]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1618]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1619]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1620]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1621]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1622]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1623]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1624]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1625]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1626]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1627]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1628]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1629]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1630]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1631]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1632]
    [0, 1]
    total reward:  0.0
    [Episode 1633]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1634]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1635]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1636]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1637]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1638]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1639]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1640]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1641]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1642]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1643]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1644]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1645]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1646]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1647]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1648]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1649]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1650]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1651]
    GOAL
    [0, 1, 1, 2, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1652]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1653]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1654]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1655]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1656]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1657]
    [0, 1]
    total reward:  0.0
    [Episode 1658]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1659]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1660]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1661]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1662]
    GOAL
    [0, 1, 2, 6, 10, 14, 10, 14]
    total reward:  1.0
    [Episode 1663]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1664]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1665]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1666]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1667]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1668]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1669]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1670]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1671]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1672]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 1673]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1674]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1675]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1676]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1677]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1678]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1679]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1680]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1681]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1682]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1683]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1684]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1685]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1686]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1687]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1688]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1689]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1690]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1691]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1692]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1693]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1694]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 1695]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1696]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1697]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1698]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1699]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1700]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1701]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1702]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1703]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1704]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1705]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1706]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1707]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1708]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1709]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1710]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1711]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1712]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1713]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1714]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1715]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1716]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1717]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1718]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1719]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1720]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1721]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1722]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1723]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1724]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1725]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1726]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1727]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1728]
    GOAL
    [0, 4, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1729]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1730]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1731]
    [0, 1]
    total reward:  0.0
    [Episode 1732]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1733]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1734]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1735]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1736]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1737]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1738]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1739]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1740]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1741]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1742]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1743]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1744]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1745]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1746]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1747]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1748]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1749]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1750]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1751]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1752]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1753]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1754]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1755]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1756]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1757]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1758]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1759]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1760]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1761]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1762]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1763]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1764]
    [0, 1, 2, 6, 10]
    total reward:  0.0
    [Episode 1765]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1766]
    GOAL
    [0, 1, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1767]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1768]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1769]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1770]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1771]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1772]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1773]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1774]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1775]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1776]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1777]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1778]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1779]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1780]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1781]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1782]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1783]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1784]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1785]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1786]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1787]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1788]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1789]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1790]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1791]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1792]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1793]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1794]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1795]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1796]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1797]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1798]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1799]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1800]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1801]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1802]
    GOAL
    [0, 1, 2, 6, 10, 14, 14]
    total reward:  1.0
    [Episode 1803]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1804]
    GOAL
    [0, 1, 2, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1805]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1806]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1807]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1808]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1809]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1810]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1811]
    [0, 1]
    total reward:  0.0
    [Episode 1812]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1813]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1814]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1815]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1816]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1817]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1818]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1819]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1820]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1821]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1822]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1823]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1824]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1825]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1826]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1827]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1828]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1829]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1830]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1831]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1832]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1833]
    [0, 1]
    total reward:  0.0
    [Episode 1834]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1835]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1836]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1837]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1838]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1839]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1840]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1841]
    GOAL
    [0, 1, 2, 6, 10, 14, 13, 14]
    total reward:  1.0
    [Episode 1842]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1843]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1844]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1845]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1846]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1847]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1848]
    GOAL
    [0, 1, 2, 6, 10, 14, 13, 9, 10, 6, 2, 2, 2, 2, 2, 2, 2, 6, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1849]
    GOAL
    [0, 0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1850]
    GOAL
    [0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1851]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1852]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1853]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1854]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1855]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1856]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1857]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1858]
    GOAL
    [0, 1, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1859]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1860]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1861]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1862]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1863]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 1864]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1865]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1866]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1867]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1868]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1869]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1870]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1871]
    [0, 1, 2, 6, 10]
    total reward:  0.0
    [Episode 1872]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1873]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1874]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1875]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1876]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1877]
    GOAL
    [0, 1, 2, 6, 10, 14, 10, 14]
    total reward:  1.0
    [Episode 1878]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1879]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1880]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1881]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1882]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1883]
    GOAL
    [0, 1, 2, 6, 10, 14, 13, 14, 13, 14]
    total reward:  1.0
    [Episode 1884]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1885]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1886]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1887]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1888]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1889]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1890]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1891]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1892]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1893]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1894]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1895]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1896]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1897]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1898]
    GOAL
    [0, 4, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1899]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1900]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1901]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1902]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1903]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1904]
    GOAL
    [0, 0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1905]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1906]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1907]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1908]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1909]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1910]
    GOAL
    [0, 1, 2, 6, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1911]
    GOAL
    [0, 1, 2, 6, 10, 14, 13, 14]
    total reward:  1.0
    [Episode 1912]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1913]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1914]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1915]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1916]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1917]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1918]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1919]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1920]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1921]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1922]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1923]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1924]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1925]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1926]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1927]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1928]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1929]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1930]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1931]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1932]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1933]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1934]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1935]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1936]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1937]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1938]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1939]
    [0, 1, 2, 6]
    total reward:  0.0
    [Episode 1940]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1941]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1942]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1943]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1944]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1945]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1946]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1947]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1948]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1949]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1950]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1951]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1952]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1953]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1954]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1955]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1956]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1957]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1958]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1959]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1960]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1961]
    GOAL
    [0, 1, 2, 3, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1962]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1963]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1964]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1965]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1966]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1967]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1968]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1969]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1970]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1971]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1972]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1973]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1974]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1975]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1976]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1977]
    GOAL
    [0, 1, 2, 6, 10, 14, 13, 14]
    total reward:  1.0
    [Episode 1978]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1979]
    GOAL
    [0, 1, 2, 6, 10, 14, 14]
    total reward:  1.0
    [Episode 1980]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1981]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1982]
    GOAL
    [0, 0, 1, 2, 6, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1983]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1984]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1985]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1986]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1987]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1988]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1989]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1990]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1991]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1992]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1993]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1994]
    GOAL
    [0, 1, 2, 6, 10, 6, 10, 14]
    total reward:  1.0
    [Episode 1995]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1996]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1997]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1998]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    [Episode 1999]
    GOAL
    [0, 1, 2, 6, 10, 14]
    total reward:  1.0
    Success prob: 0.887%

```python
for var in tf.trainable_variables('q_net'):
    print(var)
    print(sess.run(var))
```

    <tf.Variable 'q_net/fully_connected/weights:0' shape=(16, 4) dtype=float32_ref>
    [[ 1.85442626e-01  1.33606553e-01  4.03241605e-01  1.02595784e-01]
     [ 1.86924785e-01 -7.91111052e-01  4.12707448e-01  1.11890554e-01]
     [ 1.93792343e-01  1.75426632e-01  3.95332575e-01  1.12667419e-01]
     [ 2.00457394e-01 -5.23985744e-01  5.04854061e-02  7.64450431e-02]
     [ 1.66701656e-02 -5.73978499e-02 -1.74171612e-01  1.13316983e-01]
     [-4.21370029e-01 -4.46340919e-01  3.11984539e-01 -1.40076876e-02]
     [-7.47894704e-01  1.85220659e-01 -5.37969053e-01  1.20739974e-01]
     [ 3.02989960e-01 -3.62821490e-01 -3.97201329e-01  2.06099570e-01]
     [ 1.62122771e-04 -2.65900314e-01  2.22146034e-01  5.97805642e-02]
     [ 3.62168513e-02  2.03323737e-03  4.23254132e-01 -2.11137876e-01]
     [ 1.78522751e-01  1.95185006e-01 -5.35993218e-01  1.30820006e-01]
     [ 1.12197042e-01 -3.56655687e-01  1.96974635e-01  2.51908004e-01]
     [-3.29894960e-01 -3.17357183e-02  1.58759236e-01  5.29311419e-01]
     [-1.56954616e-01 -3.42321008e-01  4.38496441e-01 -5.77322170e-02]
     [ 2.08215296e-01  1.84910759e-01  4.52244371e-01  1.48723379e-01]
     [-4.77066636e-02 -3.95193160e-01 -4.41019744e-01 -3.37156534e-01]]
    <tf.Variable 'q_net/fully_connected/biases:0' shape=(4,) dtype=float32_ref>
    [0.7634763  0.79463476 0.5476724  0.8396292 ]

```python
# epsilon 변화 그래프
steps = np.arange(EPISODE)
plt.title('Epsilon values')
plt.xlabel('Timestep')
plt.ylabel('$\\epsilon$')
plt.plot(steps, epsilon_list)
```

```python
# loss 변화 그래프
update_count = np.arange(update_count)
plt.title('Loss values')
plt.xlabel('Update Count')
plt.ylabel('Loss')
plt.plot(update_count, loss_list)
```

### Test agent

```python
state = env.reset()
state = np.reshape(state, [1])
done = False
limit = 0

epsilon = 0.0
while not done and limit < 30:
    curr_q = sess.run(q_value, feed_dict={inputs: state})
    action = np.argmax(curr_q)
    next_state, reward, done, _ = env.step(action)
    next_state = np.reshape(next_state, [1])
    env.render()
    state = next_state
    limit += 1
```

      (Right)
    SFFF
    FHFH
    FFFH
    HFFG
      (Right)
    SFFF
    FHFH
    FFFH
    HFFG
      (Down)
    SFFF
    FHFH
    FFFH
    HFFG
      (Down)
    SFFF
    FHFH
    FFFH
    HFFG
      (Down)
    SFFF
    FHFH
    FFFH
    HFFG
      (Right)
    SFFF
    FHFH
    FFFH
    HFFG

```python

```