· 6 years ago · Oct 11, 2019, 07:18 PM
1Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com atomic-openshift-node[7871]: I1003 15:37:56.975462 7871 kubelet_pods.go:1127] Killing unwanted pod "master-etcd-eng-master1.lab1.betelab.ericy.com"
2Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com atomic-openshift-master-api[125295]: E1003 15:37:56.976779 125295 available_controller.go:311] v2alpha1.batch failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v2alpha1.batch": StorageError: invalid object, Code: 4, Key: /kubernetes.io/apiservices/v2alpha1.batch, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ae9cb700-e61d-11e9-b70e-001a4a16059e, UID in object meta: ae9fd0d1-e61d-11e9-8873-001a4a16059f
3Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com atomic-openshift-node[7871]: I1003 15:37:56.983002 7871 kuberuntime_container.go:547] Killing container "docker://c400ea2b01e7ee16c05059ec2377095d7cfbb9474072f437ffd66a1e32aef721" with 30 second grace period
4Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.984949 N | pkg/osutil: received terminated signal, shutting down...
5Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.985056 I | etcdserver: skipped leadership transfer for stopping non-leader member
6Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com atomic-openshift-node[7871]: I1003 15:37:56.987357 7871 mirror_client.go:85] Deleting a mirror pod "master-etcd-eng-master1.lab1.betelab.ericy.com_kube-system"
7Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.988135 I | rafthttp: stopping peer b4ef7bce07b9e509...
8Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.988712 I | rafthttp: closed the TCP streaming connection with peer b4ef7bce07b9e509 (stream MsgApp v2 writer)
9Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.988758 I | rafthttp: stopped streaming with peer b4ef7bce07b9e509 (writer)
10Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.989258 W | rafthttp: failed to process raft message (raft: stopped)
11Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.989309 I | rafthttp: closed the TCP streaming connection with peer b4ef7bce07b9e509 (stream Message writer)
12Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.989334 I | rafthttp: stopped streaming with peer b4ef7bce07b9e509 (writer)
13Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.989395 I | rafthttp: stopped HTTP pipelining with peer b4ef7bce07b9e509
14Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.989661 W | rafthttp: lost the TCP streaming connection with peer b4ef7bce07b9e509 (stream MsgApp v2 reader)
15Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.989715 I | rafthttp: stopped streaming with peer b4ef7bce07b9e509 (stream MsgApp v2 reader)
16Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.989933 W | rafthttp: lost the TCP streaming connection with peer b4ef7bce07b9e509 (stream Message reader)
17Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.989976 E | rafthttp: failed to read b4ef7bce07b9e509 on stream Message (context canceled)
18Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.990003 I | rafthttp: peer b4ef7bce07b9e509 became inactive
19Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.990032 I | rafthttp: stopped streaming with peer b4ef7bce07b9e509 (stream Message reader)
20Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.990066 I | rafthttp: stopped peer b4ef7bce07b9e509
21Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.990093 I | rafthttp: stopping peer 1bf88a760b44bce8...
22Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.990582 I | rafthttp: closed the TCP streaming connection with peer 1bf88a760b44bce8 (stream MsgApp v2 writer)
23Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.990621 I | rafthttp: stopped streaming with peer 1bf88a760b44bce8 (writer)
24Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com atomic-openshift-master-api[125295]: E1003 15:37:56.996838 125295 available_controller.go:311] v2alpha1.batch failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v2alpha1.batch": StorageError: invalid object, Code: 4, Key: /kubernetes.io/apiservices/v2alpha1.batch, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ae9fd0d1-e61d-11e9-8873-001a4a16059f, UID in object meta: aea31725-e61d-11e9-8873-001a4a16059f
25Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.991023 I | rafthttp: closed the TCP streaming connection with peer 1bf88a760b44bce8 (stream Message writer)
26Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.991064 I | rafthttp: stopped streaming with peer 1bf88a760b44bce8 (writer)
27Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.991166 I | rafthttp: stopped HTTP pipelining with peer 1bf88a760b44bce8
28Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.991355 W | rafthttp: lost the TCP streaming connection with peer 1bf88a760b44bce8 (stream MsgApp v2 reader)
29Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.991400 E | rafthttp: failed to read 1bf88a760b44bce8 on stream MsgApp v2 (context canceled)
30Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.991417 I | rafthttp: peer 1bf88a760b44bce8 became inactive
31Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.991434 I | rafthttp: stopped streaming with peer 1bf88a760b44bce8 (stream MsgApp v2 reader)
32Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.991589 W | rafthttp: lost the TCP streaming connection with peer 1bf88a760b44bce8 (stream Message reader)
33Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.991634 I | rafthttp: stopped streaming with peer 1bf88a760b44bce8 (stream Message reader)
34Oct 03 15:37:56 eng-master1.lab1.betelab.ericy.com dockerd-current[2590]: 2019-10-03 15:37:56.991650 I | rafthttp: stopped peer 1bf88a760b44bce8
35Oct 03 15:37:57 eng-master1.lab1.betelab.ericy.com atomic-openshift-node[7871]: I1003 15:37:57.007771 7871 kubelet.go:1885] SyncLoop (DELETE, "api"): "master-etcd-eng-master1.lab1.betelab.ericy.com_kube-system(5e9ff831-e61a-11e9-8873-001a4a16059f)"
36Oct 03 15:37:57 eng-master1.lab1.betelab.ericy.com atomic-openshift-node[7871]: I1003 15:37:57.007884 7871 kubelet.go:1879] SyncLoop (REMOVE, "api"): "master-etcd-eng-master1.lab1.betelab.ericy.com_kube-system(5e9ff831-e61a-11e9-8873-001a4a16059f)"
37Oct 03 15:37:57 eng-master1.lab1.betelab.ericy.com atomic-openshift-master-api[125295]: E1003 15:37:57.016544 125295 available_controller.go:311] v2alpha1.batch failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v2alpha1.batch": StorageError: invalid object, Code: 4, Key: /kubernetes.io/apiservices/v2alpha1.batch, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: aea31725-e61d-11e9-8873-001a4a16059f, UID in object meta: aea67806-e61d-11e9-8873-001a4a16059f
38Oct 03 15:37:57 eng-master1.lab1.betelab.ericy.com systemd[1]: Scope libcontainer-7871-systemd-test-default-dependencies.scope has no PIDs. Refusing.
39Oct 03 15:37:57 eng-master1.lab1.betelab.ericy.com systemd[1]: Scope libcontainer-7871-systemd-test-default-dependencies.scope has no PIDs. Refusing.
40Oct 03 15:37:57 eng-master1.lab1.betelab.ericy.com atomic-openshift-master-api[125295]: E1003 15:37:57.037059 125295 available_controller.go:311] v2alpha1.batch failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v2alpha1.batch": StorageError: invalid object, Code: 4, Key: /kubernetes.io/apiservices/v2alpha1.batch, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: aea67806-e61d-11e9-8873-001a4a16059f, UID in object meta: aea8fc63-e61d-11e9-8873-001a4a16059f