· 6 years ago · Dec 20, 2019, 12:14 PM
12019-12-20 12:01:10 kubewatch [11 TMainThread] 1.0.0-ea7 DEBUG: looking up ID for namespace default
22019-12-20 12:01:10 kubewatch [11 TMainThread] 1.0.0-ea7 DEBUG: cluster ID URL is d6e_id://1117c5b5-52a1-45b1-9d8d-9de811a7d87e/default
32019-12-20 12:01:11 kubewatch [11 TMainThread] 1.0.0-ea7 DEBUG: cluster ID is a8f9ad61-7039-55af-a2db-d0139649e2cf (from namespace default)
42019-12-20 12:01:11 AMBASSADOR INFO starting with environment:
52019-12-20 12:01:11 AMBASSADOR INFO ====
6AMBASSADOR_ADMIN_PORT=tcp://10.43.50.128:8877
7AMBASSADOR_ADMIN_PORT_8877_TCP=tcp://10.43.50.128:8877
8AMBASSADOR_ADMIN_PORT_8877_TCP_ADDR=10.43.50.128
9AMBASSADOR_ADMIN_PORT_8877_TCP_PORT=8877
10AMBASSADOR_ADMIN_PORT_8877_TCP_PROTO=tcp
11AMBASSADOR_ADMIN_SERVICE_HOST=10.43.50.128
12AMBASSADOR_ADMIN_SERVICE_PORT=8877
13AMBASSADOR_ADMIN_SERVICE_PORT_AMBASSADOR_ADMIN=8877
14AMBASSADOR_ADMIN_URL=http://127.0.0.1:8877
15AMBASSADOR_CLUSTER_ID=a8f9ad61-7039-55af-a2db-d0139649e2cf
16AMBASSADOR_CONFIG_BASE_DIR=/ambassador
17AMBASSADOR_INTERNAL_URL=https://127.0.0.1:8443
18AMBASSADOR_NAMESPACE=ambassador
19AMBASSADOR_PORT=tcp://10.43.231.237:80
20AMBASSADOR_PORT_443_TCP=tcp://10.43.231.237:443
21AMBASSADOR_PORT_443_TCP_ADDR=10.43.231.237
22AMBASSADOR_PORT_443_TCP_PORT=443
23AMBASSADOR_PORT_443_TCP_PROTO=tcp
24AMBASSADOR_PORT_80_TCP=tcp://10.43.231.237:80
25AMBASSADOR_PORT_80_TCP_ADDR=10.43.231.237
26AMBASSADOR_PORT_80_TCP_PORT=80
27AMBASSADOR_PORT_80_TCP_PROTO=tcp
28AMBASSADOR_REDIS_PORT=tcp://10.43.147.104:6379
29AMBASSADOR_REDIS_PORT_6379_TCP=tcp://10.43.147.104:6379
30AMBASSADOR_REDIS_PORT_6379_TCP_ADDR=10.43.147.104
31AMBASSADOR_REDIS_PORT_6379_TCP_PORT=6379
32AMBASSADOR_REDIS_PORT_6379_TCP_PROTO=tcp
33AMBASSADOR_REDIS_SERVICE_HOST=10.43.147.104
34AMBASSADOR_REDIS_SERVICE_PORT=6379
35AMBASSADOR_SERVICE_HOST=10.43.231.237
36AMBASSADOR_SERVICE_PORT=80
37AMBASSADOR_SERVICE_PORT_HTTP=80
38AMBASSADOR_SERVICE_PORT_HTTPS=443
39AMBASSADOR_URL=https://ambassador.default.svc.cluster.local
402019-12-20 12:01:11 AMBASSADOR INFO ====
412019-12-20 12:01:11 AMBASSADOR INFO launching worker process 'ambex': 'ambex' '-ads' '8003' '/ambassador/envoy'
422019-12-20 12:01:11 AMBASSADOR INFO ambex is PID 287
432019-12-20 12:01:11 AMBASSADOR INFO launching worker process 'diagd': 'diagd' '/ambassador/snapshots' '/ambassador/bootstrap-ads.json' '/ambassador/envoy/envoy.json' '--notices' '/ambassador/notices.json' '--kick' 'kill -HUP 1'
442019-12-20 12:01:11 AMBASSADOR INFO diagd is PID 294
45time="2019-12-20T12:01:11Z" level=info msg="Ambex 1.0.0-ea7 starting..."
46time="2019-12-20T12:01:11Z" level=info msg=Listening port=8003
47time="2019-12-20T12:01:11Z" level=info msg="Wrote PID" file=ambex.pid pid=287
48time="2019-12-20T12:01:11Z" level=info msg="Pushing snapshot v0"
492019-12-20 12:01:11 diagd 1.0.0-ea7 [P294TMainThread] INFO: thread count 33, listening on 0.0.0.0:8877
502019-12-20 12:01:12 diagd 1.0.0-ea7 [P294TMainThread] INFO: BOOT: Scout result {"latest_version": "1.0.0", "application": "aes", "notices": [{"level": "INFO", "message": "Upgrade available! to Ambassador version 1.0.0"}], "cached": false, "timestamp": 1576843272.570586}
51[2019-12-20 12:01:12 +0000] [294] [INFO] Starting gunicorn 19.9.0
52[2019-12-20 12:01:12 +0000] [294] [INFO] Listening at: http://0.0.0.0:8877 (294)
53[2019-12-20 12:01:12 +0000] [294] [INFO] Using worker: threads
54[2019-12-20 12:01:12 +0000] [306] [INFO] Booting worker with pid: 306
552019-12-20 12:01:12 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: starting Scout checker
562019-12-20 12:01:12 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: starting event watcher
572019-12-20 12:01:14 AMBASSADOR INFO diagd running
582019-12-20 12:01:14 AMBASSADOR INFO launching worker process 'watt': 'watt' '--port' '8002' '--notify' 'python /ambassador/post_update.py --watt ' '-s' 'service' '-s' 'ingresses' '-s' 'AuthService' '-s' 'Mapping' '-s' 'Module' '-s' 'RateLimitService' '-s' 'TCPMapping' '-s' 'TLSContext' '-s' 'TracingService' '-s' 'ConsulResolver' '-s' 'KubernetesEndpointResolver' '-s' 'KubernetesServiceResolver' '-s' 'Host' '-s' 'LogService' '--watch' 'python /ambassador/watch_hook.py'
592019-12-20 12:01:14 AMBASSADOR INFO watt is PID 317
602019-12-20 12:01:14 AMBASSADOR INFO launching worker process 'amb-sidecar': '/ambassador/sidecars/amb-sidecar'
612019-12-20 12:01:14 AMBASSADOR INFO amb-sidecar is PID 324
62time="2019-12-20 12:01:14" level=error msg="error validating license key from file /.config/ambassador/license-key: Token validation error: token contains an invalid number of segments: errorFlags=0x00000001=(ValidationErrorMalformed) wrappedError=(<nil>)"
632019/12/20 12:01:14 starting watt...
642019/12/20 12:01:14 kubebootstrap: starting
652019/12/20 12:01:14 consulwatchman: starting
662019/12/20 12:01:14 kubewatchman: starting
672019/12/20 12:01:14 aggregator: starting
682019/12/20 12:01:14 invoker: starting
692019/12/20 12:01:14 api: starting
702019/12/20 12:01:14 kubebootstrap: adding kubernetes watch for "service" in namespace "*"
712019/12/20 12:01:14 api: snapshot server listening on: :8002
722019/12/20 12:01:14 kubebootstrap: adding kubernetes watch for "ingresses" in namespace "*"
732019/12/20 12:01:14 kubebootstrap: adding kubernetes watch for "AuthService" in namespace "*"
742019/12/20 12:01:14 kubebootstrap: adding kubernetes watch for "Mapping" in namespace "*"
752019/12/20 12:01:14 kubebootstrap: adding kubernetes watch for "Module" in namespace "*"
762019/12/20 12:01:14 kubebootstrap: adding kubernetes watch for "RateLimitService" in namespace "*"
77time="2019-12-20 12:01:14" level=info msg="Ambassador Edge Stack configuation loaded"
78time="2019-12-20 12:01:14" level=info msg="Loading content from git repo" contentBranch=master contentSubdir=/ contentURL="https://github.com/datawire/devportal-content.git" subsystem=content
79time="2019-12-20 12:01:14" level=info msg="Creating watch on /.config/ambassador/"
802019/12/20 12:01:14 kubebootstrap: adding kubernetes watch for "TCPMapping" in namespace "*"
81time="2019-12-20 12:01:14" level=info msg="initial count 0" MAIN=ratelimit_controller
822019/12/20 12:01:14 kubebootstrap: adding kubernetes watch for "TLSContext" in namespace "*"
832019/12/20 12:01:14 kubebootstrap: adding kubernetes watch for "TracingService" in namespace "*"
842019/12/20 12:01:14 kubebootstrap: adding kubernetes watch for "ConsulResolver" in namespace "*"
852019/12/20 12:01:14 kubebootstrap: adding kubernetes watch for "KubernetesEndpointResolver" in namespace "*"
862019/12/20 12:01:14 kubebootstrap: adding kubernetes watch for "KubernetesServiceResolver" in namespace "*"
872019/12/20 12:01:14 kubebootstrap: adding kubernetes watch for "Host" in namespace "*"
882019/12/20 12:01:14 kubebootstrap: adding kubernetes watch for "LogService" in namespace "*"
89time="2019-12-20 12:01:14" level=info msg="remove /tmp/amb/config: no such file or directory" MAIN=ratelimit_controller
90time="2019-12-20 12:01:14" level=error msg="0 filters configured" MAIN=auth_controller
912019/12/20 12:01:14 kubebootstrap: found 0 "TracingService" in namespace "*"
922019/12/20 12:01:14 kubebootstrap: sent "TracingService" to 1 receivers
932019/12/20 12:01:14 kubebootstrap: found 0 "Module" in namespace "*"
942019/12/20 12:01:14 kubebootstrap: sent "Module" to 1 receivers
952019/12/20 12:01:14 kubebootstrap: found 0 "TCPMapping" in namespace "*"
962019/12/20 12:01:14 kubebootstrap: sent "TCPMapping" to 1 receivers
972019/12/20 12:01:14 kubebootstrap: found 1 "RateLimitService" in namespace "*"
982019/12/20 12:01:14 kubebootstrap: sent "RateLimitService" to 1 receivers
992019/12/20 12:01:14 kubebootstrap: found 0 "TLSContext" in namespace "*"
1002019/12/20 12:01:14 kubebootstrap: sent "TLSContext" to 1 receivers
1012019/12/20 12:01:14 kubebootstrap: found 0 "KubernetesEndpointResolver" in namespace "*"
1022019/12/20 12:01:14 kubebootstrap: sent "KubernetesEndpointResolver" to 1 receivers
1032019/12/20 12:01:14 kubebootstrap: found 0 "KubernetesServiceResolver" in namespace "*"
1042019/12/20 12:01:14 kubebootstrap: sent "KubernetesServiceResolver" to 1 receivers
1052019/12/20 12:01:14 kubebootstrap: found 8 "service" in namespace "*"
1062019/12/20 12:01:14 kubebootstrap: sent "service" to 1 receivers
1072019/12/20 12:01:14 kubebootstrap: found 0 "ingresses" in namespace "*"
1082019/12/20 12:01:14 kubebootstrap: sent "ingresses" to 1 receivers
1092019/12/20 12:01:15 kubebootstrap: found 0 "ConsulResolver" in namespace "*"
1102019/12/20 12:01:15 kubebootstrap: sent "ConsulResolver" to 1 receivers
1112019/12/20 12:01:15 kubebootstrap: found 0 "Host" in namespace "*"
1122019/12/20 12:01:15 kubebootstrap: sent "Host" to 1 receivers
1132019/12/20 12:01:15 kubebootstrap: found 1 "AuthService" in namespace "*"
1142019/12/20 12:01:15 kubebootstrap: sent "AuthService" to 1 receivers
1152019/12/20 12:01:15 kubebootstrap: found 2 "Mapping" in namespace "*"
1162019/12/20 12:01:15 kubebootstrap: sent "Mapping" to 1 receivers
1172019/12/20 12:01:15 kubebootstrap: found 0 "LogService" in namespace "*"
1182019/12/20 12:01:15 kubebootstrap: sent "LogService" to 1 receivers
1192019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
1202019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: YAML: using C parser
1212019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: YAML: using C dumper
1222019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: IRTLSContext setup good: {
1232019/12/20 12:01:15 aggregator: watch hook stderr: "_active": false,
1242019/12/20 12:01:15 aggregator: watch hook stderr: "_errored": false,
1252019/12/20 12:01:15 aggregator: watch hook stderr: "_rkey": "fallback-self-signed-context.99999",
1262019/12/20 12:01:15 aggregator: watch hook stderr: "hosts": [
1272019/12/20 12:01:15 aggregator: watch hook stderr: "*"
1282019/12/20 12:01:15 aggregator: watch hook stderr: ],
1292019/12/20 12:01:15 aggregator: watch hook stderr: "kind": "IRTLSContext",
1302019/12/20 12:01:15 aggregator: watch hook stderr: "location": "-internal-",
1312019/12/20 12:01:15 aggregator: watch hook stderr: "name": "fallback-self-signed-context",
1322019/12/20 12:01:15 aggregator: watch hook stderr: "namespace": "ambassador",
1332019/12/20 12:01:15 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
1342019/12/20 12:01:15 aggregator: watch hook stderr: "secret_info": {
1352019/12/20 12:01:15 aggregator: watch hook stderr: "secret": "fallback-self-signed-cert"
1362019/12/20 12:01:15 aggregator: watch hook stderr: }
1372019/12/20 12:01:15 aggregator: watch hook stderr: }
1382019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
1392019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: no secret_info, asking handler to load
1402019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
1412019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
1422019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: no secret_info, asking handler to load
1432019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
1442019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: IR: watching Edge Stack; wizard allowed
1452019/12/20 12:01:15 aggregator: watch hook stderr:
1462019/12/20 12:01:15 aggregator: found 2 kubernetes watches
1472019/12/20 12:01:15 aggregator: found 0 consul watches
1482019/12/20 12:01:15 aggregator: waiting for k8s watch: secret|ambassador|metadata.name=fallback-self-signed-cert|*
1492019/12/20 12:01:15 aggregator: waiting for k8s watch: TLSContext|ambassador|*|*
1502019/12/20 12:01:15 consulwatchman: processing 0 consul watches
1512019/12/20 12:01:15 kubewatchman: processing 2 kubernetes watch specs
1522019/12/20 12:01:15 kubewatchman: add kubernetes watcher kubernetes:secret|ambassador|metadata.name=fallback-self-signed-cert|*
1532019/12/20 12:01:15 kubewatchman: add kubernetes watcher kubernetes:TLSContext|ambassador|*|*
1542019/12/20 12:01:15 kubernetes:secret|ambassador|metadata.name=fallback-self-signed-cert|*: starting
1552019/12/20 12:01:15 kubernetes:TLSContext|ambassador|*|*: starting
1562019/12/20 12:01:15 kubernetes:TLSContext|ambassador|*|*: found 0 "TLSContext" in namespace "ambassador"
1572019/12/20 12:01:15 kubernetes:TLSContext|ambassador|*|*: sent "TLSContext" to receivers
1582019/12/20 12:01:15 kubernetes:secret|ambassador|metadata.name=fallback-self-signed-cert|*: found 0 "secret" in namespace "ambassador"
1592019/12/20 12:01:15 kubernetes:secret|ambassador|metadata.name=fallback-self-signed-cert|*: sent "secret" to receivers
160time="2019-12-20 12:01:15" level=warning msg="statsd is not in use"
161time="2019-12-20 12:01:15" level=info msg="Iteration started request " subsystem=fetcher
1622019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_1] INFO: 198D5A58-4FBB-4374-9EBF-F431BDF0DD62: 127.0.0.1 "GET /ambassador/v0/diag/" START
1632019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_1] ERROR: 'NoneType' object has no attribute 'overview'
164Traceback (most recent call last):
165 File "/usr/lib/python3.7/site-packages/ambassador-0.0.0.dev0-py3.7.egg/ambassador_diag/diagd.py", line 201, in wrapper
166 result = f(*args, reqid=reqid, **kwds)
167 File "/usr/lib/python3.7/site-packages/ambassador-0.0.0.dev0-py3.7.egg/ambassador_diag/diagd.py", line 459, in show_overview
168 ov = diag.overview(request, app.estats)
169AttributeError: 'NoneType' object has no attribute 'overview'
1702019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_1] ERROR: 198D5A58-4FBB-4374-9EBF-F431BDF0DD62: 127.0.0.1 "GET /ambassador/v0/diag/" 1ms 500 server error
171time="2019-12-20 12:01:15" level=error msg="Bad HTTP response" status_code=500 subsystem=fetcher url="http://127.0.0.1:8877/ambassador/v0/diag/?json=true"
172time="2019-12-20 12:01:15" level=error msg="HTTP error 500 from http://127.0.0.1:8877/ambassador/v0/diag/?json=true" subsystem=fetcher url="http://127.0.0.1:8877/ambassador/v0/diag/?json=true"
173time="2019-12-20 12:01:15" level=info msg="HTTP error 500 from http://127.0.0.1:8877/ambassador/v0/diag/?json=true"
1742019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
1752019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: YAML: using C parser
1762019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: YAML: using C dumper
1772019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: IRTLSContext setup good: {
1782019/12/20 12:01:15 aggregator: watch hook stderr: "_active": false,
1792019/12/20 12:01:15 aggregator: watch hook stderr: "_errored": false,
1802019/12/20 12:01:15 aggregator: watch hook stderr: "_rkey": "fallback-self-signed-context.99999",
1812019/12/20 12:01:15 aggregator: watch hook stderr: "hosts": [
1822019/12/20 12:01:15 aggregator: watch hook stderr: "*"
1832019/12/20 12:01:15 aggregator: watch hook stderr: ],
1842019/12/20 12:01:15 aggregator: watch hook stderr: "kind": "IRTLSContext",
1852019/12/20 12:01:15 aggregator: watch hook stderr: "location": "-internal-",
1862019/12/20 12:01:15 aggregator: watch hook stderr: "name": "fallback-self-signed-context",
1872019/12/20 12:01:15 aggregator: watch hook stderr: "namespace": "ambassador",
1882019/12/20 12:01:15 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
1892019/12/20 12:01:15 aggregator: watch hook stderr: "secret_info": {
1902019/12/20 12:01:15 aggregator: watch hook stderr: "secret": "fallback-self-signed-cert"
1912019/12/20 12:01:15 aggregator: watch hook stderr: }
1922019/12/20 12:01:15 aggregator: watch hook stderr: }
1932019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
1942019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: no secret_info, asking handler to load
1952019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
1962019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
1972019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: no secret_info, asking handler to load
1982019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
1992019/12/20 12:01:15 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: IR: watching Edge Stack; wizard allowed
2002019/12/20 12:01:15 aggregator: watch hook stderr:
2012019/12/20 12:01:15 aggregator: found 2 kubernetes watches
2022019/12/20 12:01:15 aggregator: found 0 consul watches
2032019/12/20 12:01:15 aggregator: initialized k8s watch: secret|ambassador|metadata.name=fallback-self-signed-cert|*
2042019/12/20 12:01:15 aggregator: initialized k8s watch: TLSContext|ambassador|*|*
2052019/12/20 12:01:15 aggregator: bootstrapped!
2062019/12/20 12:01:15 kubewatchman: processing 2 kubernetes watch specs
2072019/12/20 12:01:15 consulwatchman: processing 0 consul watches
2082019/12/20 12:01:15 notify: python /ambassador/post_update.py --watt http://localhost:8002/snapshots/1
2092019/12/20 12:01:15 kubernetes:secret|ambassador|metadata.name=fallback-self-signed-cert|*: found 1 "secret" in namespace "ambassador"
2102019/12/20 12:01:15 kubernetes:secret|ambassador|metadata.name=fallback-self-signed-cert|*: sent "secret" to receivers
2112019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_0] INFO: Update requested: watt, http://localhost:8002/snapshots/1
2122019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: copying configuration: watt, http://localhost:8002/snapshots/1 to /ambassador/snapshots/snapshot-tmp.yaml
2132019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
2142019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: YAML: using C parser
2152019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: YAML: using C dumper
2162019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IRTLSContext setup good: {
217 "_active": false,
218 "_errored": false,
219 "_rkey": "fallback-self-signed-context.99999",
220 "hosts": [
221 "*"
222 ],
223 "kind": "IRTLSContext",
224 "location": "-internal-",
225 "name": "fallback-self-signed-context",
226 "namespace": "ambassador",
227 "redirect_cleartext_from": 8080,
228 "secret_info": {
229 "secret": "fallback-self-signed-cert"
230 }
231}
2322019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
2332019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: no secret_info, asking handler to load
2342019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: Secret fallback-self-signed-cert.ambassador unknown
2352019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IR: starting Edge Stack; wizard allowed
2362019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IRL: wizard allowed, primary port is 8080, copying to 8443
2372019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: Using log_format 'ACCESS [%START_TIME%] "%REQ(:METHOD)% %REQ(X-ENVOY-ORIGINAL-PATH?:PATH)% %PROTOCOL%" %RESPONSE_CODE% %RESPONSE_FLAGS% %BYTES_RECEIVED% %BYTES_SENT% %DURATION% %RESP(X-ENVOY-UPSTREAM-SERVICE-TIME)% "%REQ(X-FORWARDED-FOR)%" "%REQ(USER-AGENT)%" "%REQ(X-REQUEST-ID)%" "%REQ(:AUTHORITY)%" "%UPSTREAM_HOST%"'
2382019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
239[]
2402019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: no filter chains, need cleartext
2412019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
2422019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
243[
244 {
245 "ctx_hosts": [
246 "*"
247 ],
248 "ctx_name": "-cleartext-",
249 "filter_chain_match": {},
250 "route_count": 8
251 }
252]
2532019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: leaving TLS inspector disabled
2542019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: Using log_format 'ACCESS [%START_TIME%] "%REQ(:METHOD)% %REQ(X-ENVOY-ORIGINAL-PATH?:PATH)% %PROTOCOL%" %RESPONSE_CODE% %RESPONSE_FLAGS% %BYTES_RECEIVED% %BYTES_SENT% %DURATION% %RESP(X-ENVOY-UPSTREAM-SERVICE-TIME)% "%REQ(X-FORWARDED-FOR)%" "%REQ(USER-AGENT)%" "%REQ(X-REQUEST-ID)%" "%REQ(:AUTHORITY)%" "%UPSTREAM_HOST%"'
2552019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
256[]
2572019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: no filter chains, need cleartext
2582019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
2592019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
260[
261 {
262 "ctx_hosts": [
263 "*"
264 ],
265 "ctx_name": "-cleartext-",
266 "filter_chain_match": {},
267 "route_count": 8
268 }
269]
2702019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: leaving TLS inspector disabled
2712019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: -global-: NOTICE: A future Ambassador version will change the GRPC protocol version for AuthServices and RateLimitServices. See the CHANGELOG for details.
2722019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: successfully validated the resulting envoy configuration, continuing...
2732019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: saving Envoy configuration for snapshot 1
2742019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: running 'kill -HUP 1'
275KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal-api.ambassador
276KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal.ambassador
277KubeStatus MASTER 306: mark_live Mapping/ambassador-edge-stack.ambassador
278KubeStatus MASTER 306: mark_live Mapping/edgestack-direct-mapping.ambassador
279KubeStatus MASTER 306: mark_live Mapping/edgestack-fallback-mapping.ambassador
2802019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal-api.ambassador, {"state": "Running"}...
281KubeStatus MASTER 306: Mapping/ambassador-devportal-api.ambassador needs {"state": "Running"}
2822019-12-20 12:01:15 AMBASSADOR INFO launching worker process 'envoy': 'envoy' '-c' '/ambassador/bootstrap-ads.json'
2832019-12-20 12:01:15 AMBASSADOR INFO envoy is PID 406
2842019-12-20 12:01:15 AMBASSADOR INFO KICK: started Envoy as PID 406
2852019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal.ambassador, {"state": "Running"}...
286KubeStatus MASTER 306: Mapping/ambassador-devportal.ambassador needs {"state": "Running"}
287KubeStatus UPDATE 407: running command: ['kubestatus', 'Mapping', '-f', 'metadata.name=ambassador-devportal-api', '-n', 'ambassador', '-u', '/dev/fd/0']
288KubeStatus UPDATE 409: running command: ['kubestatus', 'Mapping', '-f', 'metadata.name=ambassador-devportal', '-n', 'ambassador', '-u', '/dev/fd/0']
2892019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-edge-stack.ambassador, {"state": "Running"}...
290KubeStatus MASTER 306: Mapping/ambassador-edge-stack.ambassador needs {"state": "Running"}
2912019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-direct-mapping.ambassador, {"state": "Running"}...
292KubeStatus MASTER 306: Mapping/edgestack-direct-mapping.ambassador needs {"state": "Running"}
2932019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-fallback-mapping.ambassador, {"state": "Running"}...
294KubeStatus MASTER 306: Mapping/edgestack-fallback-mapping.ambassador needs {"state": "Running"}
295KubeStatus UPDATE 411: running command: ['kubestatus', 'Mapping', '-f', 'metadata.name=ambassador-edge-stack', '-n', 'ambassador', '-u', '/dev/fd/0']
2962019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: configuration updated from snapshot 1
297KubeStatus UPDATE 413: running command: ['kubestatus', 'Mapping', '-f', 'metadata.name=edgestack-direct-mapping', '-n', 'ambassador', '-u', '/dev/fd/0']
2982019-12-20 12:01:15 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: starting Envoy status updater
299KubeStatus UPDATE 414: running command: ['kubestatus', 'Mapping', '-f', 'metadata.name=edgestack-fallback-mapping', '-n', 'ambassador', '-u', '/dev/fd/0']
300time="2019-12-20T12:01:15Z" level=info msg="Loaded file /ambassador/envoy/envoy.json"
301[2019-12-20 12:01:15.845][406][info][main] [source/server/server.cc:249] initializing epoch 0 (hot restart version=11.104)
302[2019-12-20 12:01:15.845][406][info][main] [source/server/server.cc:251] statically linked extensions:
303[2019-12-20 12:01:15.845][406][info][main] [source/server/server.cc:253] access_loggers: envoy.file_access_log,envoy.http_grpc_access_log,envoy.tcp_grpc_access_log
304[2019-12-20 12:01:15.845][406][info][main] [source/server/server.cc:256] filters.http: envoy.buffer,envoy.cors,envoy.csrf,envoy.ext_authz,envoy.fault,envoy.filters.http.adaptive_concurrency,envoy.filters.http.dynamic_forward_proxy,envoy.filters.http.grpc_http1_reverse_bridge,envoy.filters.http.grpc_stats,envoy.filters.http.header_to_metadata,envoy.filters.http.jwt_authn,envoy.filters.http.original_src,envoy.filters.http.rbac,envoy.filters.http.tap,envoy.grpc_http1_bridge,envoy.grpc_json_transcoder,envoy.grpc_web,envoy.gzip,envoy.health_check,envoy.http_dynamo_filter,envoy.ip_tagging,envoy.lua,envoy.rate_limit,envoy.router,envoy.squash
305[2019-12-20 12:01:15.845][406][info][main] [source/server/server.cc:259] filters.listener: envoy.listener.http_inspector,envoy.listener.original_dst,envoy.listener.original_src,envoy.listener.proxy_protocol,envoy.listener.tls_inspector
306[2019-12-20 12:01:15.845][406][info][main] [source/server/server.cc:262] filters.network: envoy.client_ssl_auth,envoy.echo,envoy.ext_authz,envoy.filters.network.dubbo_proxy,envoy.filters.network.mysql_proxy,envoy.filters.network.rbac,envoy.filters.network.sni_cluster,envoy.filters.network.thrift_proxy,envoy.filters.network.zookeeper_proxy,envoy.http_connection_manager,envoy.mongo_proxy,envoy.ratelimit,envoy.redis_proxy,envoy.tcp_proxy
307[2019-12-20 12:01:15.845][406][info][main] [source/server/server.cc:264] stat_sinks: envoy.dog_statsd,envoy.metrics_service,envoy.stat_sinks.hystrix,envoy.statsd
308[2019-12-20 12:01:15.845][406][info][main] [source/server/server.cc:266] tracers: envoy.dynamic.ot,envoy.lightstep,envoy.tracers.datadog,envoy.tracers.opencensus,envoy.tracers.xray,envoy.zipkin
309[2019-12-20 12:01:15.845][406][info][main] [source/server/server.cc:269] transport_sockets.downstream: envoy.transport_sockets.alts,envoy.transport_sockets.raw_buffer,envoy.transport_sockets.tap,envoy.transport_sockets.tls,raw_buffer,tls
310[2019-12-20 12:01:15.845][406][info][main] [source/server/server.cc:272] transport_sockets.upstream: envoy.transport_sockets.alts,envoy.transport_sockets.raw_buffer,envoy.transport_sockets.tap,envoy.transport_sockets.tls,raw_buffer,tls
311[2019-12-20 12:01:15.845][406][info][main] [source/server/server.cc:278] buffer implementation: new
312[2019-12-20 12:01:15.848][406][info][main] [source/server/server.cc:344] admin address: 127.0.0.1:8001
313[2019-12-20 12:01:15.849][406][info][main] [source/server/server.cc:458] runtime: layers:
314 - name: base
315 static_layer:
316 {}
317 - name: admin
318 admin_layer:
319 {}
320[2019-12-20 12:01:15.849][406][info][config] [source/server/configuration_impl.cc:62] loading 0 static secret(s)
321[2019-12-20 12:01:15.849][406][info][config] [source/server/configuration_impl.cc:68] loading 1 cluster(s)
322[2019-12-20 12:01:15.849][406][info][upstream] [source/common/upstream/cluster_manager_impl.cc:157] cm init: initializing cds
323[2019-12-20 12:01:15.850][406][info][config] [source/server/configuration_impl.cc:72] loading 0 listener(s)
324[2019-12-20 12:01:15.850][406][info][config] [source/server/configuration_impl.cc:97] loading tracing configuration
325[2019-12-20 12:01:15.850][406][info][config] [source/server/configuration_impl.cc:117] loading stats sink configuration
326[2019-12-20 12:01:15.850][406][info][main] [source/server/server.cc:549] starting main dispatch loop
327[2019-12-20 12:01:15.853][406][info][upstream] [source/common/upstream/cds_api_impl.cc:67] cds: add 0 cluster(s), remove 1 cluster(s)
328[2019-12-20 12:01:15.853][406][info][upstream] [source/common/upstream/cluster_manager_impl.cc:161] cm init: all clusters initialized
329[2019-12-20 12:01:15.853][406][info][main] [source/server/server.cc:528] all clusters initialized. initializing init manager
330[2019-12-20 12:01:15.854][406][info][config] [source/server/listener_manager_impl.cc:578] all dependencies initialized. starting workers
331time="2019-12-20T12:01:15Z" level=info msg="Pushing snapshot v1"
332[2019-12-20 12:01:15.854][406][info][upstream] [source/common/upstream/cds_api_impl.cc:67] cds: add 3 cluster(s), remove 1 cluster(s)
333[2019-12-20 12:01:15.855][406][info][upstream] [source/common/upstream/cds_api_impl.cc:83] cds: add/update cluster 'cluster_127_0_0_1_8500'
334[2019-12-20 12:01:15.856][406][info][upstream] [source/common/upstream/cds_api_impl.cc:83] cds: add/update cluster 'cluster_127_0_0_1_8877'
335[2019-12-20 12:01:15.856][406][info][upstream] [source/common/upstream/cds_api_impl.cc:83] cds: add/update cluster 'cluster_extauth_127_0_0_1_8500'
336[2019-12-20 12:01:15.857][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
337[2019-12-20 12:01:15.859][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
338[2019-12-20 12:01:15.859][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
339[2019-12-20 12:01:15.859][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
340[2019-12-20 12:01:15.861][406][info][upstream] [source/server/lds_api.cc:63] lds: add/update listener 'ambassador-listener-8443'
341[2019-12-20 12:01:15.861][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
342[2019-12-20 12:01:15.862][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
343[2019-12-20 12:01:15.862][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
344[2019-12-20 12:01:15.862][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
345[2019-12-20 12:01:15.863][406][info][upstream] [source/server/lds_api.cc:63] lds: add/update listener 'ambassador-listener-8080'
346Updating ambassador-devportal.ambassador
3472019/12/20 12:01:15 kubebootstrap: found 2 "Mapping" in namespace "*"
3482019/12/20 12:01:15 kubebootstrap: sent "Mapping" to 1 receivers
349KubeStatus DONE 306: result ambassador-devportal.ambassador: update OK
350KubeStatus DONE 306: result edgestack-direct-mapping.ambassador: update OK
351Updating ambassador-devportal-api.ambassador
3522019/12/20 12:01:15 kubebootstrap: found 2 "Mapping" in namespace "*"
3532019/12/20 12:01:15 kubebootstrap: sent "Mapping" to 1 receivers
354KubeStatus DONE 306: result ambassador-devportal-api.ambassador: update OK
355KubeStatus DONE 306: result ambassador-edge-stack.ambassador: update OK
356KubeStatus DONE 306: result edgestack-fallback-mapping.ambassador: update OK
3572019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
3582019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: YAML: using C parser
3592019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:15 watch-hook INFO: YAML: using C dumper
3602019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: IRTLSContext setup good: {
3612019/12/20 12:01:16 aggregator: watch hook stderr: "_active": false,
3622019/12/20 12:01:16 aggregator: watch hook stderr: "_errored": false,
3632019/12/20 12:01:16 aggregator: watch hook stderr: "_rkey": "fallback-self-signed-context.99999",
3642019/12/20 12:01:16 aggregator: watch hook stderr: "hosts": [
3652019/12/20 12:01:16 aggregator: watch hook stderr: "*"
3662019/12/20 12:01:16 aggregator: watch hook stderr: ],
3672019/12/20 12:01:16 aggregator: watch hook stderr: "kind": "IRTLSContext",
3682019/12/20 12:01:16 aggregator: watch hook stderr: "location": "-internal-",
3692019/12/20 12:01:16 aggregator: watch hook stderr: "name": "fallback-self-signed-context",
3702019/12/20 12:01:16 aggregator: watch hook stderr: "namespace": "ambassador",
3712019/12/20 12:01:16 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
3722019/12/20 12:01:16 aggregator: watch hook stderr: "secret_info": {
3732019/12/20 12:01:16 aggregator: watch hook stderr: "secret": "fallback-self-signed-cert"
3742019/12/20 12:01:16 aggregator: watch hook stderr: }
3752019/12/20 12:01:16 aggregator: watch hook stderr: }
3762019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
3772019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: no secret_info, asking handler to load
3782019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
3792019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
3802019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: no secret_info, asking handler to load
3812019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
3822019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: IR: watching Edge Stack; wizard allowed
3832019/12/20 12:01:16 aggregator: watch hook stderr:
3842019/12/20 12:01:16 aggregator: found 2 kubernetes watches
3852019/12/20 12:01:16 aggregator: found 0 consul watches
3862019/12/20 12:01:16 kubewatchman: processing 2 kubernetes watch specs
3872019/12/20 12:01:16 consulwatchman: processing 0 consul watches
3882019/12/20 12:01:16 notify: python /ambassador/post_update.py --watt http://localhost:8002/snapshots/2
3892019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_1] INFO: Update requested: watt, http://localhost:8002/snapshots/2
3902019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
3912019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: YAML: using C parser
3922019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: YAML: using C dumper
3932019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: IRTLSContext setup good: {
3942019/12/20 12:01:16 aggregator: watch hook stderr: "_active": false,
3952019/12/20 12:01:16 aggregator: watch hook stderr: "_errored": false,
3962019/12/20 12:01:16 aggregator: watch hook stderr: "_rkey": "fallback-self-signed-context.99999",
3972019/12/20 12:01:16 aggregator: watch hook stderr: "hosts": [
3982019/12/20 12:01:16 aggregator: watch hook stderr: "*"
3992019/12/20 12:01:16 aggregator: watch hook stderr: ],
4002019/12/20 12:01:16 aggregator: watch hook stderr: "kind": "IRTLSContext",
4012019/12/20 12:01:16 aggregator: watch hook stderr: "location": "-internal-",
4022019/12/20 12:01:16 aggregator: watch hook stderr: "name": "fallback-self-signed-context",
4032019/12/20 12:01:16 aggregator: watch hook stderr: "namespace": "ambassador",
4042019/12/20 12:01:16 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
4052019/12/20 12:01:16 aggregator: watch hook stderr: "secret_info": {
4062019/12/20 12:01:16 aggregator: watch hook stderr: "secret": "fallback-self-signed-cert"
4072019/12/20 12:01:16 aggregator: watch hook stderr: }
4082019/12/20 12:01:16 aggregator: watch hook stderr: }
4092019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
4102019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
4112019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
4122019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
4132019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
4142019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
4152019/12/20 12:01:16 aggregator: watch hook stderr: 2019-12-20 12:01:16 watch-hook INFO: IR: watching Edge Stack; wizard allowed
4162019/12/20 12:01:16 aggregator: watch hook stderr:
4172019/12/20 12:01:16 aggregator: found 2 kubernetes watches
4182019/12/20 12:01:16 aggregator: found 0 consul watches
4192019/12/20 12:01:16 kubewatchman: processing 2 kubernetes watch specs
4202019/12/20 12:01:16 consulwatchman: processing 0 consul watches
4212019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout reports {"latest_version": "1.0.0", "application": "aes", "cached": false, "timestamp": 1576843276.460416}
4222019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout notices: [{"level": "INFO", "message": "Upgrade available! to Ambassador version 1.0.0"}]
4232019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: copying configuration: watt, http://localhost:8002/snapshots/2 to /ambassador/snapshots/snapshot-tmp.yaml
4242019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
4252019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IRTLSContext setup good: {
426 "_active": false,
427 "_errored": false,
428 "_rkey": "fallback-self-signed-context.99999",
429 "hosts": [
430 "*"
431 ],
432 "kind": "IRTLSContext",
433 "location": "-internal-",
434 "name": "fallback-self-signed-context",
435 "namespace": "ambassador",
436 "redirect_cleartext_from": 8080,
437 "secret_info": {
438 "secret": "fallback-self-signed-cert"
439 }
440}
4412019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
4422019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
4432019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
4442019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
4452019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
4462019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
4472019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IR: starting Edge Stack; wizard allowed
4482019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: ctx fallback-self-signed-context is the primary termination context
4492019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: creating redirect listener on 8080
4502019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: Using log_format 'ACCESS [%START_TIME%] "%REQ(:METHOD)% %REQ(X-ENVOY-ORIGINAL-PATH?:PATH)% %PROTOCOL%" %RESPONSE_CODE% %RESPONSE_FLAGS% %BYTES_RECEIVED% %BYTES_SENT% %DURATION% %RESP(X-ENVOY-UPSTREAM-SERVICE-TIME)% "%REQ(X-FORWARDED-FOR)%" "%REQ(USER-AGENT)%" "%REQ(X-REQUEST-ID)%" "%REQ(:AUTHORITY)%" "%UPSTREAM_HOST%"'
4512019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI (1) route check fallback-self-signed-context - ['*']
4522019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
453[
454 {
455 "ctx_hosts": [
456 "*"
457 ],
458 "ctx_name": "fallback-self-signed-context",
459 "filter_chain_match": {
460 "transport_protocol": "tls"
461 },
462 "route_count": 8
463 }
464]
4652019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
4662019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
467[
468 {
469 "ctx_hosts": [
470 "*"
471 ],
472 "ctx_name": "fallback-self-signed-context",
473 "filter_chain_match": {
474 "transport_protocol": "tls"
475 },
476 "route_count": 8
477 },
478 {
479 "ctx_hosts": [
480 "*"
481 ],
482 "ctx_name": "-cleartext-",
483 "filter_chain_match": {},
484 "route_count": 8
485 }
486]
4872019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: enabling TLS inspector
4882019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: no filter chains, need cleartext
4892019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
4902019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
491[
492 {
493 "ctx_hosts": [
494 "*"
495 ],
496 "ctx_name": "-cleartext-",
497 "filter_chain_match": {},
498 "route_count": 1
499 }
500]
5012019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: leaving TLS inspector disabled
5022019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: -global-: NOTICE: A future Ambassador version will change the GRPC protocol version for AuthServices and RateLimitServices. See the CHANGELOG for details.
5032019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: successfully validated the resulting envoy configuration, continuing...
5042019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: saving Envoy configuration for snapshot 2
5052019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: running 'kill -HUP 1'
506KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal-api.ambassador
507KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal.ambassador
508KubeStatus MASTER 306: mark_live Mapping/ambassador-edge-stack.ambassador
509KubeStatus MASTER 306: mark_live Mapping/edgestack-direct-mapping.ambassador
510KubeStatus MASTER 306: mark_live Mapping/edgestack-fallback-mapping.ambassador
5112019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal-api.ambassador, {"state": "Running"}...
5122019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal.ambassador, {"state": "Running"}...
513KubeStatus MASTER 306: Mapping/ambassador-devportal-api.ambassador == {"state": "Running"}
514KubeStatus MASTER 306: Mapping/ambassador-devportal.ambassador == {"state": "Running"}
5152019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-edge-stack.ambassador, {"state": "Running"}...
516KubeStatus MASTER 306: Mapping/ambassador-edge-stack.ambassador == {"state": "Running"}
5172019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-direct-mapping.ambassador, {"state": "Running"}...
518KubeStatus MASTER 306: Mapping/edgestack-direct-mapping.ambassador == {"state": "Running"}
5192019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-fallback-mapping.ambassador, {"state": "Running"}...
520KubeStatus MASTER 306: Mapping/edgestack-fallback-mapping.ambassador == {"state": "Running"}
5212019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: configuration updated from snapshot 2
522time="2019-12-20T12:01:16Z" level=info msg="Loaded file /ambassador/envoy/envoy.json"
523time="2019-12-20T12:01:16Z" level=info msg="Pushing snapshot v2"
5242019/12/20 12:01:16 notify: python /ambassador/post_update.py --watt http://localhost:8002/snapshots/3
525[2019-12-20 12:01:16.552][406][info][upstream] [source/common/upstream/cds_api_impl.cc:67] cds: add 3 cluster(s), remove 1 cluster(s)
526[2019-12-20 12:01:16.552][406][info][upstream] [source/server/lds_api.cc:46] lds: remove listener 'ambassador-listener-8080'
527[2019-12-20 12:01:16.552][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
528[2019-12-20 12:01:16.552][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
529[2019-12-20 12:01:16.552][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
530[2019-12-20 12:01:16.553][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
531[2019-12-20 12:01:16.553][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
532[2019-12-20 12:01:16.553][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
533[2019-12-20 12:01:16.554][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
534[2019-12-20 12:01:16.555][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
535[2019-12-20 12:01:16.555][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
536[2019-12-20 12:01:16.555][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
537[2019-12-20 12:01:16.555][406][info][upstream] [source/server/lds_api.cc:63] lds: add/update listener 'ambassador-listener-8443'
538[2019-12-20 12:01:16.556][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
539[2019-12-20 12:01:16.556][406][info][upstream] [source/server/lds_api.cc:63] lds: add/update listener 'redirect_listener'
5402019-12-20 12:01:16 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_9] INFO: Update requested: watt, http://localhost:8002/snapshots/3
5412019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout reports {"latest_version": "1.0.0", "application": "aes", "cached": false, "timestamp": 1576843277.153564}
5422019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout notices: [{"level": "INFO", "message": "Upgrade available! to Ambassador version 1.0.0"}]
5432019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: copying configuration: watt, http://localhost:8002/snapshots/3 to /ambassador/snapshots/snapshot-tmp.yaml
5442019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
5452019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IRTLSContext setup good: {
546 "_active": false,
547 "_errored": false,
548 "_rkey": "fallback-self-signed-context.99999",
549 "hosts": [
550 "*"
551 ],
552 "kind": "IRTLSContext",
553 "location": "-internal-",
554 "name": "fallback-self-signed-context",
555 "namespace": "ambassador",
556 "redirect_cleartext_from": 8080,
557 "secret_info": {
558 "secret": "fallback-self-signed-cert"
559 }
560}
5612019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
5622019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
5632019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
5642019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
5652019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
5662019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
5672019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IR: starting Edge Stack; wizard allowed
5682019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: ctx fallback-self-signed-context is the primary termination context
5692019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: creating redirect listener on 8080
5702019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: Using log_format 'ACCESS [%START_TIME%] "%REQ(:METHOD)% %REQ(X-ENVOY-ORIGINAL-PATH?:PATH)% %PROTOCOL%" %RESPONSE_CODE% %RESPONSE_FLAGS% %BYTES_RECEIVED% %BYTES_SENT% %DURATION% %RESP(X-ENVOY-UPSTREAM-SERVICE-TIME)% "%REQ(X-FORWARDED-FOR)%" "%REQ(USER-AGENT)%" "%REQ(X-REQUEST-ID)%" "%REQ(:AUTHORITY)%" "%UPSTREAM_HOST%"'
5712019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI (1) route check fallback-self-signed-context - ['*']
5722019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
573[
574 {
575 "ctx_hosts": [
576 "*"
577 ],
578 "ctx_name": "fallback-self-signed-context",
579 "filter_chain_match": {
580 "transport_protocol": "tls"
581 },
582 "route_count": 8
583 }
584]
5852019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
5862019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
587[
588 {
589 "ctx_hosts": [
590 "*"
591 ],
592 "ctx_name": "fallback-self-signed-context",
593 "filter_chain_match": {
594 "transport_protocol": "tls"
595 },
596 "route_count": 8
597 },
598 {
599 "ctx_hosts": [
600 "*"
601 ],
602 "ctx_name": "-cleartext-",
603 "filter_chain_match": {},
604 "route_count": 8
605 }
606]
6072019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: enabling TLS inspector
6082019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: no filter chains, need cleartext
6092019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
6102019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
611[
612 {
613 "ctx_hosts": [
614 "*"
615 ],
616 "ctx_name": "-cleartext-",
617 "filter_chain_match": {},
618 "route_count": 1
619 }
620]
6212019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: leaving TLS inspector disabled
6222019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: -global-: NOTICE: A future Ambassador version will change the GRPC protocol version for AuthServices and RateLimitServices. See the CHANGELOG for details.
6232019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: successfully validated the resulting envoy configuration, continuing...
6242019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: saving Envoy configuration for snapshot 3
6252019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: running 'kill -HUP 1'
626KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal-api.ambassador
627KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal.ambassador
628KubeStatus MASTER 306: mark_live Mapping/ambassador-edge-stack.ambassador
629KubeStatus MASTER 306: mark_live Mapping/edgestack-direct-mapping.ambassador
630KubeStatus MASTER 306: mark_live Mapping/edgestack-fallback-mapping.ambassador
6312019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal-api.ambassador, {"state": "Running"}...
632KubeStatus MASTER 306: Mapping/ambassador-devportal-api.ambassador == {"state": "Running"}
6332019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal.ambassador, {"state": "Running"}...
634KubeStatus MASTER 306: Mapping/ambassador-devportal.ambassador == {"state": "Running"}
6352019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-edge-stack.ambassador, {"state": "Running"}...
636KubeStatus MASTER 306: Mapping/ambassador-edge-stack.ambassador == {"state": "Running"}
6372019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-direct-mapping.ambassador, {"state": "Running"}...
638KubeStatus MASTER 306: Mapping/edgestack-direct-mapping.ambassador == {"state": "Running"}
6392019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-fallback-mapping.ambassador, {"state": "Running"}...
640KubeStatus MASTER 306: Mapping/edgestack-fallback-mapping.ambassador == {"state": "Running"}
6412019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: configuration updated from snapshot 3
6422019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout reports {"latest_version": "1.0.0", "application": "aes", "cached": true, "timestamp": 1576843276.535808}
6432019-12-20 12:01:17 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout notices: [{"level": "DEBUG", "message": "Returning cached result"}, {"level": "INFO", "message": "Upgrade available! to Ambassador version 1.0.0"}]
644time="2019-12-20T12:01:17Z" level=info msg="Loaded file /ambassador/envoy/envoy.json"
645time="2019-12-20T12:01:17Z" level=info msg="Pushing snapshot v3"
646[2019-12-20 12:01:17.264][406][info][upstream] [source/common/upstream/cds_api_impl.cc:67] cds: add 3 cluster(s), remove 1 cluster(s)
647[2019-12-20 12:01:17.265][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
648[2019-12-20 12:01:17.265][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
649[2019-12-20 12:01:17.265][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
650[2019-12-20 12:01:17.266][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
651[2019-12-20 12:01:17.266][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
6522019/12/20 12:01:23 kubebootstrap: found 9 "service" in namespace "*"
6532019/12/20 12:01:23 kubebootstrap: sent "service" to 1 receivers
6542019/12/20 12:01:23 kubebootstrap: found 10 "service" in namespace "*"
6552019/12/20 12:01:23 kubebootstrap: sent "service" to 1 receivers
6562019/12/20 12:01:23 kubebootstrap: found 3 "Mapping" in namespace "*"
6572019/12/20 12:01:23 kubebootstrap: sent "Mapping" to 1 receivers
6582019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
6592019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: YAML: using C parser
6602019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: YAML: using C dumper
6612019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: IRTLSContext setup good: {
6622019/12/20 12:01:23 aggregator: watch hook stderr: "_active": false,
6632019/12/20 12:01:23 aggregator: watch hook stderr: "_errored": false,
6642019/12/20 12:01:23 aggregator: watch hook stderr: "_rkey": "fallback-self-signed-context.99999",
6652019/12/20 12:01:23 aggregator: watch hook stderr: "hosts": [
6662019/12/20 12:01:23 aggregator: watch hook stderr: "*"
6672019/12/20 12:01:23 aggregator: watch hook stderr: ],
6682019/12/20 12:01:23 aggregator: watch hook stderr: "kind": "IRTLSContext",
6692019/12/20 12:01:23 aggregator: watch hook stderr: "location": "-internal-",
6702019/12/20 12:01:23 aggregator: watch hook stderr: "name": "fallback-self-signed-context",
6712019/12/20 12:01:23 aggregator: watch hook stderr: "namespace": "ambassador",
6722019/12/20 12:01:23 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
6732019/12/20 12:01:23 aggregator: watch hook stderr: "secret_info": {
6742019/12/20 12:01:23 aggregator: watch hook stderr: "secret": "fallback-self-signed-cert"
6752019/12/20 12:01:23 aggregator: watch hook stderr: }
6762019/12/20 12:01:23 aggregator: watch hook stderr: }
6772019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
6782019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
6792019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
6802019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
6812019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
6822019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
6832019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: IR: watching Edge Stack; wizard allowed
6842019/12/20 12:01:23 aggregator: watch hook stderr:
6852019/12/20 12:01:23 aggregator: found 2 kubernetes watches
6862019/12/20 12:01:23 aggregator: found 0 consul watches
6872019/12/20 12:01:23 kubewatchman: processing 2 kubernetes watch specs
6882019/12/20 12:01:23 consulwatchman: processing 0 consul watches
6892019/12/20 12:01:23 notify: python /ambassador/post_update.py --watt http://localhost:8002/snapshots/4
6902019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_6] INFO: Update requested: watt, http://localhost:8002/snapshots/4
6912019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: copying configuration: watt, http://localhost:8002/snapshots/4 to /ambassador/snapshots/snapshot-tmp.yaml
6922019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
6932019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IRTLSContext setup good: {
694 "_active": false,
695 "_errored": false,
696 "_rkey": "fallback-self-signed-context.99999",
697 "hosts": [
698 "*"
699 ],
700 "kind": "IRTLSContext",
701 "location": "-internal-",
702 "name": "fallback-self-signed-context",
703 "namespace": "ambassador",
704 "redirect_cleartext_from": 8080,
705 "secret_info": {
706 "secret": "fallback-self-signed-cert"
707 }
708}
7092019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
7102019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
7112019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
7122019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
7132019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
7142019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
7152019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IR: starting Edge Stack; wizard allowed
7162019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: ctx fallback-self-signed-context is the primary termination context
7172019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: creating redirect listener on 8080
7182019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: Using log_format 'ACCESS [%START_TIME%] "%REQ(:METHOD)% %REQ(X-ENVOY-ORIGINAL-PATH?:PATH)% %PROTOCOL%" %RESPONSE_CODE% %RESPONSE_FLAGS% %BYTES_RECEIVED% %BYTES_SENT% %DURATION% %RESP(X-ENVOY-UPSTREAM-SERVICE-TIME)% "%REQ(X-FORWARDED-FOR)%" "%REQ(USER-AGENT)%" "%REQ(X-REQUEST-ID)%" "%REQ(:AUTHORITY)%" "%UPSTREAM_HOST%"'
7192019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI (1) route check fallback-self-signed-context - ['*']
7202019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
721[
722 {
723 "ctx_hosts": [
724 "*"
725 ],
726 "ctx_name": "fallback-self-signed-context",
727 "filter_chain_match": {
728 "transport_protocol": "tls"
729 },
730 "route_count": 9
731 }
732]
7332019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
7342019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
735[
736 {
737 "ctx_hosts": [
738 "*"
739 ],
740 "ctx_name": "fallback-self-signed-context",
741 "filter_chain_match": {
742 "transport_protocol": "tls"
743 },
744 "route_count": 9
745 },
746 {
747 "ctx_hosts": [
748 "*"
749 ],
750 "ctx_name": "-cleartext-",
751 "filter_chain_match": {},
752 "route_count": 9
753 }
754]
7552019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: enabling TLS inspector
7562019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: no filter chains, need cleartext
7572019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
7582019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
759[
760 {
761 "ctx_hosts": [
762 "*"
763 ],
764 "ctx_name": "-cleartext-",
765 "filter_chain_match": {},
766 "route_count": 1
767 }
768]
7692019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: leaving TLS inspector disabled
7702019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: -global-: NOTICE: A future Ambassador version will change the GRPC protocol version for AuthServices and RateLimitServices. See the CHANGELOG for details.
7712019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: successfully validated the resulting envoy configuration, continuing...
7722019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: saving Envoy configuration for snapshot 4
7732019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: running 'kill -HUP 1'
774KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal-api.ambassador
775KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal.ambassador
776KubeStatus MASTER 306: mark_live Mapping/ambassador-edge-stack.ambassador
777KubeStatus MASTER 306: mark_live Mapping/edgestack-direct-mapping.ambassador
778KubeStatus MASTER 306: mark_live Mapping/edgestack-fallback-mapping.ambassador
779KubeStatus MASTER 306: mark_live Mapping/httpbin.default
7802019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal-api.ambassador, {"state": "Running"}...
781KubeStatus MASTER 306: Mapping/ambassador-devportal-api.ambassador == {"state": "Running"}
7822019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal.ambassador, {"state": "Running"}...
783KubeStatus MASTER 306: Mapping/ambassador-devportal.ambassador == {"state": "Running"}
7842019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-edge-stack.ambassador, {"state": "Running"}...
785KubeStatus MASTER 306: Mapping/ambassador-edge-stack.ambassador == {"state": "Running"}
7862019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-direct-mapping.ambassador, {"state": "Running"}...
787KubeStatus MASTER 306: Mapping/edgestack-direct-mapping.ambassador == {"state": "Running"}
7882019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-fallback-mapping.ambassador, {"state": "Running"}...
789KubeStatus MASTER 306: Mapping/edgestack-fallback-mapping.ambassador == {"state": "Running"}
7902019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping httpbin.default, {"state": "Running"}...
791KubeStatus MASTER 306: Mapping/httpbin.default needs {"state": "Running"}
7922019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: configuration updated from snapshot 4
7932019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout reports {"latest_version": "1.0.0", "application": "aes", "cached": true, "timestamp": 1576843276.535808}
7942019-12-20 12:01:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout notices: [{"level": "DEBUG", "message": "Returning cached result"}, {"level": "INFO", "message": "Upgrade available! to Ambassador version 1.0.0"}]
795KubeStatus UPDATE 409: running command: ['kubestatus', 'Mapping', '-f', 'metadata.name=httpbin', '-n', 'default', '-u', '/dev/fd/0']
796time="2019-12-20T12:01:23Z" level=info msg="Loaded file /ambassador/envoy/envoy.json"
797time="2019-12-20T12:01:23Z" level=info msg="Pushing snapshot v4"
798[2019-12-20 12:01:23.772][406][info][upstream] [source/common/upstream/cds_api_impl.cc:67] cds: add 4 cluster(s), remove 1 cluster(s)
799[2019-12-20 12:01:23.773][406][info][upstream] [source/common/upstream/cds_api_impl.cc:83] cds: add/update cluster 'cluster_httpbin_org'
800[2019-12-20 12:01:23.773][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
801[2019-12-20 12:01:23.773][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
802[2019-12-20 12:01:23.773][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
803[2019-12-20 12:01:23.774][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
804[2019-12-20 12:01:23.774][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
805[2019-12-20 12:01:23.776][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
806[2019-12-20 12:01:23.776][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
807[2019-12-20 12:01:23.776][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
808[2019-12-20 12:01:23.777][406][warning][config] [source/common/config/grpc_mux_subscription_impl.cc:82] gRPC config for type.googleapis.com/envoy.api.v2.Listener rejected: Error adding/updating listener(s) ambassador-listener-8443: route: unknown cluster 'cluster_httpbin_org'
809[2019-12-20 12:01:23.778][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
810[2019-12-20 12:01:23.778][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
811[2019-12-20 12:01:23.778][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
812[2019-12-20 12:01:23.778][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
813[2019-12-20 12:01:23.780][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
814[2019-12-20 12:01:23.780][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
815[2019-12-20 12:01:23.780][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
816[2019-12-20 12:01:23.780][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
817[2019-12-20 12:01:23.780][406][warning][config] [source/common/config/grpc_mux_subscription_impl.cc:82] gRPC config for type.googleapis.com/envoy.api.v2.Listener rejected: Error adding/updating listener(s) ambassador-listener-8443: route: unknown cluster 'cluster_httpbin_org'
818[2019-12-20 12:01:23.781][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
819[2019-12-20 12:01:23.782][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
820[2019-12-20 12:01:23.782][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
821[2019-12-20 12:01:23.782][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
822[2019-12-20 12:01:23.782][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
823[2019-12-20 12:01:23.783][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
824[2019-12-20 12:01:23.783][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
825[2019-12-20 12:01:23.783][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
826[2019-12-20 12:01:23.784][406][warning][config] [source/common/config/grpc_mux_subscription_impl.cc:82] gRPC config for type.googleapis.com/envoy.api.v2.Listener rejected: Error adding/updating listener(s) ambassador-listener-8443: route: unknown cluster 'cluster_httpbin_org'
827[2019-12-20 12:01:23.785][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
828[2019-12-20 12:01:23.785][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
829[2019-12-20 12:01:23.785][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
830[2019-12-20 12:01:23.785][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
831[2019-12-20 12:01:23.786][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
832[2019-12-20 12:01:23.786][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
833[2019-12-20 12:01:23.786][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
834[2019-12-20 12:01:23.787][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
835[2019-12-20 12:01:23.787][406][warning][config] [source/common/config/grpc_mux_subscription_impl.cc:82] gRPC config for type.googleapis.com/envoy.api.v2.Listener rejected: Error adding/updating listener(s) ambassador-listener-8443: route: unknown cluster 'cluster_httpbin_org'
836[2019-12-20 12:01:23.788][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
837[2019-12-20 12:01:23.789][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
838[2019-12-20 12:01:23.789][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
839[2019-12-20 12:01:23.789][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
840[2019-12-20 12:01:23.790][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
841[2019-12-20 12:01:23.790][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
842[2019-12-20 12:01:23.790][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
843[2019-12-20 12:01:23.791][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
844[2019-12-20 12:01:23.791][406][warning][config] [source/common/config/grpc_mux_subscription_impl.cc:82] gRPC config for type.googleapis.com/envoy.api.v2.Listener rejected: Error adding/updating listener(s) ambassador-listener-8443: route: unknown cluster 'cluster_httpbin_org'
845[2019-12-20 12:01:23.792][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
846[2019-12-20 12:01:23.792][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
847[2019-12-20 12:01:23.792][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
848[2019-12-20 12:01:23.792][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
849[2019-12-20 12:01:23.793][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
850[2019-12-20 12:01:23.793][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
851[2019-12-20 12:01:23.793][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
852[2019-12-20 12:01:23.794][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
853[2019-12-20 12:01:23.794][406][warning][config] [source/common/config/grpc_mux_subscription_impl.cc:82] gRPC config for type.googleapis.com/envoy.api.v2.Listener rejected: Error adding/updating listener(s) ambassador-listener-8443: route: unknown cluster 'cluster_httpbin_org'
854[2019-12-20 12:01:23.795][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
855[2019-12-20 12:01:23.795][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
856[2019-12-20 12:01:23.795][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
857[2019-12-20 12:01:23.795][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
858[2019-12-20 12:01:23.797][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
859[2019-12-20 12:01:23.797][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
860[2019-12-20 12:01:23.797][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
861[2019-12-20 12:01:23.797][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
862[2019-12-20 12:01:23.797][406][warning][config] [source/common/config/grpc_mux_subscription_impl.cc:82] gRPC config for type.googleapis.com/envoy.api.v2.Listener rejected: Error adding/updating listener(s) ambassador-listener-8443: route: unknown cluster 'cluster_httpbin_org'
863[2019-12-20 12:01:23.798][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
864[2019-12-20 12:01:23.798][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
865[2019-12-20 12:01:23.799][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
866[2019-12-20 12:01:23.799][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
867[2019-12-20 12:01:23.800][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
868[2019-12-20 12:01:23.800][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
869[2019-12-20 12:01:23.800][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
870[2019-12-20 12:01:23.800][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
871[2019-12-20 12:01:23.800][406][warning][config] [source/common/config/grpc_mux_subscription_impl.cc:82] gRPC config for type.googleapis.com/envoy.api.v2.Listener rejected: Error adding/updating listener(s) ambassador-listener-8443: route: unknown cluster 'cluster_httpbin_org'
872[2019-12-20 12:01:23.802][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
873[2019-12-20 12:01:23.802][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
874[2019-12-20 12:01:23.802][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
875[2019-12-20 12:01:23.802][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
876[2019-12-20 12:01:23.803][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
877[2019-12-20 12:01:23.803][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
878[2019-12-20 12:01:23.803][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
879[2019-12-20 12:01:23.804][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
880[2019-12-20 12:01:23.804][406][warning][config] [source/common/config/grpc_mux_subscription_impl.cc:82] gRPC config for type.googleapis.com/envoy.api.v2.Listener rejected: Error adding/updating listener(s) ambassador-listener-8443: route: unknown cluster 'cluster_httpbin_org'
881[2019-12-20 12:01:23.805][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
882[2019-12-20 12:01:23.805][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
883[2019-12-20 12:01:23.805][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
884[2019-12-20 12:01:23.805][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
885[2019-12-20 12:01:23.807][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
886[2019-12-20 12:01:23.807][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
887[2019-12-20 12:01:23.807][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
888[2019-12-20 12:01:23.808][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
889[2019-12-20 12:01:23.808][406][warning][config] [source/common/config/grpc_mux_subscription_impl.cc:82] gRPC config for type.googleapis.com/envoy.api.v2.Listener rejected: Error adding/updating listener(s) ambassador-listener-8443: route: unknown cluster 'cluster_httpbin_org'
890[2019-12-20 12:01:23.809][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
891[2019-12-20 12:01:23.809][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
892[2019-12-20 12:01:23.809][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
893[2019-12-20 12:01:23.809][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
894[2019-12-20 12:01:23.810][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
895[2019-12-20 12:01:23.810][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
896[2019-12-20 12:01:23.810][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
897[2019-12-20 12:01:23.811][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
898[2019-12-20 12:01:23.812][406][warning][config] [source/common/config/grpc_mux_subscription_impl.cc:82] gRPC config for type.googleapis.com/envoy.api.v2.Listener rejected: Error adding/updating listener(s) ambassador-listener-8443: route: unknown cluster 'cluster_httpbin_org'
899Updating httpbin.default
900[2019-12-20 12:01:23.813][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
901[2019-12-20 12:01:23.813][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
902[2019-12-20 12:01:23.813][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
903[2019-12-20 12:01:23.814][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
904[2019-12-20 12:01:23.816][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
905[2019-12-20 12:01:23.816][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
906[2019-12-20 12:01:23.816][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
907[2019-12-20 12:01:23.819][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
908[2019-12-20 12:01:23.819][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
909[2019-12-20 12:01:23.819][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
910[2019-12-20 12:01:23.820][406][info][upstream] [source/server/lds_api.cc:63] lds: add/update listener 'ambassador-listener-8443'
911[2019-12-20 12:01:23.820][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
9122019/12/20 12:01:23 kubebootstrap: found 3 "Mapping" in namespace "*"
9132019/12/20 12:01:23 kubebootstrap: sent "Mapping" to 1 receivers
914KubeStatus DONE 306: result httpbin.default: update OK
9152019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
9162019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: YAML: using C parser
9172019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: YAML: using C dumper
9182019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: IRTLSContext setup good: {
9192019/12/20 12:01:23 aggregator: watch hook stderr: "_active": false,
9202019/12/20 12:01:23 aggregator: watch hook stderr: "_errored": false,
9212019/12/20 12:01:23 aggregator: watch hook stderr: "_rkey": "fallback-self-signed-context.99999",
9222019/12/20 12:01:23 aggregator: watch hook stderr: "hosts": [
9232019/12/20 12:01:23 aggregator: watch hook stderr: "*"
9242019/12/20 12:01:23 aggregator: watch hook stderr: ],
9252019/12/20 12:01:23 aggregator: watch hook stderr: "kind": "IRTLSContext",
9262019/12/20 12:01:23 aggregator: watch hook stderr: "location": "-internal-",
9272019/12/20 12:01:23 aggregator: watch hook stderr: "name": "fallback-self-signed-context",
9282019/12/20 12:01:23 aggregator: watch hook stderr: "namespace": "ambassador",
9292019/12/20 12:01:23 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
9302019/12/20 12:01:23 aggregator: watch hook stderr: "secret_info": {
9312019/12/20 12:01:23 aggregator: watch hook stderr: "secret": "fallback-self-signed-cert"
9322019/12/20 12:01:23 aggregator: watch hook stderr: }
9332019/12/20 12:01:23 aggregator: watch hook stderr: }
9342019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
9352019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
9362019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
9372019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
9382019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
9392019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
9402019/12/20 12:01:23 aggregator: watch hook stderr: 2019-12-20 12:01:23 watch-hook INFO: IR: watching Edge Stack; wizard allowed
9412019/12/20 12:01:23 aggregator: watch hook stderr:
9422019/12/20 12:01:23 aggregator: found 2 kubernetes watches
9432019/12/20 12:01:23 aggregator: found 0 consul watches
9442019/12/20 12:01:23 kubewatchman: processing 2 kubernetes watch specs
9452019/12/20 12:01:23 consulwatchman: processing 0 consul watches
9462019/12/20 12:01:23 notify: python /ambassador/post_update.py --watt http://localhost:8002/snapshots/5
9472019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_19] INFO: Update requested: watt, http://localhost:8002/snapshots/5
9482019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: copying configuration: watt, http://localhost:8002/snapshots/5 to /ambassador/snapshots/snapshot-tmp.yaml
9492019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
9502019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IRTLSContext setup good: {
951 "_active": false,
952 "_errored": false,
953 "_rkey": "fallback-self-signed-context.99999",
954 "hosts": [
955 "*"
956 ],
957 "kind": "IRTLSContext",
958 "location": "-internal-",
959 "name": "fallback-self-signed-context",
960 "namespace": "ambassador",
961 "redirect_cleartext_from": 8080,
962 "secret_info": {
963 "secret": "fallback-self-signed-cert"
964 }
965}
9662019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
9672019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
9682019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
9692019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
9702019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
9712019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
9722019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IR: starting Edge Stack; wizard allowed
9732019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: ctx fallback-self-signed-context is the primary termination context
9742019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: creating redirect listener on 8080
9752019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: Using log_format 'ACCESS [%START_TIME%] "%REQ(:METHOD)% %REQ(X-ENVOY-ORIGINAL-PATH?:PATH)% %PROTOCOL%" %RESPONSE_CODE% %RESPONSE_FLAGS% %BYTES_RECEIVED% %BYTES_SENT% %DURATION% %RESP(X-ENVOY-UPSTREAM-SERVICE-TIME)% "%REQ(X-FORWARDED-FOR)%" "%REQ(USER-AGENT)%" "%REQ(X-REQUEST-ID)%" "%REQ(:AUTHORITY)%" "%UPSTREAM_HOST%"'
9762019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI (1) route check fallback-self-signed-context - ['*']
9772019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
978[
979 {
980 "ctx_hosts": [
981 "*"
982 ],
983 "ctx_name": "fallback-self-signed-context",
984 "filter_chain_match": {
985 "transport_protocol": "tls"
986 },
987 "route_count": 9
988 }
989]
9902019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
9912019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
992[
993 {
994 "ctx_hosts": [
995 "*"
996 ],
997 "ctx_name": "fallback-self-signed-context",
998 "filter_chain_match": {
999 "transport_protocol": "tls"
1000 },
1001 "route_count": 9
1002 },
1003 {
1004 "ctx_hosts": [
1005 "*"
1006 ],
1007 "ctx_name": "-cleartext-",
1008 "filter_chain_match": {},
1009 "route_count": 9
1010 }
1011]
10122019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: enabling TLS inspector
10132019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: no filter chains, need cleartext
10142019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
10152019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
1016[
1017 {
1018 "ctx_hosts": [
1019 "*"
1020 ],
1021 "ctx_name": "-cleartext-",
1022 "filter_chain_match": {},
1023 "route_count": 1
1024 }
1025]
10262019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: leaving TLS inspector disabled
10272019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: -global-: NOTICE: A future Ambassador version will change the GRPC protocol version for AuthServices and RateLimitServices. See the CHANGELOG for details.
10282019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: successfully validated the resulting envoy configuration, continuing...
10292019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: saving Envoy configuration for snapshot 5
10302019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: running 'kill -HUP 1'
1031KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal-api.ambassador
1032KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal.ambassador
1033KubeStatus MASTER 306: mark_live Mapping/ambassador-edge-stack.ambassador
1034KubeStatus MASTER 306: mark_live Mapping/edgestack-direct-mapping.ambassador
1035KubeStatus MASTER 306: mark_live Mapping/edgestack-fallback-mapping.ambassador
1036KubeStatus MASTER 306: mark_live Mapping/httpbin.default
10372019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal-api.ambassador, {"state": "Running"}...
1038KubeStatus MASTER 306: Mapping/ambassador-devportal-api.ambassador == {"state": "Running"}
10392019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal.ambassador, {"state": "Running"}...
1040KubeStatus MASTER 306: Mapping/ambassador-devportal.ambassador == {"state": "Running"}
10412019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-edge-stack.ambassador, {"state": "Running"}...
1042KubeStatus MASTER 306: Mapping/ambassador-edge-stack.ambassador == {"state": "Running"}
10432019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-direct-mapping.ambassador, {"state": "Running"}...
1044KubeStatus MASTER 306: Mapping/edgestack-direct-mapping.ambassador == {"state": "Running"}
10452019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-fallback-mapping.ambassador, {"state": "Running"}...
1046KubeStatus MASTER 306: Mapping/edgestack-fallback-mapping.ambassador == {"state": "Running"}
10472019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping httpbin.default, {"state": "Running"}...
1048KubeStatus MASTER 306: Mapping/httpbin.default == {"state": "Running"}
10492019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: configuration updated from snapshot 5
10502019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout reports {"latest_version": "1.0.0", "application": "aes", "cached": true, "timestamp": 1576843276.535808}
10512019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout notices: [{"level": "DEBUG", "message": "Returning cached result"}, {"level": "INFO", "message": "Upgrade available! to Ambassador version 1.0.0"}]
1052time="2019-12-20T12:01:24Z" level=info msg="Loaded file /ambassador/envoy/envoy.json"
1053time="2019-12-20T12:01:24Z" level=info msg="Pushing snapshot v5"
1054[2019-12-20 12:01:24.149][406][info][upstream] [source/common/upstream/cds_api_impl.cc:67] cds: add 4 cluster(s), remove 1 cluster(s)
1055[2019-12-20 12:01:24.149][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1056[2019-12-20 12:01:24.149][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1057[2019-12-20 12:01:24.150][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1058[2019-12-20 12:01:24.150][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1059[2019-12-20 12:01:24.150][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
10602019/12/20 12:01:24 aggregator: watch hook stderr: 2019-12-20 12:01:24 watch-hook INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
10612019/12/20 12:01:24 aggregator: watch hook stderr: 2019-12-20 12:01:24 watch-hook INFO: YAML: using C parser
10622019/12/20 12:01:24 aggregator: watch hook stderr: 2019-12-20 12:01:24 watch-hook INFO: YAML: using C dumper
10632019/12/20 12:01:24 aggregator: watch hook stderr: 2019-12-20 12:01:24 watch-hook INFO: IRTLSContext setup good: {
10642019/12/20 12:01:24 aggregator: watch hook stderr: "_active": false,
10652019/12/20 12:01:24 aggregator: watch hook stderr: "_errored": false,
10662019/12/20 12:01:24 aggregator: watch hook stderr: "_rkey": "fallback-self-signed-context.99999",
10672019/12/20 12:01:24 aggregator: watch hook stderr: "hosts": [
10682019/12/20 12:01:24 aggregator: watch hook stderr: "*"
10692019/12/20 12:01:24 aggregator: watch hook stderr: ],
10702019/12/20 12:01:24 aggregator: watch hook stderr: "kind": "IRTLSContext",
10712019/12/20 12:01:24 aggregator: watch hook stderr: "location": "-internal-",
10722019/12/20 12:01:24 aggregator: watch hook stderr: "name": "fallback-self-signed-context",
10732019/12/20 12:01:24 aggregator: watch hook stderr: "namespace": "ambassador",
10742019/12/20 12:01:24 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
10752019/12/20 12:01:24 aggregator: watch hook stderr: "secret_info": {
10762019/12/20 12:01:24 aggregator: watch hook stderr: "secret": "fallback-self-signed-cert"
10772019/12/20 12:01:24 aggregator: watch hook stderr: }
10782019/12/20 12:01:24 aggregator: watch hook stderr: }
10792019/12/20 12:01:24 aggregator: watch hook stderr: 2019-12-20 12:01:24 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
10802019/12/20 12:01:24 aggregator: watch hook stderr: 2019-12-20 12:01:24 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
10812019/12/20 12:01:24 aggregator: watch hook stderr: 2019-12-20 12:01:24 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
10822019/12/20 12:01:24 aggregator: watch hook stderr: 2019-12-20 12:01:24 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
10832019/12/20 12:01:24 aggregator: watch hook stderr: 2019-12-20 12:01:24 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
10842019/12/20 12:01:24 aggregator: watch hook stderr: 2019-12-20 12:01:24 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
10852019/12/20 12:01:24 aggregator: watch hook stderr: 2019-12-20 12:01:24 watch-hook INFO: IR: watching Edge Stack; wizard allowed
10862019/12/20 12:01:24 aggregator: watch hook stderr:
10872019/12/20 12:01:24 aggregator: found 2 kubernetes watches
10882019/12/20 12:01:24 aggregator: found 0 consul watches
10892019/12/20 12:01:24 kubewatchman: processing 2 kubernetes watch specs
10902019/12/20 12:01:24 consulwatchman: processing 0 consul watches
10912019/12/20 12:01:24 notify: python /ambassador/post_update.py --watt http://localhost:8002/snapshots/6
10922019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_12] INFO: Update requested: watt, http://localhost:8002/snapshots/6
10932019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: copying configuration: watt, http://localhost:8002/snapshots/6 to /ambassador/snapshots/snapshot-tmp.yaml
10942019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
10952019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IRTLSContext setup good: {
1096 "_active": false,
1097 "_errored": false,
1098 "_rkey": "fallback-self-signed-context.99999",
1099 "hosts": [
1100 "*"
1101 ],
1102 "kind": "IRTLSContext",
1103 "location": "-internal-",
1104 "name": "fallback-self-signed-context",
1105 "namespace": "ambassador",
1106 "redirect_cleartext_from": 8080,
1107 "secret_info": {
1108 "secret": "fallback-self-signed-cert"
1109 }
1110}
11112019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
11122019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
11132019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
11142019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
11152019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
11162019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
11172019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IR: starting Edge Stack; wizard allowed
11182019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: ctx fallback-self-signed-context is the primary termination context
11192019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: creating redirect listener on 8080
11202019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: Using log_format 'ACCESS [%START_TIME%] "%REQ(:METHOD)% %REQ(X-ENVOY-ORIGINAL-PATH?:PATH)% %PROTOCOL%" %RESPONSE_CODE% %RESPONSE_FLAGS% %BYTES_RECEIVED% %BYTES_SENT% %DURATION% %RESP(X-ENVOY-UPSTREAM-SERVICE-TIME)% "%REQ(X-FORWARDED-FOR)%" "%REQ(USER-AGENT)%" "%REQ(X-REQUEST-ID)%" "%REQ(:AUTHORITY)%" "%UPSTREAM_HOST%"'
11212019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI (1) route check fallback-self-signed-context - ['*']
11222019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
1123[
1124 {
1125 "ctx_hosts": [
1126 "*"
1127 ],
1128 "ctx_name": "fallback-self-signed-context",
1129 "filter_chain_match": {
1130 "transport_protocol": "tls"
1131 },
1132 "route_count": 9
1133 }
1134]
11352019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
11362019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
1137[
1138 {
1139 "ctx_hosts": [
1140 "*"
1141 ],
1142 "ctx_name": "fallback-self-signed-context",
1143 "filter_chain_match": {
1144 "transport_protocol": "tls"
1145 },
1146 "route_count": 9
1147 },
1148 {
1149 "ctx_hosts": [
1150 "*"
1151 ],
1152 "ctx_name": "-cleartext-",
1153 "filter_chain_match": {},
1154 "route_count": 9
1155 }
1156]
11572019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: enabling TLS inspector
11582019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: no filter chains, need cleartext
11592019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
11602019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
1161[
1162 {
1163 "ctx_hosts": [
1164 "*"
1165 ],
1166 "ctx_name": "-cleartext-",
1167 "filter_chain_match": {},
1168 "route_count": 1
1169 }
1170]
11712019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: leaving TLS inspector disabled
11722019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: -global-: NOTICE: A future Ambassador version will change the GRPC protocol version for AuthServices and RateLimitServices. See the CHANGELOG for details.
11732019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: successfully validated the resulting envoy configuration, continuing...
11742019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: saving Envoy configuration for snapshot 6
11752019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: running 'kill -HUP 1'
1176KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal-api.ambassador
1177KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal.ambassador
1178KubeStatus MASTER 306: mark_live Mapping/ambassador-edge-stack.ambassador
1179KubeStatus MASTER 306: mark_live Mapping/edgestack-direct-mapping.ambassador
1180KubeStatus MASTER 306: mark_live Mapping/edgestack-fallback-mapping.ambassador
1181KubeStatus MASTER 306: mark_live Mapping/httpbin.default
11822019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal-api.ambassador, {"state": "Running"}...
1183KubeStatus MASTER 306: Mapping/ambassador-devportal-api.ambassador == {"state": "Running"}
11842019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal.ambassador, {"state": "Running"}...
1185KubeStatus MASTER 306: Mapping/ambassador-devportal.ambassador == {"state": "Running"}
11862019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-edge-stack.ambassador, {"state": "Running"}...
1187KubeStatus MASTER 306: Mapping/ambassador-edge-stack.ambassador == {"state": "Running"}
1188KubeStatus MASTER 306: Mapping/edgestack-direct-mapping.ambassador == {"state": "Running"}
11892019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-direct-mapping.ambassador, {"state": "Running"}...
11902019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-fallback-mapping.ambassador, {"state": "Running"}...
1191KubeStatus MASTER 306: Mapping/edgestack-fallback-mapping.ambassador == {"state": "Running"}
11922019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping httpbin.default, {"state": "Running"}...
1193KubeStatus MASTER 306: Mapping/httpbin.default == {"state": "Running"}
11942019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: configuration updated from snapshot 6
11952019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout reports {"latest_version": "1.0.0", "application": "aes", "cached": true, "timestamp": 1576843276.535808}
11962019-12-20 12:01:24 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout notices: [{"level": "DEBUG", "message": "Returning cached result"}, {"level": "INFO", "message": "Upgrade available! to Ambassador version 1.0.0"}]
1197time="2019-12-20T12:01:24Z" level=info msg="Loaded file /ambassador/envoy/envoy.json"
1198time="2019-12-20T12:01:24Z" level=info msg="Pushing snapshot v6"
1199[2019-12-20 12:01:24.454][406][info][upstream] [source/common/upstream/cds_api_impl.cc:67] cds: add 4 cluster(s), remove 1 cluster(s)
1200[2019-12-20 12:01:24.455][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1201[2019-12-20 12:01:24.455][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1202[2019-12-20 12:01:24.455][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1203[2019-12-20 12:01:24.455][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1204[2019-12-20 12:01:24.456][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1205time="2019-12-20 12:01:26" level=info msg="[gRPC] HTTP/1.1 GET localhost:30081 /httpbin/ip" MAIN=http REQUEST_ID=17217952761073684944 SUB=http-handler
1206time="2019-12-20 12:01:26" level=info msg="using default rule" MAIN=http REQUEST_ID=17217952761073684944 SUB=http-handler
1207time="2019-12-20 12:01:26" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=17217952761073684944 SUB=http-handler
1208time="2019-12-20 12:01:26" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (58.34µs)" MAIN=http REQUEST_ID=17217952761073684944 SUB=http-handler
1209ACCESS [2019-12-20T12:01:26.471Z] "GET /httpbin/ip HTTP/1.1" 200 - 0 54 235 233 "10.42.0.0" "curl/7.58.0" "516cd776-5d31-4eea-9e89-7dd781cfa255" "httpbin.org" "34.193.212.251:80"
1210Calling Metriton
1211time="2019-12-20 12:01:30" level=info msg="[gRPC] HTTP/1.1 GET localhost:30081 /edge_stack/" MAIN=http REQUEST_ID=10549873037972188428 SUB=http-handler
1212time="2019-12-20 12:01:30" level=info msg="using default rule" MAIN=http REQUEST_ID=10549873037972188428 SUB=http-handler
1213time="2019-12-20 12:01:30" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=10549873037972188428 SUB=http-handler
1214time="2019-12-20 12:01:30" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (80.991µs)" MAIN=http REQUEST_ID=10549873037972188428 SUB=http-handler
1215ACCESS [2019-12-20T12:01:30.571Z] "GET /edge_stack/ HTTP/1.1" 404 - 0 13278 1 0 "10.42.0.0" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:71.0) Gecko/20100101 Firefox/71.0" "d99939a5-c4f0-4cd3-bab5-9a5920bebe6f" "localhost:30081" "127.0.0.1:8500"
1216time="2019-12-20 12:02:11" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/config/pod-namespace" MAIN=http REQUEST_ID=8903544710887390468 SUB=http-handler
1217time="2019-12-20 12:02:11" level=info msg="using default rule" MAIN=http REQUEST_ID=8903544710887390468 SUB=http-handler
1218time="2019-12-20 12:02:11" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=8903544710887390468 SUB=http-handler
1219time="2019-12-20 12:02:11" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (56.93µs)" MAIN=http REQUEST_ID=8903544710887390468 SUB=http-handler
1220time="2019-12-20 12:02:11" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=8293483794873566734 SUB=http-handler
1221time="2019-12-20 12:02:11" level=info msg="using default rule" MAIN=http REQUEST_ID=8293483794873566734 SUB=http-handler
1222time="2019-12-20 12:02:11" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=8293483794873566734 SUB=http-handler
1223time="2019-12-20 12:02:11" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (54.501µs)" MAIN=http REQUEST_ID=8293483794873566734 SUB=http-handler
1224time="2019-12-20 12:02:11" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/acme-host-qualifies?hostname=22a1d2b2.eu.ngrok.io" MAIN=http REQUEST_ID=4436821088793908683 SUB=http-handler
1225time="2019-12-20 12:02:11" level=info msg="using default rule" MAIN=http REQUEST_ID=4436821088793908683 SUB=http-handler
1226time="2019-12-20 12:02:11" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=4436821088793908683 SUB=http-handler
1227time="2019-12-20 12:02:11" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (87.601µs)" MAIN=http REQUEST_ID=4436821088793908683 SUB=http-handler
1228time="2019-12-20 12:02:11" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/tos-url?ca-url=https%3A%2F%2Facme-v02.api.letsencrypt.org%2Fdirectory" MAIN=http REQUEST_ID=11806219264613809031 SUB=http-handler
1229time="2019-12-20 12:02:11" level=info msg="using default rule" MAIN=http REQUEST_ID=11806219264613809031 SUB=http-handler
1230time="2019-12-20 12:02:11" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=11806219264613809031 SUB=http-handler
1231time="2019-12-20 12:02:11" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (62.831µs)" MAIN=http REQUEST_ID=11806219264613809031 SUB=http-handler
1232time="2019-12-20 12:02:11" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /openapi/services" MAIN=http REQUEST_ID=8945016130186933470 SUB=http-handler
1233time="2019-12-20 12:02:11" level=info msg="using default rule" MAIN=http REQUEST_ID=8945016130186933470 SUB=http-handler
1234time="2019-12-20 12:02:11" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=8945016130186933470 SUB=http-handler
1235time="2019-12-20 12:02:11" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (52.941µs)" MAIN=http REQUEST_ID=8945016130186933470 SUB=http-handler
1236time="2019-12-20 12:02:11" level=info msg="HTTP request" method=GET request=/openapi/services status_code=200 subsystem=server
1237time="2019-12-20 12:02:11" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=7773339592706372912 SUB=http-handler
1238time="2019-12-20 12:02:11" level=info msg="using default rule" MAIN=http REQUEST_ID=7773339592706372912 SUB=http-handler
1239time="2019-12-20 12:02:11" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=7773339592706372912 SUB=http-handler
1240time="2019-12-20 12:02:11" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (53.86µs)" MAIN=http REQUEST_ID=7773339592706372912 SUB=http-handler
12412019-12-20 12:02:11 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_24] INFO: C8A2FC39-C1E4-4143-BB8D-1A900E7C27EA: 127.0.0.1 "GET /ambassador/v0/diag/" START
12422019-12-20 12:02:11 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_24] INFO: DEBUG_MODE False
1243status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
12442019-12-20 12:02:11 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_24] INFO: C8A2FC39-C1E4-4143-BB8D-1A900E7C27EA: 127.0.0.1 "GET /ambassador/v0/diag/" 14ms 200 success
1245time="2019-12-20 12:02:12" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=16394428956209401626 SUB=http-handler
1246time="2019-12-20 12:02:12" level=info msg="using default rule" MAIN=http REQUEST_ID=16394428956209401626 SUB=http-handler
1247time="2019-12-20 12:02:12" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=16394428956209401626 SUB=http-handler
1248time="2019-12-20 12:02:12" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (76.881µs)" MAIN=http REQUEST_ID=16394428956209401626 SUB=http-handler
12492019-12-20 12:02:12 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_4] INFO: 63DC8AE0-AF17-4F49-A5DF-EAE2B6AA3732: 127.0.0.1 "GET /ambassador/v0/diag/" START
12502019-12-20 12:02:12 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_4] INFO: DEBUG_MODE False
1251status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
12522019-12-20 12:02:12 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_4] INFO: 63DC8AE0-AF17-4F49-A5DF-EAE2B6AA3732: 127.0.0.1 "GET /ambassador/v0/diag/" 16ms 200 success
1253time="2019-12-20 12:02:12" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=15826642025528606826 SUB=http-handler
1254time="2019-12-20 12:02:12" level=info msg="using default rule" MAIN=http REQUEST_ID=15826642025528606826 SUB=http-handler
1255time="2019-12-20 12:02:12" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=15826642025528606826 SUB=http-handler
1256time="2019-12-20 12:02:12" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (60.22µs)" MAIN=http REQUEST_ID=15826642025528606826 SUB=http-handler
12572019-12-20 12:02:12 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_10] INFO: 10CEAE22-A8D3-49A6-B667-FD217BC926AD: 127.0.0.1 "GET /ambassador/v0/diag/" START
12582019-12-20 12:02:12 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_10] INFO: DEBUG_MODE False
1259status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
12602019-12-20 12:02:12 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_10] INFO: 10CEAE22-A8D3-49A6-B667-FD217BC926AD: 127.0.0.1 "GET /ambassador/v0/diag/" 12ms 200 success
1261time="2019-12-20 12:02:13" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=5399142972981940691 SUB=http-handler
1262time="2019-12-20 12:02:13" level=info msg="using default rule" MAIN=http REQUEST_ID=5399142972981940691 SUB=http-handler
1263time="2019-12-20 12:02:13" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=5399142972981940691 SUB=http-handler
1264time="2019-12-20 12:02:13" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (64.79µs)" MAIN=http REQUEST_ID=5399142972981940691 SUB=http-handler
12652019-12-20 12:02:13 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_27] INFO: 0E947027-1BE3-44A9-A0CF-190842FE6F46: 127.0.0.1 "GET /ambassador/v0/diag/" START
12662019-12-20 12:02:13 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_27] INFO: DEBUG_MODE False
1267status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
12682019-12-20 12:02:13 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_27] INFO: 0E947027-1BE3-44A9-A0CF-190842FE6F46: 127.0.0.1 "GET /ambassador/v0/diag/" 12ms 200 success
1269time="2019-12-20 12:02:13" level=info msg="[gRPC] HTTP/1.1 POST 22a1d2b2.eu.ngrok.io /edge_stack/api/activity" MAIN=http REQUEST_ID=13146998719029862028 SUB=http-handler
1270time="2019-12-20 12:02:13" level=info msg="using default rule" MAIN=http REQUEST_ID=13146998719029862028 SUB=http-handler
1271time="2019-12-20 12:02:13" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=13146998719029862028 SUB=http-handler
1272time="2019-12-20 12:02:13" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (61.82µs)" MAIN=http REQUEST_ID=13146998719029862028 SUB=http-handler
1273time="2019-12-20 12:02:13" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=14252467911589384828 SUB=http-handler
1274time="2019-12-20 12:02:13" level=info msg="using default rule" MAIN=http REQUEST_ID=14252467911589384828 SUB=http-handler
1275time="2019-12-20 12:02:13" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=14252467911589384828 SUB=http-handler
1276time="2019-12-20 12:02:13" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (54.42µs)" MAIN=http REQUEST_ID=14252467911589384828 SUB=http-handler
12772019-12-20 12:02:13 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_5] INFO: 8E3F8475-89EA-44DC-97EE-019F1B086C75: 127.0.0.1 "GET /ambassador/v0/diag/" START
12782019-12-20 12:02:13 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_5] INFO: DEBUG_MODE False
1279status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
12802019-12-20 12:02:13 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_5] INFO: 8E3F8475-89EA-44DC-97EE-019F1B086C75: 127.0.0.1 "GET /ambassador/v0/diag/" 14ms 200 success
1281time="2019-12-20 12:02:14" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=9968169733827731895 SUB=http-handler
1282time="2019-12-20 12:02:14" level=info msg="using default rule" MAIN=http REQUEST_ID=9968169733827731895 SUB=http-handler
1283time="2019-12-20 12:02:14" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=9968169733827731895 SUB=http-handler
1284time="2019-12-20 12:02:14" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (50.38µs)" MAIN=http REQUEST_ID=9968169733827731895 SUB=http-handler
12852019-12-20 12:02:14 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_30] INFO: 3948F8FC-48D6-4D3F-8E8B-EEBC5CCF1CFA: 127.0.0.1 "GET /ambassador/v0/diag/" START
12862019-12-20 12:02:14 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_30] INFO: DEBUG_MODE False
1287status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
12882019-12-20 12:02:14 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_30] INFO: 3948F8FC-48D6-4D3F-8E8B-EEBC5CCF1CFA: 127.0.0.1 "GET /ambassador/v0/diag/" 17ms 200 success
1289time="2019-12-20 12:02:14" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=4506687804676969504 SUB=http-handler
1290time="2019-12-20 12:02:14" level=info msg="using default rule" MAIN=http REQUEST_ID=4506687804676969504 SUB=http-handler
1291time="2019-12-20 12:02:14" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=4506687804676969504 SUB=http-handler
1292time="2019-12-20 12:02:14" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (59.63µs)" MAIN=http REQUEST_ID=4506687804676969504 SUB=http-handler
12932019-12-20 12:02:14 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_11] INFO: E46B856D-87E9-4FA3-88A3-7CE3F9A57D0C: 127.0.0.1 "GET /ambassador/v0/diag/" START
12942019-12-20 12:02:14 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_11] INFO: DEBUG_MODE False
1295status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
12962019-12-20 12:02:14 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_11] INFO: E46B856D-87E9-4FA3-88A3-7CE3F9A57D0C: 127.0.0.1 "GET /ambassador/v0/diag/" 14ms 200 success
1297time="2019-12-20 12:02:15" level=info msg="[gRPC] HTTP/1.1 POST 22a1d2b2.eu.ngrok.io /edge_stack/api/activity" MAIN=http REQUEST_ID=7658671142028463098 SUB=http-handler
1298time="2019-12-20 12:02:15" level=info msg="using default rule" MAIN=http REQUEST_ID=7658671142028463098 SUB=http-handler
1299time="2019-12-20 12:02:15" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=7658671142028463098 SUB=http-handler
1300time="2019-12-20 12:02:15" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (58.16µs)" MAIN=http REQUEST_ID=7658671142028463098 SUB=http-handler
1301time="2019-12-20 12:02:15" level=info msg="[gRPC] HTTP/1.1 POST 22a1d2b2.eu.ngrok.io /edge_stack/api/activity" MAIN=http REQUEST_ID=5374150774305273125 SUB=http-handler
1302time="2019-12-20 12:02:15" level=info msg="using default rule" MAIN=http REQUEST_ID=5374150774305273125 SUB=http-handler
1303time="2019-12-20 12:02:15" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=5374150774305273125 SUB=http-handler
1304time="2019-12-20 12:02:15" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (66.121µs)" MAIN=http REQUEST_ID=5374150774305273125 SUB=http-handler
1305time="2019-12-20 12:02:15" level=info msg="Iteration started timer " subsystem=fetcher
13062019-12-20 12:02:15 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_1] INFO: E95CF762-4345-435C-B419-5143CC30F352: 127.0.0.1 "GET /ambassador/v0/diag/" START
13072019-12-20 12:02:15 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_1] INFO: DEBUG_MODE False
1308status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
13092019-12-20 12:02:15 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_1] INFO: E95CF762-4345-435C-B419-5143CC30F352: 127.0.0.1 "GET /ambassador/v0/diag/" 17ms 200 success
1310time="2019-12-20 12:02:15" level=info msg="Found internal mapping, skipping" baseURL="https://ambassador.default.svc.cluster.local" clusterName=cluster_127_0_0_1_8500 mappingName=edgestack-direct-mapping name=edgestack-direct-mapping namespace=ambassador prefix=/edge_stack rewrite=/edge_stack_ui/edge_stack/ subsystem=fetcher
1311time="2019-12-20 12:02:15" level=info msg="Found internal mapping, skipping" baseURL="https://ambassador.default.svc.cluster.local" clusterName=cluster_127_0_0_1_8500 mappingName=edgestack-fallback-mapping name=edgestack-fallback-mapping namespace=ambassador prefix= rewrite=/edge_stack_ui/ subsystem=fetcher
1312time="2019-12-20 12:02:15" level=info msg="Found internal mapping, skipping" baseURL="https://ambassador.default.svc.cluster.local" clusterName=cluster_127_0_0_1_8500 mappingName=ambassador-edge-stack name=ambassador-edge-stack namespace=ambassador prefix=/.ambassador rewrite= subsystem=fetcher
1313time="2019-12-20 12:02:15" level=info msg="Found mapping" baseURL="https://ambassador.default.svc.cluster.local" name=httpbin namespace=default prefix=/httpbin subsystem=fetcher
1314time="2019-12-20 12:02:15" level=info msg="[gRPC] HTTP/1.1 GET 127.0.0.1:8443 /httpbin/.ambassador-internal/openapi-docs" MAIN=http REQUEST_ID=233213542585970140 SUB=http-handler
1315time="2019-12-20 12:02:15" level=info msg="selected rule host=\"\", path=\"\", filters=[.]" MAIN=http REQUEST_ID=233213542585970140 SUB=http-handler
1316time="2019-12-20 12:02:15" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (78.88µs)" MAIN=http REQUEST_ID=233213542585970140 SUB=http-handler
1317time="2019-12-20 12:02:15" level=error msg="Bad HTTP response" status_code=404 subsystem=fetcher url="https://127.0.0.1:8443/httpbin/.ambassador-internal/openapi-docs"
1318time="2019-12-20 12:02:15" level=error msg="HTTP error 404 from https://127.0.0.1:8443/httpbin/.ambassador-internal/openapi-docs" subsystem=fetcher url="https://127.0.0.1:8443/httpbin/.ambassador-internal/openapi-docs"
1319time="2019-12-20 12:02:15" level=info msg="Found internal mapping, skipping" baseURL="https://ambassador.default.svc.cluster.local" clusterName=cluster_127_0_0_1_8500 mappingName=ambassador-devportal-api name=ambassador-devportal-api namespace=ambassador prefix=/openapi rewrite= subsystem=fetcher
1320time="2019-12-20 12:02:15" level=info msg="Prefix detected from ambassador-devportal" oldPrefix=/docs/ prefix=/docs/ rewrite=/docs/
1321time="2019-12-20 12:02:15" level=info msg="Found internal mapping, skipping" baseURL="https://ambassador.default.svc.cluster.local" clusterName=cluster_127_0_0_1_8500 mappingName=ambassador-devportal name=ambassador-devportal namespace=ambassador prefix=/docs rewrite=/docs/ subsystem=fetcher
1322time="2019-12-20 12:02:15" level=info msg="Iteration done" subsystem=fetcher
1323time="2019-12-20 12:02:15" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=2633086600953578861 SUB=http-handler
1324time="2019-12-20 12:02:15" level=info msg="using default rule" MAIN=http REQUEST_ID=2633086600953578861 SUB=http-handler
1325time="2019-12-20 12:02:15" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=2633086600953578861 SUB=http-handler
1326time="2019-12-20 12:02:15" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (59.91µs)" MAIN=http REQUEST_ID=2633086600953578861 SUB=http-handler
13272019-12-20 12:02:15 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_32] INFO: CA721101-E359-48BE-83C8-43E8AA869280: 127.0.0.1 "GET /ambassador/v0/diag/" START
13282019-12-20 12:02:15 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_32] INFO: DEBUG_MODE False
1329status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
13302019-12-20 12:02:15 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_32] INFO: CA721101-E359-48BE-83C8-43E8AA869280: 127.0.0.1 "GET /ambassador/v0/diag/" 16ms 200 success
1331time="2019-12-20 12:02:16" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=17950744967310069797 SUB=http-handler
1332time="2019-12-20 12:02:16" level=info msg="using default rule" MAIN=http REQUEST_ID=17950744967310069797 SUB=http-handler
1333time="2019-12-20 12:02:16" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=17950744967310069797 SUB=http-handler
1334time="2019-12-20 12:02:16" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (54.5µs)" MAIN=http REQUEST_ID=17950744967310069797 SUB=http-handler
13352019-12-20 12:02:16 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_3] INFO: 644DE5B3-EEF2-4039-9574-FD5575013AE5: 127.0.0.1 "GET /ambassador/v0/diag/" START
13362019-12-20 12:02:16 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_3] INFO: DEBUG_MODE False
1337status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
13382019-12-20 12:02:16 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_3] INFO: 644DE5B3-EEF2-4039-9574-FD5575013AE5: 127.0.0.1 "GET /ambassador/v0/diag/" 14ms 200 success
1339ACCESS [2019-12-20T12:02:11.217Z] "GET /edge_stack/api/config/pod-namespace HTTP/1.1" 200 - 0 10 1 0 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "16126148-72ca-40b8-9628-724486c57162" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
1340ACCESS [2019-12-20T12:02:11.255Z] "GET /edge_stack/api/snapshot HTTP/1.1" 403 - 0 47 1 0 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "d37df327-5adf-488c-b88f-46a71eaffd79" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
1341ACCESS [2019-12-20T12:02:11.342Z] "GET /edge_stack/api/acme-host-qualifies?hostname=22a1d2b2.eu.ngrok.io HTTP/1.1" 403 - 0 47 1 0 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "0c531d3c-6031-4e7e-83ef-1a7d62a77490" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
1342ACCESS [2019-12-20T12:02:11.348Z] "GET /edge_stack/api/tos-url?ca-url=https%3A%2F%2Facme-v02.api.letsencrypt.org%2Fdirectory HTTP/1.1" 403 - 0 47 1 0 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "e6613024-afb1-4d42-ab36-cb3578e5d14c" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
1343ACCESS [2019-12-20T12:02:11.442Z] "GET /openapi/services HTTP/1.1" 200 - 0 2 1 0 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "95b11c54-03c9-4210-a52c-3d77b798307e" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
1344ACCESS [2019-12-20T12:02:11.442Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 130098 21 20 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "fe331b3a-9a63-4835-a440-57c8e9059466" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
1345ACCESS [2019-12-20T12:02:12.214Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 130260 22 21 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "ae0af25d-2b21-4f91-9fcd-b50dae21c758" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
1346ACCESS [2019-12-20T12:02:12.683Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 130438 18 17 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "9daa0622-ef12-4909-a106-73036fddc9f7" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
1347ACCESS [2019-12-20T12:02:13.440Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 130619 17 16 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "0e7443ed-384b-4c27-877a-3424f9515d98" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
1348ACCESS [2019-12-20T12:02:13.697Z] "POST /edge_stack/api/activity HTTP/1.1" 200 - 0 0 4 3 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "e3e3751c-cbaf-498a-98a4-68990a9c84e2" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
1349ACCESS [2019-12-20T12:02:13.828Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 130808 20 19 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "b17b668c-0a96-4bb4-8ff4-3d0f5dc18fd4" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
1350ACCESS [2019-12-20T12:02:14.659Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 130997 22 21 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "adf408d8-b7a0-4932-bb0a-9cb3601a61a8" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
1351ACCESS [2019-12-20T12:02:14.944Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 131175 20 19 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "9829bdee-3196-43c1-8b20-c8d695c2b439" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
1352ACCESS [2019-12-20T12:02:15.144Z] "POST /edge_stack/api/activity HTTP/1.1" 200 - 0 0 3 3 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "d892970f-58bd-4727-a416-849fa68f58be" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
1353ACCESS [2019-12-20T12:02:15.602Z] "POST /edge_stack/api/activity HTTP/1.1" 200 - 0 0 3 2 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "93f36f1c-3e49-48d8-b04f-f611aafc9bc2" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
1354ACCESS [2019-12-20T12:02:15.674Z] "GET /httpbin/.ambassador-internal/openapi-docs HTTP/1.1" 404 - 0 198 223 222 "10.42.1.6" "Go-http-client/1.1" "cafae07d-50c1-440a-b3ed-e4ed39e1c750" "httpbin.org" "54.172.95.6:80"
1355ACCESS [2019-12-20T12:02:15.923Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 131542 22 21 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "5d5b6af9-5480-4dcc-93b6-cf60cf6de6f7" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
1356ACCESS [2019-12-20T12:02:16.105Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 131720 19 18 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "1b0bc799-4659-4023-bd8c-b87142336d1d" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
1357time="2019-12-20 12:02:17" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=29973609521009728 SUB=http-handler
1358time="2019-12-20 12:02:17" level=info msg="using default rule" MAIN=http REQUEST_ID=29973609521009728 SUB=http-handler
1359time="2019-12-20 12:02:17" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=29973609521009728 SUB=http-handler
1360time="2019-12-20 12:02:17" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (66.08µs)" MAIN=http REQUEST_ID=29973609521009728 SUB=http-handler
13612019-12-20 12:02:17 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_12] INFO: 5BAE8CA0-861A-4BEA-B304-CBC38C15E5A0: 127.0.0.1 "GET /ambassador/v0/diag/" START
13622019-12-20 12:02:17 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_12] INFO: DEBUG_MODE False
1363status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
13642019-12-20 12:02:17 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_12] INFO: 5BAE8CA0-861A-4BEA-B304-CBC38C15E5A0: 127.0.0.1 "GET /ambassador/v0/diag/" 14ms 200 success
1365time="2019-12-20 12:02:17" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=5957737099475123450 SUB=http-handler
1366time="2019-12-20 12:02:17" level=info msg="using default rule" MAIN=http REQUEST_ID=5957737099475123450 SUB=http-handler
1367time="2019-12-20 12:02:17" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=5957737099475123450 SUB=http-handler
1368time="2019-12-20 12:02:17" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (63.681µs)" MAIN=http REQUEST_ID=5957737099475123450 SUB=http-handler
13692019-12-20 12:02:17 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_23] INFO: 34827EA8-187F-41FB-B42D-40B418F4D786: 127.0.0.1 "GET /ambassador/v0/diag/" START
13702019-12-20 12:02:17 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_23] INFO: DEBUG_MODE False
1371status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
13722019-12-20 12:02:17 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_23] INFO: 34827EA8-187F-41FB-B42D-40B418F4D786: 127.0.0.1 "GET /ambassador/v0/diag/" 14ms 200 success
1373time="2019-12-20 12:02:18" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=16745624613345382941 SUB=http-handler
1374time="2019-12-20 12:02:18" level=info msg="using default rule" MAIN=http REQUEST_ID=16745624613345382941 SUB=http-handler
1375time="2019-12-20 12:02:18" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=16745624613345382941 SUB=http-handler
1376time="2019-12-20 12:02:18" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (59.26µs)" MAIN=http REQUEST_ID=16745624613345382941 SUB=http-handler
13772019-12-20 12:02:18 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_14] INFO: 49DE8CF8-EFC6-4D2E-81D5-89D8329C8E03: 127.0.0.1 "GET /ambassador/v0/diag/" START
13782019-12-20 12:02:18 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_14] INFO: DEBUG_MODE False
1379status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
13802019-12-20 12:02:18 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_14] INFO: 49DE8CF8-EFC6-4D2E-81D5-89D8329C8E03: 127.0.0.1 "GET /ambassador/v0/diag/" 14ms 200 success
1381time="2019-12-20 12:02:18" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=10567164193869761287 SUB=http-handler
1382time="2019-12-20 12:02:18" level=info msg="using default rule" MAIN=http REQUEST_ID=10567164193869761287 SUB=http-handler
1383time="2019-12-20 12:02:18" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=10567164193869761287 SUB=http-handler
1384time="2019-12-20 12:02:18" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (63.53µs)" MAIN=http REQUEST_ID=10567164193869761287 SUB=http-handler
13852019-12-20 12:02:18 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_24] INFO: 751E648F-51B1-4005-95B2-2D6B1B671401: 127.0.0.1 "GET /ambassador/v0/diag/" START
13862019-12-20 12:02:18 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_24] INFO: DEBUG_MODE False
1387status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
13882019-12-20 12:02:18 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_24] INFO: 751E648F-51B1-4005-95B2-2D6B1B671401: 127.0.0.1 "GET /ambassador/v0/diag/" 14ms 200 success
1389time="2019-12-20 12:02:19" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=4386016066586951743 SUB=http-handler
1390time="2019-12-20 12:02:19" level=info msg="using default rule" MAIN=http REQUEST_ID=4386016066586951743 SUB=http-handler
1391time="2019-12-20 12:02:19" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=4386016066586951743 SUB=http-handler
1392time="2019-12-20 12:02:19" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (55.811µs)" MAIN=http REQUEST_ID=4386016066586951743 SUB=http-handler
13932019-12-20 12:02:19 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_4] INFO: 78484617-57D6-4735-8587-EF14A9FC1954: 127.0.0.1 "GET /ambassador/v0/diag/" START
13942019-12-20 12:02:19 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_4] INFO: DEBUG_MODE False
1395status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
13962019-12-20 12:02:19 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_4] INFO: 78484617-57D6-4735-8587-EF14A9FC1954: 127.0.0.1 "GET /ambassador/v0/diag/" 15ms 200 success
1397time="2019-12-20 12:02:19" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=15929521669125900975 SUB=http-handler
1398time="2019-12-20 12:02:19" level=info msg="using default rule" MAIN=http REQUEST_ID=15929521669125900975 SUB=http-handler
1399time="2019-12-20 12:02:19" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=15929521669125900975 SUB=http-handler
1400time="2019-12-20 12:02:19" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (74.791µs)" MAIN=http REQUEST_ID=15929521669125900975 SUB=http-handler
14012019-12-20 12:02:19 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_10] INFO: E00004E6-BEE8-41EF-8462-2C000EB021FE: 127.0.0.1 "GET /ambassador/v0/diag/" START
14022019-12-20 12:02:19 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_10] INFO: DEBUG_MODE False
1403status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
14042019-12-20 12:02:19 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_10] INFO: E00004E6-BEE8-41EF-8462-2C000EB021FE: 127.0.0.1 "GET /ambassador/v0/diag/" 15ms 200 success
1405time="2019-12-20 12:02:20" level=info msg="[gRPC] HTTP/1.1 POST 22a1d2b2.eu.ngrok.io /edge_stack/api/activity" MAIN=http REQUEST_ID=11125105176184818917 SUB=http-handler
1406time="2019-12-20 12:02:20" level=info msg="using default rule" MAIN=http REQUEST_ID=11125105176184818917 SUB=http-handler
1407time="2019-12-20 12:02:20" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=11125105176184818917 SUB=http-handler
1408time="2019-12-20 12:02:20" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (64.961µs)" MAIN=http REQUEST_ID=11125105176184818917 SUB=http-handler
1409time="2019-12-20 12:02:20" level=info msg="[gRPC] HTTP/1.1 POST 22a1d2b2.eu.ngrok.io /edge_stack/api/apply" MAIN=http REQUEST_ID=11351121270398995911 SUB=http-handler
1410time="2019-12-20 12:02:20" level=info msg="using default rule" MAIN=http REQUEST_ID=11351121270398995911 SUB=http-handler
1411time="2019-12-20 12:02:20" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=11351121270398995911 SUB=http-handler
1412time="2019-12-20 12:02:20" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (54.82µs)" MAIN=http REQUEST_ID=11351121270398995911 SUB=http-handler
14132019/12/20 12:02:20 WEBUI: starting
14142019/12/20 12:02:20 WEBUI: exited
14152019/12/20 12:02:20 WEBUI: /usr/bin/kubectl [apply -f -]
14162019/12/20 12:02:20 WEBUI: -> metadata:
14172019/12/20 12:02:20 WEBUI: -> namespace: default
14182019/12/20 12:02:20 WEBUI: -> name: 22a1d2b2.eu.ngrok.io
14192019/12/20 12:02:20 WEBUI: -> annotations:
14202019/12/20 12:02:20 WEBUI: -> aes_res_changed: 'true'
14212019/12/20 12:02:20 WEBUI: -> spec:
14222019/12/20 12:02:20 WEBUI: -> hostname: 22a1d2b2.eu.ngrok.io
14232019/12/20 12:02:20 WEBUI: -> acmeProvider:
14242019/12/20 12:02:20 WEBUI: -> authority: 'https://acme-v02.api.letsencrypt.org/directory'
14252019/12/20 12:02:20 WEBUI: -> email: test@test.com
14262019/12/20 12:02:20 WEBUI: -> kind: Host
14272019/12/20 12:02:20 WEBUI: -> apiVersion: getambassador.io/v2
14282019/12/20 12:02:20 WEBUI: -> \no newline
14292019/12/20 12:02:20 WEBUI: <- host.getambassador.io/22a1d2b2.eu.ngrok.io created
14302019/12/20 12:02:20 WEBUI: /usr/bin/kubectl exited successfully
14312019/12/20 12:02:20 kubebootstrap: found 1 "Host" in namespace "*"
14322019/12/20 12:02:20 kubebootstrap: sent "Host" to 1 receivers
1433time="2019-12-20 12:02:20" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/acme-host-qualifies?hostname=22a1d2b2.eu.ngrok.io" MAIN=http REQUEST_ID=10305020130014847363 SUB=http-handler
1434time="2019-12-20 12:02:20" level=info msg="using default rule" MAIN=http REQUEST_ID=10305020130014847363 SUB=http-handler
1435time="2019-12-20 12:02:20" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=10305020130014847363 SUB=http-handler
1436time="2019-12-20 12:02:20" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (68.44µs)" MAIN=http REQUEST_ID=10305020130014847363 SUB=http-handler
14372019/12/20 12:02:20 aggregator: watch hook stderr: 2019-12-20 12:02:20 watch-hook INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
14382019/12/20 12:02:20 aggregator: watch hook stderr: 2019-12-20 12:02:20 watch-hook INFO: YAML: using C parser
14392019/12/20 12:02:20 aggregator: watch hook stderr: 2019-12-20 12:02:20 watch-hook INFO: YAML: using C dumper
14402019/12/20 12:02:20 aggregator: watch hook stderr: 2019-12-20 12:02:20 watch-hook INFO: IRTLSContext setup good: {
14412019/12/20 12:02:20 aggregator: watch hook stderr: "_active": false,
14422019/12/20 12:02:20 aggregator: watch hook stderr: "_errored": false,
14432019/12/20 12:02:20 aggregator: watch hook stderr: "_rkey": "fallback-self-signed-context.99999",
14442019/12/20 12:02:20 aggregator: watch hook stderr: "hosts": [
14452019/12/20 12:02:20 aggregator: watch hook stderr: "*"
14462019/12/20 12:02:20 aggregator: watch hook stderr: ],
14472019/12/20 12:02:20 aggregator: watch hook stderr: "kind": "IRTLSContext",
14482019/12/20 12:02:20 aggregator: watch hook stderr: "location": "-internal-",
14492019/12/20 12:02:20 aggregator: watch hook stderr: "name": "fallback-self-signed-context",
14502019/12/20 12:02:20 aggregator: watch hook stderr: "namespace": "ambassador",
14512019/12/20 12:02:20 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
14522019/12/20 12:02:20 aggregator: watch hook stderr: "secret_info": {
14532019/12/20 12:02:20 aggregator: watch hook stderr: "secret": "fallback-self-signed-cert"
14542019/12/20 12:02:20 aggregator: watch hook stderr: }
14552019/12/20 12:02:20 aggregator: watch hook stderr: }
14562019/12/20 12:02:20 aggregator: watch hook stderr: 2019-12-20 12:02:20 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
14572019/12/20 12:02:20 aggregator: watch hook stderr: 2019-12-20 12:02:20 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
14582019/12/20 12:02:20 aggregator: watch hook stderr: 2019-12-20 12:02:20 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
14592019/12/20 12:02:20 aggregator: watch hook stderr: 2019-12-20 12:02:20 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io setting up
14602019/12/20 12:02:20 aggregator: watch hook stderr: 2019-12-20 12:02:20 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
14612019/12/20 12:02:20 aggregator: watch hook stderr: 2019-12-20 12:02:20 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
14622019/12/20 12:02:20 aggregator: watch hook stderr: 2019-12-20 12:02:20 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
14632019/12/20 12:02:20 aggregator: watch hook stderr: 2019-12-20 12:02:20 watch-hook INFO: IR: watching Edge Stack; wizard allowed
14642019/12/20 12:02:20 aggregator: watch hook stderr:
14652019/12/20 12:02:20 aggregator: found 4 kubernetes watches
14662019/12/20 12:02:20 aggregator: found 0 consul watches
14672019/12/20 12:02:20 kubewatchman: processing 4 kubernetes watch specs
14682019/12/20 12:02:20 kubewatchman: add kubernetes watcher kubernetes:service|default|*|*
14692019/12/20 12:02:20 kubewatchman: add kubernetes watcher kubernetes:secret|default|*|*
14702019/12/20 12:02:20 kubernetes:service|default|*|*: starting
14712019/12/20 12:02:20 kubernetes:secret|default|*|*: starting
14722019/12/20 12:02:20 consulwatchman: processing 0 consul watches
14732019/12/20 12:02:20 notify: python /ambassador/post_update.py --watt http://localhost:8002/snapshots/7
14742019/12/20 12:02:20 kubernetes:secret|default|*|*: found 1 "secret" in namespace "default"
14752019/12/20 12:02:20 kubernetes:secret|default|*|*: sent "secret" to receivers
14762019/12/20 12:02:20 kubernetes:service|default|*|*: found 1 "service" in namespace "default"
14772019/12/20 12:02:20 kubernetes:service|default|*|*: sent "service" to receivers
14782019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_18] INFO: Update requested: watt, http://localhost:8002/snapshots/7
14792019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: copying configuration: watt, http://localhost:8002/snapshots/7 to /ambassador/snapshots/snapshot-tmp.yaml
14802019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
1481time="2019-12-20 12:02:20" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=8991251094923013534 SUB=http-handler
1482time="2019-12-20 12:02:20" level=info msg="using default rule" MAIN=http REQUEST_ID=8991251094923013534 SUB=http-handler
1483time="2019-12-20 12:02:20" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=8991251094923013534 SUB=http-handler
1484time="2019-12-20 12:02:20" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (57.691µs)" MAIN=http REQUEST_ID=8991251094923013534 SUB=http-handler
14852019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_7] INFO: B8EB8148-3579-4568-A712-2D90B0AE44BA: 127.0.0.1 "GET /ambassador/v0/diag/" START
14862019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IRTLSContext setup good: {
1487 "_active": false,
1488 "_errored": false,
1489 "_rkey": "fallback-self-signed-context.99999",
1490 "hosts": [
1491 "*"
1492 ],
1493 "kind": "IRTLSContext",
1494 "location": "-internal-",
1495 "name": "fallback-self-signed-context",
1496 "namespace": "ambassador",
1497 "redirect_cleartext_from": 8080,
1498 "secret_info": {
1499 "secret": "fallback-self-signed-cert"
1500 }
1501}
15022019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
15032019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
15042019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
15052019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io setting up
15062019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
15072019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
15082019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
15092019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_7] INFO: DEBUG_MODE False
1510status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
15112019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_7] INFO: B8EB8148-3579-4568-A712-2D90B0AE44BA: 127.0.0.1 "GET /ambassador/v0/diag/" 16ms 200 success
15122019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IR: starting Edge Stack; wizard allowed
15132019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: ctx fallback-self-signed-context is the primary termination context
15142019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: creating redirect listener on 8080
15152019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: Using log_format 'ACCESS [%START_TIME%] "%REQ(:METHOD)% %REQ(X-ENVOY-ORIGINAL-PATH?:PATH)% %PROTOCOL%" %RESPONSE_CODE% %RESPONSE_FLAGS% %BYTES_RECEIVED% %BYTES_SENT% %DURATION% %RESP(X-ENVOY-UPSTREAM-SERVICE-TIME)% "%REQ(X-FORWARDED-FOR)%" "%REQ(USER-AGENT)%" "%REQ(X-REQUEST-ID)%" "%REQ(:AUTHORITY)%" "%UPSTREAM_HOST%"'
15162019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI (1) route check fallback-self-signed-context - ['*']
15172019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
1518[
1519 {
1520 "ctx_hosts": [
1521 "*"
1522 ],
1523 "ctx_name": "fallback-self-signed-context",
1524 "filter_chain_match": {
1525 "transport_protocol": "tls"
1526 },
1527 "route_count": 9
1528 }
1529]
15302019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
15312019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
1532[
1533 {
1534 "ctx_hosts": [
1535 "*"
1536 ],
1537 "ctx_name": "fallback-self-signed-context",
1538 "filter_chain_match": {
1539 "transport_protocol": "tls"
1540 },
1541 "route_count": 9
1542 },
1543 {
1544 "ctx_hosts": [
1545 "*"
1546 ],
1547 "ctx_name": "-cleartext-",
1548 "filter_chain_match": {},
1549 "route_count": 9
1550 }
1551]
15522019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: enabling TLS inspector
15532019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: no filter chains, need cleartext
15542019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
15552019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
1556[
1557 {
1558 "ctx_hosts": [
1559 "*"
1560 ],
1561 "ctx_name": "-cleartext-",
1562 "filter_chain_match": {},
1563 "route_count": 1
1564 }
1565]
15662019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: leaving TLS inspector disabled
15672019-12-20 12:02:20 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: -global-: NOTICE: A future Ambassador version will change the GRPC protocol version for AuthServices and RateLimitServices. See the CHANGELOG for details.
15682019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: successfully validated the resulting envoy configuration, continuing...
15692019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: saving Envoy configuration for snapshot 7
15702019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: running 'kill -HUP 1'
1571KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal-api.ambassador
1572KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal.ambassador
1573KubeStatus MASTER 306: mark_live Mapping/ambassador-edge-stack.ambassador
1574KubeStatus MASTER 306: mark_live Mapping/edgestack-direct-mapping.ambassador
1575KubeStatus MASTER 306: mark_live Mapping/edgestack-fallback-mapping.ambassador
1576KubeStatus MASTER 306: mark_live Mapping/httpbin.default
15772019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal-api.ambassador, {"state": "Running"}...
1578KubeStatus MASTER 306: Mapping/ambassador-devportal-api.ambassador == {"state": "Running"}
15792019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal.ambassador, {"state": "Running"}...
1580KubeStatus MASTER 306: Mapping/ambassador-devportal.ambassador == {"state": "Running"}
15812019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-edge-stack.ambassador, {"state": "Running"}...
1582KubeStatus MASTER 306: Mapping/ambassador-edge-stack.ambassador == {"state": "Running"}
15832019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-direct-mapping.ambassador, {"state": "Running"}...
1584KubeStatus MASTER 306: Mapping/edgestack-direct-mapping.ambassador == {"state": "Running"}
15852019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-fallback-mapping.ambassador, {"state": "Running"}...
1586KubeStatus MASTER 306: Mapping/edgestack-fallback-mapping.ambassador == {"state": "Running"}
15872019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping httpbin.default, {"state": "Running"}...
1588KubeStatus MASTER 306: Mapping/httpbin.default == {"state": "Running"}
15892019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: configuration updated from snapshot 7
15902019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout reports {"latest_version": "1.0.0", "application": "aes", "cached": true, "timestamp": 1576843276.535808}
15912019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout notices: [{"level": "DEBUG", "message": "Returning cached result"}, {"level": "INFO", "message": "Upgrade available! to Ambassador version 1.0.0"}]
1592time="2019-12-20T12:02:21Z" level=info msg="Loaded file /ambassador/envoy/envoy.json"
1593time="2019-12-20 12:02:21" level=info msg="Event(v1.ObjectReference{Kind:\"Host\", Namespace:\"default\", Name:\"22a1d2b2.eu.ngrok.io\", UID:\"9f3b6565-0d4d-45c1-901c-d690aa83d4b0\", APIVersion:\"getambassador.io/v2\", ResourceVersion:\"811\", FieldPath:\"\"}): type: 'Normal' reason: 'Pending' waiting for Host DefaultsFilled change to be reflected in snapshot" MAIN=event-broadcaster event-namespace=default
1594E1220 12:02:21.018667 324 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"22a1d2b2.eu.ngrok.io.15e212aa07cf25ec", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Host", Namespace:"default", Name:"22a1d2b2.eu.ngrok.io", UID:"9f3b6565-0d4d-45c1-901c-d690aa83d4b0", APIVersion:"getambassador.io/v2", ResourceVersion:"811", FieldPath:""}, Reason:"Pending", Message:"waiting for Host DefaultsFilled change to be reflected in snapshot", Source:v1.EventSource{Component:"Ambassador Edge Stack", Host:"ambassador-544fbbf997-rttjd"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf3411063ec, ext:66459312892, loc:(*time.Location)(0x2c744a0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf3411063ec, ext:66459312892, loc:(*time.Location)(0x2c744a0)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events is forbidden: User "system:serviceaccount:ambassador:ambassador" cannot create resource "events" in API group "" in the namespace "default"' (will not retry!)
15952019/12/20 12:02:21 kubebootstrap: found 1 "Host" in namespace "*"
15962019/12/20 12:02:21 kubebootstrap: sent "Host" to 1 receivers
1597time="2019-12-20T12:02:21Z" level=info msg="Pushing snapshot v7"
1598[2019-12-20 12:02:21.025][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1599[2019-12-20 12:02:21.025][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1600[2019-12-20 12:02:21.025][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1601[2019-12-20 12:02:21.026][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1602[2019-12-20 12:02:21.026][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1603[2019-12-20 12:02:21.026][406][info][upstream] [source/common/upstream/cds_api_impl.cc:67] cds: add 4 cluster(s), remove 1 cluster(s)
1604time="2019-12-20 12:02:21" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=16650143366614345693 SUB=http-handler
1605time="2019-12-20 12:02:21" level=info msg="using default rule" MAIN=http REQUEST_ID=16650143366614345693 SUB=http-handler
1606time="2019-12-20 12:02:21" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=16650143366614345693 SUB=http-handler
1607time="2019-12-20 12:02:21" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (61.1µs)" MAIN=http REQUEST_ID=16650143366614345693 SUB=http-handler
16082019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_11] INFO: 99B546D1-B809-4B44-960D-EF4BCB59B7BC: 127.0.0.1 "GET /ambassador/v0/diag/" START
16092019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_11] INFO: DEBUG_MODE False
1610status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
16112019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_11] INFO: 99B546D1-B809-4B44-960D-EF4BCB59B7BC: 127.0.0.1 "GET /ambassador/v0/diag/" 15ms 200 success
16122019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
16132019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: YAML: using C parser
16142019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: YAML: using C dumper
16152019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: IRTLSContext setup good: {
16162019/12/20 12:02:21 aggregator: watch hook stderr: "_active": false,
16172019/12/20 12:02:21 aggregator: watch hook stderr: "_errored": false,
16182019/12/20 12:02:21 aggregator: watch hook stderr: "_rkey": "fallback-self-signed-context.99999",
16192019/12/20 12:02:21 aggregator: watch hook stderr: "hosts": [
16202019/12/20 12:02:21 aggregator: watch hook stderr: "*"
16212019/12/20 12:02:21 aggregator: watch hook stderr: ],
16222019/12/20 12:02:21 aggregator: watch hook stderr: "kind": "IRTLSContext",
16232019/12/20 12:02:21 aggregator: watch hook stderr: "location": "-internal-",
16242019/12/20 12:02:21 aggregator: watch hook stderr: "name": "fallback-self-signed-context",
16252019/12/20 12:02:21 aggregator: watch hook stderr: "namespace": "ambassador",
16262019/12/20 12:02:21 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
16272019/12/20 12:02:21 aggregator: watch hook stderr: "secret_info": {
16282019/12/20 12:02:21 aggregator: watch hook stderr: "secret": "fallback-self-signed-cert"
16292019/12/20 12:02:21 aggregator: watch hook stderr: }
16302019/12/20 12:02:21 aggregator: watch hook stderr: }
16312019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
16322019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
16332019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
16342019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io setting up
16352019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
16362019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
16372019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
16382019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: IR: watching Edge Stack; wizard allowed
16392019/12/20 12:02:21 aggregator: watch hook stderr:
16402019/12/20 12:02:21 aggregator: found 4 kubernetes watches
16412019/12/20 12:02:21 aggregator: found 0 consul watches
16422019/12/20 12:02:21 kubewatchman: processing 4 kubernetes watch specs
16432019/12/20 12:02:21 consulwatchman: processing 0 consul watches
16442019/12/20 12:02:21 notify: python /ambassador/post_update.py --watt http://localhost:8002/snapshots/8
1645time="2019-12-20 12:02:21" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /openapi/services" MAIN=http REQUEST_ID=18241137211192417264 SUB=http-handler
1646time="2019-12-20 12:02:21" level=info msg="using default rule" MAIN=http REQUEST_ID=18241137211192417264 SUB=http-handler
1647time="2019-12-20 12:02:21" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=18241137211192417264 SUB=http-handler
1648time="2019-12-20 12:02:21" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (63.06µs)" MAIN=http REQUEST_ID=18241137211192417264 SUB=http-handler
1649time="2019-12-20 12:02:21" level=info msg="HTTP request" method=GET request=/openapi/services status_code=200 subsystem=server
16502019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_1] INFO: Update requested: watt, http://localhost:8002/snapshots/8
16512019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: copying configuration: watt, http://localhost:8002/snapshots/8 to /ambassador/snapshots/snapshot-tmp.yaml
16522019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
1653time="2019-12-20 12:02:21" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/tos-url?ca-url=https%3A%2F%2Facme-v02.api.letsencrypt.org%2Fdirectory" MAIN=http REQUEST_ID=2508151359755956749 SUB=http-handler
1654time="2019-12-20 12:02:21" level=info msg="using default rule" MAIN=http REQUEST_ID=2508151359755956749 SUB=http-handler
1655time="2019-12-20 12:02:21" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=2508151359755956749 SUB=http-handler
1656time="2019-12-20 12:02:21" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (72.981µs)" MAIN=http REQUEST_ID=2508151359755956749 SUB=http-handler
16572019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IRTLSContext setup good: {
1658 "_active": false,
1659 "_errored": false,
1660 "_rkey": "fallback-self-signed-context.99999",
1661 "hosts": [
1662 "*"
1663 ],
1664 "kind": "IRTLSContext",
1665 "location": "-internal-",
1666 "name": "fallback-self-signed-context",
1667 "namespace": "ambassador",
1668 "redirect_cleartext_from": 8080,
1669 "secret_info": {
1670 "secret": "fallback-self-signed-cert"
1671 }
1672}
16732019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
16742019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
16752019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
16762019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io setting up
16772019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io: TLS secret name is 22a1d2b2.eu.ngrok.io
16782019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: no secret_info, asking handler to load
16792019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: Secret 22a1d2b2.eu.ngrok.io.default unknown
16802019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: Host 22a1d2b2.eu.ngrok.io: continuing with invalid TLS secret 22a1d2b2.eu.ngrok.io
16812019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
16822019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
16832019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
16842019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IR: starting Edge Stack; wizard allowed
16852019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: ctx fallback-self-signed-context is the primary termination context
16862019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: creating redirect listener on 8080
16872019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: Using log_format 'ACCESS [%START_TIME%] "%REQ(:METHOD)% %REQ(X-ENVOY-ORIGINAL-PATH?:PATH)% %PROTOCOL%" %RESPONSE_CODE% %RESPONSE_FLAGS% %BYTES_RECEIVED% %BYTES_SENT% %DURATION% %RESP(X-ENVOY-UPSTREAM-SERVICE-TIME)% "%REQ(X-FORWARDED-FOR)%" "%REQ(USER-AGENT)%" "%REQ(X-REQUEST-ID)%" "%REQ(:AUTHORITY)%" "%UPSTREAM_HOST%"'
16882019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI (1) route check fallback-self-signed-context - ['*']
16892019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
1690[
1691 {
1692 "ctx_hosts": [
1693 "*"
1694 ],
1695 "ctx_name": "fallback-self-signed-context",
1696 "filter_chain_match": {
1697 "transport_protocol": "tls"
1698 },
1699 "route_count": 9
1700 }
1701]
17022019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
17032019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
1704[
1705 {
1706 "ctx_hosts": [
1707 "*"
1708 ],
1709 "ctx_name": "fallback-self-signed-context",
1710 "filter_chain_match": {
1711 "transport_protocol": "tls"
1712 },
1713 "route_count": 9
1714 },
1715 {
1716 "ctx_hosts": [
1717 "*"
1718 ],
1719 "ctx_name": "-cleartext-",
1720 "filter_chain_match": {},
1721 "route_count": 9
1722 }
1723]
17242019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: enabling TLS inspector
17252019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: no filter chains, need cleartext
17262019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
17272019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
1728[
1729 {
1730 "ctx_hosts": [
1731 "*"
1732 ],
1733 "ctx_name": "-cleartext-",
1734 "filter_chain_match": {},
1735 "route_count": 1
1736 }
1737]
17382019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: leaving TLS inspector disabled
17392019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: -global-: NOTICE: A future Ambassador version will change the GRPC protocol version for AuthServices and RateLimitServices. See the CHANGELOG for details.
1740time="2019-12-20 12:02:21" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/acme-host-qualifies?hostname=22a1d2b2.eu.ngrok.io" MAIN=http REQUEST_ID=7240829073065432701 SUB=http-handler
1741time="2019-12-20 12:02:21" level=info msg="using default rule" MAIN=http REQUEST_ID=7240829073065432701 SUB=http-handler
1742time="2019-12-20 12:02:21" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=7240829073065432701 SUB=http-handler
1743time="2019-12-20 12:02:21" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (75.23µs)" MAIN=http REQUEST_ID=7240829073065432701 SUB=http-handler
17442019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: successfully validated the resulting envoy configuration, continuing...
17452019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: saving Envoy configuration for snapshot 8
17462019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: running 'kill -HUP 1'
1747KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal-api.ambassador
1748KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal.ambassador
1749KubeStatus MASTER 306: mark_live Mapping/ambassador-edge-stack.ambassador
1750KubeStatus MASTER 306: mark_live Mapping/edgestack-direct-mapping.ambassador
1751KubeStatus MASTER 306: mark_live Mapping/edgestack-fallback-mapping.ambassador
1752KubeStatus MASTER 306: mark_live Mapping/httpbin.default
17532019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal-api.ambassador, {"state": "Running"}...
1754KubeStatus MASTER 306: Mapping/ambassador-devportal-api.ambassador == {"state": "Running"}
17552019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal.ambassador, {"state": "Running"}...
1756KubeStatus MASTER 306: Mapping/ambassador-devportal.ambassador == {"state": "Running"}
17572019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-edge-stack.ambassador, {"state": "Running"}...
1758KubeStatus MASTER 306: Mapping/ambassador-edge-stack.ambassador == {"state": "Running"}
17592019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-direct-mapping.ambassador, {"state": "Running"}...
1760KubeStatus MASTER 306: Mapping/edgestack-direct-mapping.ambassador == {"state": "Running"}
17612019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-fallback-mapping.ambassador, {"state": "Running"}...
1762KubeStatus MASTER 306: Mapping/edgestack-fallback-mapping.ambassador == {"state": "Running"}
17632019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping httpbin.default, {"state": "Running"}...
1764KubeStatus MASTER 306: Mapping/httpbin.default == {"state": "Running"}
17652019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: configuration updated from snapshot 8
17662019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout reports {"latest_version": "1.0.0", "application": "aes", "cached": true, "timestamp": 1576843276.535808}
17672019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout notices: [{"level": "DEBUG", "message": "Returning cached result"}, {"level": "INFO", "message": "Upgrade available! to Ambassador version 1.0.0"}]
1768time="2019-12-20 12:02:21" level=info msg="Event(v1.ObjectReference{Kind:\"Host\", Namespace:\"default\", Name:\"22a1d2b2.eu.ngrok.io\", UID:\"9f3b6565-0d4d-45c1-901c-d690aa83d4b0\", APIVersion:\"getambassador.io/v2\", ResourceVersion:\"812\", FieldPath:\"\"}): type: 'Normal' reason: 'Pending' creating private key Secret" MAIN=event-broadcaster event-namespace=default
1769time="2019-12-20T12:02:21Z" level=info msg="Loaded file /ambassador/envoy/envoy.json"
1770E1220 12:02:21.422073 324 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"22a1d2b2.eu.ngrok.io.15e212aa1fd772c6", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Host", Namespace:"default", Name:"22a1d2b2.eu.ngrok.io", UID:"9f3b6565-0d4d-45c1-901c-d690aa83d4b0", APIVersion:"getambassador.io/v2", ResourceVersion:"812", FieldPath:""}, Reason:"Pending", Message:"creating private key Secret", Source:v1.EventSource{Component:"Ambassador Edge Stack", Host:"ambassador-544fbbf997-rttjd"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf35918b0c6, ext:66862510048, loc:(*time.Location)(0x2c744a0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf35918b0c6, ext:66862510048, loc:(*time.Location)(0x2c744a0)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events is forbidden: User "system:serviceaccount:ambassador:ambassador" cannot create resource "events" in API group "" in the namespace "default"' (will not retry!)
1771time="2019-12-20 12:02:21" level=info msg="Event(v1.ObjectReference{Kind:\"Host\", Namespace:\"default\", Name:\"22a1d2b2.eu.ngrok.io\", UID:\"9f3b6565-0d4d-45c1-901c-d690aa83d4b0\", APIVersion:\"getambassador.io/v2\", ResourceVersion:\"812\", FieldPath:\"\"}): type: 'Normal' reason: 'Pending' waiting for private key Secret creation to be reflected in snapshot" MAIN=event-broadcaster event-namespace=default
1772E1220 12:02:21.425027 324 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"22a1d2b2.eu.ngrok.io.15e212aa200bd137", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Host", Namespace:"default", Name:"22a1d2b2.eu.ngrok.io", UID:"9f3b6565-0d4d-45c1-901c-d690aa83d4b0", APIVersion:"getambassador.io/v2", ResourceVersion:"812", FieldPath:""}, Reason:"Pending", Message:"waiting for private key Secret creation to be reflected in snapshot", Source:v1.EventSource{Component:"Ambassador Edge Stack", Host:"ambassador-544fbbf997-rttjd"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf3594d0f37, ext:66865942077, loc:(*time.Location)(0x2c744a0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf3594d0f37, ext:66865942077, loc:(*time.Location)(0x2c744a0)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events is forbidden: User "system:serviceaccount:ambassador:ambassador" cannot create resource "events" in API group "" in the namespace "default"' (will not retry!)
17732019/12/20 12:02:21 kubernetes:secret|default|*|*: found 2 "secret" in namespace "default"
17742019/12/20 12:02:21 kubernetes:secret|default|*|*: sent "secret" to receivers
1775time="2019-12-20T12:02:21Z" level=info msg="Pushing snapshot v8"
1776[2019-12-20 12:02:21.434][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1777[2019-12-20 12:02:21.434][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1778[2019-12-20 12:02:21.434][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1779[2019-12-20 12:02:21.434][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1780[2019-12-20 12:02:21.435][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1781[2019-12-20 12:02:21.435][406][info][upstream] [source/common/upstream/cds_api_impl.cc:67] cds: add 4 cluster(s), remove 1 cluster(s)
17822019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
17832019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: YAML: using C parser
17842019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: YAML: using C dumper
17852019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: IRTLSContext setup good: {
17862019/12/20 12:02:21 aggregator: watch hook stderr: "_active": false,
17872019/12/20 12:02:21 aggregator: watch hook stderr: "_errored": false,
17882019/12/20 12:02:21 aggregator: watch hook stderr: "_rkey": "fallback-self-signed-context.99999",
17892019/12/20 12:02:21 aggregator: watch hook stderr: "hosts": [
17902019/12/20 12:02:21 aggregator: watch hook stderr: "*"
17912019/12/20 12:02:21 aggregator: watch hook stderr: ],
17922019/12/20 12:02:21 aggregator: watch hook stderr: "kind": "IRTLSContext",
17932019/12/20 12:02:21 aggregator: watch hook stderr: "location": "-internal-",
17942019/12/20 12:02:21 aggregator: watch hook stderr: "name": "fallback-self-signed-context",
17952019/12/20 12:02:21 aggregator: watch hook stderr: "namespace": "ambassador",
17962019/12/20 12:02:21 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
17972019/12/20 12:02:21 aggregator: watch hook stderr: "secret_info": {
17982019/12/20 12:02:21 aggregator: watch hook stderr: "secret": "fallback-self-signed-cert"
17992019/12/20 12:02:21 aggregator: watch hook stderr: }
18002019/12/20 12:02:21 aggregator: watch hook stderr: }
18012019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
18022019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
18032019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
18042019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io setting up
18052019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io: TLS secret name is 22a1d2b2.eu.ngrok.io
18062019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: no secret_info, asking handler to load
18072019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: found secret, asking handler to cache
18082019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io: creating TLSContext 22a1d2b2.eu.ngrok.io-context
18092019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: IRTLSContext setup good: {
18102019/12/20 12:02:21 aggregator: watch hook stderr: "_active": false,
18112019/12/20 12:02:21 aggregator: watch hook stderr: "_errored": false,
18122019/12/20 12:02:21 aggregator: watch hook stderr: "_rkey": "22a1d2b2.eu.ngrok.io.default.1",
18132019/12/20 12:02:21 aggregator: watch hook stderr: "hosts": [
18142019/12/20 12:02:21 aggregator: watch hook stderr: "22a1d2b2.eu.ngrok.io"
18152019/12/20 12:02:21 aggregator: watch hook stderr: ],
18162019/12/20 12:02:21 aggregator: watch hook stderr: "kind": "IRTLSContext",
18172019/12/20 12:02:21 aggregator: watch hook stderr: "location": "22a1d2b2.eu.ngrok.io.default.1",
18182019/12/20 12:02:21 aggregator: watch hook stderr: "name": "22a1d2b2.eu.ngrok.io-context",
18192019/12/20 12:02:21 aggregator: watch hook stderr: "namespace": "default",
18202019/12/20 12:02:21 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
18212019/12/20 12:02:21 aggregator: watch hook stderr: "secret_info": {
18222019/12/20 12:02:21 aggregator: watch hook stderr: "secret": "22a1d2b2.eu.ngrok.io"
18232019/12/20 12:02:21 aggregator: watch hook stderr: }
18242019/12/20 12:02:21 aggregator: watch hook stderr: }
18252019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io: ACME private key name is https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com
18262019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: resolve_secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default: no secret_info, asking handler to load
18272019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: resolve_secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default: found secret, asking handler to cache
18282019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
18292019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
18302019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
18312019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: TLSContext.resolve_secret 22a1d2b2.eu.ngrok.io, namespace default: namespacing is True
18322019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: resolve_secret 22a1d2b2.eu.ngrok.io: using cached SavedSecret
18332019/12/20 12:02:21 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: IR: watching Edge Stack; wizard allowed
18342019/12/20 12:02:21 aggregator: watch hook stderr:
18352019/12/20 12:02:21 aggregator: found 7 kubernetes watches
18362019/12/20 12:02:21 aggregator: found 0 consul watches
18372019/12/20 12:02:21 kubewatchman: processing 7 kubernetes watch specs
18382019/12/20 12:02:21 kubewatchman: add kubernetes watcher kubernetes:service|default|*|hostname=22a1d2b2.eu.ngrok.io
18392019/12/20 12:02:21 kubewatchman: add kubernetes watcher kubernetes:secret|default|*|hostname=22a1d2b2.eu.ngrok.io
18402019/12/20 12:02:21 kubewatchman: add kubernetes watcher kubernetes:secret|default|metadata.name=22a1d2b2.eu.ngrok.io|*
18412019/12/20 12:02:21 kubewatchman: add kubernetes watcher kubernetes:secret|default|metadata.name=https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com|*
18422019/12/20 12:02:21 kubewatchman: add kubernetes watcher kubernetes:secret|eu.ngrok.io|metadata.name=22a1d2b2|*
18432019/12/20 12:02:21 kubewatchman: remove kubernetes watcher kubernetes:secret|default|*|*
18442019/12/20 12:02:21 kubernetes:secret|default|*|*: signaling shutdown
18452019/12/20 12:02:21 kubernetes:service|default|*|hostname=22a1d2b2.eu.ngrok.io: starting
18462019/12/20 12:02:21 kubernetes:secret|default|*|hostname=22a1d2b2.eu.ngrok.io: starting
18472019/12/20 12:02:21 kubernetes:secret|default|metadata.name=22a1d2b2.eu.ngrok.io|*: starting
18482019/12/20 12:02:21 kubernetes:secret|default|metadata.name=https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com|*: starting
18492019/12/20 12:02:21 kubernetes:secret|eu.ngrok.io|metadata.name=22a1d2b2|*: starting
18502019/12/20 12:02:21 consulwatchman: processing 0 consul watches
18512019/12/20 12:02:21 kubernetes:secret|default|*|*: exited
18522019/12/20 12:02:21 kubewatchman: remove kubernetes watcher kubernetes:service|default|*|*
18532019/12/20 12:02:21 kubernetes:service|default|*|*: signaling shutdown
18542019/12/20 12:02:21 kubernetes:service|default|*|*: exited
18552019/12/20 12:02:21 notify: python /ambassador/post_update.py --watt http://localhost:8002/snapshots/9
18562019/12/20 12:02:21 kubernetes:service|default|*|hostname=22a1d2b2.eu.ngrok.io: found 0 "service" in namespace "default"
18572019/12/20 12:02:21 kubernetes:service|default|*|hostname=22a1d2b2.eu.ngrok.io: sent "service" to receivers
18582019/12/20 12:02:21 kubernetes:secret|eu.ngrok.io|metadata.name=22a1d2b2|*: found 0 "secret" in namespace "eu.ngrok.io"
18592019/12/20 12:02:21 kubernetes:secret|eu.ngrok.io|metadata.name=22a1d2b2|*: sent "secret" to receivers
18602019/12/20 12:02:21 kubernetes:secret|default|metadata.name=22a1d2b2.eu.ngrok.io|*: found 0 "secret" in namespace "default"
18612019/12/20 12:02:21 kubernetes:secret|default|metadata.name=22a1d2b2.eu.ngrok.io|*: sent "secret" to receivers
18622019/12/20 12:02:21 kubernetes:secret|default|metadata.name=https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com|*: found 1 "secret" in namespace "default"
18632019/12/20 12:02:21 kubernetes:secret|default|metadata.name=https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com|*: sent "secret" to receivers
18642019/12/20 12:02:21 kubernetes:secret|default|*|hostname=22a1d2b2.eu.ngrok.io: found 0 "secret" in namespace "default"
18652019/12/20 12:02:21 kubernetes:secret|default|*|hostname=22a1d2b2.eu.ngrok.io: sent "secret" to receivers
18662019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_3] INFO: Update requested: watt, http://localhost:8002/snapshots/9
18672019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: copying configuration: watt, http://localhost:8002/snapshots/9 to /ambassador/snapshots/snapshot-tmp.yaml
18682019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
18692019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IRTLSContext setup good: {
1870 "_active": false,
1871 "_errored": false,
1872 "_rkey": "fallback-self-signed-context.99999",
1873 "hosts": [
1874 "*"
1875 ],
1876 "kind": "IRTLSContext",
1877 "location": "-internal-",
1878 "name": "fallback-self-signed-context",
1879 "namespace": "ambassador",
1880 "redirect_cleartext_from": 8080,
1881 "secret_info": {
1882 "secret": "fallback-self-signed-cert"
1883 }
1884}
18852019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
18862019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
18872019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
18882019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io setting up
18892019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io: TLS secret name is 22a1d2b2.eu.ngrok.io
18902019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: no secret_info, asking handler to load
18912019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: Secret 22a1d2b2.eu.ngrok.io.default unknown
18922019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: Host 22a1d2b2.eu.ngrok.io: continuing with invalid TLS secret 22a1d2b2.eu.ngrok.io
18932019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
18942019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
18952019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
18962019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IR: starting Edge Stack; wizard allowed
18972019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: ctx fallback-self-signed-context is the primary termination context
18982019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: creating redirect listener on 8080
18992019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: Using log_format 'ACCESS [%START_TIME%] "%REQ(:METHOD)% %REQ(X-ENVOY-ORIGINAL-PATH?:PATH)% %PROTOCOL%" %RESPONSE_CODE% %RESPONSE_FLAGS% %BYTES_RECEIVED% %BYTES_SENT% %DURATION% %RESP(X-ENVOY-UPSTREAM-SERVICE-TIME)% "%REQ(X-FORWARDED-FOR)%" "%REQ(USER-AGENT)%" "%REQ(X-REQUEST-ID)%" "%REQ(:AUTHORITY)%" "%UPSTREAM_HOST%"'
19002019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI (1) route check fallback-self-signed-context - ['*']
19012019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
1902[
1903 {
1904 "ctx_hosts": [
1905 "*"
1906 ],
1907 "ctx_name": "fallback-self-signed-context",
1908 "filter_chain_match": {
1909 "transport_protocol": "tls"
1910 },
1911 "route_count": 9
1912 }
1913]
19142019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
19152019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
1916[
1917 {
1918 "ctx_hosts": [
1919 "*"
1920 ],
1921 "ctx_name": "fallback-self-signed-context",
1922 "filter_chain_match": {
1923 "transport_protocol": "tls"
1924 },
1925 "route_count": 9
1926 },
1927 {
1928 "ctx_hosts": [
1929 "*"
1930 ],
1931 "ctx_name": "-cleartext-",
1932 "filter_chain_match": {},
1933 "route_count": 9
1934 }
1935]
19362019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: enabling TLS inspector
19372019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: no filter chains, need cleartext
19382019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
19392019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
1940[
1941 {
1942 "ctx_hosts": [
1943 "*"
1944 ],
1945 "ctx_name": "-cleartext-",
1946 "filter_chain_match": {},
1947 "route_count": 1
1948 }
1949]
19502019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: leaving TLS inspector disabled
19512019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: -global-: NOTICE: A future Ambassador version will change the GRPC protocol version for AuthServices and RateLimitServices. See the CHANGELOG for details.
19522019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: successfully validated the resulting envoy configuration, continuing...
19532019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: saving Envoy configuration for snapshot 9
19542019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: running 'kill -HUP 1'
1955KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal-api.ambassador
1956KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal.ambassador
1957KubeStatus MASTER 306: mark_live Mapping/ambassador-edge-stack.ambassador
1958KubeStatus MASTER 306: mark_live Mapping/edgestack-direct-mapping.ambassador
1959KubeStatus MASTER 306: mark_live Mapping/edgestack-fallback-mapping.ambassador
1960KubeStatus MASTER 306: mark_live Mapping/httpbin.default
19612019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal-api.ambassador, {"state": "Running"}...
1962KubeStatus MASTER 306: Mapping/ambassador-devportal-api.ambassador == {"state": "Running"}
19632019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal.ambassador, {"state": "Running"}...
1964KubeStatus MASTER 306: Mapping/ambassador-devportal.ambassador == {"state": "Running"}
19652019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-edge-stack.ambassador, {"state": "Running"}...
1966KubeStatus MASTER 306: Mapping/ambassador-edge-stack.ambassador == {"state": "Running"}
19672019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-direct-mapping.ambassador, {"state": "Running"}...
1968KubeStatus MASTER 306: Mapping/edgestack-direct-mapping.ambassador == {"state": "Running"}
19692019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-fallback-mapping.ambassador, {"state": "Running"}...
1970KubeStatus MASTER 306: Mapping/edgestack-fallback-mapping.ambassador == {"state": "Running"}
19712019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping httpbin.default, {"state": "Running"}...
1972KubeStatus MASTER 306: Mapping/httpbin.default == {"state": "Running"}
19732019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: configuration updated from snapshot 9
19742019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout reports {"latest_version": "1.0.0", "application": "aes", "cached": true, "timestamp": 1576843276.535808}
19752019-12-20 12:02:21 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout notices: [{"level": "DEBUG", "message": "Returning cached result"}, {"level": "INFO", "message": "Upgrade available! to Ambassador version 1.0.0"}]
1976time="2019-12-20T12:02:21Z" level=info msg="Loaded file /ambassador/envoy/envoy.json"
1977time="2019-12-20 12:02:21" level=info msg="Event(v1.ObjectReference{Kind:\"Host\", Namespace:\"default\", Name:\"22a1d2b2.eu.ngrok.io\", UID:\"9f3b6565-0d4d-45c1-901c-d690aa83d4b0\", APIVersion:\"getambassador.io/v2\", ResourceVersion:\"812\", FieldPath:\"\"}): type: 'Normal' reason: 'Pending' waiting for Host status change to be reflected in snapshot" MAIN=event-broadcaster event-namespace=default
1978E1220 12:02:21.883747 324 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"22a1d2b2.eu.ngrok.io.15e212aa3b617439", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Host", Namespace:"default", Name:"22a1d2b2.eu.ngrok.io", UID:"9f3b6565-0d4d-45c1-901c-d690aa83d4b0", APIVersion:"getambassador.io/v2", ResourceVersion:"812", FieldPath:""}, Reason:"Pending", Message:"waiting for Host status change to be reflected in snapshot", Source:v1.EventSource{Component:"Ambassador Edge Stack", Host:"ambassador-544fbbf997-rttjd"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf374a2b239, ext:67324539209, loc:(*time.Location)(0x2c744a0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf374a2b239, ext:67324539209, loc:(*time.Location)(0x2c744a0)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events is forbidden: User "system:serviceaccount:ambassador:ambassador" cannot create resource "events" in API group "" in the namespace "default"' (will not retry!)
19792019/12/20 12:02:21 kubebootstrap: found 1 "Host" in namespace "*"
19802019/12/20 12:02:21 kubebootstrap: sent "Host" to 1 receivers
1981time="2019-12-20T12:02:21Z" level=info msg="Pushing snapshot v9"
1982[2019-12-20 12:02:21.892][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1983[2019-12-20 12:02:21.892][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1984[2019-12-20 12:02:21.892][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1985[2019-12-20 12:02:21.893][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1986[2019-12-20 12:02:21.893][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
1987[2019-12-20 12:02:21.893][406][info][upstream] [source/common/upstream/cds_api_impl.cc:67] cds: add 4 cluster(s), remove 1 cluster(s)
1988time="2019-12-20 12:02:22" level=info msg="HTTP CLIENT: NET: \"GET\" \"https://acme-v02.api.letsencrypt.org/directory\" => HTTP 200 (690.603168ms)" MAIN=http SUB=http-server/handler
19892019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
19902019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: YAML: using C parser
19912019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:21 watch-hook INFO: YAML: using C dumper
19922019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: IRTLSContext setup good: {
19932019/12/20 12:02:22 aggregator: watch hook stderr: "_active": false,
19942019/12/20 12:02:22 aggregator: watch hook stderr: "_errored": false,
19952019/12/20 12:02:22 aggregator: watch hook stderr: "_rkey": "fallback-self-signed-context.99999",
19962019/12/20 12:02:22 aggregator: watch hook stderr: "hosts": [
19972019/12/20 12:02:22 aggregator: watch hook stderr: "*"
19982019/12/20 12:02:22 aggregator: watch hook stderr: ],
19992019/12/20 12:02:22 aggregator: watch hook stderr: "kind": "IRTLSContext",
20002019/12/20 12:02:22 aggregator: watch hook stderr: "location": "-internal-",
20012019/12/20 12:02:22 aggregator: watch hook stderr: "name": "fallback-self-signed-context",
20022019/12/20 12:02:22 aggregator: watch hook stderr: "namespace": "ambassador",
20032019/12/20 12:02:22 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
20042019/12/20 12:02:22 aggregator: watch hook stderr: "secret_info": {
20052019/12/20 12:02:22 aggregator: watch hook stderr: "secret": "fallback-self-signed-cert"
20062019/12/20 12:02:22 aggregator: watch hook stderr: }
20072019/12/20 12:02:22 aggregator: watch hook stderr: }
20082019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
20092019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
20102019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
20112019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io setting up
20122019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io: TLS secret name is 22a1d2b2.eu.ngrok.io
20132019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: no secret_info, asking handler to load
20142019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: found secret, asking handler to cache
20152019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io: creating TLSContext 22a1d2b2.eu.ngrok.io-context
20162019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: IRTLSContext setup good: {
20172019/12/20 12:02:22 aggregator: watch hook stderr: "_active": false,
20182019/12/20 12:02:22 aggregator: watch hook stderr: "_errored": false,
20192019/12/20 12:02:22 aggregator: watch hook stderr: "_rkey": "22a1d2b2.eu.ngrok.io.default.1",
20202019/12/20 12:02:22 aggregator: watch hook stderr: "hosts": [
20212019/12/20 12:02:22 aggregator: watch hook stderr: "22a1d2b2.eu.ngrok.io"
20222019/12/20 12:02:22 aggregator: watch hook stderr: ],
20232019/12/20 12:02:22 aggregator: watch hook stderr: "kind": "IRTLSContext",
20242019/12/20 12:02:22 aggregator: watch hook stderr: "location": "22a1d2b2.eu.ngrok.io.default.1",
20252019/12/20 12:02:22 aggregator: watch hook stderr: "name": "22a1d2b2.eu.ngrok.io-context",
20262019/12/20 12:02:22 aggregator: watch hook stderr: "namespace": "default",
20272019/12/20 12:02:22 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
20282019/12/20 12:02:22 aggregator: watch hook stderr: "secret_info": {
20292019/12/20 12:02:22 aggregator: watch hook stderr: "secret": "22a1d2b2.eu.ngrok.io"
20302019/12/20 12:02:22 aggregator: watch hook stderr: }
20312019/12/20 12:02:22 aggregator: watch hook stderr: }
20322019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io: ACME private key name is https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com
20332019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: resolve_secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default: no secret_info, asking handler to load
20342019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: resolve_secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default: found secret, asking handler to cache
20352019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
20362019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
20372019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
20382019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: TLSContext.resolve_secret 22a1d2b2.eu.ngrok.io, namespace default: namespacing is True
20392019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: resolve_secret 22a1d2b2.eu.ngrok.io: using cached SavedSecret
20402019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: IR: watching Edge Stack; wizard allowed
20412019/12/20 12:02:22 aggregator: watch hook stderr:
20422019/12/20 12:02:22 aggregator: found 7 kubernetes watches
20432019/12/20 12:02:22 aggregator: found 0 consul watches
20442019/12/20 12:02:22 kubewatchman: processing 7 kubernetes watch specs
20452019/12/20 12:02:22 consulwatchman: processing 0 consul watches
20462019/12/20 12:02:22 notify: python /ambassador/post_update.py --watt http://localhost:8002/snapshots/10
20472019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_12] INFO: Update requested: watt, http://localhost:8002/snapshots/10
20482019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: copying configuration: watt, http://localhost:8002/snapshots/10 to /ambassador/snapshots/snapshot-tmp.yaml
2049time="2019-12-20 12:02:22" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=12670706479402512950 SUB=http-handler
2050time="2019-12-20 12:02:22" level=info msg="using default rule" MAIN=http REQUEST_ID=12670706479402512950 SUB=http-handler
2051time="2019-12-20 12:02:22" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=12670706479402512950 SUB=http-handler
2052time="2019-12-20 12:02:22" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (84.08µs)" MAIN=http REQUEST_ID=12670706479402512950 SUB=http-handler
20532019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
20542019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_8] INFO: EBC659CC-CBBB-419A-8497-F2526944E197: 127.0.0.1 "GET /ambassador/v0/diag/" START
20552019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_8] INFO: DEBUG_MODE False
2056status_dict {'Error check': {'status': True, 'specifics': [(True, 'No errors logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
20572019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_8] INFO: EBC659CC-CBBB-419A-8497-F2526944E197: 127.0.0.1 "GET /ambassador/v0/diag/" 37ms 200 success
20582019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1: <RichStatus BAD error=<Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1> defines Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1, which is already defined by https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1 hostname=ambassador-544fbbf997-rttjd version=1.0.0-ea7>
20592019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: ERROR ERROR ERROR Starting with configuration errors
20602019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IRTLSContext setup good: {
2061 "_active": false,
2062 "_errored": false,
2063 "_rkey": "fallback-self-signed-context.99999",
2064 "hosts": [
2065 "*"
2066 ],
2067 "kind": "IRTLSContext",
2068 "location": "-internal-",
2069 "name": "fallback-self-signed-context",
2070 "namespace": "ambassador",
2071 "redirect_cleartext_from": 8080,
2072 "secret_info": {
2073 "secret": "fallback-self-signed-cert"
2074 }
2075}
20762019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
20772019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
20782019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
20792019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io setting up
20802019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io: TLS secret name is 22a1d2b2.eu.ngrok.io
20812019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: no secret_info, asking handler to load
20822019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: Secret 22a1d2b2.eu.ngrok.io.default unknown
20832019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: Host 22a1d2b2.eu.ngrok.io: continuing with invalid TLS secret 22a1d2b2.eu.ngrok.io
20842019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
20852019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
20862019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
20872019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IR: starting Edge Stack; wizard allowed
20882019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: ctx fallback-self-signed-context is the primary termination context
20892019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: creating redirect listener on 8080
20902019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: Using log_format 'ACCESS [%START_TIME%] "%REQ(:METHOD)% %REQ(X-ENVOY-ORIGINAL-PATH?:PATH)% %PROTOCOL%" %RESPONSE_CODE% %RESPONSE_FLAGS% %BYTES_RECEIVED% %BYTES_SENT% %DURATION% %RESP(X-ENVOY-UPSTREAM-SERVICE-TIME)% "%REQ(X-FORWARDED-FOR)%" "%REQ(USER-AGENT)%" "%REQ(X-REQUEST-ID)%" "%REQ(:AUTHORITY)%" "%UPSTREAM_HOST%"'
20912019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI (1) route check fallback-self-signed-context - ['*']
20922019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
2093[
2094 {
2095 "ctx_hosts": [
2096 "*"
2097 ],
2098 "ctx_name": "fallback-self-signed-context",
2099 "filter_chain_match": {
2100 "transport_protocol": "tls"
2101 },
2102 "route_count": 9
2103 }
2104]
21052019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
21062019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
2107[
2108 {
2109 "ctx_hosts": [
2110 "*"
2111 ],
2112 "ctx_name": "fallback-self-signed-context",
2113 "filter_chain_match": {
2114 "transport_protocol": "tls"
2115 },
2116 "route_count": 9
2117 },
2118 {
2119 "ctx_hosts": [
2120 "*"
2121 ],
2122 "ctx_name": "-cleartext-",
2123 "filter_chain_match": {},
2124 "route_count": 9
2125 }
2126]
21272019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: enabling TLS inspector
21282019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: no filter chains, need cleartext
21292019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
21302019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
2131[
2132 {
2133 "ctx_hosts": [
2134 "*"
2135 ],
2136 "ctx_name": "-cleartext-",
2137 "filter_chain_match": {},
2138 "route_count": 1
2139 }
2140]
21412019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: leaving TLS inspector disabled
21422019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: -global-: NOTICE: A future Ambassador version will change the GRPC protocol version for AuthServices and RateLimitServices. See the CHANGELOG for details.
21432019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: successfully validated the resulting envoy configuration, continuing...
21442019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: saving Envoy configuration for snapshot 10
21452019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: running 'kill -HUP 1'
2146KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal-api.ambassador
2147KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal.ambassador
2148KubeStatus MASTER 306: mark_live Mapping/ambassador-edge-stack.ambassador
2149KubeStatus MASTER 306: mark_live Mapping/edgestack-direct-mapping.ambassador
2150KubeStatus MASTER 306: mark_live Mapping/edgestack-fallback-mapping.ambassador
2151KubeStatus MASTER 306: mark_live Mapping/httpbin.default
21522019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal-api.ambassador, {"state": "Running"}...
2153KubeStatus MASTER 306: Mapping/ambassador-devportal-api.ambassador == {"state": "Running"}
21542019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal.ambassador, {"state": "Running"}...
2155KubeStatus MASTER 306: Mapping/ambassador-devportal.ambassador == {"state": "Running"}
21562019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-edge-stack.ambassador, {"state": "Running"}...
2157KubeStatus MASTER 306: Mapping/ambassador-edge-stack.ambassador == {"state": "Running"}
21582019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-direct-mapping.ambassador, {"state": "Running"}...
2159KubeStatus MASTER 306: Mapping/edgestack-direct-mapping.ambassador == {"state": "Running"}
21602019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-fallback-mapping.ambassador, {"state": "Running"}...
2161KubeStatus MASTER 306: Mapping/edgestack-fallback-mapping.ambassador == {"state": "Running"}
21622019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping httpbin.default, {"state": "Running"}...
2163KubeStatus MASTER 306: Mapping/httpbin.default == {"state": "Running"}
21642019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: configuration updated from snapshot 10
21652019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: error https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1 <Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1> defines Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1, which is already defined by https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1
2166time="2019-12-20 12:02:22" level=info msg="Event(v1.ObjectReference{Kind:\"Host\", Namespace:\"default\", Name:\"22a1d2b2.eu.ngrok.io\", UID:\"9f3b6565-0d4d-45c1-901c-d690aa83d4b0\", APIVersion:\"getambassador.io/v2\", ResourceVersion:\"815\", FieldPath:\"\"}): type: 'Normal' reason: 'Pending' registering ACME account" MAIN=event-broadcaster event-namespace=default
2167E1220 12:02:22.326115 324 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"22a1d2b2.eu.ngrok.io.15e212aa55bdd18b", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Host", Namespace:"default", Name:"22a1d2b2.eu.ngrok.io", UID:"9f3b6565-0d4d-45c1-901c-d690aa83d4b0", APIVersion:"getambassador.io/v2", ResourceVersion:"815", FieldPath:""}, Reason:"Pending", Message:"registering ACME account", Source:v1.EventSource{Component:"Ambassador Edge Stack", Host:"ambassador-544fbbf997-rttjd"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf39364458b, ext:67766800007, loc:(*time.Location)(0x2c744a0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf39364458b, ext:67766800007, loc:(*time.Location)(0x2c744a0)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events is forbidden: User "system:serviceaccount:ambassador:ambassador" cannot create resource "events" in API group "" in the namespace "default"' (will not retry!)
2168time="2019-12-20T12:02:22Z" level=info msg="Loaded file /ambassador/envoy/envoy.json"
2169time="2019-12-20T12:02:22Z" level=info msg="Pushing snapshot v10"
2170[2019-12-20 12:02:22.336][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2171[2019-12-20 12:02:22.336][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2172[2019-12-20 12:02:22.337][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2173[2019-12-20 12:02:22.337][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2174[2019-12-20 12:02:22.337][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2175[2019-12-20 12:02:22.338][406][info][upstream] [source/common/upstream/cds_api_impl.cc:67] cds: add 4 cluster(s), remove 1 cluster(s)
2176time="2019-12-20 12:02:22" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=2735435641630802205 SUB=http-handler
2177time="2019-12-20 12:02:22" level=info msg="using default rule" MAIN=http REQUEST_ID=2735435641630802205 SUB=http-handler
2178time="2019-12-20 12:02:22" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=2735435641630802205 SUB=http-handler
2179time="2019-12-20 12:02:22" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (65.26µs)" MAIN=http REQUEST_ID=2735435641630802205 SUB=http-handler
21802019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_14] INFO: 7D46551F-0B8D-4516-BF1C-ADEB96A5FC09: 127.0.0.1 "GET /ambassador/v0/diag/" START
21812019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_14] INFO: DEBUG_MODE False
2182status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
21832019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_14] INFO: 7D46551F-0B8D-4516-BF1C-ADEB96A5FC09: 127.0.0.1 "GET /ambassador/v0/diag/" 11ms 200 success
21842019/12/20 12:02:22 [INFO] acme: Registering account for test@test.com
21852019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
21862019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: YAML: using C parser
21872019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: YAML: using C dumper
21882019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook ERROR: https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1: <RichStatus BAD error=<Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1> defines Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1, which is already defined by https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1 hostname=ambassador-544fbbf997-rttjd version=1.0.0-ea7>
21892019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook ERROR: ERROR ERROR ERROR Starting with configuration errors
21902019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: IRTLSContext setup good: {
21912019/12/20 12:02:22 aggregator: watch hook stderr: "_active": false,
21922019/12/20 12:02:22 aggregator: watch hook stderr: "_errored": false,
21932019/12/20 12:02:22 aggregator: watch hook stderr: "_rkey": "fallback-self-signed-context.99999",
21942019/12/20 12:02:22 aggregator: watch hook stderr: "hosts": [
21952019/12/20 12:02:22 aggregator: watch hook stderr: "*"
21962019/12/20 12:02:22 aggregator: watch hook stderr: ],
21972019/12/20 12:02:22 aggregator: watch hook stderr: "kind": "IRTLSContext",
21982019/12/20 12:02:22 aggregator: watch hook stderr: "location": "-internal-",
21992019/12/20 12:02:22 aggregator: watch hook stderr: "name": "fallback-self-signed-context",
22002019/12/20 12:02:22 aggregator: watch hook stderr: "namespace": "ambassador",
22012019/12/20 12:02:22 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
22022019/12/20 12:02:22 aggregator: watch hook stderr: "secret_info": {
22032019/12/20 12:02:22 aggregator: watch hook stderr: "secret": "fallback-self-signed-cert"
22042019/12/20 12:02:22 aggregator: watch hook stderr: }
22052019/12/20 12:02:22 aggregator: watch hook stderr: }
22062019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
22072019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
22082019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
22092019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io setting up
22102019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io: TLS secret name is 22a1d2b2.eu.ngrok.io
22112019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: no secret_info, asking handler to load
22122019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: found secret, asking handler to cache
22132019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io: creating TLSContext 22a1d2b2.eu.ngrok.io-context
22142019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: IRTLSContext setup good: {
22152019/12/20 12:02:22 aggregator: watch hook stderr: "_active": false,
22162019/12/20 12:02:22 aggregator: watch hook stderr: "_errored": false,
22172019/12/20 12:02:22 aggregator: watch hook stderr: "_rkey": "22a1d2b2.eu.ngrok.io.default.1",
22182019/12/20 12:02:22 aggregator: watch hook stderr: "hosts": [
22192019/12/20 12:02:22 aggregator: watch hook stderr: "22a1d2b2.eu.ngrok.io"
22202019/12/20 12:02:22 aggregator: watch hook stderr: ],
22212019/12/20 12:02:22 aggregator: watch hook stderr: "kind": "IRTLSContext",
22222019/12/20 12:02:22 aggregator: watch hook stderr: "location": "22a1d2b2.eu.ngrok.io.default.1",
22232019/12/20 12:02:22 aggregator: watch hook stderr: "name": "22a1d2b2.eu.ngrok.io-context",
22242019/12/20 12:02:22 aggregator: watch hook stderr: "namespace": "default",
22252019/12/20 12:02:22 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
22262019/12/20 12:02:22 aggregator: watch hook stderr: "secret_info": {
22272019/12/20 12:02:22 aggregator: watch hook stderr: "secret": "22a1d2b2.eu.ngrok.io"
22282019/12/20 12:02:22 aggregator: watch hook stderr: }
22292019/12/20 12:02:22 aggregator: watch hook stderr: }
22302019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io: ACME private key name is https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com
22312019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: resolve_secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default: no secret_info, asking handler to load
22322019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: resolve_secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default: found secret, asking handler to cache
22332019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
22342019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
22352019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
22362019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: TLSContext.resolve_secret 22a1d2b2.eu.ngrok.io, namespace default: namespacing is True
22372019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: resolve_secret 22a1d2b2.eu.ngrok.io: using cached SavedSecret
22382019/12/20 12:02:22 aggregator: watch hook stderr: 2019-12-20 12:02:22 watch-hook INFO: IR: watching Edge Stack; wizard allowed
22392019/12/20 12:02:22 aggregator: watch hook stderr:
22402019/12/20 12:02:22 aggregator: found 7 kubernetes watches
22412019/12/20 12:02:22 aggregator: found 0 consul watches
22422019/12/20 12:02:22 kubewatchman: processing 7 kubernetes watch specs
22432019/12/20 12:02:22 consulwatchman: processing 0 consul watches
22442019/12/20 12:02:22 invoker: deleting snapshot 1
22452019/12/20 12:02:22 notify: python /ambassador/post_update.py --watt http://localhost:8002/snapshots/11
22462019-12-20 12:02:22 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_24] INFO: Update requested: watt, http://localhost:8002/snapshots/11
2247time="2019-12-20 12:02:22" level=info msg="Event(v1.ObjectReference{Kind:\"Host\", Namespace:\"default\", Name:\"22a1d2b2.eu.ngrok.io\", UID:\"9f3b6565-0d4d-45c1-901c-d690aa83d4b0\", APIVersion:\"getambassador.io/v2\", ResourceVersion:\"815\", FieldPath:\"\"}): type: 'Normal' reason: 'Pending' ACME account registered" MAIN=event-broadcaster event-namespace=default
2248E1220 12:02:22.898098 324 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"22a1d2b2.eu.ngrok.io.15e212aa77d534fd", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Host", Namespace:"default", Name:"22a1d2b2.eu.ngrok.io", UID:"9f3b6565-0d4d-45c1-901c-d690aa83d4b0", APIVersion:"getambassador.io/v2", ResourceVersion:"815", FieldPath:""}, Reason:"Pending", Message:"ACME account registered", Source:v1.EventSource{Component:"Ambassador Edge Stack", Host:"ambassador-544fbbf997-rttjd"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf3b57ba8fd, ext:68338758157, loc:(*time.Location)(0x2c744a0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf3b57ba8fd, ext:68338758157, loc:(*time.Location)(0x2c744a0)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events is forbidden: User "system:serviceaccount:ambassador:ambassador" cannot create resource "events" in API group "" in the namespace "default"' (will not retry!)
2249time="2019-12-20 12:02:22" level=info msg="Event(v1.ObjectReference{Kind:\"Host\", Namespace:\"default\", Name:\"22a1d2b2.eu.ngrok.io\", UID:\"9f3b6565-0d4d-45c1-901c-d690aa83d4b0\", APIVersion:\"getambassador.io/v2\", ResourceVersion:\"815\", FieldPath:\"\"}): type: 'Normal' reason: 'Pending' waiting for Host ACME account registration change to be reflected in snapshot" MAIN=event-broadcaster event-namespace=default
2250E1220 12:02:22.900664 324 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"22a1d2b2.eu.ngrok.io.15e212aa7800ff03", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Host", Namespace:"default", Name:"22a1d2b2.eu.ngrok.io", UID:"9f3b6565-0d4d-45c1-901c-d690aa83d4b0", APIVersion:"getambassador.io/v2", ResourceVersion:"815", FieldPath:""}, Reason:"Pending", Message:"waiting for Host ACME account registration change to be reflected in snapshot", Source:v1.EventSource{Component:"Ambassador Edge Stack", Host:"ambassador-544fbbf997-rttjd"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf3b5a77303, ext:68341627923, loc:(*time.Location)(0x2c744a0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf3b5a77303, ext:68341627923, loc:(*time.Location)(0x2c744a0)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events is forbidden: User "system:serviceaccount:ambassador:ambassador" cannot create resource "events" in API group "" in the namespace "default"' (will not retry!)
22512019/12/20 12:02:22 kubebootstrap: found 1 "Host" in namespace "*"
22522019/12/20 12:02:22 kubebootstrap: sent "Host" to 1 receivers
22532019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout reports {"latest_version": "1.0.0", "application": "aes", "cached": false, "timestamp": 1576843343.046622}
22542019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout notices: [{"level": "INFO", "message": "Upgrade available! to Ambassador version 1.0.0"}]
22552019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: copying configuration: watt, http://localhost:8002/snapshots/11 to /ambassador/snapshots/snapshot-tmp.yaml
22562019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
22572019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1: <RichStatus BAD error=<Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1> defines Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1, which is already defined by https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1 hostname=ambassador-544fbbf997-rttjd version=1.0.0-ea7>
22582019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: ERROR ERROR ERROR Starting with configuration errors
22592019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IRTLSContext setup good: {
2260 "_active": false,
2261 "_errored": false,
2262 "_rkey": "fallback-self-signed-context.99999",
2263 "hosts": [
2264 "*"
2265 ],
2266 "kind": "IRTLSContext",
2267 "location": "-internal-",
2268 "name": "fallback-self-signed-context",
2269 "namespace": "ambassador",
2270 "redirect_cleartext_from": 8080,
2271 "secret_info": {
2272 "secret": "fallback-self-signed-cert"
2273 }
2274}
22752019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
22762019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
22772019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
22782019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io setting up
22792019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io: TLS secret name is 22a1d2b2.eu.ngrok.io
22802019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: no secret_info, asking handler to load
22812019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: Secret 22a1d2b2.eu.ngrok.io.default unknown
22822019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: Host 22a1d2b2.eu.ngrok.io: continuing with invalid TLS secret 22a1d2b2.eu.ngrok.io
22832019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
22842019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
22852019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
22862019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IR: starting Edge Stack; wizard allowed
22872019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: ctx fallback-self-signed-context is the primary termination context
22882019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: creating redirect listener on 8080
22892019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: Using log_format 'ACCESS [%START_TIME%] "%REQ(:METHOD)% %REQ(X-ENVOY-ORIGINAL-PATH?:PATH)% %PROTOCOL%" %RESPONSE_CODE% %RESPONSE_FLAGS% %BYTES_RECEIVED% %BYTES_SENT% %DURATION% %RESP(X-ENVOY-UPSTREAM-SERVICE-TIME)% "%REQ(X-FORWARDED-FOR)%" "%REQ(USER-AGENT)%" "%REQ(X-REQUEST-ID)%" "%REQ(:AUTHORITY)%" "%UPSTREAM_HOST%"'
22902019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI (1) route check fallback-self-signed-context - ['*']
22912019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
2292[
2293 {
2294 "ctx_hosts": [
2295 "*"
2296 ],
2297 "ctx_name": "fallback-self-signed-context",
2298 "filter_chain_match": {
2299 "transport_protocol": "tls"
2300 },
2301 "route_count": 9
2302 }
2303]
23042019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
23052019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
2306[
2307 {
2308 "ctx_hosts": [
2309 "*"
2310 ],
2311 "ctx_name": "fallback-self-signed-context",
2312 "filter_chain_match": {
2313 "transport_protocol": "tls"
2314 },
2315 "route_count": 9
2316 },
2317 {
2318 "ctx_hosts": [
2319 "*"
2320 ],
2321 "ctx_name": "-cleartext-",
2322 "filter_chain_match": {},
2323 "route_count": 9
2324 }
2325]
23262019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: enabling TLS inspector
23272019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: no filter chains, need cleartext
23282019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
23292019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
2330[
2331 {
2332 "ctx_hosts": [
2333 "*"
2334 ],
2335 "ctx_name": "-cleartext-",
2336 "filter_chain_match": {},
2337 "route_count": 1
2338 }
2339]
23402019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: leaving TLS inspector disabled
23412019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: -global-: NOTICE: A future Ambassador version will change the GRPC protocol version for AuthServices and RateLimitServices. See the CHANGELOG for details.
23422019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: successfully validated the resulting envoy configuration, continuing...
23432019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: saving Envoy configuration for snapshot 11
23442019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: running 'kill -HUP 1'
2345KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal-api.ambassador
2346KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal.ambassador
2347KubeStatus MASTER 306: mark_live Mapping/ambassador-edge-stack.ambassador
2348KubeStatus MASTER 306: mark_live Mapping/edgestack-direct-mapping.ambassador
2349KubeStatus MASTER 306: mark_live Mapping/edgestack-fallback-mapping.ambassador
2350KubeStatus MASTER 306: mark_live Mapping/httpbin.default
2351KubeStatus MASTER 306: Mapping/ambassador-devportal-api.ambassador == {"state": "Running"}
23522019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal-api.ambassador, {"state": "Running"}...
2353KubeStatus MASTER 306: Mapping/ambassador-devportal.ambassador == {"state": "Running"}
23542019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal.ambassador, {"state": "Running"}...
23552019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-edge-stack.ambassador, {"state": "Running"}...
2356KubeStatus MASTER 306: Mapping/ambassador-edge-stack.ambassador == {"state": "Running"}
23572019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-direct-mapping.ambassador, {"state": "Running"}...
2358KubeStatus MASTER 306: Mapping/edgestack-direct-mapping.ambassador == {"state": "Running"}
23592019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-fallback-mapping.ambassador, {"state": "Running"}...
2360KubeStatus MASTER 306: Mapping/edgestack-fallback-mapping.ambassador == {"state": "Running"}
23612019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping httpbin.default, {"state": "Running"}...
2362KubeStatus MASTER 306: Mapping/httpbin.default == {"state": "Running"}
23632019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: configuration updated from snapshot 11
23642019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: error https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1 <Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1> defines Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1, which is already defined by https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1
23652019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout reports {"latest_version": "1.0.0", "application": "aes", "cached": true, "timestamp": 1576843342.321342}
23662019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout notices: [{"level": "DEBUG", "message": "Returning cached result"}, {"level": "INFO", "message": "Upgrade available! to Ambassador version 1.0.0"}]
2367time="2019-12-20T12:02:23Z" level=info msg="Loaded file /ambassador/envoy/envoy.json"
2368time="2019-12-20T12:02:23Z" level=info msg="Pushing snapshot v11"
2369[2019-12-20 12:02:23.164][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2370[2019-12-20 12:02:23.164][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2371[2019-12-20 12:02:23.165][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2372[2019-12-20 12:02:23.165][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2373[2019-12-20 12:02:23.166][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2374[2019-12-20 12:02:23.166][406][info][upstream] [source/common/upstream/cds_api_impl.cc:67] cds: add 4 cluster(s), remove 1 cluster(s)
23752019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
23762019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: YAML: using C parser
23772019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: YAML: using C dumper
23782019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook ERROR: https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1: <RichStatus BAD error=<Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1> defines Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1, which is already defined by https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1 hostname=ambassador-544fbbf997-rttjd version=1.0.0-ea7>
23792019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook ERROR: ERROR ERROR ERROR Starting with configuration errors
23802019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: IRTLSContext setup good: {
23812019/12/20 12:02:23 aggregator: watch hook stderr: "_active": false,
23822019/12/20 12:02:23 aggregator: watch hook stderr: "_errored": false,
23832019/12/20 12:02:23 aggregator: watch hook stderr: "_rkey": "fallback-self-signed-context.99999",
23842019/12/20 12:02:23 aggregator: watch hook stderr: "hosts": [
23852019/12/20 12:02:23 aggregator: watch hook stderr: "*"
23862019/12/20 12:02:23 aggregator: watch hook stderr: ],
23872019/12/20 12:02:23 aggregator: watch hook stderr: "kind": "IRTLSContext",
23882019/12/20 12:02:23 aggregator: watch hook stderr: "location": "-internal-",
23892019/12/20 12:02:23 aggregator: watch hook stderr: "name": "fallback-self-signed-context",
23902019/12/20 12:02:23 aggregator: watch hook stderr: "namespace": "ambassador",
23912019/12/20 12:02:23 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
23922019/12/20 12:02:23 aggregator: watch hook stderr: "secret_info": {
23932019/12/20 12:02:23 aggregator: watch hook stderr: "secret": "fallback-self-signed-cert"
23942019/12/20 12:02:23 aggregator: watch hook stderr: }
23952019/12/20 12:02:23 aggregator: watch hook stderr: }
23962019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
23972019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
23982019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
23992019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io setting up
24002019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io: TLS secret name is 22a1d2b2.eu.ngrok.io
24012019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: no secret_info, asking handler to load
24022019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: found secret, asking handler to cache
24032019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io: creating TLSContext 22a1d2b2.eu.ngrok.io-context
24042019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: IRTLSContext setup good: {
24052019/12/20 12:02:23 aggregator: watch hook stderr: "_active": false,
24062019/12/20 12:02:23 aggregator: watch hook stderr: "_errored": false,
24072019/12/20 12:02:23 aggregator: watch hook stderr: "_rkey": "22a1d2b2.eu.ngrok.io.default.1",
24082019/12/20 12:02:23 aggregator: watch hook stderr: "hosts": [
24092019/12/20 12:02:23 aggregator: watch hook stderr: "22a1d2b2.eu.ngrok.io"
24102019/12/20 12:02:23 aggregator: watch hook stderr: ],
24112019/12/20 12:02:23 aggregator: watch hook stderr: "kind": "IRTLSContext",
24122019/12/20 12:02:23 aggregator: watch hook stderr: "location": "22a1d2b2.eu.ngrok.io.default.1",
24132019/12/20 12:02:23 aggregator: watch hook stderr: "name": "22a1d2b2.eu.ngrok.io-context",
24142019/12/20 12:02:23 aggregator: watch hook stderr: "namespace": "default",
24152019/12/20 12:02:23 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
24162019/12/20 12:02:23 aggregator: watch hook stderr: "secret_info": {
24172019/12/20 12:02:23 aggregator: watch hook stderr: "secret": "22a1d2b2.eu.ngrok.io"
24182019/12/20 12:02:23 aggregator: watch hook stderr: }
24192019/12/20 12:02:23 aggregator: watch hook stderr: }
24202019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io: ACME private key name is https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com
24212019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: resolve_secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default: no secret_info, asking handler to load
24222019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: resolve_secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default: found secret, asking handler to cache
24232019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
24242019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
24252019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
24262019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: TLSContext.resolve_secret 22a1d2b2.eu.ngrok.io, namespace default: namespacing is True
24272019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: resolve_secret 22a1d2b2.eu.ngrok.io: using cached SavedSecret
24282019/12/20 12:02:23 aggregator: watch hook stderr: 2019-12-20 12:02:23 watch-hook INFO: IR: watching Edge Stack; wizard allowed
24292019/12/20 12:02:23 aggregator: watch hook stderr:
24302019/12/20 12:02:23 aggregator: found 7 kubernetes watches
24312019/12/20 12:02:23 aggregator: found 0 consul watches
24322019/12/20 12:02:23 kubewatchman: processing 7 kubernetes watch specs
24332019/12/20 12:02:23 consulwatchman: processing 0 consul watches
24342019/12/20 12:02:23 invoker: deleting snapshot 2
24352019/12/20 12:02:23 notify: python /ambassador/post_update.py --watt http://localhost:8002/snapshots/12
24362019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_5] INFO: Update requested: watt, http://localhost:8002/snapshots/12
24372019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: copying configuration: watt, http://localhost:8002/snapshots/12 to /ambassador/snapshots/snapshot-tmp.yaml
24382019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
24392019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1: <RichStatus BAD error=<Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1> defines Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1, which is already defined by https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1 hostname=ambassador-544fbbf997-rttjd version=1.0.0-ea7>
24402019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: ERROR ERROR ERROR Starting with configuration errors
24412019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IRTLSContext setup good: {
2442 "_active": false,
2443 "_errored": false,
2444 "_rkey": "fallback-self-signed-context.99999",
2445 "hosts": [
2446 "*"
2447 ],
2448 "kind": "IRTLSContext",
2449 "location": "-internal-",
2450 "name": "fallback-self-signed-context",
2451 "namespace": "ambassador",
2452 "redirect_cleartext_from": 8080,
2453 "secret_info": {
2454 "secret": "fallback-self-signed-cert"
2455 }
2456}
24572019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
24582019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
24592019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
24602019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io setting up
24612019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io: TLS secret name is 22a1d2b2.eu.ngrok.io
24622019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: no secret_info, asking handler to load
24632019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: Secret 22a1d2b2.eu.ngrok.io.default unknown
24642019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: Host 22a1d2b2.eu.ngrok.io: continuing with invalid TLS secret 22a1d2b2.eu.ngrok.io
24652019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
24662019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
24672019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
24682019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IR: starting Edge Stack; wizard allowed
24692019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: ctx fallback-self-signed-context is the primary termination context
24702019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: creating redirect listener on 8080
24712019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: Using log_format 'ACCESS [%START_TIME%] "%REQ(:METHOD)% %REQ(X-ENVOY-ORIGINAL-PATH?:PATH)% %PROTOCOL%" %RESPONSE_CODE% %RESPONSE_FLAGS% %BYTES_RECEIVED% %BYTES_SENT% %DURATION% %RESP(X-ENVOY-UPSTREAM-SERVICE-TIME)% "%REQ(X-FORWARDED-FOR)%" "%REQ(USER-AGENT)%" "%REQ(X-REQUEST-ID)%" "%REQ(:AUTHORITY)%" "%UPSTREAM_HOST%"'
24722019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI (1) route check fallback-self-signed-context - ['*']
24732019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
2474[
2475 {
2476 "ctx_hosts": [
2477 "*"
2478 ],
2479 "ctx_name": "fallback-self-signed-context",
2480 "filter_chain_match": {
2481 "transport_protocol": "tls"
2482 },
2483 "route_count": 9
2484 }
2485]
24862019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
24872019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
2488[
2489 {
2490 "ctx_hosts": [
2491 "*"
2492 ],
2493 "ctx_name": "fallback-self-signed-context",
2494 "filter_chain_match": {
2495 "transport_protocol": "tls"
2496 },
2497 "route_count": 9
2498 },
2499 {
2500 "ctx_hosts": [
2501 "*"
2502 ],
2503 "ctx_name": "-cleartext-",
2504 "filter_chain_match": {},
2505 "route_count": 9
2506 }
2507]
25082019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: enabling TLS inspector
25092019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: no filter chains, need cleartext
25102019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
25112019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
2512[
2513 {
2514 "ctx_hosts": [
2515 "*"
2516 ],
2517 "ctx_name": "-cleartext-",
2518 "filter_chain_match": {},
2519 "route_count": 1
2520 }
2521]
25222019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: leaving TLS inspector disabled
25232019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: -global-: NOTICE: A future Ambassador version will change the GRPC protocol version for AuthServices and RateLimitServices. See the CHANGELOG for details.
25242019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: successfully validated the resulting envoy configuration, continuing...
25252019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: saving Envoy configuration for snapshot 12
25262019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: running 'kill -HUP 1'
2527KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal-api.ambassador
2528KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal.ambassador
2529KubeStatus MASTER 306: mark_live Mapping/ambassador-edge-stack.ambassador
2530KubeStatus MASTER 306: mark_live Mapping/edgestack-direct-mapping.ambassador
2531KubeStatus MASTER 306: mark_live Mapping/edgestack-fallback-mapping.ambassador
2532KubeStatus MASTER 306: mark_live Mapping/httpbin.default
25332019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal-api.ambassador, {"state": "Running"}...
2534KubeStatus MASTER 306: Mapping/ambassador-devportal-api.ambassador == {"state": "Running"}
25352019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal.ambassador, {"state": "Running"}...
2536KubeStatus MASTER 306: Mapping/ambassador-devportal.ambassador == {"state": "Running"}
2537KubeStatus MASTER 306: Mapping/ambassador-edge-stack.ambassador == {"state": "Running"}
25382019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-edge-stack.ambassador, {"state": "Running"}...
25392019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-direct-mapping.ambassador, {"state": "Running"}...
2540KubeStatus MASTER 306: Mapping/edgestack-direct-mapping.ambassador == {"state": "Running"}
25412019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-fallback-mapping.ambassador, {"state": "Running"}...
2542KubeStatus MASTER 306: Mapping/edgestack-fallback-mapping.ambassador == {"state": "Running"}
25432019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping httpbin.default, {"state": "Running"}...
2544KubeStatus MASTER 306: Mapping/httpbin.default == {"state": "Running"}
25452019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: configuration updated from snapshot 12
25462019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: error https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1 <Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1> defines Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1, which is already defined by https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1
25472019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout reports {"latest_version": "1.0.0", "application": "aes", "cached": true, "timestamp": 1576843342.321342}
25482019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout notices: [{"level": "DEBUG", "message": "Returning cached result"}, {"level": "INFO", "message": "Upgrade available! to Ambassador version 1.0.0"}]
2549time="2019-12-20 12:02:23" level=info msg="Event(v1.ObjectReference{Kind:\"Host\", Namespace:\"default\", Name:\"22a1d2b2.eu.ngrok.io\", UID:\"9f3b6565-0d4d-45c1-901c-d690aa83d4b0\", APIVersion:\"getambassador.io/v2\", ResourceVersion:\"817\", FieldPath:\"\"}): type: 'Normal' reason: 'Pending' tlsSecret \"22a1d2b2.eu.ngrok.io\".\"default\" (hostnames=[\"22a1d2b2.eu.ngrok.io\"]): needs updated: tlsSecret does not exist" MAIN=event-broadcaster event-namespace=default
2550time="2019-12-20 12:02:23" level=info msg="Event(v1.ObjectReference{Kind:\"Host\", Namespace:\"default\", Name:\"22a1d2b2.eu.ngrok.io\", UID:\"9f3b6565-0d4d-45c1-901c-d690aa83d4b0\", APIVersion:\"getambassador.io/v2\", ResourceVersion:\"817\", FieldPath:\"\"}): type: 'Normal' reason: 'Pending' performing ACME challenge for tlsSecret \"22a1d2b2.eu.ngrok.io\".\"default\" (hostnames=[\"22a1d2b2.eu.ngrok.io\"])..." MAIN=event-broadcaster event-namespace=default
2551E1220 12:02:23.491534 324 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"22a1d2b2.eu.ngrok.io.15e212aa9b33c871", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Host", Namespace:"default", Name:"22a1d2b2.eu.ngrok.io", UID:"9f3b6565-0d4d-45c1-901c-d690aa83d4b0", APIVersion:"getambassador.io/v2", ResourceVersion:"817", FieldPath:""}, Reason:"Pending", Message:"tlsSecret \"22a1d2b2.eu.ngrok.io\".\"default\" (hostnames=[\"22a1d2b2.eu.ngrok.io\"]): needs updated: tlsSecret does not exist", Source:v1.EventSource{Component:"Ambassador Edge Stack", Host:"ambassador-544fbbf997-rttjd"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf3dd3f7271, ext:68932158839, loc:(*time.Location)(0x2c744a0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf3dd3f7271, ext:68932158839, loc:(*time.Location)(0x2c744a0)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events is forbidden: User "system:serviceaccount:ambassador:ambassador" cannot create resource "events" in API group "" in the namespace "default"' (will not retry!)
2552E1220 12:02:23.492040 324 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"22a1d2b2.eu.ngrok.io.15e212aa9b350547", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Host", Namespace:"default", Name:"22a1d2b2.eu.ngrok.io", UID:"9f3b6565-0d4d-45c1-901c-d690aa83d4b0", APIVersion:"getambassador.io/v2", ResourceVersion:"817", FieldPath:""}, Reason:"Pending", Message:"performing ACME challenge for tlsSecret \"22a1d2b2.eu.ngrok.io\".\"default\" (hostnames=[\"22a1d2b2.eu.ngrok.io\"])...", Source:v1.EventSource{Component:"Ambassador Edge Stack", Host:"ambassador-544fbbf997-rttjd"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf3dd40af47, ext:68932239949, loc:(*time.Location)(0x2c744a0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf3dd40af47, ext:68932239949, loc:(*time.Location)(0x2c744a0)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events is forbidden: User "system:serviceaccount:ambassador:ambassador" cannot create resource "events" in API group "" in the namespace "default"' (will not retry!)
2553time="2019-12-20T12:02:23Z" level=info msg="Loaded file /ambassador/envoy/envoy.json"
2554time="2019-12-20T12:02:23Z" level=info msg="Pushing snapshot v12"
2555[2019-12-20 12:02:23.503][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2556[2019-12-20 12:02:23.503][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2557[2019-12-20 12:02:23.503][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2558[2019-12-20 12:02:23.504][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2559[2019-12-20 12:02:23.505][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2560[2019-12-20 12:02:23.505][406][info][upstream] [source/common/upstream/cds_api_impl.cc:67] cds: add 4 cluster(s), remove 1 cluster(s)
2561time="2019-12-20 12:02:23" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=7727531085458374643 SUB=http-handler
2562time="2019-12-20 12:02:23" level=info msg="using default rule" MAIN=http REQUEST_ID=7727531085458374643 SUB=http-handler
2563time="2019-12-20 12:02:23" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=7727531085458374643 SUB=http-handler
2564time="2019-12-20 12:02:23" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (55.52µs)" MAIN=http REQUEST_ID=7727531085458374643 SUB=http-handler
25652019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_18] INFO: 144E3AE7-5242-47A6-9FC6-12306B37A1CD: 127.0.0.1 "GET /ambassador/v0/diag/" START
25662019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_18] INFO: DEBUG_MODE False
2567status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
25682019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_18] INFO: 144E3AE7-5242-47A6-9FC6-12306B37A1CD: 127.0.0.1 "GET /ambassador/v0/diag/" 18ms 200 success
2569time="2019-12-20 12:02:23" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=926132826550210795 SUB=http-handler
2570time="2019-12-20 12:02:23" level=info msg="using default rule" MAIN=http REQUEST_ID=926132826550210795 SUB=http-handler
2571time="2019-12-20 12:02:23" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=926132826550210795 SUB=http-handler
2572time="2019-12-20 12:02:23" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (64.94µs)" MAIN=http REQUEST_ID=926132826550210795 SUB=http-handler
25732019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_30] INFO: 2684F206-425A-42A8-87DA-DD89D5A43200: 127.0.0.1 "GET /ambassador/v0/diag/" START
25742019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_30] INFO: DEBUG_MODE False
2575status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
25762019-12-20 12:02:23 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_30] INFO: 2684F206-425A-42A8-87DA-DD89D5A43200: 127.0.0.1 "GET /ambassador/v0/diag/" 15ms 200 success
25772019/12/20 12:02:23 [INFO] [22a1d2b2.eu.ngrok.io] acme: Obtaining bundled SAN certificate
25782019/12/20 12:02:24 [INFO] [22a1d2b2.eu.ngrok.io] AuthURL: https://acme-v02.api.letsencrypt.org/acme/authz-v3/1831761760
25792019/12/20 12:02:24 [INFO] [22a1d2b2.eu.ngrok.io] acme: Could not find solver for: tls-alpn-01
25802019/12/20 12:02:24 [INFO] [22a1d2b2.eu.ngrok.io] acme: use http-01 solver
25812019/12/20 12:02:24 [INFO] [22a1d2b2.eu.ngrok.io] acme: Trying to solve HTTP-01
2582time="2019-12-20 12:02:24" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /.well-known/acme-challenge/A6qs30hAeV3XUs0qSoKFV6wHlENcqTeD6SmUxHpprnQ" MAIN=http REQUEST_ID=3396731974919364651 SUB=http-handler
2583time="2019-12-20 12:02:24" level=info msg="selected rule host=\"\", path=\"\", filters=[.]" MAIN=http REQUEST_ID=3396731974919364651 SUB=http-handler
2584time="2019-12-20 12:02:24" level=info msg="[gRPC] *filterapi.HTTPResponse : 200 (188.781µs)" MAIN=http REQUEST_ID=3396731974919364651 SUB=http-handler
2585time="2019-12-20 12:02:24" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=10243965922537222235 SUB=http-handler
2586time="2019-12-20 12:02:24" level=info msg="using default rule" MAIN=http REQUEST_ID=10243965922537222235 SUB=http-handler
2587time="2019-12-20 12:02:24" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=10243965922537222235 SUB=http-handler
2588time="2019-12-20 12:02:24" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (67.461µs)" MAIN=http REQUEST_ID=10243965922537222235 SUB=http-handler
25892019-12-20 12:02:24 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_11] INFO: 3C0214B1-891B-4E5F-87EC-D952B664EE40: 127.0.0.1 "GET /ambassador/v0/diag/" START
25902019-12-20 12:02:24 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_11] INFO: DEBUG_MODE False
2591status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
25922019-12-20 12:02:24 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_11] INFO: 3C0214B1-891B-4E5F-87EC-D952B664EE40: 127.0.0.1 "GET /ambassador/v0/diag/" 14ms 200 success
2593time="2019-12-20 12:02:24" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /.well-known/acme-challenge/A6qs30hAeV3XUs0qSoKFV6wHlENcqTeD6SmUxHpprnQ" MAIN=http REQUEST_ID=17780880818675706153 SUB=http-handler
2594time="2019-12-20 12:02:24" level=info msg="selected rule host=\"\", path=\"\", filters=[.]" MAIN=http REQUEST_ID=17780880818675706153 SUB=http-handler
2595time="2019-12-20 12:02:24" level=info msg="[gRPC] *filterapi.HTTPResponse : 200 (195.601µs)" MAIN=http REQUEST_ID=17780880818675706153 SUB=http-handler
2596time="2019-12-20 12:02:25" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /.well-known/acme-challenge/A6qs30hAeV3XUs0qSoKFV6wHlENcqTeD6SmUxHpprnQ" MAIN=http REQUEST_ID=15807863307766509839 SUB=http-handler
2597time="2019-12-20 12:02:25" level=info msg="selected rule host=\"\", path=\"\", filters=[.]" MAIN=http REQUEST_ID=15807863307766509839 SUB=http-handler
2598time="2019-12-20 12:02:25" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=7438509396120754713 SUB=http-handler
2599time="2019-12-20 12:02:25" level=info msg="using default rule" MAIN=http REQUEST_ID=7438509396120754713 SUB=http-handler
2600time="2019-12-20 12:02:25" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=7438509396120754713 SUB=http-handler
2601time="2019-12-20 12:02:25" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (154.82µs)" MAIN=http REQUEST_ID=7438509396120754713 SUB=http-handler
2602time="2019-12-20 12:02:25" level=info msg="[gRPC] *filterapi.HTTPResponse : 200 (190.362µs)" MAIN=http REQUEST_ID=15807863307766509839 SUB=http-handler
26032019-12-20 12:02:25 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_1] INFO: 8B6E61EA-DD95-452C-8E36-688C41313F3C: 127.0.0.1 "GET /ambassador/v0/diag/" START
26042019-12-20 12:02:25 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_1] INFO: DEBUG_MODE False
2605status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
26062019-12-20 12:02:25 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_1] INFO: 8B6E61EA-DD95-452C-8E36-688C41313F3C: 127.0.0.1 "GET /ambassador/v0/diag/" 15ms 200 success
2607time="2019-12-20 12:02:25" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /.well-known/acme-challenge/A6qs30hAeV3XUs0qSoKFV6wHlENcqTeD6SmUxHpprnQ" MAIN=http REQUEST_ID=4032882882577608528 SUB=http-handler
2608time="2019-12-20 12:02:25" level=info msg="selected rule host=\"\", path=\"\", filters=[.]" MAIN=http REQUEST_ID=4032882882577608528 SUB=http-handler
2609time="2019-12-20 12:02:25" level=info msg="[gRPC] *filterapi.HTTPResponse : 200 (201.482µs)" MAIN=http REQUEST_ID=4032882882577608528 SUB=http-handler
2610time="2019-12-20 12:02:26" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=2988238649407909598 SUB=http-handler
2611time="2019-12-20 12:02:26" level=info msg="using default rule" MAIN=http REQUEST_ID=2988238649407909598 SUB=http-handler
2612time="2019-12-20 12:02:26" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=2988238649407909598 SUB=http-handler
2613time="2019-12-20 12:02:26" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (57.371µs)" MAIN=http REQUEST_ID=2988238649407909598 SUB=http-handler
26142019-12-20 12:02:26 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_3] INFO: AA1F8364-02F8-494A-B151-77904572A233: 127.0.0.1 "GET /ambassador/v0/diag/" START
26152019-12-20 12:02:26 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_3] INFO: DEBUG_MODE False
2616status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
26172019-12-20 12:02:26 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_3] INFO: AA1F8364-02F8-494A-B151-77904572A233: 127.0.0.1 "GET /ambassador/v0/diag/" 14ms 200 success
2618time="2019-12-20 12:02:26" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=12290997235226097944 SUB=http-handler
2619time="2019-12-20 12:02:26" level=info msg="using default rule" MAIN=http REQUEST_ID=12290997235226097944 SUB=http-handler
2620time="2019-12-20 12:02:26" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=12290997235226097944 SUB=http-handler
2621time="2019-12-20 12:02:26" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (59.871µs)" MAIN=http REQUEST_ID=12290997235226097944 SUB=http-handler
26222019-12-20 12:02:26 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_25] INFO: D03A20F0-45EE-4F75-8023-99CBB36D70A7: 127.0.0.1 "GET /ambassador/v0/diag/" START
26232019-12-20 12:02:26 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_25] INFO: DEBUG_MODE False
2624status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
26252019-12-20 12:02:26 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_25] INFO: D03A20F0-45EE-4F75-8023-99CBB36D70A7: 127.0.0.1 "GET /ambassador/v0/diag/" 14ms 200 success
2626ACCESS [2019-12-20T12:02:17.081Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 131882 20 18 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "907cb1d7-7fdd-4b51-9199-927779372ba2" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2627ACCESS [2019-12-20T12:02:17.324Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 132060 20 19 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "87fb87d6-02f1-4e8c-9870-bbe0f4c5f43c" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2628ACCESS [2019-12-20T12:02:18.378Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 132245 19 18 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "ef9dc733-69ad-4212-a910-5a7a3123d391" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2629ACCESS [2019-12-20T12:02:18.546Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 132423 20 19 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "83dda746-4a5a-4407-80bf-5346e8c3cc5f" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2630ACCESS [2019-12-20T12:02:19.664Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 132601 20 19 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "239cbcd6-d6e2-40e7-aac0-5a167750458c" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2631ACCESS [2019-12-20T12:02:19.858Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 132779 21 20 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "ce62f53d-a13b-4593-8e98-4d81674fffb7" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2632ACCESS [2019-12-20T12:02:20.194Z] "POST /edge_stack/api/activity HTTP/1.1" 200 - 0 0 3 2 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "52a7b551-29a3-4461-8f92-4b0394a295ab" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2633ACCESS [2019-12-20T12:02:20.233Z] "POST /edge_stack/api/apply HTTP/1.1" 200 - 290 51 170 169 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "59dfa5e9-cfe9-4ee7-bdc1-d11e4fe4bf33" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2634ACCESS [2019-12-20T12:02:20.494Z] "GET /edge_stack/api/acme-host-qualifies?hostname=22a1d2b2.eu.ngrok.io HTTP/1.1" 200 - 0 5 4 3 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "2e31b5ff-8f2a-44d2-88fb-10baf6d396a3" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2635ACCESS [2019-12-20T12:02:20.939Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 132966 26 25 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "12f5d0ae-8a96-4e58-9b59-c11353c47dee" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2636ACCESS [2019-12-20T12:02:21.126Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 131626 20 19 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "ceda7e6a-b007-4ac4-bca9-12426827ecb7" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2637ACCESS [2019-12-20T12:02:21.278Z] "GET /openapi/services HTTP/1.1" 200 - 0 168 1 1 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "c23fb12c-0e9b-42c4-b19d-1eebea7005a8" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2638ACCESS [2019-12-20T12:02:21.395Z] "GET /edge_stack/api/acme-host-qualifies?hostname=22a1d2b2.eu.ngrok.io HTTP/1.1" 200 - 0 5 4 3 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "b4a1a306-0a2d-46af-8d39-04d93da5601c" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2639ACCESS [2019-12-20T12:02:21.356Z] "GET /edge_stack/api/tos-url?ca-url=https%3A%2F%2Facme-v02.api.letsencrypt.org%2Fdirectory HTTP/1.1" 200 - 0 65 695 694 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "0464384d-d98b-4837-9753-5f908a957705" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2640ACCESS [2019-12-20T12:02:22.209Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 137151 63 61 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "de4589c8-6cff-4507-a36a-e6a62980bdaf" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2641ACCESS [2019-12-20T12:02:22.352Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 138368 16 15 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "1a40031f-e4fd-4af9-82de-8db0bd216f84" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2642ACCESS [2019-12-20T12:02:23.514Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 138768 23 22 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "ec927dc4-4e5c-4188-88a7-35b845009e44" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2643ACCESS [2019-12-20T12:02:23.619Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 138946 22 20 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "9ff36c03-537c-4c53-9aee-df2356826404" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2644ACCESS [2019-12-20T12:02:24.661Z] "GET /.well-known/acme-challenge/A6qs30hAeV3XUs0qSoKFV6wHlENcqTeD6SmUxHpprnQ HTTP/1.1" 200 UAEX 0 87 0 - "3.14.255.131,10.42.0.5" "Mozilla/5.0 (compatible; Let's Encrypt validation server; +https://www.letsencrypt.org)" "c27f6a1b-5fd8-418d-9771-daa5b88f3a65" "22a1d2b2.eu.ngrok.io" "-"
2645ACCESS [2019-12-20T12:02:24.812Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 139124 21 20 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "c69156e1-dd8b-485d-9843-dedef77ac22a" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2646ACCESS [2019-12-20T12:02:24.925Z] "GET /.well-known/acme-challenge/A6qs30hAeV3XUs0qSoKFV6wHlENcqTeD6SmUxHpprnQ HTTP/1.1" 200 UAEX 0 87 0 - "34.222.229.130,10.42.0.5" "Mozilla/5.0 (compatible; Let's Encrypt validation server; +https://www.letsencrypt.org)" "f5ca89aa-9f5c-46fd-8ff4-c9ee5492c55f" "22a1d2b2.eu.ngrok.io" "-"
2647ACCESS [2019-12-20T12:02:25.007Z] "GET /.well-known/acme-challenge/A6qs30hAeV3XUs0qSoKFV6wHlENcqTeD6SmUxHpprnQ HTTP/1.1" 200 UAEX 0 87 1 - "52.28.236.88,10.42.0.5" "Mozilla/5.0 (compatible; Let's Encrypt validation server; +https://www.letsencrypt.org)" "275bd70c-2beb-4d55-8536-6e0aa9511a31" "22a1d2b2.eu.ngrok.io" "-"
2648ACCESS [2019-12-20T12:02:25.007Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 139302 20 19 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "ebf778b2-b9ff-438d-a48f-36664fe5cf71" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2649ACCESS [2019-12-20T12:02:25.101Z] "GET /.well-known/acme-challenge/A6qs30hAeV3XUs0qSoKFV6wHlENcqTeD6SmUxHpprnQ HTTP/1.1" 200 UAEX 0 87 0 - "66.133.109.36,10.42.0.5" "Mozilla/5.0 (compatible; Let's Encrypt validation server; +https://www.letsencrypt.org)" "6f723a8a-914d-4b50-97b6-4ae0b9b316aa" "22a1d2b2.eu.ngrok.io" "-"
2650ACCESS [2019-12-20T12:02:26.086Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 139489 19 18 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "da4709e4-a611-442e-84eb-a0d8677e71c4" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2651ACCESS [2019-12-20T12:02:26.264Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 139667 19 18 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "480832e1-8845-46d4-9b07-e8b2e058527f" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
2652time="2019-12-20 12:02:27" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=4275871949906028986 SUB=http-handler
2653time="2019-12-20 12:02:27" level=info msg="using default rule" MAIN=http REQUEST_ID=4275871949906028986 SUB=http-handler
2654time="2019-12-20 12:02:27" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=4275871949906028986 SUB=http-handler
2655time="2019-12-20 12:02:27" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (63.79µs)" MAIN=http REQUEST_ID=4275871949906028986 SUB=http-handler
26562019-12-20 12:02:27 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_12] INFO: C3ADADF6-F6BF-419E-B3CC-39ECEAE01D21: 127.0.0.1 "GET /ambassador/v0/diag/" START
26572019-12-20 12:02:27 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_12] INFO: DEBUG_MODE False
2658status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
26592019-12-20 12:02:27 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_12] INFO: C3ADADF6-F6BF-419E-B3CC-39ECEAE01D21: 127.0.0.1 "GET /ambassador/v0/diag/" 14ms 200 success
2660time="2019-12-20 12:02:27" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=4889920918896965027 SUB=http-handler
2661time="2019-12-20 12:02:27" level=info msg="using default rule" MAIN=http REQUEST_ID=4889920918896965027 SUB=http-handler
2662time="2019-12-20 12:02:27" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=4889920918896965027 SUB=http-handler
2663time="2019-12-20 12:02:27" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (50.501µs)" MAIN=http REQUEST_ID=4889920918896965027 SUB=http-handler
26642019-12-20 12:02:27 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_23] INFO: 2A58A8CE-9823-4818-B696-7B85FE88D5AE: 127.0.0.1 "GET /ambassador/v0/diag/" START
26652019-12-20 12:02:27 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_23] INFO: DEBUG_MODE False
2666status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
26672019-12-20 12:02:27 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_23] INFO: 2A58A8CE-9823-4818-B696-7B85FE88D5AE: 127.0.0.1 "GET /ambassador/v0/diag/" 12ms 200 success
2668time="2019-12-20 12:02:28" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=2148966675758717205 SUB=http-handler
2669time="2019-12-20 12:02:28" level=info msg="using default rule" MAIN=http REQUEST_ID=2148966675758717205 SUB=http-handler
2670time="2019-12-20 12:02:28" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=2148966675758717205 SUB=http-handler
2671time="2019-12-20 12:02:28" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (59.42µs)" MAIN=http REQUEST_ID=2148966675758717205 SUB=http-handler
26722019-12-20 12:02:28 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_14] INFO: 988DB298-892F-4B17-A1FA-060827F858EF: 127.0.0.1 "GET /ambassador/v0/diag/" START
26732019-12-20 12:02:28 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_14] INFO: DEBUG_MODE False
2674status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
26752019-12-20 12:02:28 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_14] INFO: 988DB298-892F-4B17-A1FA-060827F858EF: 127.0.0.1 "GET /ambassador/v0/diag/" 11ms 200 success
2676time="2019-12-20 12:02:28" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=16202906503873898418 SUB=http-handler
2677time="2019-12-20 12:02:28" level=info msg="using default rule" MAIN=http REQUEST_ID=16202906503873898418 SUB=http-handler
2678time="2019-12-20 12:02:28" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=16202906503873898418 SUB=http-handler
2679time="2019-12-20 12:02:28" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (59.521µs)" MAIN=http REQUEST_ID=16202906503873898418 SUB=http-handler
26802019-12-20 12:02:28 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_28] INFO: 2FE1E75B-CE09-4F55-9512-C8E26EEEA71E: 127.0.0.1 "GET /ambassador/v0/diag/" START
26812019-12-20 12:02:28 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_28] INFO: DEBUG_MODE False
2682status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
26832019-12-20 12:02:28 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_28] INFO: 2FE1E75B-CE09-4F55-9512-C8E26EEEA71E: 127.0.0.1 "GET /ambassador/v0/diag/" 13ms 200 success
2684time="2019-12-20 12:02:28" level=info msg="[gRPC] HTTP/1.1 POST 22a1d2b2.eu.ngrok.io /edge_stack/api/activity" MAIN=http REQUEST_ID=2067756780060826383 SUB=http-handler
2685time="2019-12-20 12:02:28" level=info msg="using default rule" MAIN=http REQUEST_ID=2067756780060826383 SUB=http-handler
2686time="2019-12-20 12:02:28" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=2067756780060826383 SUB=http-handler
2687time="2019-12-20 12:02:28" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (62.191µs)" MAIN=http REQUEST_ID=2067756780060826383 SUB=http-handler
26882019/12/20 12:02:29 [INFO] [22a1d2b2.eu.ngrok.io] The server validated our request
26892019/12/20 12:02:29 [INFO] [22a1d2b2.eu.ngrok.io] acme: Validations succeeded; requesting certificates
2690time="2019-12-20 12:02:29" level=info msg="[gRPC] HTTP/1.1 POST 22a1d2b2.eu.ngrok.io /edge_stack/api/activity" MAIN=http REQUEST_ID=16421296154077712712 SUB=http-handler
2691time="2019-12-20 12:02:29" level=info msg="using default rule" MAIN=http REQUEST_ID=16421296154077712712 SUB=http-handler
2692time="2019-12-20 12:02:29" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=16421296154077712712 SUB=http-handler
2693time="2019-12-20 12:02:29" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (62.99µs)" MAIN=http REQUEST_ID=16421296154077712712 SUB=http-handler
2694time="2019-12-20 12:02:29" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=8220432817501665269 SUB=http-handler
2695time="2019-12-20 12:02:29" level=info msg="using default rule" MAIN=http REQUEST_ID=8220432817501665269 SUB=http-handler
2696time="2019-12-20 12:02:29" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=8220432817501665269 SUB=http-handler
2697time="2019-12-20 12:02:29" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (62.83µs)" MAIN=http REQUEST_ID=8220432817501665269 SUB=http-handler
26982019-12-20 12:02:29 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_27] INFO: 67D421AC-A7E1-4AFC-A31B-3FBA4C5CB1DF: 127.0.0.1 "GET /ambassador/v0/diag/" START
26992019-12-20 12:02:29 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_27] INFO: DEBUG_MODE False
2700status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
27012019-12-20 12:02:29 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_27] INFO: 67D421AC-A7E1-4AFC-A31B-3FBA4C5CB1DF: 127.0.0.1 "GET /ambassador/v0/diag/" 12ms 200 success
2702time="2019-12-20 12:02:30" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=12719446717952228993 SUB=http-handler
2703time="2019-12-20 12:02:30" level=info msg="using default rule" MAIN=http REQUEST_ID=12719446717952228993 SUB=http-handler
2704time="2019-12-20 12:02:30" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=12719446717952228993 SUB=http-handler
2705time="2019-12-20 12:02:30" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (64.01µs)" MAIN=http REQUEST_ID=12719446717952228993 SUB=http-handler
27062019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_5] INFO: 5BFD114B-BEF0-4B8D-A592-7B71464D2313: 127.0.0.1 "GET /ambassador/v0/diag/" START
27072019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_5] INFO: DEBUG_MODE False
2708status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
27092019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_5] INFO: 5BFD114B-BEF0-4B8D-A592-7B71464D2313: 127.0.0.1 "GET /ambassador/v0/diag/" 13ms 200 success
2710time="2019-12-20 12:02:30" level=info msg="[gRPC] HTTP/1.1 POST 22a1d2b2.eu.ngrok.io /edge_stack/api/activity" MAIN=http REQUEST_ID=1288435048344772243 SUB=http-handler
2711time="2019-12-20 12:02:30" level=info msg="using default rule" MAIN=http REQUEST_ID=1288435048344772243 SUB=http-handler
2712time="2019-12-20 12:02:30" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=1288435048344772243 SUB=http-handler
2713time="2019-12-20 12:02:30" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (64.151µs)" MAIN=http REQUEST_ID=1288435048344772243 SUB=http-handler
27142019/12/20 12:02:30 [INFO] [22a1d2b2.eu.ngrok.io] Server responded with a certificate.
2715time="2019-12-20 12:02:30" level=info msg="Event(v1.ObjectReference{Kind:\"Host\", Namespace:\"default\", Name:\"22a1d2b2.eu.ngrok.io\", UID:\"9f3b6565-0d4d-45c1-901c-d690aa83d4b0\", APIVersion:\"getambassador.io/v2\", ResourceVersion:\"817\", FieldPath:\"\"}): type: 'Normal' reason: 'Pending' updating TLS Secret" MAIN=event-broadcaster event-namespace=default
2716E1220 12:02:30.393265 324 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"22a1d2b2.eu.ngrok.io.15e212ac3692f80d", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Host", Namespace:"default", Name:"22a1d2b2.eu.ngrok.io", UID:"9f3b6565-0d4d-45c1-901c-d690aa83d4b0", APIVersion:"getambassador.io/v2", ResourceVersion:"817", FieldPath:""}, Reason:"Pending", Message:"(combined from similar events): updating TLS Secret", Source:v1.EventSource{Component:"Ambassador Edge Stack", Host:"ambassador-544fbbf997-rttjd"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf597631c0d, ext:75833832783, loc:(*time.Location)(0x2c744a0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf597631c0d, ext:75833832783, loc:(*time.Location)(0x2c744a0)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events is forbidden: User "system:serviceaccount:ambassador:ambassador" cannot create resource "events" in API group "" in the namespace "default"' (will not retry!)
2717time="2019-12-20 12:02:30" level=info msg="Event(v1.ObjectReference{Kind:\"Host\", Namespace:\"default\", Name:\"22a1d2b2.eu.ngrok.io\", UID:\"9f3b6565-0d4d-45c1-901c-d690aa83d4b0\", APIVersion:\"getambassador.io/v2\", ResourceVersion:\"817\", FieldPath:\"\"}): type: 'Normal' reason: 'Pending' waiting for TLS Secret update to be reflected in snapshot" MAIN=event-broadcaster event-namespace=default
2718E1220 12:02:30.395577 324 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"22a1d2b2.eu.ngrok.io.15e212ac3692f80d", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Host", Namespace:"default", Name:"22a1d2b2.eu.ngrok.io", UID:"9f3b6565-0d4d-45c1-901c-d690aa83d4b0", APIVersion:"getambassador.io/v2", ResourceVersion:"817", FieldPath:""}, Reason:"Pending", Message:"(combined from similar events): waiting for TLS Secret update to be reflected in snapshot", Source:v1.EventSource{Component:"Ambassador Edge Stack", Host:"ambassador-544fbbf997-rttjd"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf597631c0d, ext:75833832783, loc:(*time.Location)(0x2c744a0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf59789cea2, ext:75836368818, loc:(*time.Location)(0x2c744a0)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "22a1d2b2.eu.ngrok.io.15e212ac3692f80d" is forbidden: User "system:serviceaccount:ambassador:ambassador" cannot patch resource "events" in API group "" in the namespace "default"' (will not retry!)
27192019/12/20 12:02:30 kubernetes:secret|default|metadata.name=22a1d2b2.eu.ngrok.io|*: found 1 "secret" in namespace "default"
27202019/12/20 12:02:30 kubernetes:secret|default|metadata.name=22a1d2b2.eu.ngrok.io|*: sent "secret" to receivers
2721time="2019-12-20 12:02:30" level=info msg="[gRPC] HTTP/1.1 POST 22a1d2b2.eu.ngrok.io /edge_stack/api/activity" MAIN=http REQUEST_ID=4226682120837970417 SUB=http-handler
2722time="2019-12-20 12:02:30" level=info msg="using default rule" MAIN=http REQUEST_ID=4226682120837970417 SUB=http-handler
2723time="2019-12-20 12:02:30" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=4226682120837970417 SUB=http-handler
2724time="2019-12-20 12:02:30" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (59.59µs)" MAIN=http REQUEST_ID=4226682120837970417 SUB=http-handler
27252019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
27262019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: YAML: using C parser
27272019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: YAML: using C dumper
27282019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook ERROR: https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1: <RichStatus BAD error=<Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1> defines Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1, which is already defined by https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1 hostname=ambassador-544fbbf997-rttjd version=1.0.0-ea7>
27292019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook ERROR: ERROR ERROR ERROR Starting with configuration errors
27302019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: IRTLSContext setup good: {
27312019/12/20 12:02:30 aggregator: watch hook stderr: "_active": false,
27322019/12/20 12:02:30 aggregator: watch hook stderr: "_errored": false,
27332019/12/20 12:02:30 aggregator: watch hook stderr: "_rkey": "fallback-self-signed-context.99999",
27342019/12/20 12:02:30 aggregator: watch hook stderr: "hosts": [
27352019/12/20 12:02:30 aggregator: watch hook stderr: "*"
27362019/12/20 12:02:30 aggregator: watch hook stderr: ],
27372019/12/20 12:02:30 aggregator: watch hook stderr: "kind": "IRTLSContext",
27382019/12/20 12:02:30 aggregator: watch hook stderr: "location": "-internal-",
27392019/12/20 12:02:30 aggregator: watch hook stderr: "name": "fallback-self-signed-context",
27402019/12/20 12:02:30 aggregator: watch hook stderr: "namespace": "ambassador",
27412019/12/20 12:02:30 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
27422019/12/20 12:02:30 aggregator: watch hook stderr: "secret_info": {
27432019/12/20 12:02:30 aggregator: watch hook stderr: "secret": "fallback-self-signed-cert"
27442019/12/20 12:02:30 aggregator: watch hook stderr: }
27452019/12/20 12:02:30 aggregator: watch hook stderr: }
27462019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
27472019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
27482019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
27492019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io setting up
27502019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io: TLS secret name is 22a1d2b2.eu.ngrok.io
27512019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: found secret_info
27522019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: found secret, asking handler to cache
27532019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io: creating TLSContext 22a1d2b2.eu.ngrok.io-context
27542019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: IRTLSContext setup good: {
27552019/12/20 12:02:30 aggregator: watch hook stderr: "_active": false,
27562019/12/20 12:02:30 aggregator: watch hook stderr: "_errored": false,
27572019/12/20 12:02:30 aggregator: watch hook stderr: "_rkey": "22a1d2b2.eu.ngrok.io.default.1",
27582019/12/20 12:02:30 aggregator: watch hook stderr: "hosts": [
27592019/12/20 12:02:30 aggregator: watch hook stderr: "22a1d2b2.eu.ngrok.io"
27602019/12/20 12:02:30 aggregator: watch hook stderr: ],
27612019/12/20 12:02:30 aggregator: watch hook stderr: "kind": "IRTLSContext",
27622019/12/20 12:02:30 aggregator: watch hook stderr: "location": "22a1d2b2.eu.ngrok.io.default.1",
27632019/12/20 12:02:30 aggregator: watch hook stderr: "name": "22a1d2b2.eu.ngrok.io-context",
27642019/12/20 12:02:30 aggregator: watch hook stderr: "namespace": "default",
27652019/12/20 12:02:30 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
27662019/12/20 12:02:30 aggregator: watch hook stderr: "secret_info": {
27672019/12/20 12:02:30 aggregator: watch hook stderr: "secret": "22a1d2b2.eu.ngrok.io"
27682019/12/20 12:02:30 aggregator: watch hook stderr: }
27692019/12/20 12:02:30 aggregator: watch hook stderr: }
27702019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io: ACME private key name is https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com
27712019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: resolve_secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default: no secret_info, asking handler to load
27722019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: resolve_secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default: found secret, asking handler to cache
27732019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
27742019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
27752019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
27762019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: TLSContext.resolve_secret 22a1d2b2.eu.ngrok.io, namespace default: namespacing is True
27772019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: resolve_secret 22a1d2b2.eu.ngrok.io: using cached SavedSecret
27782019/12/20 12:02:30 aggregator: watch hook stderr: 2019-12-20 12:02:30 watch-hook INFO: IR: watching Edge Stack; wizard allowed
27792019/12/20 12:02:30 aggregator: watch hook stderr:
27802019/12/20 12:02:30 aggregator: found 7 kubernetes watches
27812019/12/20 12:02:30 aggregator: found 0 consul watches
27822019/12/20 12:02:30 kubewatchman: processing 7 kubernetes watch specs
27832019/12/20 12:02:30 consulwatchman: processing 0 consul watches
27842019/12/20 12:02:30 invoker: deleting snapshot 3
27852019/12/20 12:02:30 notify: python /ambassador/post_update.py --watt http://localhost:8002/snapshots/13
27862019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_31] INFO: Update requested: watt, http://localhost:8002/snapshots/13
27872019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: copying configuration: watt, http://localhost:8002/snapshots/13 to /ambassador/snapshots/snapshot-tmp.yaml
27882019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
27892019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1: <RichStatus BAD error=<Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1> defines Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1, which is already defined by https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1 hostname=ambassador-544fbbf997-rttjd version=1.0.0-ea7>
27902019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: ERROR ERROR ERROR Starting with configuration errors
27912019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IRTLSContext setup good: {
2792 "_active": false,
2793 "_errored": false,
2794 "_rkey": "fallback-self-signed-context.99999",
2795 "hosts": [
2796 "*"
2797 ],
2798 "kind": "IRTLSContext",
2799 "location": "-internal-",
2800 "name": "fallback-self-signed-context",
2801 "namespace": "ambassador",
2802 "redirect_cleartext_from": 8080,
2803 "secret_info": {
2804 "secret": "fallback-self-signed-cert"
2805 }
2806}
28072019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
28082019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
28092019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
28102019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io setting up
28112019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io: TLS secret name is 22a1d2b2.eu.ngrok.io
28122019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: found secret_info
28132019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: found secret, asking handler to cache
28142019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io: creating TLSContext 22a1d2b2.eu.ngrok.io-context
28152019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IRTLSContext setup good: {
2816 "_active": false,
2817 "_errored": false,
2818 "_rkey": "22a1d2b2.eu.ngrok.io.default.1",
2819 "hosts": [
2820 "22a1d2b2.eu.ngrok.io"
2821 ],
2822 "kind": "IRTLSContext",
2823 "location": "22a1d2b2.eu.ngrok.io.default.1",
2824 "name": "22a1d2b2.eu.ngrok.io-context",
2825 "namespace": "default",
2826 "redirect_cleartext_from": 8080,
2827 "secret_info": {
2828 "secret": "22a1d2b2.eu.ngrok.io"
2829 }
2830}
28312019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io: ACME private key name is https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com
28322019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default: no secret_info, asking handler to load
28332019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default unknown
28342019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: Host 22a1d2b2.eu.ngrok.io: continuing with invalid private key secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com
28352019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
28362019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
28372019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
28382019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret 22a1d2b2.eu.ngrok.io, namespace default: namespacing is True
28392019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret 22a1d2b2.eu.ngrok.io: using cached SavedSecret
28402019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IR: starting Edge Stack; wizard allowed
28412019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: ctx fallback-self-signed-context is the primary termination context
28422019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: ctx 22a1d2b2.eu.ngrok.io-context is a termination context
28432019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: creating redirect listener on 8080
28442019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: Using log_format 'ACCESS [%START_TIME%] "%REQ(:METHOD)% %REQ(X-ENVOY-ORIGINAL-PATH?:PATH)% %PROTOCOL%" %RESPONSE_CODE% %RESPONSE_FLAGS% %BYTES_RECEIVED% %BYTES_SENT% %DURATION% %RESP(X-ENVOY-UPSTREAM-SERVICE-TIME)% "%REQ(X-FORWARDED-FOR)%" "%REQ(USER-AGENT)%" "%REQ(X-REQUEST-ID)%" "%REQ(:AUTHORITY)%" "%UPSTREAM_HOST%"'
28452019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI (1) route check fallback-self-signed-context - ['*']
28462019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI (1) route check 22a1d2b2.eu.ngrok.io-context - ['22a1d2b2.eu.ngrok.io']
28472019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
2848[
2849 {
2850 "ctx_hosts": [
2851 "*"
2852 ],
2853 "ctx_name": "fallback-self-signed-context",
2854 "filter_chain_match": {
2855 "transport_protocol": "tls"
2856 },
2857 "route_count": 9
2858 },
2859 {
2860 "ctx_hosts": [
2861 "22a1d2b2.eu.ngrok.io"
2862 ],
2863 "ctx_name": "22a1d2b2.eu.ngrok.io-context",
2864 "filter_chain_match": {
2865 "server_names": [
2866 "22a1d2b2.eu.ngrok.io"
2867 ],
2868 "transport_protocol": "tls"
2869 },
2870 "route_count": 9
2871 }
2872]
28732019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
28742019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
2875[
2876 {
2877 "ctx_hosts": [
2878 "*"
2879 ],
2880 "ctx_name": "fallback-self-signed-context",
2881 "filter_chain_match": {
2882 "transport_protocol": "tls"
2883 },
2884 "route_count": 9
2885 },
2886 {
2887 "ctx_hosts": [
2888 "22a1d2b2.eu.ngrok.io"
2889 ],
2890 "ctx_name": "22a1d2b2.eu.ngrok.io-context",
2891 "filter_chain_match": {
2892 "server_names": [
2893 "22a1d2b2.eu.ngrok.io"
2894 ],
2895 "transport_protocol": "tls"
2896 },
2897 "route_count": 9
2898 },
2899 {
2900 "ctx_hosts": [
2901 "*"
2902 ],
2903 "ctx_name": "-cleartext-",
2904 "filter_chain_match": {},
2905 "route_count": 9
2906 }
2907]
29082019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: enabling TLS inspector
29092019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: no filter chains, need cleartext
29102019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
29112019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
2912[
2913 {
2914 "ctx_hosts": [
2915 "*"
2916 ],
2917 "ctx_name": "-cleartext-",
2918 "filter_chain_match": {},
2919 "route_count": 1
2920 }
2921]
29222019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: leaving TLS inspector disabled
29232019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: -global-: NOTICE: A future Ambassador version will change the GRPC protocol version for AuthServices and RateLimitServices. See the CHANGELOG for details.
29242019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: successfully validated the resulting envoy configuration, continuing...
29252019-12-20 12:02:30 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: saving Envoy configuration for snapshot 13
29262019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: running 'kill -HUP 1'
2927KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal-api.ambassador
2928KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal.ambassador
2929KubeStatus MASTER 306: mark_live Mapping/ambassador-edge-stack.ambassador
2930KubeStatus MASTER 306: mark_live Mapping/edgestack-direct-mapping.ambassador
2931KubeStatus MASTER 306: mark_live Mapping/edgestack-fallback-mapping.ambassador
2932KubeStatus MASTER 306: mark_live Mapping/httpbin.default
29332019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal-api.ambassador, {"state": "Running"}...
2934KubeStatus MASTER 306: Mapping/ambassador-devportal-api.ambassador == {"state": "Running"}
29352019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal.ambassador, {"state": "Running"}...
2936KubeStatus MASTER 306: Mapping/ambassador-devportal.ambassador == {"state": "Running"}
29372019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-edge-stack.ambassador, {"state": "Running"}...
2938KubeStatus MASTER 306: Mapping/ambassador-edge-stack.ambassador == {"state": "Running"}
29392019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-direct-mapping.ambassador, {"state": "Running"}...
2940KubeStatus MASTER 306: Mapping/edgestack-direct-mapping.ambassador == {"state": "Running"}
2941KubeStatus MASTER 306: Mapping/edgestack-fallback-mapping.ambassador == {"state": "Running"}
29422019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-fallback-mapping.ambassador, {"state": "Running"}...
29432019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping httpbin.default, {"state": "Running"}...
2944KubeStatus MASTER 306: Mapping/httpbin.default == {"state": "Running"}
29452019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: configuration updated from snapshot 13
29462019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: error https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1 <Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1> defines Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1, which is already defined by https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1
29472019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout reports {"latest_version": "1.0.0", "application": "aes", "cached": true, "timestamp": 1576843342.321342}
29482019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout notices: [{"level": "DEBUG", "message": "Returning cached result"}, {"level": "INFO", "message": "Upgrade available! to Ambassador version 1.0.0"}]
2949time="2019-12-20 12:02:31" level=info msg="Event(v1.ObjectReference{Kind:\"Host\", Namespace:\"default\", Name:\"22a1d2b2.eu.ngrok.io\", UID:\"9f3b6565-0d4d-45c1-901c-d690aa83d4b0\", APIVersion:\"getambassador.io/v2\", ResourceVersion:\"817\", FieldPath:\"\"}): type: 'Normal' reason: 'Ready' Host with ACME-provisioned TLS certificate marked Ready" MAIN=event-broadcaster event-namespace=default
2950E1220 12:02:31.012962 324 event.go:237] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"22a1d2b2.eu.ngrok.io.15e212ac5b86ebd4", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Host", Namespace:"default", Name:"22a1d2b2.eu.ngrok.io", UID:"9f3b6565-0d4d-45c1-901c-d690aa83d4b0", APIVersion:"getambassador.io/v2", ResourceVersion:"817", FieldPath:""}, Reason:"Ready", Message:"Host with ACME-provisioned TLS certificate marked Ready", Source:v1.EventSource{Component:"Ambassador Edge Stack", Host:"ambassador-544fbbf997-rttjd"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf5c0bc45d4, ext:76453800174, loc:(*time.Location)(0x2c744a0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf774bf5c0bc45d4, ext:76453800174, loc:(*time.Location)(0x2c744a0)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events is forbidden: User "system:serviceaccount:ambassador:ambassador" cannot create resource "events" in API group "" in the namespace "default"' (will not retry!)
2951time="2019-12-20T12:02:31Z" level=info msg="Loaded file /ambassador/envoy/envoy.json"
29522019/12/20 12:02:31 kubebootstrap: found 1 "Host" in namespace "*"
29532019/12/20 12:02:31 kubebootstrap: sent "Host" to 1 receivers
2954time="2019-12-20T12:02:31Z" level=info msg="Pushing snapshot v13"
2955[2019-12-20 12:02:31.027][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2956[2019-12-20 12:02:31.027][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2957[2019-12-20 12:02:31.027][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2958[2019-12-20 12:02:31.027][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2959[2019-12-20 12:02:31.028][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2960[2019-12-20 12:02:31.028][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2961[2019-12-20 12:02:31.030][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2962[2019-12-20 12:02:31.030][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2963[2019-12-20 12:02:31.030][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2964[2019-12-20 12:02:31.033][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2965[2019-12-20 12:02:31.033][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2966[2019-12-20 12:02:31.033][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2967[2019-12-20 12:02:31.036][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2968[2019-12-20 12:02:31.036][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.network.http_connection_manager.v2.HttpFilter.config' from file http_connection_manager.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2969[2019-12-20 12:02:31.036][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.config.filter.accesslog.v2.AccessLog.config' from file accesslog.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2970[2019-12-20 12:02:31.036][406][info][upstream] [source/server/lds_api.cc:63] lds: add/update listener 'ambassador-listener-8443'
2971[2019-12-20 12:02:31.037][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
2972[2019-12-20 12:02:31.037][406][info][upstream] [source/common/upstream/cds_api_impl.cc:67] cds: add 4 cluster(s), remove 1 cluster(s)
2973time="2019-12-20 12:02:31" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=7591555548271388990 SUB=http-handler
2974time="2019-12-20 12:02:31" level=info msg="using default rule" MAIN=http REQUEST_ID=7591555548271388990 SUB=http-handler
2975time="2019-12-20 12:02:31" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=7591555548271388990 SUB=http-handler
2976time="2019-12-20 12:02:31" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (69.461µs)" MAIN=http REQUEST_ID=7591555548271388990 SUB=http-handler
29772019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_30] INFO: 87BB01C9-791C-49EE-A902-0D160202E4D1: 127.0.0.1 "GET /ambassador/v0/diag/" START
29782019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_30] INFO: DEBUG_MODE False
2979status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
29802019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_30] INFO: 87BB01C9-791C-49EE-A902-0D160202E4D1: 127.0.0.1 "GET /ambassador/v0/diag/" 18ms 200 success
2981time="2019-12-20 12:02:31" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=3513612975212046462 SUB=http-handler
2982time="2019-12-20 12:02:31" level=info msg="using default rule" MAIN=http REQUEST_ID=3513612975212046462 SUB=http-handler
2983time="2019-12-20 12:02:31" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=3513612975212046462 SUB=http-handler
2984time="2019-12-20 12:02:31" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (80.271µs)" MAIN=http REQUEST_ID=3513612975212046462 SUB=http-handler
29852019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_11] INFO: 16BC048F-0C69-4DCA-A8EB-8699108D12D3: 127.0.0.1 "GET /ambassador/v0/diag/" START
29862019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_11] INFO: DEBUG_MODE False
2987status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
29882019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_11] INFO: 16BC048F-0C69-4DCA-A8EB-8699108D12D3: 127.0.0.1 "GET /ambassador/v0/diag/" 17ms 200 success
2989time="2019-12-20 12:02:31" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /openapi/services" MAIN=http REQUEST_ID=13722017598437411750 SUB=http-handler
2990time="2019-12-20 12:02:31" level=info msg="using default rule" MAIN=http REQUEST_ID=13722017598437411750 SUB=http-handler
2991time="2019-12-20 12:02:31" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=13722017598437411750 SUB=http-handler
2992time="2019-12-20 12:02:31" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (55.41µs)" MAIN=http REQUEST_ID=13722017598437411750 SUB=http-handler
2993time="2019-12-20 12:02:31" level=info msg="HTTP request" method=GET request=/openapi/services status_code=200 subsystem=server
29942019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
29952019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: YAML: using C parser
29962019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: YAML: using C dumper
29972019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook ERROR: https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1: <RichStatus BAD error=<Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1> defines Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1, which is already defined by https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1 hostname=ambassador-544fbbf997-rttjd version=1.0.0-ea7>
29982019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook ERROR: ERROR ERROR ERROR Starting with configuration errors
29992019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: IRTLSContext setup good: {
30002019/12/20 12:02:31 aggregator: watch hook stderr: "_active": false,
30012019/12/20 12:02:31 aggregator: watch hook stderr: "_errored": false,
30022019/12/20 12:02:31 aggregator: watch hook stderr: "_rkey": "fallback-self-signed-context.99999",
30032019/12/20 12:02:31 aggregator: watch hook stderr: "hosts": [
30042019/12/20 12:02:31 aggregator: watch hook stderr: "*"
30052019/12/20 12:02:31 aggregator: watch hook stderr: ],
30062019/12/20 12:02:31 aggregator: watch hook stderr: "kind": "IRTLSContext",
30072019/12/20 12:02:31 aggregator: watch hook stderr: "location": "-internal-",
30082019/12/20 12:02:31 aggregator: watch hook stderr: "name": "fallback-self-signed-context",
30092019/12/20 12:02:31 aggregator: watch hook stderr: "namespace": "ambassador",
30102019/12/20 12:02:31 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
30112019/12/20 12:02:31 aggregator: watch hook stderr: "secret_info": {
30122019/12/20 12:02:31 aggregator: watch hook stderr: "secret": "fallback-self-signed-cert"
30132019/12/20 12:02:31 aggregator: watch hook stderr: }
30142019/12/20 12:02:31 aggregator: watch hook stderr: }
30152019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
30162019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
30172019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
30182019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io setting up
30192019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io: TLS secret name is 22a1d2b2.eu.ngrok.io
30202019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: found secret_info
30212019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: found secret, asking handler to cache
30222019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io: creating TLSContext 22a1d2b2.eu.ngrok.io-context
30232019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: IRTLSContext setup good: {
30242019/12/20 12:02:31 aggregator: watch hook stderr: "_active": false,
30252019/12/20 12:02:31 aggregator: watch hook stderr: "_errored": false,
30262019/12/20 12:02:31 aggregator: watch hook stderr: "_rkey": "22a1d2b2.eu.ngrok.io.default.1",
30272019/12/20 12:02:31 aggregator: watch hook stderr: "hosts": [
30282019/12/20 12:02:31 aggregator: watch hook stderr: "22a1d2b2.eu.ngrok.io"
30292019/12/20 12:02:31 aggregator: watch hook stderr: ],
30302019/12/20 12:02:31 aggregator: watch hook stderr: "kind": "IRTLSContext",
30312019/12/20 12:02:31 aggregator: watch hook stderr: "location": "22a1d2b2.eu.ngrok.io.default.1",
30322019/12/20 12:02:31 aggregator: watch hook stderr: "name": "22a1d2b2.eu.ngrok.io-context",
30332019/12/20 12:02:31 aggregator: watch hook stderr: "namespace": "default",
30342019/12/20 12:02:31 aggregator: watch hook stderr: "redirect_cleartext_from": 8080,
30352019/12/20 12:02:31 aggregator: watch hook stderr: "secret_info": {
30362019/12/20 12:02:31 aggregator: watch hook stderr: "secret": "22a1d2b2.eu.ngrok.io"
30372019/12/20 12:02:31 aggregator: watch hook stderr: }
30382019/12/20 12:02:31 aggregator: watch hook stderr: }
30392019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: Host 22a1d2b2.eu.ngrok.io: ACME private key name is https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com
30402019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: resolve_secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default: no secret_info, asking handler to load
30412019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: resolve_secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default: found secret, asking handler to cache
30422019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
30432019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
30442019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
30452019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: TLSContext.resolve_secret 22a1d2b2.eu.ngrok.io, namespace default: namespacing is True
30462019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: resolve_secret 22a1d2b2.eu.ngrok.io: using cached SavedSecret
30472019/12/20 12:02:31 aggregator: watch hook stderr: 2019-12-20 12:02:31 watch-hook INFO: IR: watching Edge Stack; wizard allowed
30482019/12/20 12:02:31 aggregator: watch hook stderr:
30492019/12/20 12:02:31 aggregator: found 7 kubernetes watches
30502019/12/20 12:02:31 aggregator: found 0 consul watches
30512019/12/20 12:02:31 kubewatchman: processing 7 kubernetes watch specs
30522019/12/20 12:02:31 consulwatchman: processing 0 consul watches
30532019/12/20 12:02:31 invoker: deleting snapshot 4
30542019/12/20 12:02:31 notify: python /ambassador/post_update.py --watt http://localhost:8002/snapshots/14
30552019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_1] INFO: Update requested: watt, http://localhost:8002/snapshots/14
30562019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: copying configuration: watt, http://localhost:8002/snapshots/14 to /ambassador/snapshots/snapshot-tmp.yaml
30572019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: reading edge-stack-mappings.yaml (/ambassador/init-config/edge-stack-mappings.yaml)
30582019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1: <RichStatus BAD error=<Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1> defines Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1, which is already defined by https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1 hostname=ambassador-544fbbf997-rttjd version=1.0.0-ea7>
30592019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: ERROR ERROR ERROR Starting with configuration errors
30602019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IRTLSContext setup good: {
3061 "_active": false,
3062 "_errored": false,
3063 "_rkey": "fallback-self-signed-context.99999",
3064 "hosts": [
3065 "*"
3066 ],
3067 "kind": "IRTLSContext",
3068 "location": "-internal-",
3069 "name": "fallback-self-signed-context",
3070 "namespace": "ambassador",
3071 "redirect_cleartext_from": 8080,
3072 "secret_info": {
3073 "secret": "fallback-self-signed-cert"
3074 }
3075}
30762019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
30772019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
30782019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
30792019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io setting up
30802019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io: TLS secret name is 22a1d2b2.eu.ngrok.io
30812019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: found secret_info
30822019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret 22a1d2b2.eu.ngrok.io.default: found secret, asking handler to cache
30832019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io: creating TLSContext 22a1d2b2.eu.ngrok.io-context
30842019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IRTLSContext setup good: {
3085 "_active": false,
3086 "_errored": false,
3087 "_rkey": "22a1d2b2.eu.ngrok.io.default.1",
3088 "hosts": [
3089 "22a1d2b2.eu.ngrok.io"
3090 ],
3091 "kind": "IRTLSContext",
3092 "location": "22a1d2b2.eu.ngrok.io.default.1",
3093 "name": "22a1d2b2.eu.ngrok.io-context",
3094 "namespace": "default",
3095 "redirect_cleartext_from": 8080,
3096 "secret_info": {
3097 "secret": "22a1d2b2.eu.ngrok.io"
3098 }
3099}
31002019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Host 22a1d2b2.eu.ngrok.io: ACME private key name is https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com
31012019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default: no secret_info, asking handler to load
31022019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default unknown
31032019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] ERROR: Host 22a1d2b2.eu.ngrok.io: continuing with invalid private key secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com
31042019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret fallback-self-signed-cert, namespace ambassador: namespacing is True
31052019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret_info
31062019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret fallback-self-signed-cert.ambassador: found secret, asking handler to cache
31072019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: TLSContext.resolve_secret 22a1d2b2.eu.ngrok.io, namespace default: namespacing is True
31082019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: resolve_secret 22a1d2b2.eu.ngrok.io: using cached SavedSecret
31092019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: IR: starting Edge Stack; wizard allowed
31102019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: ctx fallback-self-signed-context is the primary termination context
31112019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: ctx 22a1d2b2.eu.ngrok.io-context is a termination context
31122019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: ListenerFactory: creating redirect listener on 8080
31132019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: Using log_format 'ACCESS [%START_TIME%] "%REQ(:METHOD)% %REQ(X-ENVOY-ORIGINAL-PATH?:PATH)% %PROTOCOL%" %RESPONSE_CODE% %RESPONSE_FLAGS% %BYTES_RECEIVED% %BYTES_SENT% %DURATION% %RESP(X-ENVOY-UPSTREAM-SERVICE-TIME)% "%REQ(X-FORWARDED-FOR)%" "%REQ(USER-AGENT)%" "%REQ(X-REQUEST-ID)%" "%REQ(:AUTHORITY)%" "%UPSTREAM_HOST%"'
31142019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI (1) route check fallback-self-signed-context - ['*']
31152019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI (1) route check 22a1d2b2.eu.ngrok.io-context - ['22a1d2b2.eu.ngrok.io']
31162019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
3117[
3118 {
3119 "ctx_hosts": [
3120 "*"
3121 ],
3122 "ctx_name": "fallback-self-signed-context",
3123 "filter_chain_match": {
3124 "transport_protocol": "tls"
3125 },
3126 "route_count": 9
3127 },
3128 {
3129 "ctx_hosts": [
3130 "22a1d2b2.eu.ngrok.io"
3131 ],
3132 "ctx_name": "22a1d2b2.eu.ngrok.io-context",
3133 "filter_chain_match": {
3134 "server_names": [
3135 "22a1d2b2.eu.ngrok.io"
3136 ],
3137 "transport_protocol": "tls"
3138 },
3139 "route_count": 9
3140 }
3141]
31422019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
31432019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
3144[
3145 {
3146 "ctx_hosts": [
3147 "*"
3148 ],
3149 "ctx_name": "fallback-self-signed-context",
3150 "filter_chain_match": {
3151 "transport_protocol": "tls"
3152 },
3153 "route_count": 9
3154 },
3155 {
3156 "ctx_hosts": [
3157 "22a1d2b2.eu.ngrok.io"
3158 ],
3159 "ctx_name": "22a1d2b2.eu.ngrok.io-context",
3160 "filter_chain_match": {
3161 "server_names": [
3162 "22a1d2b2.eu.ngrok.io"
3163 ],
3164 "transport_protocol": "tls"
3165 },
3166 "route_count": 9
3167 },
3168 {
3169 "ctx_hosts": [
3170 "*"
3171 ],
3172 "ctx_name": "-cleartext-",
3173 "filter_chain_match": {},
3174 "route_count": 9
3175 }
3176]
31772019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: enabling TLS inspector
31782019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: no filter chains, need cleartext
31792019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: wizard allowed, need cleartext
31802019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2Listener: SNI filter chains
3181[
3182 {
3183 "ctx_hosts": [
3184 "*"
3185 ],
3186 "ctx_name": "-cleartext-",
3187 "filter_chain_match": {},
3188 "route_count": 1
3189 }
3190]
31912019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: V2L: leaving TLS inspector disabled
31922019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: -global-: NOTICE: A future Ambassador version will change the GRPC protocol version for AuthServices and RateLimitServices. See the CHANGELOG for details.
31932019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: successfully validated the resulting envoy configuration, continuing...
31942019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: saving Envoy configuration for snapshot 14
31952019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: running 'kill -HUP 1'
3196KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal-api.ambassador
3197KubeStatus MASTER 306: mark_live Mapping/ambassador-devportal.ambassador
3198KubeStatus MASTER 306: mark_live Mapping/ambassador-edge-stack.ambassador
3199KubeStatus MASTER 306: mark_live Mapping/edgestack-direct-mapping.ambassador
3200KubeStatus MASTER 306: mark_live Mapping/edgestack-fallback-mapping.ambassador
3201KubeStatus MASTER 306: mark_live Mapping/httpbin.default
32022019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal-api.ambassador, {"state": "Running"}...
3203KubeStatus MASTER 306: Mapping/ambassador-devportal-api.ambassador == {"state": "Running"}
32042019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-devportal.ambassador, {"state": "Running"}...
3205KubeStatus MASTER 306: Mapping/ambassador-devportal.ambassador == {"state": "Running"}
32062019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping ambassador-edge-stack.ambassador, {"state": "Running"}...
3207KubeStatus MASTER 306: Mapping/ambassador-edge-stack.ambassador == {"state": "Running"}
32082019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-direct-mapping.ambassador, {"state": "Running"}...
3209KubeStatus MASTER 306: Mapping/edgestack-direct-mapping.ambassador == {"state": "Running"}
32102019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping edgestack-fallback-mapping.ambassador, {"state": "Running"}...
3211KubeStatus MASTER 306: Mapping/edgestack-fallback-mapping.ambassador == {"state": "Running"}
32122019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: K8s status update: Mapping httpbin.default, {"state": "Running"}...
3213KubeStatus MASTER 306: Mapping/httpbin.default == {"state": "Running"}
32142019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: configuration updated from snapshot 14
32152019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: error https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1 <Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1> defines Secret https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1, which is already defined by https-3a-2f-2facme-2dv02.api.letsencrypt.org-2fdirectory--test-40test.com.default.1
32162019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout reports {"latest_version": "1.0.0", "application": "aes", "cached": true, "timestamp": 1576843342.321342}
32172019-12-20 12:02:31 diagd 1.0.0-ea7 [P306TAmbassadorEventWatcher] INFO: Scout notices: [{"level": "DEBUG", "message": "Returning cached result"}, {"level": "INFO", "message": "Upgrade available! to Ambassador version 1.0.0"}]
3218time="2019-12-20T12:02:31Z" level=info msg="Loaded file /ambassador/envoy/envoy.json"
3219time="2019-12-20T12:02:31Z" level=info msg="Pushing snapshot v14"
3220[2019-12-20 12:02:31.635][406][info][upstream] [source/common/upstream/cds_api_impl.cc:67] cds: add 4 cluster(s), remove 1 cluster(s)
3221[2019-12-20 12:02:31.637][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
3222[2019-12-20 12:02:31.637][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
3223[2019-12-20 12:02:31.637][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.FilterChain.tls_context' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
3224[2019-12-20 12:02:31.637][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
3225[2019-12-20 12:02:31.637][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
3226[2019-12-20 12:02:31.638][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.ListenerFilter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
3227[2019-12-20 12:02:31.639][406][warning][misc] [source/common/protobuf/utility.cc:282] Using deprecated option 'envoy.api.v2.listener.Filter.config' from file listener.proto. This configuration will be removed from Envoy soon. Please see https://www.envoyproxy.io/docs/envoy/latest/intro/deprecated for details.
3228time="2019-12-20 12:02:32" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=15420880478533566643 SUB=http-handler
3229time="2019-12-20 12:02:32" level=info msg="using default rule" MAIN=http REQUEST_ID=15420880478533566643 SUB=http-handler
3230time="2019-12-20 12:02:32" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=15420880478533566643 SUB=http-handler
3231time="2019-12-20 12:02:32" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (47.651µs)" MAIN=http REQUEST_ID=15420880478533566643 SUB=http-handler
32322019-12-20 12:02:32 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_25] INFO: 09B3469D-24C1-4537-A4DC-5088017EF074: 127.0.0.1 "GET /ambassador/v0/diag/" START
32332019-12-20 12:02:32 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_25] INFO: DEBUG_MODE False
3234status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
32352019-12-20 12:02:32 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_25] INFO: 09B3469D-24C1-4537-A4DC-5088017EF074: 127.0.0.1 "GET /ambassador/v0/diag/" 14ms 200 success
3236time="2019-12-20 12:02:32" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=12457955104760263188 SUB=http-handler
3237time="2019-12-20 12:02:32" level=info msg="using default rule" MAIN=http REQUEST_ID=12457955104760263188 SUB=http-handler
3238time="2019-12-20 12:02:32" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=12457955104760263188 SUB=http-handler
3239time="2019-12-20 12:02:32" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (60.041µs)" MAIN=http REQUEST_ID=12457955104760263188 SUB=http-handler
32402019-12-20 12:02:32 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_12] INFO: 174D145C-2B1B-4975-BDD7-ED1AAA2067D8: 127.0.0.1 "GET /ambassador/v0/diag/" START
32412019-12-20 12:02:32 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_12] INFO: DEBUG_MODE False
3242status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
32432019-12-20 12:02:32 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_12] INFO: 174D145C-2B1B-4975-BDD7-ED1AAA2067D8: 127.0.0.1 "GET /ambassador/v0/diag/" 14ms 200 success
3244time="2019-12-20 12:02:32" level=info msg="[gRPC] HTTP/1.1 POST 22a1d2b2.eu.ngrok.io /edge_stack/api/activity" MAIN=http REQUEST_ID=16366887913714072377 SUB=http-handler
3245time="2019-12-20 12:02:32" level=info msg="using default rule" MAIN=http REQUEST_ID=16366887913714072377 SUB=http-handler
3246time="2019-12-20 12:02:32" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=16366887913714072377 SUB=http-handler
3247time="2019-12-20 12:02:32" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (53.28µs)" MAIN=http REQUEST_ID=16366887913714072377 SUB=http-handler
3248time="2019-12-20 12:02:33" level=info msg="[gRPC] HTTP/1.1 POST 22a1d2b2.eu.ngrok.io /edge_stack/api/activity" MAIN=http REQUEST_ID=742782341210676833 SUB=http-handler
3249time="2019-12-20 12:02:33" level=info msg="using default rule" MAIN=http REQUEST_ID=742782341210676833 SUB=http-handler
3250time="2019-12-20 12:02:33" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=742782341210676833 SUB=http-handler
3251time="2019-12-20 12:02:33" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (69.06µs)" MAIN=http REQUEST_ID=742782341210676833 SUB=http-handler
3252time="2019-12-20 12:02:33" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=11957821706837071795 SUB=http-handler
3253time="2019-12-20 12:02:33" level=info msg="using default rule" MAIN=http REQUEST_ID=11957821706837071795 SUB=http-handler
3254time="2019-12-20 12:02:33" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=11957821706837071795 SUB=http-handler
3255time="2019-12-20 12:02:33" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (43.671µs)" MAIN=http REQUEST_ID=11957821706837071795 SUB=http-handler
32562019-12-20 12:02:33 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_23] INFO: 77F7DEBC-4A17-4BD7-9441-78932796C2B2: 127.0.0.1 "GET /ambassador/v0/diag/" START
32572019-12-20 12:02:33 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_23] INFO: DEBUG_MODE False
3258status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
32592019-12-20 12:02:33 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_23] INFO: 77F7DEBC-4A17-4BD7-9441-78932796C2B2: 127.0.0.1 "GET /ambassador/v0/diag/" 14ms 200 success
3260time="2019-12-20 12:02:33" level=info msg="[gRPC] HTTP/1.1 POST 22a1d2b2.eu.ngrok.io /edge_stack/api/activity" MAIN=http REQUEST_ID=4005299448367483282 SUB=http-handler
3261time="2019-12-20 12:02:33" level=info msg="using default rule" MAIN=http REQUEST_ID=4005299448367483282 SUB=http-handler
3262time="2019-12-20 12:02:33" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=4005299448367483282 SUB=http-handler
3263time="2019-12-20 12:02:33" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (83.35µs)" MAIN=http REQUEST_ID=4005299448367483282 SUB=http-handler
3264time="2019-12-20 12:02:33" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=18332945561966785137 SUB=http-handler
3265time="2019-12-20 12:02:33" level=info msg="using default rule" MAIN=http REQUEST_ID=18332945561966785137 SUB=http-handler
3266time="2019-12-20 12:02:33" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=18332945561966785137 SUB=http-handler
3267time="2019-12-20 12:02:33" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (57.59µs)" MAIN=http REQUEST_ID=18332945561966785137 SUB=http-handler
32682019-12-20 12:02:33 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_14] INFO: 6E1EFACD-41C7-400D-8E51-6C7BFCA0C925: 127.0.0.1 "GET /ambassador/v0/diag/" START
32692019-12-20 12:02:33 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_14] INFO: DEBUG_MODE False
3270status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
32712019-12-20 12:02:33 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_14] INFO: 6E1EFACD-41C7-400D-8E51-6C7BFCA0C925: 127.0.0.1 "GET /ambassador/v0/diag/" 15ms 200 success
3272time="2019-12-20 12:02:34" level=info msg="[gRPC] HTTP/1.1 POST 22a1d2b2.eu.ngrok.io /edge_stack/api/activity" MAIN=http REQUEST_ID=586224772594364077 SUB=http-handler
3273time="2019-12-20 12:02:34" level=info msg="using default rule" MAIN=http REQUEST_ID=586224772594364077 SUB=http-handler
3274time="2019-12-20 12:02:34" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=586224772594364077 SUB=http-handler
3275time="2019-12-20 12:02:34" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (65.65µs)" MAIN=http REQUEST_ID=586224772594364077 SUB=http-handler
3276time="2019-12-20 12:02:34" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=4779885670523349500 SUB=http-handler
3277time="2019-12-20 12:02:34" level=info msg="using default rule" MAIN=http REQUEST_ID=4779885670523349500 SUB=http-handler
3278time="2019-12-20 12:02:34" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=4779885670523349500 SUB=http-handler
3279time="2019-12-20 12:02:34" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (58.041µs)" MAIN=http REQUEST_ID=4779885670523349500 SUB=http-handler
32802019-12-20 12:02:34 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_28] INFO: B9EC8B79-8EC3-45C4-AD18-8F093118A048: 127.0.0.1 "GET /ambassador/v0/diag/" START
32812019-12-20 12:02:34 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_28] INFO: DEBUG_MODE False
3282status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
32832019-12-20 12:02:34 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_28] INFO: B9EC8B79-8EC3-45C4-AD18-8F093118A048: 127.0.0.1 "GET /ambassador/v0/diag/" 16ms 200 success
3284time="2019-12-20 12:02:35" level=info msg="[gRPC] HTTP/1.1 POST 22a1d2b2.eu.ngrok.io /edge_stack/api/activity" MAIN=http REQUEST_ID=6080412852307188648 SUB=http-handler
3285time="2019-12-20 12:02:35" level=info msg="using default rule" MAIN=http REQUEST_ID=6080412852307188648 SUB=http-handler
3286time="2019-12-20 12:02:35" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=6080412852307188648 SUB=http-handler
3287time="2019-12-20 12:02:35" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (69.08µs)" MAIN=http REQUEST_ID=6080412852307188648 SUB=http-handler
3288time="2019-12-20 12:02:35" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=5517711297774490178 SUB=http-handler
3289time="2019-12-20 12:02:35" level=info msg="using default rule" MAIN=http REQUEST_ID=5517711297774490178 SUB=http-handler
3290time="2019-12-20 12:02:35" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=5517711297774490178 SUB=http-handler
3291time="2019-12-20 12:02:35" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (63.781µs)" MAIN=http REQUEST_ID=5517711297774490178 SUB=http-handler
32922019-12-20 12:02:35 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_10] INFO: 3EBDC754-42E4-409B-97BC-B0A0BE3045FE: 127.0.0.1 "GET /ambassador/v0/diag/" START
32932019-12-20 12:02:35 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_10] INFO: DEBUG_MODE False
3294status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
32952019-12-20 12:02:35 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_10] INFO: 3EBDC754-42E4-409B-97BC-B0A0BE3045FE: 127.0.0.1 "GET /ambassador/v0/diag/" 12ms 200 success
3296time="2019-12-20 12:02:35" level=info msg="[gRPC] HTTP/1.1 POST 22a1d2b2.eu.ngrok.io /edge_stack/api/activity" MAIN=http REQUEST_ID=3529846677166276549 SUB=http-handler
3297time="2019-12-20 12:02:35" level=info msg="using default rule" MAIN=http REQUEST_ID=3529846677166276549 SUB=http-handler
3298time="2019-12-20 12:02:35" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=3529846677166276549 SUB=http-handler
3299time="2019-12-20 12:02:35" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (57.191µs)" MAIN=http REQUEST_ID=3529846677166276549 SUB=http-handler
3300time="2019-12-20 12:02:36" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=18302665878696651006 SUB=http-handler
3301time="2019-12-20 12:02:36" level=info msg="using default rule" MAIN=http REQUEST_ID=18302665878696651006 SUB=http-handler
3302time="2019-12-20 12:02:36" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=18302665878696651006 SUB=http-handler
3303time="2019-12-20 12:02:36" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (64.901µs)" MAIN=http REQUEST_ID=18302665878696651006 SUB=http-handler
33042019-12-20 12:02:36 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_5] INFO: 26259C21-3DED-4B99-8E4E-4D0F4669999E: 127.0.0.1 "GET /ambassador/v0/diag/" START
33052019-12-20 12:02:36 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_5] INFO: DEBUG_MODE False
3306status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
33072019-12-20 12:02:36 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_5] INFO: 26259C21-3DED-4B99-8E4E-4D0F4669999E: 127.0.0.1 "GET /ambassador/v0/diag/" 16ms 200 success
3308time="2019-12-20 12:02:36" level=info msg="[gRPC] HTTP/1.1 POST 22a1d2b2.eu.ngrok.io /edge_stack/api/activity" MAIN=http REQUEST_ID=15232336539518151504 SUB=http-handler
3309time="2019-12-20 12:02:36" level=info msg="using default rule" MAIN=http REQUEST_ID=15232336539518151504 SUB=http-handler
3310time="2019-12-20 12:02:36" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=15232336539518151504 SUB=http-handler
3311time="2019-12-20 12:02:36" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (64.961µs)" MAIN=http REQUEST_ID=15232336539518151504 SUB=http-handler
3312time="2019-12-20 12:02:36" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=6068035908016657212 SUB=http-handler
3313time="2019-12-20 12:02:36" level=info msg="using default rule" MAIN=http REQUEST_ID=6068035908016657212 SUB=http-handler
3314time="2019-12-20 12:02:36" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=6068035908016657212 SUB=http-handler
3315time="2019-12-20 12:02:36" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (59.87µs)" MAIN=http REQUEST_ID=6068035908016657212 SUB=http-handler
33162019-12-20 12:02:36 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_31] INFO: B8430689-9ED5-4BF7-B681-F19971402EA2: 127.0.0.1 "GET /ambassador/v0/diag/" START
3317ACCESS [2019-12-20T12:02:27.344Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 139829 20 18 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "ceb10ecc-de9d-44b2-b7fe-39efabcb61ef" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3318ACCESS [2019-12-20T12:02:27.535Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 140007 18 17 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "c7d1a783-a76b-4578-922c-d5615079e3fa" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3319ACCESS [2019-12-20T12:02:28.621Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 140192 16 14 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "178da40b-1917-45cd-846d-cdbf11be8edc" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3320ACCESS [2019-12-20T12:02:28.812Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 140370 19 18 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "8566ba7b-9b48-4a15-9ae5-746dfea76e17" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3321ACCESS [2019-12-20T12:02:28.911Z] "POST /edge_stack/api/activity HTTP/1.1" 200 - 0 0 3 3 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "6ee1af4a-5ebb-4a27-8017-eda54bcba902" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3322ACCESS [2019-12-20T12:02:29.564Z] "POST /edge_stack/api/activity HTTP/1.1" 200 - 0 0 3 2 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "ac982fd1-0c5c-401a-81eb-3145ccf191c7" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3323ACCESS [2019-12-20T12:02:29.879Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 140548 18 16 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "e09d6248-f596-436c-bdc1-9cc205cd55ef" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3324ACCESS [2019-12-20T12:02:30.032Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 140726 19 17 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "f2127091-6f87-4c50-ab74-37a7e8b3ea51" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3325ACCESS [2019-12-20T12:02:30.203Z] "POST /edge_stack/api/activity HTTP/1.1" 200 - 0 0 3 2 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "facf72c9-6c34-436c-aabe-d00281e00417" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3326ACCESS [2019-12-20T12:02:30.734Z] "POST /edge_stack/api/activity HTTP/1.1" 200 - 0 0 3 2 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "88a95013-9dbb-464b-8b02-1d81262e3567" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3327ACCESS [2019-12-20T12:02:31.134Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 164422 24 23 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "d9fd8c1a-d3b1-4487-8561-3bf9deacb373" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3328ACCESS [2019-12-20T12:02:31.250Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 164600 23 22 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "1fd3f967-3c68-4f6e-945e-1275d7625e56" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3329ACCESS [2019-12-20T12:02:31.288Z] "GET /openapi/services HTTP/1.1" 200 - 0 168 0 0 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "2e43bde6-f33b-4319-bce4-8373980d7835" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3330ACCESS [2019-12-20T12:02:32.377Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 164324 20 18 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "9a4e7deb-68e4-4adb-97d9-9812efb03421" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3331ACCESS [2019-12-20T12:02:32.569Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 164502 20 19 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "501ef9e2-6478-4660-83fa-930862bea791" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3332ACCESS [2019-12-20T12:02:32.975Z] "POST /edge_stack/api/activity HTTP/1.1" 200 - 0 0 3 3 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "b8405553-b429-4068-a41f-c31e497a01c9" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3333ACCESS [2019-12-20T12:02:33.461Z] "POST /edge_stack/api/activity HTTP/1.1" 200 - 0 0 3 2 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "6d18551e-41f5-4a93-859d-51a70b343679" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3334ACCESS [2019-12-20T12:02:33.641Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 164687 21 20 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "97586a99-fc45-4d8a-ac8b-755a23da36b8" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3335ACCESS [2019-12-20T12:02:33.790Z] "POST /edge_stack/api/activity HTTP/1.1" 200 - 0 0 3 3 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "5628621e-3f24-4057-9e30-ba9d4b91afa5" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3336ACCESS [2019-12-20T12:02:33.828Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 164865 20 19 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "788f28a8-4702-4c54-994c-315bc7c19ba2" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3337ACCESS [2019-12-20T12:02:34.173Z] "POST /edge_stack/api/activity HTTP/1.1" 200 - 0 0 3 3 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "4a9b4678-e2bd-4dc5-bd06-f0e3340d3357" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3338ACCESS [2019-12-20T12:02:34.863Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 165043 23 22 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "1b7c2b09-1827-41cf-9ede-abfb3c7c8717" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3339ACCESS [2019-12-20T12:02:35.021Z] "POST /edge_stack/api/activity HTTP/1.1" 200 - 0 0 5 4 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "520dcad9-eafc-49cf-bf4c-63299f4ad071" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3340ACCESS [2019-12-20T12:02:35.056Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 165221 18 17 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "58e3fac6-0b82-4985-8f8e-56758a9fa461" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3341ACCESS [2019-12-20T12:02:35.925Z] "POST /edge_stack/api/activity HTTP/1.1" 200 - 0 0 2 2 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "12fe2cc4-ac89-465b-8824-06a51a7dac3f" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3342ACCESS [2019-12-20T12:02:36.127Z] "GET /edge_stack/api/snapshot HTTP/1.1" 200 - 0 165408 23 21 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "2996fec8-b511-4c48-96a3-c84a4cd1d08c" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
3343ACCESS [2019-12-20T12:02:36.465Z] "POST /edge_stack/api/activity HTTP/1.1" 200 - 0 0 4 3 "170.253.6.170,10.42.0.5" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.79 Safari/537.36" "6032da48-7a9b-4a30-8133-c769c6d925dc" "22a1d2b2.eu.ngrok.io" "127.0.0.1:8500"
33442019-12-20 12:02:36 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_31] INFO: DEBUG_MODE False
3345status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
33462019-12-20 12:02:36 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_31] INFO: B8430689-9ED5-4BF7-B681-F19971402EA2: 127.0.0.1 "GET /ambassador/v0/diag/" 15ms 200 success
3347time="2019-12-20 12:02:37" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=16633582508959528179 SUB=http-handler
3348time="2019-12-20 12:02:37" level=info msg="using default rule" MAIN=http REQUEST_ID=16633582508959528179 SUB=http-handler
3349time="2019-12-20 12:02:37" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=16633582508959528179 SUB=http-handler
3350time="2019-12-20 12:02:37" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (69.98µs)" MAIN=http REQUEST_ID=16633582508959528179 SUB=http-handler
33512019-12-20 12:02:37 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_18] INFO: 5EC60026-3D3D-47EF-9E08-9CE1281DB38E: 127.0.0.1 "GET /ambassador/v0/diag/" START
33522019-12-20 12:02:37 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_18] INFO: DEBUG_MODE False
3353status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
33542019-12-20 12:02:37 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_18] INFO: 5EC60026-3D3D-47EF-9E08-9CE1281DB38E: 127.0.0.1 "GET /ambassador/v0/diag/" 15ms 200 success
3355time="2019-12-20 12:02:37" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=16870208221406463006 SUB=http-handler
3356time="2019-12-20 12:02:37" level=info msg="using default rule" MAIN=http REQUEST_ID=16870208221406463006 SUB=http-handler
3357time="2019-12-20 12:02:37" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=16870208221406463006 SUB=http-handler
3358time="2019-12-20 12:02:37" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (64.41µs)" MAIN=http REQUEST_ID=16870208221406463006 SUB=http-handler
33592019-12-20 12:02:37 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_30] INFO: B930E1E7-C5AF-4FE0-B626-1F27A73FA363: 127.0.0.1 "GET /ambassador/v0/diag/" START
33602019-12-20 12:02:37 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_30] INFO: DEBUG_MODE False
3361status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
33622019-12-20 12:02:37 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_30] INFO: B930E1E7-C5AF-4FE0-B626-1F27A73FA363: 127.0.0.1 "GET /ambassador/v0/diag/" 18ms 200 success
3363time="2019-12-20 12:02:38" level=info msg="[gRPC] HTTP/1.1 POST 22a1d2b2.eu.ngrok.io /edge_stack/api/activity" MAIN=http REQUEST_ID=12288953209219753309 SUB=http-handler
3364time="2019-12-20 12:02:38" level=info msg="using default rule" MAIN=http REQUEST_ID=12288953209219753309 SUB=http-handler
3365time="2019-12-20 12:02:38" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=12288953209219753309 SUB=http-handler
3366time="2019-12-20 12:02:38" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (54.75µs)" MAIN=http REQUEST_ID=12288953209219753309 SUB=http-handler
3367time="2019-12-20 12:02:38" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=7375349302448356180 SUB=http-handler
3368time="2019-12-20 12:02:38" level=info msg="using default rule" MAIN=http REQUEST_ID=7375349302448356180 SUB=http-handler
3369time="2019-12-20 12:02:38" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=7375349302448356180 SUB=http-handler
3370time="2019-12-20 12:02:38" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (77.321µs)" MAIN=http REQUEST_ID=7375349302448356180 SUB=http-handler
33712019-12-20 12:02:38 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_32] INFO: 058F58EC-B21F-4998-B00E-B3D63DC76560: 127.0.0.1 "GET /ambassador/v0/diag/" START
33722019-12-20 12:02:38 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_32] INFO: DEBUG_MODE False
3373status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
33742019-12-20 12:02:38 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_32] INFO: 058F58EC-B21F-4998-B00E-B3D63DC76560: 127.0.0.1 "GET /ambassador/v0/diag/" 14ms 200 success
3375time="2019-12-20 12:02:39" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=2451049207617057583 SUB=http-handler
3376time="2019-12-20 12:02:39" level=info msg="using default rule" MAIN=http REQUEST_ID=2451049207617057583 SUB=http-handler
3377time="2019-12-20 12:02:39" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=2451049207617057583 SUB=http-handler
3378time="2019-12-20 12:02:39" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (56.521µs)" MAIN=http REQUEST_ID=2451049207617057583 SUB=http-handler
33792019-12-20 12:02:39 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_3] INFO: 2E239BBD-5A72-4B54-BEA3-814F3471CD1D: 127.0.0.1 "GET /ambassador/v0/diag/" START
33802019-12-20 12:02:39 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_3] INFO: DEBUG_MODE False
3381status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
33822019-12-20 12:02:39 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_3] INFO: 2E239BBD-5A72-4B54-BEA3-814F3471CD1D: 127.0.0.1 "GET /ambassador/v0/diag/" 16ms 200 success
3383time="2019-12-20 12:02:39" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=4779185912696118033 SUB=http-handler
3384time="2019-12-20 12:02:39" level=info msg="using default rule" MAIN=http REQUEST_ID=4779185912696118033 SUB=http-handler
3385time="2019-12-20 12:02:39" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=4779185912696118033 SUB=http-handler
3386time="2019-12-20 12:02:39" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (64.221µs)" MAIN=http REQUEST_ID=4779185912696118033 SUB=http-handler
33872019-12-20 12:02:39 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_21] INFO: DCF1049C-8F80-4A7F-94A5-F2A3BACA5EAF: 127.0.0.1 "GET /ambassador/v0/diag/" START
33882019-12-20 12:02:39 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_21] INFO: DEBUG_MODE False
3389status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
33902019-12-20 12:02:39 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_21] INFO: DCF1049C-8F80-4A7F-94A5-F2A3BACA5EAF: 127.0.0.1 "GET /ambassador/v0/diag/" 17ms 200 success
3391time="2019-12-20 12:02:40" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=9064766948056309861 SUB=http-handler
3392time="2019-12-20 12:02:40" level=info msg="using default rule" MAIN=http REQUEST_ID=9064766948056309861 SUB=http-handler
3393time="2019-12-20 12:02:40" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=9064766948056309861 SUB=http-handler
3394time="2019-12-20 12:02:40" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (74.66µs)" MAIN=http REQUEST_ID=9064766948056309861 SUB=http-handler
33952019-12-20 12:02:40 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_25] INFO: EBF1FE6D-CEF9-4FDC-A800-39D8C33299E8: 127.0.0.1 "GET /ambassador/v0/diag/" START
33962019-12-20 12:02:40 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_25] INFO: DEBUG_MODE False
3397status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
33982019-12-20 12:02:40 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_25] INFO: EBF1FE6D-CEF9-4FDC-A800-39D8C33299E8: 127.0.0.1 "GET /ambassador/v0/diag/" 17ms 200 success
3399time="2019-12-20 12:02:40" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=11444997964882582381 SUB=http-handler
3400time="2019-12-20 12:02:40" level=info msg="using default rule" MAIN=http REQUEST_ID=11444997964882582381 SUB=http-handler
3401time="2019-12-20 12:02:40" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=11444997964882582381 SUB=http-handler
3402time="2019-12-20 12:02:40" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (75.64µs)" MAIN=http REQUEST_ID=11444997964882582381 SUB=http-handler
34032019-12-20 12:02:40 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_12] INFO: 4148B89A-1708-42CC-B7BD-2DC02B381042: 127.0.0.1 "GET /ambassador/v0/diag/" START
34042019-12-20 12:02:40 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_12] INFO: DEBUG_MODE False
3405status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
34062019-12-20 12:02:40 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_12] INFO: 4148B89A-1708-42CC-B7BD-2DC02B381042: 127.0.0.1 "GET /ambassador/v0/diag/" 13ms 200 success
3407time="2019-12-20 12:02:41" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /openapi/services" MAIN=http REQUEST_ID=7645606996285925942 SUB=http-handler
3408time="2019-12-20 12:02:41" level=info msg="using default rule" MAIN=http REQUEST_ID=7645606996285925942 SUB=http-handler
3409time="2019-12-20 12:02:41" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=7645606996285925942 SUB=http-handler
3410time="2019-12-20 12:02:41" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (70.4µs)" MAIN=http REQUEST_ID=7645606996285925942 SUB=http-handler
3411time="2019-12-20 12:02:41" level=info msg="HTTP request" method=GET request=/openapi/services status_code=200 subsystem=server
3412time="2019-12-20 12:02:41" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=13917698139439888341 SUB=http-handler
3413time="2019-12-20 12:02:41" level=info msg="using default rule" MAIN=http REQUEST_ID=13917698139439888341 SUB=http-handler
3414time="2019-12-20 12:02:41" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=13917698139439888341 SUB=http-handler
3415time="2019-12-20 12:02:41" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (73.11µs)" MAIN=http REQUEST_ID=13917698139439888341 SUB=http-handler
34162019-12-20 12:02:41 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_28] INFO: FEF10C8C-E441-4916-B720-762D32065A1A: 127.0.0.1 "GET /ambassador/v0/diag/" START
34172019-12-20 12:02:41 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_28] INFO: DEBUG_MODE False
3418status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
34192019-12-20 12:02:41 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_28] INFO: FEF10C8C-E441-4916-B720-762D32065A1A: 127.0.0.1 "GET /ambassador/v0/diag/" 17ms 200 success
3420time="2019-12-20 12:02:42" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=154519797912478546 SUB=http-handler
3421time="2019-12-20 12:02:42" level=info msg="using default rule" MAIN=http REQUEST_ID=154519797912478546 SUB=http-handler
3422time="2019-12-20 12:02:42" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=154519797912478546 SUB=http-handler
3423time="2019-12-20 12:02:42" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (73.851µs)" MAIN=http REQUEST_ID=154519797912478546 SUB=http-handler
34242019-12-20 12:02:42 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_24] INFO: 0093143C-58E0-4B94-BA98-BE32308DB16C: 127.0.0.1 "GET /ambassador/v0/diag/" START
34252019-12-20 12:02:42 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_24] INFO: DEBUG_MODE False
3426status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
34272019-12-20 12:02:42 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_24] INFO: 0093143C-58E0-4B94-BA98-BE32308DB16C: 127.0.0.1 "GET /ambassador/v0/diag/" 15ms 200 success
3428time="2019-12-20 12:02:42" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=8552031208458010290 SUB=http-handler
3429time="2019-12-20 12:02:42" level=info msg="using default rule" MAIN=http REQUEST_ID=8552031208458010290 SUB=http-handler
3430time="2019-12-20 12:02:42" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=8552031208458010290 SUB=http-handler
3431time="2019-12-20 12:02:42" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (41.6µs)" MAIN=http REQUEST_ID=8552031208458010290 SUB=http-handler
34322019-12-20 12:02:42 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_10] INFO: 8AA00FA9-20A4-413A-84A6-0407E7C05A91: 127.0.0.1 "GET /ambassador/v0/diag/" START
34332019-12-20 12:02:42 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_10] INFO: DEBUG_MODE False
3434status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
34352019-12-20 12:02:42 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_10] INFO: 8AA00FA9-20A4-413A-84A6-0407E7C05A91: 127.0.0.1 "GET /ambassador/v0/diag/" 12ms 200 success
3436time="2019-12-20 12:02:43" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=12009653750237855865 SUB=http-handler
3437time="2019-12-20 12:02:43" level=info msg="using default rule" MAIN=http REQUEST_ID=12009653750237855865 SUB=http-handler
3438time="2019-12-20 12:02:43" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=12009653750237855865 SUB=http-handler
3439time="2019-12-20 12:02:43" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (91.501µs)" MAIN=http REQUEST_ID=12009653750237855865 SUB=http-handler
34402019-12-20 12:02:43 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_27] INFO: FC9CC170-BB55-40FA-ADA9-4955BDA4EA74: 127.0.0.1 "GET /ambassador/v0/diag/" START
34412019-12-20 12:02:43 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_27] INFO: DEBUG_MODE False
3442status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
34432019-12-20 12:02:43 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_27] INFO: FC9CC170-BB55-40FA-ADA9-4955BDA4EA74: 127.0.0.1 "GET /ambassador/v0/diag/" 14ms 200 success
3444time="2019-12-20 12:02:43" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=9641933473747142470 SUB=http-handler
3445time="2019-12-20 12:02:43" level=info msg="using default rule" MAIN=http REQUEST_ID=9641933473747142470 SUB=http-handler
3446time="2019-12-20 12:02:43" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=9641933473747142470 SUB=http-handler
3447time="2019-12-20 12:02:43" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (79.44µs)" MAIN=http REQUEST_ID=9641933473747142470 SUB=http-handler
34482019-12-20 12:02:43 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_5] INFO: 8146E0F8-7C8E-46A9-9F4A-25CE23E3D4E0: 127.0.0.1 "GET /ambassador/v0/diag/" START
34492019-12-20 12:02:44 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_5] INFO: DEBUG_MODE False
3450status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}
34512019-12-20 12:02:44 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_5] INFO: 8146E0F8-7C8E-46A9-9F4A-25CE23E3D4E0: 127.0.0.1 "GET /ambassador/v0/diag/" 16ms 200 success
3452time="2019-12-20 12:02:44" level=info msg="[gRPC] HTTP/1.1 GET 22a1d2b2.eu.ngrok.io /edge_stack/api/snapshot" MAIN=http REQUEST_ID=18347635386734684915 SUB=http-handler
3453time="2019-12-20 12:02:44" level=info msg="using default rule" MAIN=http REQUEST_ID=18347635386734684915 SUB=http-handler
3454time="2019-12-20 12:02:44" level=info msg="selected rule host=\"\", path=\"\", filters=[]" MAIN=http REQUEST_ID=18347635386734684915 SUB=http-handler
3455time="2019-12-20 12:02:44" level=info msg="[gRPC] *filterapi.HTTPRequestModification : 0 headers (65.751µs)" MAIN=http REQUEST_ID=18347635386734684915 SUB=http-handler
34562019-12-20 12:02:44 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_30] INFO: 2F287F43-4A6B-4235-B879-631A97C44BF5: 127.0.0.1 "GET /ambassador/v0/diag/" START
34572019-12-20 12:02:44 diagd 1.0.0-ea7 [P306TThreadPoolExecutor-0_30] INFO: DEBUG_MODE False
3458status_dict {'Error check': {'status': False, 'specifics': [(False, '1 total error logged')]}, 'TLS': {'status': True, 'specifics': [(True, '1 TLSContext is active')]}, 'Mappings': {'status': True, 'specifics': [(True, '6 Mappings are active')]}}