· 6 years ago · Mar 24, 2020, 06:46 AM
1eksctl create cluster -f nodegroups/dr/cluster.yml
2[ℹ] eksctl version 0.15.0
3[ℹ] using region ap-southeast-1
4[✔] using existing VPC (vpc-2586eb42) and subnets (private:[subnet-0b710a88e8b97b5c4 subnet-0c82eec08a0470b9d] public:[subnet-032c5c35cf3d4bef4 subnet-0eb22060623eca6d8])
5[!] custom VPC/subnets will be used; if resulting cluster doesn't function as expected, make sure to review the configuration of VPC/subnets
6[ℹ] using Kubernetes version 1.14
7[ℹ] creating EKS cluster "dr-eks" in "ap-southeast-1" region with
8[ℹ] will create a CloudFormation stack for cluster itself and 0 nodegroup stack(s)
9[ℹ] will create a CloudFormation stack for cluster itself and 0 managed nodegroup stack(s)
10[ℹ] if you encounter any issues, check CloudFormation console or try 'eksctl utils describe-stacks --region=ap-southeast-1 --cluster=dr-eks'
11[ℹ] CloudWatch logging will not be enabled for cluster "dr-eks" in "ap-southeast-1"
12[ℹ] you can enable it with 'eksctl utils update-cluster-logging --region=ap-southeast-1 --cluster=dr-eks'
13[ℹ] Kubernetes API endpoint access will use default of {publicAccess=true, privateAccess=false} for cluster "dr-eks" in "ap-southeast-1"
14[ℹ] 1 task: { create cluster control plane "dr-eks" }
15[ℹ] building cluster stack "eksctl-dr-eks-cluster"
16[ℹ] deploying stack "eksctl-dr-eks-cluster"
17[✔] all EKS cluster resources for "dr-eks" have been created
18[✔] saved kubeconfig as "/root/.kube/config"
19[✖] unable to use kubectl with the EKS cluster (check 'kubectl version'): usage: aws [options] <command> <subcommand> [<subcommand> ...] [parameters]
20To see help text, you can run:
21
22 aws help
23 aws <command> help
24 aws <command> <subcommand> help
25aws: error: argument command: Invalid choice, valid choices are:
26
27acm | alexaforbusiness
28apigateway | application-autoscaling
29appstream | appsync
30athena | autoscaling
31autoscaling-plans | batch
32budgets | ce
33cloud9 | clouddirectory
34cloudformation | cloudfront
35cloudhsm | cloudhsmv2
36cloudsearch | cloudsearchdomain
37cloudtrail | cloudwatch
38codebuild | codecommit
39codepipeline | codestar
40cognito-identity | cognito-idp
41cognito-sync | comprehend
42cur | datapipeline
43dax | devicefarm
44directconnect | discovery
45dms | ds
46dynamodb | dynamodbstreams
47ec2 | ecr
48ecs | efs
49elasticache | elasticbeanstalk
50elastictranscoder | elb
51elbv2 | emr
52es | events
53firehose | gamelift
54glacier | glue
55greengrass | guardduty
56health | iam
57importexport | inspector
58iot | iot-data
59iot-jobs-data | kinesis
60kinesis-video-archived-media | kinesis-video-media
61kinesisanalytics | kinesisvideo
62kms | lambda
63lex-models | lex-runtime
64lightsail | logs
65machinelearning | marketplace-entitlement
66marketplacecommerceanalytics | mediaconvert
67medialive | mediapackage
68mediastore | mediastore-data
69meteringmarketplace | mgh
70mobile | mq
71mturk | opsworks
72opsworkscm | organizations
73pinpoint | polly
74pricing | rds
75redshift | rekognition
76resource-groups | resourcegroupstaggingapi
77route53 | route53domains
78sagemaker | sagemaker-runtime
79sdb | serverlessrepo
80servicecatalog | servicediscovery
81ses | shield
82sms | snowball
83sns | sqs
84ssm | stepfunctions
85storagegateway | sts
86support | swf
87transcribe | translate
88waf | waf-regional
89workdocs | workmail
90workspaces | xray
91s3api | s3
92configure | deploy
93configservice | opsworks-cm
94runtime.sagemaker | history
95help
96
97
98Invalid choice: 'eks', maybe you meant:
99
100 * es
101Unable to connect to the server: getting credentials: exec: exit status 2
102
103[ℹ] cluster should be functional despite missing (or misconfigured) client binaries
104[✔] EKS cluster "dr-eks" in "ap-southeast-1" region is ready
105+ date
106Tue Mar 24 06:28:27 UTC 2020
107++ ls nodegroups/dr/ng-app.yml nodegroups/dr/ng-default.yml nodegroups/dr/ng-kiam.yml nodegroups/dr/ng-monitoring.yml nodegroups/dr/ng-orch-compute.yml
108+ for ng in $(ls nodegroups/dr/ng-*.yml)
109+ for ng in $(ls nodegroups/dr/ng-*.yml)
110+ eksctl create nodegroup -f nodegroups/dr/ng-app.yml
111+ for ng in $(ls nodegroups/dr/ng-*.yml)
112+ eksctl create nodegroup -f nodegroups/dr/ng-default.yml
113+ for ng in $(ls nodegroups/dr/ng-*.yml)
114+ eksctl create nodegroup -f nodegroups/dr/ng-kiam.yml
115+ for ng in $(ls nodegroups/dr/ng-*.yml)
116+ wait
117+ eksctl create nodegroup -f nodegroups/dr/ng-monitoring.yml
118+ eksctl create nodegroup -f nodegroups/dr/ng-orch-compute.yml
119[ℹ] eksctl version 0.15.0
120[ℹ] using region ap-southeast-1
121[ℹ] eksctl version 0.15.0
122[ℹ] using region ap-southeast-1
123[ℹ] eksctl version 0.15.0
124[ℹ] using region ap-southeast-1
125[ℹ] eksctl version 0.15.0
126[ℹ] using region ap-southeast-1
127[ℹ] eksctl version 0.15.0
128[ℹ] using region ap-southeast-1
129[ℹ] will use version 1.14 for new nodegroup(s) based on control plane version
130[ℹ] will use version 1.14 for new nodegroup(s) based on control plane version
131[ℹ] will use version 1.14 for new nodegroup(s) based on control plane version
132[ℹ] will use version 1.14 for new nodegroup(s) based on control plane version
133[ℹ] will use version 1.14 for new nodegroup(s) based on control plane version
134[!] retryable error (Throttling: Rate exceeded
135 status code: 400, request id: ef93d7ba-19e3-4fd0-88fe-04f2f20930f2) from cloudformation/ListStacks - will retry after delay of 595.387637ms
136[ℹ] nodegroup "ng-default-v1" will use "ami-024ce53b56277d5d5" [AmazonLinux2/1.14]
137[ℹ] nodegroup "ng-kiam-v1" will use "ami-024ce53b56277d5d5" [AmazonLinux2/1.14]
138[ℹ] nodegroup "ng-monitoring-v1" will use "ami-024ce53b56277d5d5" [AmazonLinux2/1.14]
139[ℹ] nodegroup "ng-orch-compute-v1" will use "ami-024ce53b56277d5d5" [AmazonLinux2/1.14]
140[ℹ] using EC2 key pair "kubernetes.prod.vpc.mindtickle.com-b9:75:5f:af:aa:21:30:e7:28:ed:fe:ba:3a:ae:a2:76"
141[ℹ] using EC2 key pair "kubernetes.prod.vpc.mindtickle.com-b9:75:5f:af:aa:21:30:e7:28:ed:fe:ba:3a:ae:a2:76"
142[ℹ] using EC2 key pair "kubernetes.prod.vpc.mindtickle.com-b9:75:5f:af:aa:21:30:e7:28:ed:fe:ba:3a:ae:a2:76"
143[ℹ] using EC2 key pair "kubernetes.prod.vpc.mindtickle.com-b9:75:5f:af:aa:21:30:e7:28:ed:fe:ba:3a:ae:a2:76"
144[!] retryable error (Throttling: Rate exceeded
145 status code: 400, request id: 7f63744c-b3e6-446e-937f-1356f8dbd04d) from cloudformation/ListStacks - will retry after delay of 963.209508ms
146[!] retryable error (Throttling: Rate exceeded
147 status code: 400, request id: a5025356-3250-441a-89de-193f13c1d791) from cloudformation/ListStacks - will retry after delay of 588.882978ms
148[!] retryable error (Throttling: Rate exceeded
149 status code: 400, request id: d6da1d46-6ff5-4aaf-a212-93f6c9b39c9d) from cloudformation/ListStacks - will retry after delay of 530.494431ms
150[!] retryable error (Throttling: Rate exceeded
151 status code: 400, request id: a200ffd8-90a1-445f-a831-8e37c0a5d5ad) from cloudformation/ListStacks - will retry after delay of 519.513734ms
152[!] retryable error (Throttling: Rate exceeded
153 status code: 400, request id: 7566d076-8459-4572-99fb-e5777c5d3b92) from cloudformation/ListStacks - will retry after delay of 1.173720824s
154[ℹ] 1 nodegroup (ng-monitoring-v1) was included (based on the include/exclude rules)
155[ℹ] will create a CloudFormation stack for each of 1 nodegroups in cluster "dr-eks"
156[ℹ] 2 sequential tasks: { fix cluster compatibility, 1 task: { 1 task: { create nodegroup "ng-monitoring-v1" } } }
157[ℹ] checking cluster stack for missing resources
158[ℹ] 1 nodegroup (ng-kiam-v1) was included (based on the include/exclude rules)
159[ℹ] will create a CloudFormation stack for each of 1 nodegroups in cluster "dr-eks"
160[ℹ] 2 sequential tasks: { fix cluster compatibility, 1 task: { 1 task: { create nodegroup "ng-kiam-v1" } } }
161[ℹ] checking cluster stack for missing resources
162[ℹ] 1 nodegroup (ng-default-v1) was included (based on the include/exclude rules)
163[ℹ] will create a CloudFormation stack for each of 1 nodegroups in cluster "dr-eks"
164[ℹ] 2 sequential tasks: { fix cluster compatibility, 1 task: { 1 task: { create nodegroup "ng-default-v1" } } }
165[ℹ] checking cluster stack for missing resources
166[!] retryable error (Throttling: Rate exceeded
167 status code: 400, request id: d3b6952e-96be-46af-8344-ebfab654af74) from cloudformation/ListStacks - will retry after delay of 1.580097402s
168[ℹ] cluster stack is missing resources for Fargate
169[ℹ] adding missing resources to cluster stack
170[ℹ] cluster stack is missing resources for Fargate
171[ℹ] adding missing resources to cluster stack
172[ℹ] cluster stack is missing resources for Fargate
173[ℹ] adding missing resources to cluster stack
174[ℹ] re-building cluster stack "eksctl-dr-eks-cluster"
175[ℹ] updating stack to add new resources [PolicyCloudWatchMetrics PolicyNLB ServiceRole] and outputs []
176[ℹ] re-building cluster stack "eksctl-dr-eks-cluster"
177[ℹ] updating stack to add new resources [PolicyCloudWatchMetrics PolicyNLB ServiceRole] and outputs []
178[ℹ] re-building cluster stack "eksctl-dr-eks-cluster"
179[ℹ] updating stack to add new resources [PolicyCloudWatchMetrics PolicyNLB ServiceRole] and outputs []
180[!] retryable error (Throttling: Rate exceeded
181 status code: 400, request id: 97d9c4b0-90ac-4b8d-914e-5a679d552249) from cloudformation/ListStacks - will retry after delay of 2.254277568s
182[ℹ] 1 nodegroup (ng-orch-compute-v1) was included (based on the include/exclude rules)
183[ℹ] will create a CloudFormation stack for each of 1 nodegroups in cluster "dr-eks"
184[ℹ] 2 sequential tasks: { fix cluster compatibility, 1 task: { 1 task: { create nodegroup "ng-orch-compute-v1" } } }
185[ℹ] checking cluster stack for missing resources
186[ℹ] cluster stack is missing resources for Fargate
187[ℹ] adding missing resources to cluster stack
188[ℹ] re-building cluster stack "eksctl-dr-eks-cluster"
189[ℹ] updating stack to add new resources [PolicyCloudWatchMetrics PolicyNLB ServiceRole] and outputs []
190[ℹ] nodegroup "ng-app-v2" will use "ami-024ce53b56277d5d5" [AmazonLinux2/1.14]
191[ℹ] using EC2 key pair "kubernetes.prod.vpc.mindtickle.com-b9:75:5f:af:aa:21:30:e7:28:ed:fe:ba:3a:ae:a2:76"
192[ℹ] 1 nodegroup (ng-app-v2) was included (based on the include/exclude rules)
193[ℹ] will create a CloudFormation stack for each of 1 nodegroups in cluster "dr-eks"
194[ℹ] 2 sequential tasks: { fix cluster compatibility, 1 task: { 1 task: { create nodegroup "ng-app-v2" } } }
195[ℹ] checking cluster stack for missing resources
196[ℹ] cluster stack is missing resources for Fargate
197[ℹ] adding missing resources to cluster stack
198[ℹ] re-building cluster stack "eksctl-dr-eks-cluster"
199[ℹ] updating stack to add new resources [PolicyCloudWatchMetrics PolicyNLB ServiceRole] and outputs []
200[!] error executing Cloudformation changeSet eksctl-update-cluster-1585031312 in stack eksctl-dr-eks-cluster. Check the Cloudformation console for further details
201[ℹ] 1 error(s) occurred and nodegroups haven't been created properly, you may wish to check CloudFormation console
202[ℹ] to cleanup resources, run 'eksctl delete nodegroup --region=ap-southeast-1 --cluster=dr-eks --name=<name>' for each of the failed nodegroup
203[✖] executing CloudFormation ChangeSet "eksctl-update-cluster-1585031312" for stack "eksctl-dr-eks-cluster": ChangeSetNotFound: ChangeSet [eksctl-update-cluster-1585031312] does not exist
204 status code: 404, request id: cb56d0d5-a96f-4075-9510-dab311f7a76f
205Error: failed to create nodegroups for cluster "dr-eks"
206Error: failed to create nodegroups for cluster "dr-eks"
207[!] error executing Cloudformation changeSet eksctl-update-cluster-1585031312 in stack eksctl-dr-eks-cluster. Check the Cloudformation console for further details
208[ℹ] 1 error(s) occurred and nodegroups haven't been created properly, you may wish to check CloudFormation console
209[ℹ] to cleanup resources, run 'eksctl delete nodegroup --region=ap-southeast-1 --cluster=dr-eks --name=<name>' for each of the failed nodegroup
210[✖] executing CloudFormation ChangeSet "eksctl-update-cluster-1585031312" for stack "eksctl-dr-eks-cluster": ChangeSetNotFound: ChangeSet [eksctl-update-cluster-1585031312] does not exist
211 status code: 404, request id: 9eba20af-474d-4685-a4f9-03222558db21
212[!] retryable error (RequestError: send request failed
213caused by: Post https://cloudformation.ap-southeast-1.amazonaws.com/: EOF) from cloudformation/DescribeChangeSet - will retry after delay of 40.890236ms
214[ℹ] building nodegroup stack "eksctl-dr-eks-nodegroup-ng-monitoring-v1"
215[ℹ] deploying stack "eksctl-dr-eks-nodegroup-ng-monitoring-v1"
216[ℹ] adding identity "arn:aws:iam::191195949309:role/devops-eks-prod-node" to auth ConfigMap
217[ℹ] nodegroup "ng-monitoring-v1" has 0 node(s)
218[ℹ] waiting for at least 2 node(s) to become ready in "ng-monitoring-v1"
219[ℹ] nodegroup "ng-monitoring-v1" has 2 node(s)
220[ℹ] node "ip-10-10-163-45.ap-southeast-1.compute.internal" is ready
221[ℹ] node "ip-10-10-187-228.ap-southeast-1.compute.internal" is ready
222[✔] created 1 nodegroup(s) in cluster "dr-eks"
223[✔] created 0 managed nodegroup(s) in cluster "dr-eks"
224[ℹ] checking security group configuration for all nodegroups
225[ℹ] all nodegroups have up-to-date configuration