The document discusses Amazon Web Services (AWS) Batch and how it can help customers run batch computing workloads on AWS. It notes that AWS Batch automatically provisions the optimal quantity and type of compute resources (e.g., EC2 instances) required to run jobs efficiently. It also allows customers to integrate their own scheduling and application code with AWS Batch through simple API calls or SDKs.
The document discusses Amazon Web Services container management services and Kubernetes. It provides an overview of AWS services like Amazon ECS, EKS, Fargate, ECR, Cloud Map and App Mesh. It also describes Kubernetes concepts like pods, deployments, services, namespaces and control plane/data plane architecture. Amazon EKS is highlighted as a managed Kubernetes service that makes it easy to run Kubernetes on AWS without operating the control plane.
The document discusses Amazon Web Services (AWS) Batch and how it can help customers run batch computing workloads on AWS. It notes that AWS Batch automatically provisions the optimal quantity and type of compute resources (e.g., EC2 instances) required to run jobs efficiently. It also allows customers to integrate their own scheduling and application code with AWS Batch through simple API calls or SDKs.
The document discusses Amazon Web Services container management services and Kubernetes. It provides an overview of AWS services like Amazon ECS, EKS, Fargate, ECR, Cloud Map and App Mesh. It also describes Kubernetes concepts like pods, deployments, services, namespaces and control plane/data plane architecture. Amazon EKS is highlighted as a managed Kubernetes service that makes it easy to run Kubernetes on AWS without operating the control plane.
1. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
K O R E A | M A Y 1 1 - 1 2 , 2 0 2 1
2. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Fault Injection Simulator? ??
?? ??? ?????
???
?? ????????
AWS
??
SW????,
???????
3. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? ?? ???? ???
? ??? ????? ?? ? ???
? AWS Fault Injection Simulator (FIS)
? ?? ?? ? ?? ??
??
4. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Distributed systems are complex
Message
Message
Reply
Reply
Network Server
Client
Message
Message
Reply
Reply
Network
Microservice
?? ¨C ?? ???? ?? ?? - Amazon Builders Library
https://aws.amazon.com/ko/builders-library/challenges-with-distributed-systems
Microservice
5. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
???? ???? ???
??? ?? ???? ? ??!
?? ??? ?? ???
??? ???? ????? ????
?? ?? ???
?? ?? ???
?? ??? ???? ?? ? ??
?? ???
6. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
IOError: No space left on device
close failed in file object destructor:
IOError: No space left on device
close failed in file object destructor:
IOError: No space left on device
close failed in file object destructor:
IOError: No space left on device
close failed in file object destructor:
IOError: No space left on device
close failed in file object destructor:
IOError: No space left on device
close failed in file object destructor:
IOError: No space left on device
??? ??? ?? ??
logfile
ROTATE
logfile.0
ROTATE
logfile.1
ROTATE
logfile.2
ROTATE
logfile.n
ROTATE
7. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Chaos Engineering?
? ??? ?? ??(Failure Injection)
???? ?? ?? ??
??? ???? ??
??? ?? ???? ??? ??
(Monitoring, observability, and alarm¡)
8. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
??? ????? ??? ?? ??
Amazon 2006
GameDay: Creating
Resiliency Through
Destruction
Jesse Robbins
Netflix 2011
Chaos Monkeys:
Test the resilience of
its Infrastructure
Simian Army ¨C Open Source
Chaos Toolkit
Netflix, Dropbox, Uber, Twilio,
Digitla Ocean, LinkedIn, NAB¡
?? ¨C Chaos Engineering Mind Map
http://bit.ly/chaos-engineering-mindmap
9. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
??? ????? ??
????? ???
?? ??? ??
Amazon: 100 ms of extra
load time caused a 1% drop
in sales (Greg Linden).
? 404 ?? 503 ?????
? 300ms?? ??????
? ??? ??? ? ????
What if?
? ??? ?? ??
? ?? ?? ?? ?? ???
? ?? ?? ??? ? ??
??? ????
?? ??
? ?? ?? ? ?? ???
? ?? ?? ?? ???
? ?? ?? ? ??? ???
?? ?? ?
?? ??
? ??? ??(PostMortems)
? ?? ??(Correction of
Errors)
?? ??
?? ??
http://channy.creation.net/blog/netflix-principles-of-chaos-engineering
?? ¨C ??? ????? ?? Principlas of Chaos Engineering
10. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
??? ????? ??? ???
?? ???
??? ???
??? ???
?? ????
??
1
???? ??
????? ??
??
3
2
"??"????
???? ???
(? ?? ?? ??)
4
11. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
???? ?? ??
?? ?? ?? ??
??? ?? ??
AWS Fault Injection Simulator
?? ??? ??? ????? ???
12. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
13. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
?? ????? ??/???? ?? ???
AWS ?? ?? ? AWS CLI? ??
?? ?? ??? ?? ? ??? ?? ??
?? ????? ?? ??
??? ?? ??
14. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
?? ?? ?? ??
??? ?? ?? ??? ?? ??
???? ?? ?? (???, ???,
???? ?)? ??
??? ?? ???? ?? ?? ??
15. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
£¢?? ?? ??£¢ ?? ??
?? ?? ?? ??
Amazon CloudWatch? ??
??? ? IAM ?? ??
???? ?? ??
16. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS FIS ?? ??
AWS Fault Injection
Simulator
Experiment
template
AWS Command
Line Interface
AWS Management
Console
AWS Identity and
Access Management
FIS safeguards
FIS engine
Compute
Start experiment
Third party
AWS
Amazon
EventBridge
Amazon
CloudWatch
alarms
AWS resources
Databases Networking Storage
Compute
Monitoring
Stop experiment
17. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Experiment
templates
(?? ???)
Experiments
(??)
Actions
(??)
Targets
(??)
AWS FIS ?? ??
18. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
19. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Actions - ?? ?? ???? ?? ?? ??
aws:<service-name>:<action-type>
?? ??:
? ?? ??
? ?? ??
? ?? ??
? ?? ??? ??? ???
? ?? ?? ?? ?? ? ?? ??
Actions (??)
AWS FIS ?? ??
20. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Actions (??)
"actions":{
"StopInstances":{
"actionId":"aws:ec2:stop-instances",
"parameters":{
"start-instances-at-end":"true"
},
"duration":"PT10M",
"targets":{
"Instances":"AllTaggedInstances"
}
},
"TerminateInstances":{
"actionId":"aws:ec2:terminate-instances",
"parameters":{
},
"duration":"PT1M",
"targets":{
"Instances":"RandomInstancesInAZ"
},
"startAfter":[
"StopInstances"
]
}
}
AWS FIS ?? ??
21. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
EC2 ???? ???
EC2 ???? ??
EC2 ???? ??
ECS ???? ??
EKS ?? ??
API ?? ?? ??
API ???? ??
API ?? ??
?? ?? ??
DB ???? ??
DB ???? ???
SSM ??? ??
22. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Targets (??)
Targets (??) - ??? ?? ? ?? ??? AWS ???
?? ??:
? ??? ??
? ??? IDs, ?? ? ??
? ?? ?? (e.g., ALL, RANDOM)
AWS FIS ?? ??
23. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
"targets":{
"AllTaggedInstances":{
"resourceType":"aws:ec2:instance",
"resourceTags":{
"Purpose":"chaos-ready"
},
"selectionMode":"ALL"
},
"RandomInstancesInAZ":{
"resourceType":"aws:ec2:instance",
"resourceTags":{
"Purpose":"chaos-ready"
},
"filters":[
{
"path":"Placement.AvailabilityZone¡¯,
values: [¡®us.east.1a¡¯]
},
{
path: ¡±state.Name",
"values":['running¡¯]
}
]
}
]
Targets
AWS FIS ?? ??
24. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Experiment templates ?? ??? ?? ??
??? ??:
? Actions (??)
? Targets (??)
? Stop condition alarms (?? ??)
? IAM ??
? ??
? ??
Experiment
templates
(?? ???)
AWS FIS ?? ??
25. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Experiment
templates
(?? ???)
AWS FIS ?? ??
{
"tags¡±: {
"Name": "StopAndRestartRandomeInstance"
},
"description": "Valkyrie Stop and Restart One Random Instance",
"roleArn": "arn:aws:iam::0123456789:role/MyFISExperimentRole¡±,
"stopConditions": [
{
"source": "aws:cloudwatch:alarm",
"value": " "arn:aws:cloudwatch::alarm:No_Traffic"
}
],
"targets": {
"myInstance": {
"resourceTags": {
¡±Purpose": "chaos-ready"
},
"resourceType": "aws:ec2:instance",
"selectionMode": ¡±RANDOM(1)"
}
},
"actions": {
"StopInstances": {
"actionId": "aws:ec2:stop-instances",
"description": "stop the instances",
"duration": "PT2M",
"parameters": {
"start-instances-at-end": "true"
},
"targets": {
"Instances": "myInstance"
}
}
Description
IAM role
Stop conditions
Targets
Actions
Name
26. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
27. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Experiment template A
Stop conditions
Targets
Actions Action 1 Action 2
Amazon
CloudWatch alarm
i-aaaa i-bbbb i-cccc
Specific EC2 instances
Experiment template B
Stop conditions
Targets
Actions
Action 3
Action 1
Action 2
Amazon CloudWatch
alarms
All EC2 instances with
¡°chaos-ready¡± tag
AWS FIS ?? ????
28. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Experiments (??)? ?? ???? ??? ?? ? ??
?? ??? ?? ??:
? ?? ?? ?
? ?? ? ?? ??
? ??
? ?? ID
? ?? ??? ID
? IAM ?? ARN
Experiments
AWS FIS ?? ??
29. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
30. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
31. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
??? ????? ??? ?????
? ??? ???? ????? ?? ??,
?? ? ????? ?? ???? ??
? ??? ??(risk-free) ??? ? ????
?? ??? ???? ?? AWS ???
?? ??? ???? ? ?? ??
? AWS ???? ?? ?? ??
1) AWS Game Day ????
32. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
??? ????? ??? ?????
? ??? ?????? ?? ???
??? ??? ??? ????.
? ??? ?? ? ??, ?? ??, ????
?? ?? ?????.
2) ???? ????
https://www.facebook.com/groups/chaosengkorea/
https://www.meetup.com/Korea-Chaos-Engineering-Community/
33. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? ??? ?? ??? ???? ?? ??? ?? ???, ??? ?? ??
??? ????, ?? ?? ??? ????? ??? ??? ? ??.
? AWS ??? ??? ???? ??? ?? ?? ??? ?? AWS Fault
Injection Simulator ???? ??? ? ??.
? Amazon EC2, ECS, EKS, RDS ??? ?? ?? ? API ??, ?? ?? ??
?? ??? ??? ????, ?? ?? ?? ?? ????.
? JSON/YAML ?? ?? ???? AWS SSM ??? ??? ?? ? ???
??? ??? ???? ??? ? ??.
? ??? ??? ?? ? ? ??? ??? ?? ????, ?? ??? ?
???? ?? ???? ??? ? ??.
???
34. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
? ??? ?? ??? ???? ?? ??? ?? ???, ??? ?? ??
??? ????, ?? ?? ??? ????? ??? ??? ? ??.
? AWS ??? ??? ???? ??? ?? ?? ??? ?? AWS Fault
Injection Simulator ???? ??? ? ??.
? Amazon EC2, ECS, EKS, RDS ??? ?? ?? ? API ??, ?? ?? ??
?? ??? ??? ????, ?? ?? ?? ?? ????.
? JSON/YAML ?? ?? ???? AWS SSM ??? ??? ?? ? ???
??? ??? ???? ??? ? ??.
? ??? ??? ?? ? ? ??? ??? ?? ????, ?? ??? ?
???? ?? ???? ??? ? ??.
???
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
???? ??? ???? ?????.
?? ?? ?, ?? ??? ??? ???!
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
35. ? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.
?????
? 2021, Amazon Web Services, Inc. or its affiliates. All rights reserved.