Continuous Deployment in AWS Lambda
2 likes1,013 views
Lambda Deployer is a Lambda function that automates continuous deployment of other Lambda functions to AWS. It packages functions, uploads code to S3, creates/updates Lambda functions and aliases. This allows developers to focus on code while Lambda Deployer handles releasing updates across many functions and stages. At KKStream, 12 developers used it to deploy 99 functions 4288 times with only 1 failed deployment.
![Who am I
class SoftwareEngineer(Human):
def __init__(self):
self.interests = [
"AWS"
]
self.languages = [
"Python",
"Golang"
]](https://image.slidesharecdn.com/pycontw2016lambda-160604064424/85/Continuous-Deployment-in-AWS-Lambda-2-320.jpg)
![API Gateway Lambda
200 OK
{
name: ,
characters: [ ...],
}](https://image.slidesharecdn.com/pycontw2016lambda-160604064424/85/Continuous-Deployment-in-AWS-Lambda-24-320.jpg)
![S3 event
1 def lambda_handler(event, context):
2 s3 = boto3.client('s3')
3
4 bucket = event['Records'][0]['s3']['bucket']['name']
5 key = event['Records'][0]['s3']['object']['key']
6 print "S3 Bucket: %s" % bucket
7 print "S3 Key: %s" % key
8](https://image.slidesharecdn.com/pycontw2016lambda-160604064424/85/Continuous-Deployment-in-AWS-Lambda-31-320.jpg)
![deployer.py
1 class Deployer(object):
2
3 def deploy(self, record):
4 bucket = record["s3"]["bucket"]["name"]
5 key = record["s3"]["object"]["key"]
6
7 lambda_function = LambdaFunction(bucket, key)
8 version = self.put_function(lambda_function)
9 self.put_alias(lambda_function, version)](https://image.slidesharecdn.com/pycontw2016lambda-160604064424/85/Continuous-Deployment-in-AWS-Lambda-50-320.jpg)
![main.py
1 import boto3, json
2 from deployer import Deployer
3
4 def run(event, context):
5 d = Deployer()
6 print "boto3 version:", boto3.__version__
7 print json.dumps(event, indent=2)
8 for record in event["Records"]:
9 d.deploy(record)](https://image.slidesharecdn.com/pycontw2016lambda-160604064424/85/Continuous-Deployment-in-AWS-Lambda-51-320.jpg)
More Related Content
What's hot (14)
Similar to Continuous Deployment in AWS Lambda (17)
Recently uploaded (20)
![Windows 8.1 Pro Activator Crack Version [April-2025]](https://cdn.slidesharecdn.com/ss_thumbnails/lecture9-250228130043-bd676d0e-250401141425-60508047-250401150607-9cd2b2bd-thumbnail.jpg?width=560&fit=bounds)
Continuous Deployment in AWS Lambda
- 1. Continuous Deployment in AWS Lambda Suiting Tseng (@suitingtseng)
- 2. Who am I class SoftwareEngineer(Human): def __init__(self): self.interests = [ "AWS" ] self.languages = [ "Python", "Golang" ]
- 3. KKStream We back you up to compete against Net鍖ix, Spotify, and KKBOX.
- 4. Outline AWS Lambda Introduction Lambda Deployer Adoption in KKStream
- 6. AWS AWS Lambda is a zero-administration compute platform for back-end web developers that runs your code for you in the AWS cloud and provides you with a 鍖ne-grained pricing structure.
- 7. AWS AWS Lambda runs your back-end code on its own AWS compute 鍖eet of Amazon Elastic Compute Cloud (Amazon EC2) instances across multiple Availability Zones in a region, which provides the high availability, security, performance, and scalability of the AWS infrastructure.
- 8. Cloud Computing in AWS Elastic Compute Cloud (EC2) Infrastructure as a Service Abstract hardware
- 9. Cloud Computing in AWS Elastic Compute Cloud (EC2) EC2 Container Service (ECS) Container as a Service Abstract OS
- 10. Cloud Computing in AWS Elastic Compute Cloud (EC2) EC2 Container Service (ECS) AWS Lambda Function as a Service Serverless
- 11. Lambda Runtime Python 2.7 Java OpenJDK 1.8 Node.js v0.10.36, v4.3.2
- 13. Event & Context Event What happen? S3? DynamoDB? Context How much time remaining?
- 14. Execution model Synchronous Event driven
- 15. Execution model Synchronous Event driven
- 16. Sync. Call AWS SDK AWS API Gateway
- 17. Sync. Call AWS SDK AWS API Gateway
- 19. Sync. Call AWS SDK AWS API Gateway
- 21. API Gateway Lambda API Gateway calls Lambda
- 22. API Gateway Lambda Lambda retrieve data from somewhere
- 23. API Gateway Lambda Lambda response
- 24. API Gateway Lambda 200 OK { name: , characters: [ ...], }
- 26. Execution model Synchronous Event driven
- 27. Event driven Event sources S3 Scheduled Event DynamoDB and many more
- 28. raw thumbnailLambda Users upload their photo
- 29. raw thumbnailLambda S3 triggers Lambda
- 30. raw thumbnailLambda Lambda resizes the image, and put it to another bucket
- 31. S3 event 1 def lambda_handler(event, context): 2 s3 = boto3.client('s3') 3 4 bucket = event['Records'][0]['s3']['bucket']['name'] 5 key = event['Records'][0]['s3']['object']['key'] 6 print "S3 Bucket: %s" % bucket 7 print "S3 Key: %s" % key 8
- 32. Lambda usage HTTP API backend Worker Cronjob
- 33. Version and Alias Version 1, 2, 3, 4 . Incremental integer Immutable Alias feature -> 4 testing -> 8 Mutable
- 34. Outline AWS Lambda Introduction Lambda Deployer Adoption in KKStream
- 35. Problem So you wanna deploy Upload a zip to S3 Create or update function Con鍖gure version Create or update alias And you may have 100+ functions
- 36. Our goal push
- 37. Our goal notify
- 40. Deploy pipeline 1. Build dependency 2. Testing 3. Package 4. Upload to S3
- 41. Deploy pipeline Triggers Lambda Deployer
- 42. Lambda deployer is also a Lambda function!
- 43. Behind the scene - 1 packages/ my-func-1/ my-func-2/ my-func-3/
- 44. Behind the scene - 2 packages/ my-func-1/ bfb53884976e70966a9e8a8d5133bcb2e1c06691/ eed8ccf9ea22099cef07b0a2012085cd45e1d3ad/
- 45. Behind the scene - 3 packages/ my-func-1/ bfb53884976e70966a9e8a8d5133bcb2e1c06691/ lambda.zip function.json
- 47. Behind the scene - 4 packages/ my-func-1/ bfb53884976e70966a9e8a8d5133bcb2e1c06691/ eed8ccf9ea22099cef07b0a2012085cd45e1d3ad/ testing
- 48. Deploy pipeline Create / update function Publish new version Update alias
- 49. deployer.py class Deployer(object): def __init__(self): self.s3_client = boto3.client("s3") self.lambda_client = boto3.client("lambda") self.slack = Slacker(open("config/slack-token").read()) self.slack_channel = json.load(open("config/slack.json"))
- 50. deployer.py 1 class Deployer(object): 2 3 def deploy(self, record): 4 bucket = record["s3"]["bucket"]["name"] 5 key = record["s3"]["object"]["key"] 6 7 lambda_function = LambdaFunction(bucket, key) 8 version = self.put_function(lambda_function) 9 self.put_alias(lambda_function, version)
- 51. main.py 1 import boto3, json 2 from deployer import Deployer 3 4 def run(event, context): 5 d = Deployer() 6 print "boto3 version:", boto3.__version__ 7 print json.dumps(event, indent=2) 8 for record in event["Records"]: 9 d.deploy(record)
- 52. Pros Serverless (yes we are lazy) One deployer manages many functions many stages (using alias) Perfectly 鍖ts in our work鍖ow
- 53. In KKStream From 2016/02/01 to 2016/05/31 12 developers 99 functions 4288 deployments 1 fork
- 54. In KKStream Deploy itself 56 times ( code ) failed several times but very easy to rollback
- 55. Future work Add event source mapping More con鍖gurations https://github.com/KKStream/aws-lambda-deployer
- 56. Q & A
- 57. Were hiring!
- 58. Meet us at our booth on 4th 鍖oor!
- 59. Thank you!