AWS CloudFormation template for triggering SNS-compatible AWS events at a specific time.
cloudformation-scheduled-tasks
is an AWS CloudFormation template generated using the
Serverless Framework designed to trigger any SNS-compatible AWS
event (Lambda function, Email, Text Message, etc) at a specific time.
It’s simple! Click this fancy button:
Then give the stack a name, and configure it:
Parameter | Default Value | Description |
---|---|---|
PollingSchedule | rate(5 minutes) |
The CloudWatch ScheduleExpression defining the interval the polling Lambda runs at. |
ReadCapacityUnits | 1 | The read capacity units for the Scheduled Tasks DynamoDB table. |
WriteCapacityUnits | 1 | The write capacity units for the Scheduled Tasks DynamoDB table. |
DestinationArns | A comma-separated list of possible destination SNS topic ARNS for permissioning the polling Lambda. |
Finally, reference the outputs inside another stack, or in your code:
Output | Description |
---|---|
IngestSNSTopicArn | The ARN of the ingest SNS topic. Read below for what data to send to this. |
Once the stack is deployed, send a new message to the SNS topic to schedule a task:
sns.publish({
TopicArn: process.env.INGEST_TOPIC_ARN,
Message: JSON.stringify({
executeTime: moment().add(1, 'hour').unix(),
taskId: 'achieve-world-peace-today',
topicArn: 'arn:aws:sns:us-east-1:123456789:achieve-world-peace',
payload: {
when: moment().format()
}
})
})
You can also update a task to execute at a new time or with a different payload by sending it again:
sns.publish({
TopicArn: process.env.INGEST_TOPIC_ARN,
Message: JSON.stringify({
executeTime: moment().add(1, 'hour').add(1, 'day').unix(),
taskId: 'achieve-world-peace-today',
topicArn: 'arn:aws:sns:us-east-1:123456789:achieve-world-peace',
payload: {
when: moment().add(1, 'day').format()
}
})
})
You can delete a task by passing a falsy executeTime
:
sns.publish({
TopicArn: process.env.INGEST_TOPIC_ARN,
Message: JSON.stringify({
executeTime: null,
taskId: 'achieve-world-peace-today'
})
})
Add something like this underneath resources:
subscriptionExpiredTopic:
Type: AWS::SNS::Topic
Properties: {}
otherTopic:
Type: AWS::SNS::Topic
Properties: {}
scheduledTasksStack:
Type: AWS::CloudFormation::Stack
Properties:
TemplateURL: https://sammarks-cf-templates.s3.amazonaws.com/scheduled-tasks/VERSION/template.yaml
Parameters:
PollingSchedule: 'rate(5 minutes)'
ReadCapacityUnits: 1
WriteCapacityUnits: 1
DestinationArns:
'Fn::Join':
- ','
- - Ref: subscriptionExpiredTopic
- - Ref: otherTopic
And then when you want to reference the ingest topic in your environment variables:
environment:
SCHEDULED_TASK_INGEST:
Fn::GetAtt:
- scheduledTasksStack
- 'Outputs.IngestSNSTopicArn'
Note: This stack will require the CAPABILITY_AUTO_EXPAND
capability when deploying
the parent stack with CloudFormation. If you are using the Serverless framework, you can
“trick” it into adding the required capabilities by adding this to your serverless.yaml
:
resources:
Transform: 'AWS::Serverless-2016-10-31' # Trigger Serverless to add CAPABILITY_AUTO_EXPAND
Resources:
otherResource: # ... all of your original resources
A quick note on regions: If you are deploying this stack in a region other than us-east-1
,
you need to reference the proper region S3 bucket as we’re deploying Lambda functions. Just
add the region suffix to the template URL, so this:
https://sammarks-cf-templates.s3.amazonaws.com/scheduled-tasks/VERSION/template.yaml
becomes this:
https://sammarks-cf-templates-us-east-2.s3.amazonaws.com/scheduled-tasks/VERSION/template.yaml
The best way to describe this is to go through what each lambda function is responsible for:
The Ingest Lambda is responsible for processing incoming messages from the ingest SNS topic.
If a new message comes in with a truthy executeTime
, it updates the scheduled tasks table
inside DynamoDB with the passed payload, topic ARN, and execution time (in unix time, seconds).
If the executeTime
is falsy, it attempts to delete the existing record from DynamoDB so it
is not executed.
The Schedule Lambda is run periodically (you can configure the interval in the stack parameters).
When it runs, it queries the scheduled tasks table in DynamoDB for any execution times less than
the current time. If it finds any, it sends a message to their topic ARN containing the payload,
and then deletes the item from the table. If the SNS posting fails, it leaves the item in the
table to be processed later.
It is possible under some less-than-ideal circumstances for an SNS message to be sent out twice
for the same execution. Currently this will only happen if the initial message is sent out correctly,
but then removing the record from DynamoDB fails.
Please write your messaging handling code to respond to duplicates and ignore them.
Each time a release is made in this repository, the corresponding template is available at:
https://cloudformation-scheduled-tasks.s3.amazonaws.com/VERSION/template.yaml
On upgrading: I actually recommend you lock the template you use to a specific version.
Then, if you want to update to a new version, all you have to change in your CloudFormation
template is the version and AWS will automatically delete the old stack and re-create the
new one for you.
Right now Lambda supports executing functions at an interval very well. It unfortunately does not
support running tasks at a specific time very well.
Suppose you have built your own subscription system, and you need to keep track of when subscriptions
are about to expire, have expired, or are currently expiring. Since the only data you have stored is
when the subscription expires, it makes sense to automatically create a “scheduled task” whenever
updating that expiration date that schedules the actions you would like to take on the expiration
of the subscription.
Sure, you could also roll your own solution to this, but why do that when there is a ready-to-deploy
solution already out there?