How to process continuous streaming data from application

logs or user actions from social media applications?

Characteristics of streaming data: Continuously generated, Small pieces of

data which are Sequenced - mostly associated with time

Option: S3 Notifications

Send notifications to SNS, SQS, trigger lambdas on

creation, deletion or update of an S3 object

Setup at bucket level (Use prefix and suffix)

Cost efficient for simple use cases (S3 notification -> Lambda)

Almost negligible cost (storage for file + invocation)

Option: DynamoDB Streams (DynamoDB > Stream > Lambda)

Events from DynamoDB buffered in a stream (real-time sequenced)

Can be enabled or disabled

Use case - Send email when user registers