AWS Step Functions to orchestrate Lambda functions - Step by Step Example
If you know how to set up a single AWS Lambda function, you should learn how to orchestrate these Lambda functions into one logical workflow which works as a serverless solution in the cloud. For this purpose we will use the AWS Step functions. The main idea is to connect multiple Lambda functions so that they work as one unit once the first function will be triggered by input of some value.
In this example, I demonstrate how to connect three Lambda functions which expect to get some input and provide some output separately, and then set up input/output transferring between these functions. This is how three independent Lambda functions are connected with data bridges between them. This is easily illustrated with a graph in an AWS Step service page, and allows you to build your Step functions pipelines just by drag and drop elements directly into the interactive chart. You will see it in this video tutorial.
All AWS Lambda functions were written in Python 3.8 in this tutorial. Good to know that AWS Step functions supports not only AWS Lambda functions for orchestration, but other services also, such as AWS Blazing Text, AWS ECS, AWS DynamoDB and much more. Feel free to experiment with these with a very low cost.
Check the links below to read more official information about AWS Step Function:
AWS Step developer guide (official from Amazon): https://docs.aws.amazon.com/step-func...
Getting started with AWS Step Function (official from Amazon): https://docs.aws.amazon.com/step-func...
The content of the video:
0:00 - Intro
4:03 - Hands-on AWS Step Functions
13:45 - Debug and Edit AWS Step Functions
During this session, I wrongly selected the initial payload to the first Lambda function in the workflow, so you can benefit from that to see how to debug AWS Pipelines, and run your Step Functions workflow with dynamic input. You can freely experiment with your custom function, and play with different input scenarios. As a result, you will get a JSON format result file which describes your final workflow output.
AWS Step function is very important to test systems, workflows and basically, it is a big player in the domain of MLOps (Machine Learning Operations).
I am sure this tutorial will be not for AWS beginners only, but for advanced users also. Personally for me, this would really help in the AWS Machine Learning Specialty certification exam.
Enjoy!
#stepfunction #aws #lambdafunction
Watch video AWS Step Functions to orchestrate Lambda functions - Step by Step Example online without registration, duration hours minute second in high quality. This video was added by user Data Science Garage 22 July 2021, don't forget to share it with your friends and acquaintances, it has been viewed on our site 16,651 once and liked it 235 people.