Processing Data Lake with Node.js in serverless architecture
We'll discuss processing of data lake with cloud AWS Lambda functions on Node.js, from choosing cloud architecture patterns to deep diving into optimization of lambda functions on Node.js. We will identify and use the strengths of Node.js to accelerate data processing. We'll see how to increase throughput by scaling up to 7000 instances of lambda functions and services we use (streams, queues, and databases), tuning and optimizing lambda functions on Node.js, and choosing the best possible data communication protocols. We'll explore special aspects of profiling functions, logging, and monitoring in production cloud infrastructure.
Nikolay is a software engineer and Node.js expert at Grid Dynamics. He is a big fan of performance optimization in Node.js.
Now he is working in St. Petersburg, Florida. Together with Amazon's consulting team, he is building a cloud computing platform for a product supply chain management project for one of the largest electronics companies in the United States.