ARCHITECTS
Building And Automating Serverless Auto-Scaling Data Pipelines In AWS
Damien Jones
AWS Consultant at Steamhaus | Creator at amazonwebshark
The modern data professional navigates a dynamic data landscape, handling high-velocity raw data at ever-changing volumes. In this intermediate session, I demonstrate a fully serverless auto-scaling data pipeline using AWS services.
This session includes:
-
Getting and storing API data with AWS Lambda and Amazon S3.
-
Transforming the API data with AWS Glue & Amazon Athena.
-
Pipeline automation and orchestration with AWS Step Functions and Amazon EventBridge.
Ideal for Data, DevOps, and Architecture professionals, this session offers practical insights into building efficient serverless data pipelines. Join to enhance your skills and explore the latest in Data Engineering and AWS.
SESSION 1: 09.40
Avoiding the big ball of mud with serverless event-driven architectures
Developer Advocate (Serverless) AWS | Full stack developer
EDA offers speed but risks chaos without careful implementation. This talk covers challenges, effective patterns, and governance to ensure scalable, maintainable EDAs, turning obstacles into innovation opportunities.
DAVID BOYNE
DAVID BOYNE
SESSION 2: 10.30
Rust or not to Rust
Daniele Frasca
AWS Serverless Community Builder
The modern data professional navigates a dynamic data landscape, handling high-velocity raw data at ever-changing volumes. In this intermediate session, I demonstrate a fully serverless auto-scaling data pipeline using AWS services.
This session includes:
-
Getting and storing API data with AWS Lambda and Amazon S3.
-
Transforming the API data with AWS Glue & Amazon Athena.
-
Pipeline automation and orchestration with AWS Step Functions and Amazon EventBridge.
Ideal for Data, DevOps, and Architecture professionals, this session offers practical insights into building efficient serverless data pipelines. Join to enhance your skills and explore the latest in Data Engineering and AWS.
SESSION 3: 11.30
Solving data challenges embracing serverless simplicity
Fabrizio Gattuso
Solution Architect at Nordcloud
Embark on a transformative tech journey, sidestepping traditional data tools for a serverless experience with AWS Athena, Step Functions, and Lambda. Seamlessly manage terabytes of CloudWatch and CloudTrail logs, employing diverse file formats and parallel execution. Witness the alchemy of compressing and transforming data, turning complexity into a low code (no-ETL) pipeline tailored on the customer use case. This journey not only delivers practical insights but also unveils cost-saving strategies, ensuring efficiency and value to the solution. Leave behind the complexities of heavy engineering and enter a realm where serverless simplicity converges with optimized data processing. Now, individuals with minimal data experience can effortlessly construct products with ease.
SESSION 4: 12.20
Empower your business with GenAI on Modern Serverless Applications on AWS
Urmila Raju
Senior solutions architect at AWS
This session will describe various Gen AI use cases and how we can leverage the existing AWS Serverless services in conjunction with the new feature announcements of Amazon Bedrock to implement the use cases. The session will showcase a demo at the end of the session to bring the GenAI use case to life, highlight the business outcomes and provide resources to enable the audience to use it for their business problems.
SESSION 5: 14.10
Senior Software Engineer & AWS Community Builder
Event-driven architectures offer a multitude of benefits, liberating our systems by enabling extendability, scalability, fault tolerance, and flexibility. However, the asynchronous nature of event-driven architectures challenges us to rethink our approaches towards our operations.
Navigating the testing of asynchronous architectures poses significant challenges, prompting questions about the “what,” “where,” “when,” and “how” of implementing effective testing strategies. Observability, release, and rollback strategies become ever more critical as they need to balance with the testing strategies.
In this talk, Sarah answers some of these difficult questions and drives a conversation around building reliable and resilient event-driven architectures.
Sarah Hamilton
Sarah hamilton
SESSION 6: 15.00
ECS or EKS: The great debate
Solutions Architect - AWS Public Sector - Aviation and Maritime
As businesses consider their container strategy on AWS, the EKS vs ECS debate often delays the decision making process. So which is the right choice? Well, it depends. With so many myths and jargon muddying the waters, let’s explore this topic together and give you a decision making framework to consider when facing these decisions.
Grace Shaffi
SESSION 7: 16.00
Data Driven Well Architected
Matt Houghton
Data Architect at CDL Software
In this session I’ll be talking about how you can use data from the Well Architected Tool to drive improvements in software development.
I will demo how to extract data from the WA tool and then show how I’ve used QuickSight to build dashboards that profile risks across an organisations architecture.
I’ll show how you can improve design review transparency and tailor well architected to your organisation or industry specific needs with custom lenses.
Above all I will show a data driven approach to identifying trends for improvements across a software development organisation.
