Shail R. Shah

Software Engineer · Distributed Systems & GenAI

Software Engineer with 8 years of experience building high-scale distributed systems and GenAI platforms at Amazon. Transformed manual processes into automated pipelines, reducing launch times by 86% and saving 57K+ analyst hours annually. Built RAG-based services handling 4K+ TPS for Bedrock and Alexa+. Led cross-org initiatives across 12+ engineers and mentored 3 to promotion.

Experience

Software Development Engineer II — Artificial General Intelligence for AWS

Amazon
Apr 2025 - Aug 2026

Tech: Java, Kotlin, Python, TypeScript, Bedrock, Step Functions, ECS, Lambda, API Gateway, DynamoDB, CloudFormation, CloudWatch, IAM

  • Spearheaded region expansion automation for a distributed RAG service (4000+ TPS), cutting launch time by 86% (28 to 4 days).
  • Defined and led cross-org migration to IAM-based authN/authZ across 5 teams (12 engineers), ensuring zero security incidents.
  • Reduced config deployment time by 57% (7 to 3 hours) by decomposing a monolithic stack and enabling parallel deployments.
  • Accelerated service packaging by 4.8x (2h28m to 33m) by identifying and removing a 12GB ECS sidecar bottleneck.
  • Mentored 3 engineers to promotion and interviewed 40+ candidates as part of Bar Raiser training.

Software Development Engineer II — Amazon Ads – Insights

Amazon
Sep 2022 - Apr 2025

Tech: Java, Python, TypeScript, React, Step Functions, Lambda, SageMaker, S3, DynamoDB

  • Architected an LLM-powered document generation service using RAG, taking it from design through production and reducing report generation time from 30+ hours to under 2 minutes with >95% grounding accuracy.
  • Built a no-code analytics automation platform saving 57K analyst hours annually and reducing time-to-insight by 90%.
  • Designed an event-driven demographic reporting workflow using Step Functions to orchestrate distributed Spark jobs via asynchronous polling, replacing manual Redshift exports and shrinking processing time by 75%.

Software Development Engineer II — Amazon Stores – Seller Fulfillment Services

Amazon
Jun 2020 - Sep 2022

Tech: Java, TypeScript, React, Kinesis, S3, DynamoDB, API Gateway, Elasticsearch

  • Led migration of Orders API for 60+ internal clients, delivering an adapter library with async shadow testing; improved latency by 42% and reduced infrastructure costs by $60K annually.
  • Built an automated order cancellation workflow reducing 93.9K annual seller contacts and saving $11.2M per year.
  • Designed a plugin system for backend-driven UI changes, reducing files touched per change by 75%.
  • Resolved a high-impact DynamoDB issue, reducing UI 5xx errors by 98% via exponential backoff and retry strategies.

Software Engineer – IC2

Yelp
Jan 2019 - Jun 2020

Tech: Python, React, Cassandra, MySQL, Kafka, GraphQL

  • Built campaign control and reporting systems for 150K+ customers, supporting $1B+ in annual advertising revenue.
  • Improved retention by $4M+/year by designing and running A/B experiments to optimize advertiser tools.

Education

Northeastern University

MS (GPA: 3.92) in Computer Science
Sep 2016 - Dec 2018

University of Mumbai

Bachelor (CGPA: 7.75) in Information Technology
Jun 2012 - May 2016

Skills

Architecture & Services

Distributed Systems, Event-Driven Architecture, Microservices, API Design

Languages

Java, Kotlin, Python, TypeScript

Cloud Services (AWS)

ECS, Lambda, Step Functions, S3, API Gateway, SQS, SNS, IAM, CloudWatch, VPC, Route53

GenAI / ML

RAG pipelines, LLM integration, Amazon Bedrock, SageMaker

Data & Search

DynamoDB, MySQL, Cassandra, Elasticsearch, Kafka

Infrastructure & Tools

Terraform, CloudFormation, Spring Boot, React, Flask, Gradle, Git