AI-Assisted AWS Log Investigation
A serverless tool that lets engineers query CloudTrail, VPC Flow Logs, and ALB logs in plain English.
Outcome
Roughly $0.001 per query (about $3/month at 100 queries/day), with instant Lambda cold starts and no client-side infrastructure to manage.
The problem
Engineers had to manually dig through CloudTrail, VPC Flow Logs, ALB logs, and custom application logs scattered across multiple S3 buckets to investigate incidents.
Logs sit in AWS's native delivery layout across multiple S3 buckets in JSON, CSV, JSONL, and gzip-compressed formats, so the tool had to auto-discover and parse them with zero pre-processing or data migration.
How I approached it
My role: End-to-end architecture and delivery: the Lambda, API Gateway, and Bedrock pipeline, fully deployed via Terraform.
A Lambda function behind API Gateway auto-discovers and parses CloudTrail, VPC Flow Logs, ALB logs, and custom application logs directly from S3, then hands the parsed context to Bedrock (Claude) to answer the engineer's question in plain English.
Architecture
Technology used
- AWS Lambda
- API Gateway
- S3
- Amazon Bedrock
- Terraform
