Birdeye
Software Development Engineer II
Palo Alto, California · Remote
Architecting distributed systems and AI-powered infrastructure across web crawling, database scalability, high-throughput services, and production reliability.
- Built an AI-powered self-healing web-crawling framework combining deterministic heuristics, confidence-scored LLM fallbacks, human-in-the-loop validation and circuit-breaker resilience.
- Engineered a low-latency global transaction sharding architecture using PostgreSQL partitioning, Foreign Data Wrappers (FDW), and AWS RDS Proxy.
- Engineered LLM-driven adaptive crawling using LangChain and OpenAI agents to dynamically select HTML, REST, and GraphQL extraction strategies.
- Separated an 800 GB production database from a shared database with zero downtime and zero data loss, improving scalability and reliability.
- Architected and executed a zero-downtime MongoDB v3 → v7 migration across distributed microservices with phased rollout and rollback automation.
- Improved P95 latency of three high-traffic Listing APIs by 40% through MongoDB aggregation optimization, query tuning, profiling, and distributed caching.
- Designed an end-to-end observability and alerting framework with automated Slack/email incident notifications, reducing production MTTD.
- 40% reduction in P95 latency across three high-traffic services.
- Separated an 800 GB production database with zero downtime and data loss, removing a critical scalability constraint.
- Completed a zero-downtime MongoDB v3 → v7 migration across distributed microservices.
- Enabled cross-region transaction scaling using PostgreSQL partitioning, FDW, and RDS Proxy.
- Eliminated manual crawler maintenance by 65% through an AI-powered self-healing recovery system.
- Reduced production MTTD with end-to-end tracing and automated incident alerting.
- Delivered a scalable reporting platform generating $100K+ in annual revenue.
- Standardized CI/CD infrastructure across teams using Jenkins and Kubernetes-based dynamic agents.