Tech Blogs Digest 17.11 - 23.11
This week we AI-analysed 8949 posts for you, filtered out the chaff and hand-picked the wheat. Subscribe to stay up to date with future digests!
This week
🏗️ Architecture - brand new ML platform architecture, petabytes of traces with reasonable bills, the dark side of high availability, and more
📊 Data - hybrid search techniques
🤖 LLMs in production - healing a modern RAG system, implementing a behavioral overseer, and addressing the context rot problem
👨🔧 Engineering culture - open source learnings, measuring carbon footprint, and building the right culture for AI driven development
🧠 ML - AI race car design, and feature differences between training and production
🛡️ Security - a Microsoft marketplace vulnerability, and personal repo risks for organizations
☕ Java - virtual threads with Spring
🏗️ ARCHITECTURE
LyftLearn Evolution: Rethinking ML Platform Architecture | 15 min read
Lyft re-architected its ML infrastructure: swapping a wholly Kubernetes-based system for a hybrid model using AWS SageMaker for offline workloads while still serving real-time predictions on Kubernetes, boosting both scalability and developer speed
