|
Each week, I share one insight. One piece of wisdom. One question to reflect on. (and a little Lagniappe) InsightThis week LiteLLM, the most popular open-source LLM proxy in the python ecosystem, was hit by a really gnarly software supply chain attack. The awful part was that the attack vector was through Trivy, a security scanner LiteLLM trusted to help protect its code. Attackers compromised Trivy's GitHub Actions and used that to steal LiteLLM's PyPI publishing credentials, and used them to push backdoored packages that harvested secrets from anyone running LiteLLM in their Python stack. Moments like these are important reminders of how vulnerable we all are if we get sloppy with our trust models. Every dependency is a trust decision, and trust is transitive. It builds a chain of trust, and like any chain, it is only as strong as its weakest link. LiteLLM trusted Trivy. When Trivy fell, everything downstream fell with it. Now, what can we learn from this? We must use defense-in-depth. We must pin dependencies to immutable hashes. We must scope credentials narrowly. We must filter network egress in build environments. And finally, we must regularly take the time to think through our trust models. Wisdom"The best way to find out if you can trust somebody is to trust them." — Ernest Hemingway ReflectionHow would you triage an incident like LiteLLM? Lagniappe
|
Practical insights on platform engineering, developer experience, and building teams that ship. Each issue is written to be useful, actionable, and applicable. No filler, no promotions-only emails. Enter your email and sign up for free right now.
Each week, I share one insight. One piece of wisdom. One question to reflect on. (and a little Lagniappe) Insight Every Sunday, I fill up the gas tank on our little Suzuki Vitara. I learned this from Tom Limoncelli in Time Management For System Administrators. It doesn't matter if it's a quarter empty or a quarter full. I just top it off. The ritual categorically removes a potential source of stress from my week, all from a simple little habit. Wisdom A schedule defends from chaos and whim....
Each week, I share one insight. One piece of wisdom. One question to reflect on. (and a little Lagniappe) Insight I have to come clean. I've been putting off one of the most-recommended books in our field for years: The Mythical Man-Month. I can't believe, after co-hosting Book Overflow for almost two years, we hadn't read this yet. Martin Fowler's recent post finally got me to take the plunge, and boy was I missing out! My favorite idea in the book is conceptual integrity. Conceptual...
Each week, I share one insight. One piece of wisdom. One question to reflect on. (and a little Lagniappe) Insight Tony Fadell tells a story in his book, Build, about his time at General Magic. The place was filled with brilliant people, but they had no shipping rhythm and no external pressures. Years passed and the work drifted, missing chances to prove it out with customers. He argues that the way to combat this is with "heartbeats and handcuffs". Heartbeats are an internal cadence....