napkin llm router math
napkin math on whether llm routers are worth it.
#mlops
3 posts
Infra and devtool themes I'm excited about in 2024
A survey of the infrastructure layer beneath foundation models — from compute and deployment to prompt tooling, vector databases, and AI-native dev tools.
AI-native software infrastructure: what I was excited about in 2023
A survey of the infrastructure layer beneath foundation models — from compute and deployment to prompt tooling, vector databases, and AI-native dev tools.