Mar 30
Adding a DynamoDB Caching Layer to a Serverless LLM Pipeline
Another late night on Sunday shipping features. This week I added a caching layer to ResumeMatch that drops duplicate analysis latency from 25 second...
8 min read
I'm Wenhao, a software engineer. I write up system design problems I've worked through, what I'm learning about LLMs, notes from shipping side projects like ResumeMatch, and the occasional take on layoffs and where the industry is heading.
Another late night on Sunday shipping features. This week I added a caching layer to ResumeMatch that drops duplicate analysis latency from 25 second...