Jul 27
Tuning Neural Networks
The essence of neural networks lies in progressively applying activation functions to linear transformations. Input → Hidden → Output (x) → (a...
3 min read
I'm Wenhao, a software engineer. I write up system design problems I've worked through, what I'm learning about LLMs, notes from shipping side projects like ResumeMatch, and the occasional take on layoffs and where the industry is heading.
The essence of neural networks lies in progressively applying activation functions to linear transformations. Input → Hidden → Output (x) → (a...
Let's start with a simple linear function: y = wx + b Q: What's a good w and b? A: A good set of parameters produces predictions that closely match...
What if I told you that everything we know about the world - every rule, every pattern, every piece of logic - can be described by functions? This ch...