Blog posts



Model Reproduction

7 minute read


Model reimplementation is both a pain and a great source of learning.

Reverse Mode Differentiation with Vector Calculus

5 minute read


This is something back in 2016 when I was struggling with my first serious neural model. Previously I mostly use Scala for NLP. But there was no auto differentiation locally in Scala, so we ended up thinking to write our own package. The task, naturally, turned out to be waaaaay too non-trivial, and we soon gave it up days after. Well, anyway, here is the wrap-up.