Blog posts

2019

2018

Model Reproduction

7 minute read

Published:

Model reimplementation is both a pain and a great source of learning.

Reverse Mode Differentiation with Vector Calculus

5 minute read

Published:

This is something back in 2016 when I was struggling with my first serious neural model. Previously I mostly use Scala for NLP. But there was no auto differentiation locally in Scala, so we ended up thinking to write our own package. The task, naturally, turned out to be waaaaay too non-trivial, and we soon gave it up days after. Well, anyway, here is the wrap-up.