Python modules for machine learning/reinforcement learning

I use those libraries on a weekly basis and they’re indeed awesome (especially Keras), however aside from Numpy / Scipy I don’t think they’re necessary.

  • Running those on CG in the runtime allocated would be difficult (loading Theano + Keras + serialized model and weights would take much more than that)

  • Other languages would require the same treatment: Breeze for Scala, D4J for Java, … I think I’ve heard that even C/C++ doesn’t have all the possibles compiler optimizations enabled. And that would be a lot of work to maintain

  • I’ve been on CG for only a few months and I’ve reimplemented from scratch more algorithms than I’ve ever done in the past. It felt great and I learned a lot. I believe that is a core aspect of CG, contrary like Kaggle for example which is much more focused on the competition.

You might already know about those :slight_smile:

http://iamtrask.github.io/2015/07/12/basic-python-network/

http://outlace.com/Reinforcement-Learning-Part-3/

which are great examples of that.

3 Likes