I have wanted to start a ramen log for a while now. To finally kick it off, I decided to eat 3 bowls of ramen this past Thursday. It was heavenly. In this blog post, I plan to log every bowl of ramen I eat and to take pictures along...

I’ve been wanting to go cross-country skiing since my dreams were shattered last winter in Stockholm (X-country ice-skating instead of skiing). So we made it happen in Montana at the Izaak Walton Inn. If you do want to visit Montana or Glacier National Park in the winter, I don’t think...

A two week trip to Stockholm, Chamonix, and Budapest. Where I saught snow, I found ice, and where I saught ice, I found snow. But when I wanted goulash and hot baths, I found them in Budapest. Stockholm At least the monarch in Sweden is illegitimate. Trumpsplaining wasn’t pleasant. Gotta...

The mountains were calling in Peru. Huaraz Laguna Churup Laguna Ahuac Laguna 69 Vallunaraju Took a 6-day mountaineering course with Skyline Adventures; thank you for teaching us first and foremost an awesome mountain mentality!

1. Tokyo 2. Ueda 3. Nagano 4. Matsumoto 5. Kamikochi 6. Shirahone 7. Yakedake 8. Takayama 9. Kyoto 10. Nara 11. Kagoshima 12. Zamami Seriously healthy dogs: Shiro - dog statue that matches Maririn on Zamami. Found at the port. Shiro was a famous dog that swam from Aka to...

After a 3 week wonderful sejour in SF, I decided to go to Mexico City with my girlfriend for 4 days. I wanted to share my experience about hiking on the outskirts of the city, since it was pretty interesting. Also, I have some time to write this post since...

I’m in SF on break and I just created this blog. I used Jekyll with github-pages. I didn’t think it would be this easy to launch honestly, but there are many templates out there that you can launch on the fly. I used the mediator template from Dirk Fabisch and...

I build Tensorflow models and deploy them with Docker on Kubernetes during the day. There are two very painful pitfalls that can increase memory usage up to ~7x and slow down inference up to ~30x running on CPU. In the interest of saving you time, either don’t try to run...

I was recently asked a question about the “No Free Lunch Theorem”. I’ve heard of it in passing, but I never really read much into it. After reading the wikipedia more thoroughly, I found it pretty hard to reconcile implications of the theorem. Should I stop fitting models on things...

After several years as a Python user, I think I’m finally coming around to really appreciating the language. Whatever it lacks as a dynamically typed scripting language (granted there is now mypy), it makes up for it with its ease of use and readability. To illustrate what I mean, I’ll...

I stare at screens a lot. You probably do too. Staring at screens is easier with apps like f.lux and iris, which apply color filters to our displays to reduce the amount of blue light our eyes consume. If your screen has mostly white colors and you use f.lux, the...

In the last yarlp blog post, I ran Double Deep Q-Learning on Atari, which took around 1-1.5 days to train per Atari environment for 40M frames. I wanted to implemented something faster, namely A2C (Advantage Actor Critic). It’s related to A3C by Mnih et al, 2016, without the asynchronous part....

Reinforcement Learning…again? I wanted to re-create the latest Deep Q-Learning results on Atari, a huge milestone for AI Research in the past few years. Apart from the official code in Lua, I found several Python implementations on github, notably this one from OpenAI or this one among many others. Very...

There are a lot of RL packages out there, tensorforce, rllab, openai-lab, baselines, and the list goes on. It’s hard to know however, how any of those implementations stack up to published state-of-the-art results. There are several reasons, some are: The standard RL tasks (Mujoco & Atari) are extremely sensitive...

OS X 10.12.6 was working great for me…until I wanted to run tensorflow on GPU. OS X 10.13 didn’t help. Unfortunately tensorflow isn’t Mac friendly, because “As of version 1.2, TensorFlow no longer provides GPU support on Mac OS X.”. I don’t even understand what that means since you can...

After building a desktop a few months ago, I left it running on Linux. It wasn’t all that bad, as long as I didn’t need to use any applications with a real GUI 😂. This left me in a state of dismay, not using my new build as much as...

There are a lot of packages out there for deep Reinforcement Learning (RL), and so it became obvious to me that there needed to be yet another implementation! I’m calling it yarlp, Yet Another Reinforcement Learning Package! I’m developing it mostly for educational purposes. Here are several great implementations that...

I finally decided to build a computer, after using the same macbook pro for 8 years (although upgrading the RAM and SSD made it a bit easier to bare)! Building a PC is surprisingly easy, I highly recommend it if you don’t like spending too much money on AWS. The...

Check out this 2D race car learning to drive through a track by using On-Policy Monte Carlo control. The car doesn’t know anything about the track; it only sees its current location, velocity, and rewards it gets while driving. The car can choose to change it’s velocity by 1 unit...

Chat with climatechangebot here! I’ve been concerned about climate change for a while now. My girlfriend and I finally found a way to share that concern with everyone else on this planet! It’s called climatechangebot, the first ever climate change chat bot. If you’re ever feeling concerned about climate change,...

Do you need a non-negative square matrix converted to a doubly stochastic matrix? That is, you want all rows and columns to sum to one? Well here’s a package just for that! I had the function lying around for a deep learning project I was working on at Columbia, and...

We’ve all heard people say, “oh you should be more optimistic!”. But honestly, besides having a prettier outlook on life, what’s the point? Doesn’t optimism set us up for disappointment anyways? Why even bother arguing for or against optimism? Why even bother writing a blog post? … Maybe I’m getting...

Donald Trump has sure been getting a lot of attention in the media lately. His speeches are pretty funny (or not). Well now we can all bring out the Donald Trump inside of us with Donald TrumpBot. Just type in some words in the text box below and click ‘Go!’...

Panel of Industry Leaders: Matthew Bryan, Claudia Perlich, Gilad Lotan, Drew Conway, Jake Hofman It is truly inspiring how a simple idea can evolve over the course of a few months into a full-fledged event, bringing hundreds of people together. This is exactly what happened on March 6th of 2015...