There are a lot of RL packages out there, tensorforce, rllab, openai-lab, baselines, and the list goes on. It’s hard to know however, how any of those implementations stack up to published state-of-the-art results. There are several reasons, some are: The standard RL tasks (Mujoco & Atari) are extremely sensitive...

I’ve been wanting to go cross-country skiing since my dreams were shattered last winter in Stockholm (X-country ice-skating instead of skiing). So we made it happen in Montana at the Izaak Walton Inn. If you do want to visit Montana or Glacier National Park in the winter, I don’t think...

OS X 10.12.6 was working great for me…until I wanted to run tensorflow on GPU. OS X 10.13 didn’t help. Unfortunately tensorflow isn’t Mac friendly, because “As of version 1.2, TensorFlow no longer provides GPU support on Mac OS X.”. I don’t even understand what that means since you can...

After building a desktop a few months ago, I left it running on Linux. It wasn’t all that bad, as long as I didn’t need to use any applications with a real GUI 😂. This left me in a state of dismay, not using my new build as much as...

There are a lot of packages out there for deep Reinforcement Learning (RL), and so it became obvious to me that there needed to be yet another implementation! I’m calling it yarlp, Yet Another Reinforcement Learning Package! I’m developing it mostly for educational purposes. Here are several great implementations that...

A two week trip to Stockholm, Chamonix, and Budapest. Where I saught snow, I found ice, and where I saught ice, I found snow. But when I wanted goulash and hot baths, I found them in Budapest. Stockholm At least the monarch in Sweden is illegitimate. Trumpsplaining wasn’t pleasant. Gotta...

I finally decided to build a computer, after using the same macbook pro for 8 years (although upgrading the RAM and SSD made it a bit easier to bare)! Building a PC is surprisingly easy, I highly recommend it if you don’t like spending too much money on AWS. The...

Check out this 2D race car learning to drive through a track by using On-Policy Monte Carlo control. The car doesn’t know anything about the track; it only sees its current location, velocity, and rewards it gets while driving. The car can choose to change it’s velocity by 1 unit...