HierLearning is a C++11 implementation of a multi-agent, hierarchical reinforcement learning system for sequential decision problems.