Course homeworks for Mathematical Foundations of RL at DSV, Stockholm University, Instructors: Sindri Magnússon, Venktesh Viswanathan