Marlos C. Machado

Here's another paper we'll be presenting at ICML'26 - @icmlconf.bsky.social. Laplacian Representations for Decision-Time Planning openreview.net/forum?id=6Jw... This work was led by Dikshant Shehmar, and he'll be presenting on 8th July at 2 pm, Korea time. This video summarize…

Verifying your browser | OpenReview openreview.net

I am so excited about this paper. Wayfarer fulfills a vision I had 10 years ago when I wrote Learning Purposeful Behaviour in the Absence of Rewards. It fulfills the promise of options, maybe for the first time. End of thread. 9/9 arXiv link: arxiv.org/abs/2610.03604

Mastering Atari 2600 Games with Discovered Options arxiv.org

Every year, we have the RLAI Tea Time Talks at the @ualberta.bsky.social. Last year, I talked about how some of our work can be seen from a physics perspective. I gave the same talk at the RLC'25 IBRL Workshop. I uploaded the recording to make it broadly accessible. www.youtub…

Heat Diffusion as an Inductive Bias for Discovering Temporal Abstractions in RL youtube.com

The benefit of using options for credit assignment is also easy to see. In Montezuma's Revenge, for example, the agent discovers options (without domain knowledge) that it can sequence to reach the 3rd screen in 2 orders of magnitude fewer decisions. 5/9 www.youtube.com/watch?…

Wayfarer: Montezuma's Revenge — primitive actions vs. options youtube.com

Wayfarer enables temporally extended exploration with options that generate observations that are hard to obtain from the agent's perspective. For example, a single option executed in the game Private Eye lets the agent scan the entire environment! 4/9 www.youtube.com/shorts/R…

Wayfarer: Private Eye — discovered option youtube.com