I found that you need to have the Journey active before you take the potion and enter the dungeon.