The wisp/light spell works for me in the Wine Cellar. Just logged in to test it, works completely fine. AFAIK, it is enabled in all dungeon.

Not all magic is blocked in dungeons, only some spells such as Ice Bridge, probably as it would allow to skip some parts.

Next question… why isn’t it working for you?