Low fps and unplayable


Been playing Conan in coop and the frames are terrible. It get worse during time and everytime the resources tick, get new gold and such, the game goes down to 10 fps. Battles are 15 fps as well. My coop buddy has no issues, we tried both hosting the game. Makes no difference.

I changes all settings and even on low, I get the same issues.

System specs:
Cpu AMD Ryzen 3600x
Gpu Radeon RX5700XT
Mem 32Gb

Playing on a 1440p ultrawide

Any ideas are welcome.