Good news! (edit: kinda)
I remembered that I had similar performance problems with RDR2, and had to update the BIOS to fix it
So I updated the BIOS
Game runs better now
Edit: After further testing, it's better, but still chunky. It looked so smooth when I started the game though