I started the game again, putting a ton of points into Intelligence and Luck. So far fights are going a lot better with VATS. I also focused more on small weapons rather than trying to spread points between two weapon types, and put some into melee to conserve ammo.
It sucks not having high speech and charisma though