So I checked all the solder joints. They were all good. I had noticed the chip for the A register getting pretty hot. Now these are basically just flip-flops in particular the 74HC754:
It’s a Octal D-Type Flip-Flop. A Flip-Flop is a basic memory element.
And I had it plugged in upside down. Woops! So GND was at +5V and 8Q was at ground. Not good and causes some heat. Found my IC extractor and pulled the chip out, replaced it in the correct orientation and it works fine now. Weird that I got every other chip in the right orientation except that one. But it happens.