Seems I had/have 3 issues.
1, Even though the card went in easily enough, my HD bay was slightly in the way causing it not to be seated fully.
2, My power supply is not good enough. Bought this
and installed this
and all boots proper now. Using my normal PSU alone does not allow the card to boot.
3, My card has issues.