I should probably also include this list of things I've tried already
Enable/disable IRQ in BIOS
Enable/disable kernel agpgart
Enable/disable driver agp
commented out ModeLine
None of that worked, obviously. I've scoured the internet and found a few mentions of this problem, but it doesn't look like anyone has ever resolved it.