Your system looks quite OK i think, even on my old 133 MHz, 32 meg machine
the startup is faster though it depends on the used windowmanager.
Well as a first test and without checking any log files and other
stuff , just enter 'X' on a text console and estimate the seconds
until a black crossed mouse pointer is visible on a grey screen.
Then finish this windowmanager free X session by ctrl-alt-backspace.
Is there a significant difference of the elapsed time?