You stated that your system has 128MB's of RAM. I've read that it requires 128MB's of RAM minimum to run X and at least 192MB's or more to run it properly.. This may very well be your problem.
I can't quote on that as most of my systems run 512MB's minimum..
Who know's this may be the cause of the slow startup and such..