There is a nice article on TuxRadar giving many tips on different levels on howto tweak your Linux system: TuxRadar: make Linux faster and lighter

If you are running openSUSE, don't get too much into the Yum and Apt tweaking bits... ;)

Happy tweaking!