Windows
There is a tool installed with Windows, called MSConfig, that allows you to quickly and easily see what's running at startup and disable the programs you prefer to run on our own after startup as needed.
Linux
On a redhat style system:
sudo chkconfig mysqld off
On Debian:
sudo update-rc.d -f mysqld remove