Wordpress Permalinks not working?

When creating a local website on your own webserver running Apache2 and using Wordpress, you will see that the URL is created by referring to different kind of ID's. This could be Post ID's, Category ID's, Page ID's and so on. So I went into the Wordpress Administration Panel and told it to use permalinks instead. Hoping this would make the URL's a little prettier...