WordPress is slow. Really slow. It is bad coded, I know because I have done a lot of plugin development and even more debugging of the WordPress core code.
The blog entry 5 Essential Tips for Overcoming WordPress 2.8 Performance Problems describes some severe issues that WordPress blogs has, especially regarding bad performance.
In short: “Deal With It.”