I always look for a few things: Reliability, Support/Knowledge, Price - you get what you pay for really.
I would say that rockhoster.com is one of the best web hosts I've tried.
Their customer support is responsive and friendly - any problem is solved immediately.