Like these ones in Fran's blog post? Yes, they can make a significant difference and they don't have to be a permanent feature.
In general, diffuse (ie scattered) reflections from far away are good and anything focussed and/or close is bad. Large flat surfaces in small spaces will tend to need quite heavy treatment. A large room with "broken-up" surfaces will scatter sound waves around and give them room to breathe.