I think the problem is more that CGI was invented to help offset the cost of movies and instead has inflated budgets. Of course with hollywood accounting its really difficult to accurately peg where the fault lies. Many CGI/animation companies go under right after a big project when a studio screws them on something so its hard to fault one side or the other in a scenario where they're all fucking each other.
In terms of seeing the effects in films, there are times its done really well and there are times I wish they had used more practical effects or just been less ambitious. Some films seem to use it as a crutch when the director was simply overreaching with his budget or the script calls for things that just aren't practical. Sometimes this works out well but I would say more often than not it doesn't and ends up looking really poorly implemented.
I don't think you really consider that some people just find it jarring by the way. In an entertainment medium where escapism is paramount (heh!) that's not an insignificant factor. The use of CGI certainly isn't going anywhere so people have to suck it up but in their defense I can see how its overuse would annoy people who end up blaming the tool instead of the person wielding it.
Playing: Xenoblade Chronicles DE, Ys IX, God of War
Watching: Lupin, You me and the Apocalypse, Days of Thunder