It seems like there should be a warning output, but not the ruby_gntp.rb: Connection refused - connect(2) error.
If you work in a team where someone doesn't use Growl, this is a pain. Before they compass watch, they have to comment out require "compass-growl" in their config.rb.