At what stage would it become pointless to continue the church?

The only difference would be people would actually know that they aren't being heard, because there is nothing to hear them. Other then that I don't think anything would change if they are trying to act like a good little faithful.