Depending on where you look, a little research reveals that the quote is attributed to Lincoln, Clemens/Twain and several others, each apparently having a version of the biblical 'Proverbs 17:28'.

http://www.quotationring.net/mailarc/msg00363.html