When at a lecture, it's fine that you don't always clap.  It is, however, a problem when you don't ever clap at all.  Come on now.  These people are lecturers for a reason; they're charismatic and inspirational in some form.  Show some appreciation!