Should an atheist bow his head during grace ?

Should an atheist bow his or her head during public prayer (at a funeral, or wedding, or at a dinner table) as a sign of respect to the host, or should he "stick to his guns" and not bow to a "non-existant" god ?