Not puzzling at all. He is making a general analogy between man's freedom to exercise speech and freedom to exercise privacy. There is no mention of constitution or bill of rights in that statement. Courts refusing to protect freedoms are not mentioned either.