When you sin against other believers in that way, you harm their weak sense of what is right and wrong. By doing that you sin against Christ.