Because you really care about others, you might have to put your desires on hold for them so you are not a stumbling block.
Read: Romans 14:21
21 It is better not to eat meat or drink wine or do anything else if it might cause another believer to stumble.