If you’re going to say that restrictions aren’t a violation, you have to be consistent. You’ll have to accept restrictions on abortion, on voting, on speech that are all designed to limit exercise, just as gun control is aimed at doing.
And if you expect support for the rights that you personally value, you’d do well to support rights that you choose not to exercise.