Freedom is to be able to do what you WANT

I do not misundertand it at all.

Your freedom to swing your fist ends where my face begins.

Exactly. So it's NOT FREEDOM. If I'm not free to punch you in the face, then I don't have that freedom.

But... If you're my friend and I care about you, I don't need a law that says I can't kill you, do I? No, because I wouldn't WANT to kill my friend. SO there doesn't need to be a law that says I can't. My freedom isn't being infringed in any way.

Now imagine if no one WANTED to kill anybody. Then you wouldn't need a law that says you can't kill anybody, would you? No.

That's what a truely free society would be like.