It could be a press fit, it could be attached with a spot of weld or blind pinned. Perhaps the roll pin holding on the factory sight is a bit long, enough to protrude into the cuts on the brake and hold it in place?
I'd figure out a way to get the thing off. I've not yet seen an aftermarket non-thread type of brake that looks right on the Mini.