Your first comment expands on both privacy and security. There is no privacy without some type of security.
Now to answer your questions: Yes and yes. Users from c/all were downvoting posts from a small community I’m a part of because they don’t agree with. I couldn’t see the posts from small communities that are important to me because of that. Now we have the possibility to sort by “scaled”, which fixes that. Sometimes there are discussions that are very relevant as to who is voting for what. But that discussion has nothing to do with privacy, which was your first point and went unacknowledged on your second comment.
There’s nothing stopping a malicious user from doing that right now. Be aware that anyone who wants can already see your votes.