To take it further, what if the emoji reactions and the karma system were two separate entities?
To the best of my knowledge, the only faces that don't add karma are the 'Wow', 'Sad', and 'Confused' ones. And I've seen a good few instances where the 'Haha' clearly wasn't meant in a positive connotation. Similar to the 'Wow' many times being worthy of boosting a user's rep.
AND retractions don't even update in real time...they only appear once an admin does a site-wide audit to refresh those statuses. I learned that the hard way when I thought I had hit a milestone, yet @S77 showed me that in actuality I wasn't even close. 😋
No offense, but this forum is rather, uh, "unique" in how the user feedback/reputation system is set up. Never seen anything quite akin to it in my decades of surfing the web. And I'm not sure whether or not it's the most efficient way of going about things. 😕