I think that whoever actually kills the baddy should get the gem (if the gem happens to spawn that time) and it'd have a small gem icon above the player (at the same size and placement as the orb icon when you lose health) and it goes away after like 0.30 seconds, just indicating who was rewarded it.