Players not being removed from hud

I have issues with players still appearing within the TeamInfo UI even long after they have left a Clan/Team how do I fix this? 

I think it works only with the default button to get out of a team, but it doesn't catch the clan leave command. But it happens on my server too, it definitely needs to be fixed.

A fix for if you want to patch it, is have it reload the plugin on a timer.