Well the insert special characters menu works for me from menu or keybinding.
Despite its name, and the example given in its plugin manager description, it does not automatically replace HTML chars like < > & ; etc probably because if it did then it would be kind of hard to type HTML and XML :)
Also note that automatic replacement only happens in those filetypes.