These are part of your decorations. Are you running Compiz because it messes
with the decorations sometimes? You change the decorations by going to System,
Preferences, Appearance. However if you use Compiz then you can install the
Compiz Fusion Icon that allows you to turn Compiz on or off and change
decorations from Compiz to Metacity or even KDE4.