Haven't tried it but I suspect acetone might attack the window frame. I find almost all adhesive residues are shifted by either white spirit or meths. If one doesn't do it, the other will.
Try nail polish remover if its just a little bit. Seems to work well getting sticky tape marks off various surfaces. I think it has acitone (sp) in it.