VIM removal of Unicode ('bomb')

VIM removal of Unicode ('bomb')

Avraham Rosenberg for.avraham at gmail.com
Thu Feb 5 10:32:00 IST 2009


On Wed, Feb 04, 2009 at 04:53:26PM +0200, Noam Rathaus wrote:
> I am using:
> VIM - Vi IMproved 6.1 (2002 Mar 24, compiled Jan 15 2003 08:05:27)
> 
> And I have a few unicode characters (unicode encoding 'bomb'/marker) at the 
> beginning of the file that I want to remove.
> 0000000 bbef 3cbf 4421 434f 5954 4550 6820 6d74
> 
> I m referring to 0xbb, 0xef, 0x3c, 0xbf
> 
> I would to remove them, but opening the file with vim doesn't show them - as 
> they are markers it hides.
> 
> Can anyone help me get rid of them?
> 
> Any solution (not just using VIM) would be great.
> 
> -- 
> Noam Rathaus
> CTO
> noamr at beyondsecurity.com
> http://www.beyondsecurity.com
> 
> "Know that you are safe."
> 
> Beyond Security Finalist for the "Red Herring 100 Global" Awards 2007
> 
> _______________________________________________
> Linux-il mailing list
> Linux-il at cs.huji.ac.il
> http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
Hi
Try filtering with "tr":
Sick-file < tr '\0xbb' ' ' | tr '\0xef' ' ' | tr  '\0x3c' ' ' |  tr '\0xbf'
' ' >Healed-file
Of course, tr requires octal, not hexadecimal numbers. I was too lazy to
translate...
Cheers, Avraham

-- 
Please avoid sending to this address Excell or Powerpoint attachments.



More information about the Linux-il mailing list