http://jscrollpane.kelvinluck.com/

If you need to customize how scroll bars looks for your div, and to customize the behavior , this is the right plugin to use.

I tried it with Firefox, Chrome, IE, works well.