Used other than figuratively or idiomatically: see brush, off. To remove something with a brush.
To disregard (something), to dismiss or ignore (someone), as unimportant.