There are a few things you can do to clean mortar off bricks without using acid. First, use a plunger to suction onto the mortar and pull until the mortar comes off in small pieces. Next, use a vacuum cleaner to suck the mortar up into the vacuum cleaner. Finally, use a scrubber to scrub the mortar off of the brick.