We have recently removed the lime plaster from an internal chimney breast and would like to leave it exposed. The problem is that we are having difficulty removing the remnants off the brick face -we've tried using a stiff brush but it seems to just smear it in. We are worried that if we try to use anything harsher that it will damage the bricks which are quite soft. Any advice please?