Whenever a new friend comes over, one of the first things they say to me is that I am "so lucky" to have an exposed brick wall in my apartment ... The paste (middle) works well for cleaning ...
Here's how I clean my brick wall without damaging it. Salt and dish soap work well (with a caveat ... It's also smart to use a bucket of water to continually wet and rinse your rag.