Steadily and continuously in a step-by-step manner, especially the creation or destruction of something. Likened to erecting (or demolishing) a house or other building one brick at a time. We built this business from nothing, brick by brick, until we had the largest retail chain in the city. Lawmakers have been tearing down the existing immigration legislation brick by brick.