Pigeon roosts were carved into the walls