This is the only known photo of a black Union soldier with his family. General Grant to President Lincoln: "I have given the subject of arming the negro my hearty support." Ultimately 179,000 black troops fought for the North.