The 55th Massachusetts Regiment was formed after an overwelming turnout of recruits for the 54th Massachusetts Colored Infantry Regiment in 1863. The 55th were called for duty in February, 1864 and sent to Jacksonville, Florida to take part in the Unions Florida Campaign. The 55th would soon see action on Morris Island, James Island, Charlestown and most notably the Battle of Honey Hill and the Last Fight for Charlestown.

While a brigade commander, Hartwell spearheaded an investigation into certain abuses in the recruitment of black soldiers in the South. The Hartwell collection includes correspodence conducted by hartwell into these allegation as well as affidavits and statments from black soldiers.

The Alfred Stedman Hartwell Collection includes correspondence conducted by Hartwell into the allegations of recruiting abuses as well as affidavits and statements from black soldiers. Other aspects of the collection includes mementos of his service with the 44th and 55th Regiments, including photographs of white and black soldiers (among them Robert Gould Shaw), general and special orders pertaining to freed slaves, and a record of donations to the military from Ladies Aid Societies in Massachusetts. The Alfred Stedman Hartwell Collection resides in the State Library of Masssachusetts Special Collections Department.