Robert Patterson was s/o William Patterson and Dorcas Spear and m. Mary Anne "Marianne" Caton, d/o Richard Caton and Mary Carroll d/o Charles Carroll of Carrollton (MD signer of The Declaration of Independence) on 1 May 1806. Robert and Marianne had no issue. In 1811 Robert and Marianne accompanied by her sisters went to Lisbon. While in Spain they met the Duke of Wellington who gave them entre'e to the most exclusive houses in England. After Robert Patterson's death Marianne rejoined her sisters in England and m2. Richard Wesley, 1st Marquess Wellesley of Norragh. Robert Patterson was 1 of the founders of The City Bank of Baltimore in 1812 and a major stockholder in U.S. Bank. He was also part owner in 4 privateer schooners out of Baltimore: "Highflyer", "Rolla", "Rossie", and "Tom". During the War of 1812 Robert served as a private in Capt. Henry Thompson's First Baltimore Horse Artillery (aka Capt Thompson's Co of Cavalry, MD Militia) that saw action in 1814 as a cavalry messenger/observation unit at the Battles of Bladensburg and Baltimore in addition to being the personal guard of Maj Gen Samuel Smith, commander of the 3rd Division. Augustine C. Smith, Assistant Inspector General of the U.S. Military requested on 5 Sep 1814 that Robert Patterson be discharged from service in First Baltimore Horse Artillery to be appointed Assistant Division Inspector in the 3rd Division under Maj Gen Samuel Smith. In 1816 Charles Carroll of Carrollton gave his granddaughter Marianne and Robert Patterson "Tuscarora" plantation near Buckeystown, MD. Robert commenced an elaborate restoration of the manor until he fled from a cholera outbreak in the area October 1822. No sooner had he returned to "Brooklandwood", he was taken with cholera and died a few days later. He was buried 26 Oct 1822 in The Patterson Family Cemetery in present day Homewood-Coldstream neighborhood at Filmore Street and Kirkwood Avenue.