Joseph Wilson Patterson served in the War of 1812 as 3rd Lt. in Capt. Henry Thompson's First Baltimore Horse Artillery (aka Capt. Thompson's Co. Cavalry, MD Militia) that saw action in 1814 at the Battles of Bladensburg and Baltimore as a messenger/observation cavalry unit in addition to being the personal guard of Maj. Gen. Samuel Smith, commander of the 3rd Division. (His promotion to 2nd Lt. of the company on 20 Dec 1814 was in place of John Eager Howard, Jr.)

He was the son of William Patterson and Dorcas Spear and married Charlotte Graham Nicols, daughter of James Nichols and Charlotte Graham, at St. Paul's Church, Baltimore, on 30 Dec 1817.

Joseph and Charlotte had issue two sons and two daughters: William (b. 14 Nov 1818); Charlotte Nicols (b. 27 Mar 1820, wife of Charles S. Gilmor); Joseph Wilson, Jr. (B. 1 Jul 1823); and Caroline (b. 8 Jun 1828, wife of Reverdy Johnson, Jr.).

In 1826, he was appointed a director of the Bank of United States. He was one of the first Directors of the B&O Railroad in 1827 and was an interim President of the B&O in 1836. Also, he was a member of the 2nd Branch of City Council from 9th Ward in 1829 and from 8th Ward in 1842; member of the great Tariff Convention held in New York in 1835; one of the incorporators of The National Farmers & Planters Bank of Baltimore in 1836. He was part owner of three privateer schooners out of Baltimore: "Highflyer," "Rolla," and "Torpedo."

The 1822/3 Baltimore Directory shows him as iron merchant at s w corner of Commerce & Pratt Streets; in 1831 as iron & nail merchant at same address. In 1846 he was partner with his brother Edward in Ashland Furnace in Baltimore County. Prior to inheriting Cold Stream along with all the furnishings from his father's estate in 1835, he owned Evesham and is credited with enlarging the original home on the Drumquehastle tract into a neo-Gothic fantasy.

He was buried at Green Mount Cemetery.

Information submitted by researcher Nelson Bolton.