Hi Sandy,
James E. (Jef) Ferguson, II
ferguson.jef@gmail.com

So I think the lineage between me and Joseph is as follows.
James E. Ferguson, II, b. Oct, 25, 1951 (me)
James E. Ferguson, b. June 1, 1925 Wills Point, TX, d. Feb, 1996, Charlottesville, VA
Robert Marshall Ferguson, b. February 21, 1873 in McKinney, Collin Co., TX, d July 12, 1947, Los Angeles, CA
Felix William Ferguson, b. February 21, 1837 in Pittsylvania Co, VA, d. Feb 4, 1876, Plano, Collin Co., TX
Edmund Ferguson, b. 1800 in Pittsylvania Co., VA, d. April 25, 1825 in Pittsylvania Co., VA. 
                 Married a Nancy Whitehurst in 1825 in Pittsylvania Co, VA. She was from Halifax Co, VA. 
                 They had Felix ~ 1836 or 7, Henry Bedford b. May 1, 1833, Robert Bethel b. ~ 1828.
Covington Ferguson, b. ~1770, b. Halifax or Pittsylvania Co, VA., d. ? Pittsylvania Co. 
                 (Married a Frances Gunnell on Nov 26, 1792 in Pittsylvania Co., VA) 
                 I think their children were John F b. 1795, Eliz F b. 1810, Edmund, b. ~ 1800, 
                 Rob't F, b. 1815 and Rebecca b. ~ 1800)
Joseph Ferguson, b. ~1740 (Based on what you said in Ireland, along with Richard and Andrew and James), d. ~ 1797 
                 I think in VA. (Married a Mary Jones on Mar 12, 1760 in Christ's Church, Philadelphia, PA. 
                 They had a Joseph in ~ 1762, a Sally in 1764 and Robert in 1761 and Covington in ~1770.
James Ferguson, b. ~ 1680, where? Ireland?       d. 1752, where? Ireland? (your Richard's and my Joseph's father)
James Ferguson, b. ? in Scotland?, d. ~ 1720?