Xi Delta is the first historically Black Greek-lettered organization recognized at James Madison University (JMU) and Washington and Lee University (WLU), both which are predominately non-minority. In a little over 30 years, Xi Delta has initiated over 146 honorable men through 34 lines into Alpha Phi Alpha Fraternity, Inc. Such include five-time Super bowl champion, pro-football player, Charles L. Haley of the Dallas Cowboys and noted news personality, Ronald Burke of WCAU-TV in Philadelphia, Pennsylvania .

It all started with the "GODFATHER" James Alphonso Taylor, Alphonso, as he likes to be called, was initiated into the Alpha Zeta Chapter of Alpha Phi Alpha Fraternity, Inc., in January 1977 while an undergraduate student at Marshall University in Hunting, West Virginia. Later, during his junior year, Alphonso transferred to JMU where he pursued a degree in Communications.

JMU had grown a sizable Black male population, and because there was not a historically Black fraternity on campus, Alphonso began the endeavor of establishing a chapter of Alpha Phi Alpha. After numerous discussions with Steve Waters, and George Johnson, the then Blue Ridge Area Director and Virginia Association of Chapters of Alpha Phi Alpha (VACAPAF) respectively, the first "Smoker" was held in Warren Campus Center Hall. The first brothers of Xi Delta, "The First Great Eight" were initiated on March 2, 1979 with Alphonso as their "Dean." After meeting with the then Dean of Student Affairs of JMU, Alphonso was able to convince the university of the need for a "historically-Black" fraternity. Xi Delta was officially recognized as campus organization during the spring of 1979.

Alphonso graduated May 1979 with a Bachelors degree in Communications. He later served as the Chapter's "Fraternity" Advisor for two years. In keeping with his dedication to Xi Delta and Alpha Phi Alpha Fraternity, Inc., he serves as both the President of the Gamma Alpha Lambda Chapter in Charlottesville, Virginia, and the Blue Ridge Area Director which oversees the Gamma Alpha Lambda Chapter, Iota Beta (UVA) and Xi Delta (JMU/WLU) .

Over the years, Xi Delta has continued in the spirit of Alpha Phi Alpha by bringing programs to JMU that have benefited African-Americans and the JMU community. Xi Delta planned, established and initiated the first "Black Freshman Weekend" at JMU, which later became known as "Perspectives Weekend." Xi Delta initiated the first annual "Martin Luther King, Jr." celebration program that has brought such visitors to JMU as Maya Angelou, Reverend Benjamin Chase, and Betty King the daughter of Martin Luther King, Jr. Xi Delta was the leading organization to push the university in adopting a "Step-Show" as part of its annual Homecoming celebration. In an effort to also increase spiritual growth among African-American students, Xi Delta established and initiated the first " University Sunday" a program now adopted by numerous minority student organizations that invite visiting ministers to JMU to provide church services for minority students.

Members of Xi Delta have a history of distinguished leadership throughout the campus. Yearly the organization and its members are recognized by the NAACP and the JMU Leadership office. Yearly members maintained offices in other organizations such as President of Student Minority Outreach (SMO), Black Student Alliance (BSA), and Bond. A member of Xi Delta also founded Black Arts Social Society, a recognized student organization that "promotes the contributions that Africa-Americans have contributed to Art, Music, Dance, Theater, Painting, Literature, and Drama." In addition to countless awards Xi Delta has won first place at the annual JMU Homecoming Step-Show more times than any other fraternity.

During the Fall term in 1990, four Washington and Lee University students, Jonathan Harris, Curtis Joseph, Courtney Penn, and William Toles, petitioned the fraternity to recharter a chapter at WLU. It was the decision of the national organization to allow these gentleman to seek membership through the Xi Delta Chapter at James Madison University. The members petitioned IFC, and through a special session, was recognized as a student organization by the Executivtive Committee. Since 1991, the chapter has initiated eight additional WLU students,Ronald R. Magee Jr (WLU Class of 2012), Jarrett Smith (WLU Class of 2012), Kenneth Hopkins (WLU Class of 2010), Matthew Locke (WLU Class of 2011), DeVarion Carter, Larry Clark (WLU Class of 2008), Andrew Elliott (WLU Class of 2007)and Andrae Anderson (WLU Class of 2006).