In August 1796, African members of the John Street Methodist Episcopal Church in New York asked for permission to worship separately and to exercise their own spiritual gifts, tired of the restrictions a white-controlled congregation placed on them. Permission was granted, and by 1800 the group had built its own church, which they named Zion. The congregation incorporated in 1801, still worshipping under Methodist Episcopal oversight and still without a minister of its own ordained by its own authority.
That gap closed slowly. In June 1821 the young church held its first annual conference, and at that gathering James Varick was ordained, along with Abraham Thompson and Leven Smith, by white Methodist elders willing to perform the rite. It was not until July 30, 1822 that Varick was raised to the office of superintendent, the position that would come to be called bishop, making him the first bishop of what would become the African Methodist Episcopal Zion Church. Two years earlier, in October 1820, before any of that ordination had happened, the congregation had already published its own Book of Discipline. The church's own history names that act, not the later ordinations, as what set Zion apart as an independent church body: a Black congregation writing its own rule of doctrine and order before it had the ordained clergy a fully independent denomination would normally require, and building the rest of its independence around a document it had already put in writing.