Why did C.C. Poindexter leave Alpha Phi Alpha?

C.C. poindexter was the first president of Alpha Phi alpha, but he left when it became a fraternal order. Is that the only reason for his departure?