The latest group to distance themselves from comedian Bill Cosby are the chairs of The University of Massachusetts Amherst's capital campaign program.

Due to numerous allegations of sexual assault, up to at least 15 at this point, the comedian stepped down Wednesday from his co-chair spot that helps his alma mater raise funds.

"Bill Cosby has agreed to resign as an honorary co-chair of UMass Amherst's capital campaign. He no longer has any affiliation with the campaign nor does he serve in any other capacity for the university," UMass spokesman Ed Blaguszewski said in a statement.

UMass had announced earlier in the week that Cosby would remain in the position. The comedian and his wife have donated several hundred thousand dollars to the university where he received a master's degree in education in 1972 and his doctorate in 1976.

Other colleges are looking to sever relations with Cosby as well. On Tuesday, Berklee College of Music removed Cosby's name from one of its scholarships.

"Berklee no longer awards an online scholarship in Mr. Cosby's name," campus spokesman Allen Bush told The Boston Globe.

In 2004, Cosby spoke at Berklee's commencement where he was given an honorary degree.

High Point University in North Carolina has taken a different approach. The college has only temporarily removed Cosby from its advisory board "until all information on this matter is available," campus spokeswoman Pamela Haynes said, reported The Boston Globe.

The first college Cosby ever attended as a student continues to stick by him though - for the time being at least. The comedian remains a member of the Board of Trustees at Temple University.

Cosby attended the Philadelphia school while pursuing his undergraduate degree but dropped out. The university eventually awarded him with the degree. However, NewsWorks.com reported the university board has received pressure from a campaign started by a 2005 alumnus to drop him as a member.

Despite the growing allegations of sexual assault against Cosby, a lawyer for him has called the number of claims "ridiculous" and said that the media should stop airing "unsubstantiated, fantastical stories."