SAN FRANCISCO >> The stellar career of world-renowned conductor Charles Dutoit has come crashing down in the wake of sexual assault accusations by three singers and a musician. Symphonies from Boston to Sydney have severed ties with the maestro, and he has canceled guest appearances with other major orchestras.

The Royal Philharmonic Orchestra in London, where the 81-year-old Dutoit is artistic director and principal conductor, issued a statement early Friday saying the symphony and Dutoit “have jointly agreed to release him from his forthcoming concert obligations with the orchestra for the immediate future.”

The Royal Philharmonic statement says the facts should be determined by a legal process and that Dutoit “needs to be given a fair opportunity to seek legal advice and contest these allegations.”

Later Friday, The Philadelphia Orchestra became the latest to sever ties with Dutoit, its chief conductor from 2008-12, and said in a statement it has removed Dutoit’s title of conductor laureate following the allegations of sexual misconduct.

It brought to eight the number of major symphonies that have ended long relationships with Dutoit since Thursday when The Associated Press published a story with graphic sexual assault accusations by the four women.

The Sydney, Boston and San Francisco symphonies also announced they were cutting ties with Dutoit, citing the “serious nature of the allegations” detailed by the AP. Meanwhile, orchestras in New York, Chicago and Cleveland quickly released statements saying that Dutoit has withdrawn his services for upcoming concerts. He was scheduled to appear at the New York Philharmonic next month; the other performances were scattered through 2018.

Aside from the orchestra statements attributed to Dutoit about his voluntary withdrawals, the famous conductor has remained silent.

Prior to release of the AP story, Dutoit did not respond to multiple attempts for comment through the Royal Philharmonic Orchestra and his office in Montreal. The Royal Philharmonic said Dutoit was on vacation, but that it had forwarded the AP’s emailed requests for comment directly to him. The AP also reached out to Dutoit’s office with several phone calls and emails.

The reaction has been swift in the classical music world, accompanied by assertions about Dutoit’s decades-long reputation for inappropriate behavior. The developments also have left the orchestras scrambling to find substitute conductors.

Joe Kluger, former president of The Philadelphia Orchestra from 1989 to 2005, told The AP that Dutoit’s reputation as “extremely flirtatious” was one factor that caused the organization to pass him over twice for the job of music director during those years.

He said rumors of Dutoit’s “inappropriate behavior with women were common knowledge in the classical music business.” He added: “I do recall telling our staff to be wary around him and encouraged them to report any inappropriate behavior immediately.”

Kluger said he was unaware of any formal complaints filed about Dutoit by musicians or staff members. He said he had never heard that Dutoit had assaulted women.

The four women who spoke to AP said Dutoit attacked them on the sidelines of rehearsals and performances with orchestras in five cities — Chicago, Los Angeles, Minneapolis, Philadelphia and Saratoga Springs, New York. All four told the AP they never filed formal complaints because they were young and Dutoit was the maestro; they figured they would lose their jobs, not him.

They said the incidents occurred between 1985 and 2010 in a variety of places, including a moving car, Dutoit’s dressing room, a hotel elevator and his suite at the Four Seasons Hotel in Chicago.

The women, two who were named, said the Swiss-born conductor physically restrained them, forced his body against theirs, sometimes put his tongue in their mouths and, in one case, stuck her hand down his pants.

One of the women who spoke to the AP said Dutoit attacked her on four occasions during performances with The Philadelphia Orchestra in 2006 and 2010.

The accusations against Dutoit made him the second high-profile figure in the classical music world to be accused of sexual misconduct recently. Earlier this month, the Metropolitan Opera suspended conductor James Levine when misconduct accusations surfaced.

In a long, distinguished career, Dutoit has traveled the world as a guest conductor and led several highly regarded orchestras, including the Orchestra National de France, the NHK Symphony in Tokyo and the Montreal Symphony Orchestra.

Pascale Ouimet, spokesman for the Montreal Symphony, where Dutoit served as music director for nearly 25 years until 2002, said he had no comment on the allegations.

Dutoit’s long relationship with Montreal came to an acrimonious end in 2002, following a dispute with the musicians’ union.

Among those who spoke to AP were soprano and two-time Grammy winner Sylvia McNair, 61, who said Dutoit had cornered her in a hotel elevator after a rehearsal with the Minnesota Orchestra in 1985.

“As soon as it was just the two of us in the elevator, Charles Dutoit pushed me back against the elevator wall and pressed his knee way up between my legs and pressed himself all over me,” said McNair, who was 28 at the time. “I managed to shove him off and right at that moment, the elevator door opened. I remember saying, ‘Stop it!’ And I made a dash for it.”

Retired mezzo-soprano Paula Rasmussen said Dutoit summoned her to his dressing room at the LA Opera in September 1991, before a dress rehearsal for “Les Troyens.”

“He threw me against the wall, shoved my hand down his pants and shoved his tongue down my throat,” she said. She refused to ever be alone with the maestro again, said Rasmussen, 52, now an attorney in the San Francisco area.