Anger, frustration and calls for action echoed around the NBA on Saturday after an audio recording surfaced of a man identified as Los Angeles Clippers owner Donald Sterling telling his girlfriend not to bring black people to games.

Everybody except for the embattled Clippers owner, who has a decades-long history of discrimination and offensive behavior, seemed to have a response.

The league said it was investigating the recording posted on TMZ's website, calling the comments "disturbing and offensive." Lakers Hall of Famer Magic Johnson, a target of Sterling's remarks, said he wouldn't attend Clippers' games as long as Sterling was the owner. Miami Heat star LeBron James asked new NBA Commissioner Adam Silver to take aggressive measures, saying "there is no room for Donald Sterling in our league."

"Obviously, if the reports are true it's unacceptable in our league," James said. "It doesn't matter, white, black or Hispanic — all across the races it's unacceptable. As the commissioner of our league they have to make a stand. They have to be very aggressive with it. I don't know what it will be, but we can't have that in our league."

Silver spoke Saturday night in Memphis, Tenn., before the Grizzlies' game against Oklahoma City, repeating that the league finds the audio tape "disturbing and offensive" and that Sterling agreed to not attend the Clippers' game Sunday at Golden State.

"All members of the NBA family should be afforded due process and a fair opportunity to present their side of any controversy, which is why I'm not yet prepared to discuss any potential sanctions against Donald Sterling," Silver said. "We will, however, move extraordinarily quickly in our investigation."

Silver said the NBA needs to confirm authenticity of the audio tape and interview both Sterling and the woman in the recording. The Clippers will be back in Los Angeles for Game 5 on Tuesday night.

"We do hope to have this wrapped up in the next few days," Silver said.

Clippers coach Doc Rivers said players discussed boycotting Game 4 of their first-round playoff series during a 45-minute team meeting but quickly decided against it.

"I think the biggest statement we can make as men, not as black men, as men, is to stick together and show how strong we are as a group," Rivers said. "Not splinter. Not walk. It's easy to protest. The protest will be in our play."

Clippers President Andy Roeser said in a statement that the team did not know if the tape is legitimate or has been altered. He said the woman on the tape, identified by TMZ as V. Stiviano, "is the defendant in a lawsuit brought by the Sterling family alleging that she embezzled more than $1.8 million US, who told Mr. Sterling that she would 'get even."'

Roeser also said the recording does not reflect Sterling's beliefs. He added that Sterling is "upset and apologizes for sentiments attributed to him" about Johnson, whom he called Sterling's friend.

In the recording posted on TMZ, the man questions his girlfriend's association with minorities. TMZ reported Stiviano, who is of black and Mexican descent, posted a picture of herself with Johnson on Instagram — which has since been removed.

The man asked Stiviano not to broadcast her association with black people or bring black people to games. The man specifically mentioned Johnson on the recording, saying "don't bring him to my games, OK?"

"I will never go to a Clippers game again as long as Donald Sterling is the owner," Johnson responded on Twitter. He also said the alleged comments are "a black eye for the NBA" and said he felt bad that friends such as Rivers and Clippers point guard Chris Paul had to work for Sterling.

Paul released a statement through the players' union that said "this is a very serious issue which we will address aggressively." He also said Sacramento Mayor Kevin Johnson, a former NBA All-Star guard who is the chairman of a search committee to find a new director for the union, would take a leading role to help players address the matter.

Paul and Clippers All-Star forward Blake Griffin declined further comment on the issue after the team's practice at the University of San Francisco. Other players were not made available as Rivers said he would speak for the team.

"A lot of guys voiced their opinions. None of them were happy about it," Rivers said. "This was a situation where we're trying to go after something very important for us, something that we've all dreamed about all our childhoods. Donald or anyone else had nothing to do with that dream, and we're not going to let anything get in the way of those dreams."

On TNT's halftime studio show Saturday, host Charles Barkley said "this is the first test of Adam Silver." He said Silver had to "suspend him and fine him immediately."

In Dallas, Mavericks owner Mark Cuban said "I have plenty of opinions, just not going to share them. He fended off several inquiries before saying: "Obviously, if any business or entrepreneur says or does things that aren't congruent with what the organization is trying to convey, that's a problem. But it's not my problem."

Warriors coach Mark Jackson, who played for the Clippers from 1992-94, said of Sterling's comments: "My feeling would be the same, no matter if I was coaching, playing or a fan. There's no place for it."

Jacky Johnson, a spokeswoman for the Rev. Al Sharpton's National Action Network, said the organization planned a protest outside Game 5 of the Clippers-Warriors series Tuesday night in Los Angeles.

Sterling, a real estate owner, bought the Clippers in 1981. He is the longest-tenured owner in the NBA since Lakers owner Jerry Buss died last year.

Sterling has been frequently criticized for his frugal operation of the Clippers, although in recent years he has spent heavily to add stars such as Paul and Rivers, who is in his first year as coach. Sterling also has been involved in several lawsuits over the years, including ones with accusations of discrimination.

In November 2009, Sterling agreed to pay $2.73 million to settle allegations by the government that he refused to rent apartments to Hispanics and blacks and to families with children. The Justice Department sued Sterling in August 2006 for allegations of housing discrimination in the Koreatown area of Los Angeles.

In March 2011, Sterling won a lawsuit against former Clippers general manager Elgin Baylor when a jury rejected the Hall of Famer's claim of age discrimination and harassment. Baylor, who was 76 at the time, had sought about $2 million after claiming he was forced out of the job he had held for 22 years. The team said Baylor left on his own and a jury awarded him nothing.

Sterling is a courtside fixture at Clippers home games. But he rarely visits the team's locker room at Staples Center, although he made an appearance in December 2012 after the Clippers won their 11th straight game, when he led an awkward locker room cheer.