Brian Jean has been "mortally wounded" by his own words, says an Alberta political watcher.

Controversial comments Jean made about physically beating Premier Rachel Notley will derail the Wildrose leader's political career and further fracture the Alberta conservatives, says David Climenhaga, an NDP supporter and author of the blog albertapolitics.ca.

"It's very damaging," said Climenhaga. "This may be the end of his hopes to lead the united right.

"It's very hard to back away from something like that, even it was an off-the-cuff remark."

Jean's comments came at a public town hall Tuesday night in Fort McMurray, where the Wildrose has been holding a caucus retreat this week.

The opposition leader was responding to concerns about the need to push ahead with construction of a long-awaited seniors care centre, which was destroyed in the May wildfire.

"Let's be honest. I've been beating this drum for 10, 11, 12 years now, so I will continue to beat it, I promise," Jean said to the crowd.

"But it is against the law to beat Rachel Notley."

Jean has since apologized for the comments, describing them as an "inappropriate attempt" at humour.

However, the backlash has been swift and pointed from both political leaders and everyday Albertans.

Climenhaga says the damage to Jean and his party's political image will not be easily repaired.

"It will be very hard for him to get out from under this," he told CBC's Edmonton AM in an interview Thursday.

Notley has been subjected to a series of highly-publicized violent threats and images in the past year. Last December Jean spoke out about the need to stop online commenters from making assassination threats against the premier.

"These kinds of comments cross all bounds of respect and decency and have absolutely no place in our political discourse," he said at the time. "This is not how Albertans behave."

Despite the firestorm created by Jean's comments, some political watchers believe Jean can recover.

Brock Harrison, a conservative activist and former Wildrose communications director, says Jean is still capable of reuniting the right, but acknowledges the blemish made by the remarks will be hard to erase.

"It is quite damaging. It really was just a very ham-fisted attempt at being funny, and I know Brian personally, and I know that's not Brian, that's not what Brian thinks, that's not him as a person, but having said that, he own the remarks and the remarks were hurtful.

"I have no doubt those remarks have caused a lot of pain for some people. And he's got to live with those consequences," he said.

"This is one of those gaffes that unfortunately will stick with the leader for a very, very long time."