MIAMI BEACH (CBSMiami) – The man who bashed Paris Hilton’s little brother in the face over the weekend at a Miami Beach mansion is denying that Lindsay Lohan had anything to do with it.

A rep for Ray Lemoine claims he got into a fight with Barron Hilton after he refused to leave a party early Friday morning at the mansion, according the celeb news website TMZ.com. Lemoine also claims that things got physical when Hilton pushed him.

READ MORE: Doral Police ID Officers Injured In Friday's Shooting

Lemoine said Hilton is to blame for what happened.

Hilton, 24, told police that he got into a heated argument with a guy at the party but didn’t know his name. Hilton said the male hit in the face with an ‘unknown object’, according the police incident report. Two witnesses at the party said the fight began when Lemoine asked Hilton to leave the party.

Lemoine, who was renting the mansion for a few days, had invited Lilo to stay there over the Art Basel weekend because she was a “friend of a friend,” according to TMZ.com.

READ MORE: Six People Hospitalized Following Boat Explosion In Dania Beach

Hilton claimed that Lohan masterminded the attack on him after he reportedly bad mouthed her at the party.

Lohan and her father have denied she had anything to do with the attack and had left the party before it happened. Michael Lohan claims they have several witnesses who will back up their story, according to TMZ.com.

A video obtained by TMZ.com may contradict that. It shows Lohan sitting in an SUV being confronted Hilton after the attack. On the video, Lohan can be heard saying she saw nothing and taunting Hilton who claims she was harassing him.

On Saturday, Hilton posted a picture of his battered face on Instagram on Saturday.

When big sis Paris saw the picture she posted online, “They both will pay for what they did. No one f***s with my family and gets away with it!!”

MORE NEWS: Florida Is Ditching Palm Trees To Fight Climate Crisis

The celebrity news website TMZ.com contributed to this report.