‘I don’t know why this particular group gets all this focus,’ Kevin O’Leary declared on Tuesday