What's the context? If you're doing something 'just for the sake of it', it usually means you're doing it with no ulterior motives, for no good reason other than just doing it, your activity is an end in itself. It may, therefore, often seem like you're doing something for no particular reason. Hope I've explained it better this time.