Is it OK if he comes along? -- You're asking permission concerning an event that has not yet happened. You probably have already made some plans to ask him to come along.
Would it be OK if he came along? -- Also asking permission concerning an event that has not yet happened. In this case, it's less certain that he might come along. Only the possibility that he might come along is b