offhand This is all one word, not two. Yes, it's a well-known and common word. An offhand remark is one that you don't think much about before saying. I think the main sense is 'casually, without thinking much'.
off the cuff Here, the main sense is 'with little or no preparation'.