Nice question. (1) This is my opinion: (a) Perhaps your first sentence should read: I am worried (that I won't be able to finish my assignment on time). " (b) Your second sentence is fine (I would prefer "on" time in this sentence).
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.
Anonymous Noun clause modifying the adjective "worried."