The solution cannot be removed when a job is scheduled or running
Also when you go to the Central Administration > Operations > Solution Management, you will notice that an error shows up in the list of solutions.
Off course there is a way to fix this. Alex Thissens wrote a nice blogpost of this issue. Maybe there are other ways to fix this, but Alex' way worked for me.