You may have to hit the stop button twice. That's because as long as the program is running, hitting the button will not stop debugging, but will tell the debugger to break the program.
If you hit the button while the program is held at a breakpoint, it will stop debugging.