Hi,
This may have nothing to do with your problem, but I was getting erratic debugger behavior while experimenting with gcc 4.2 and 4.3.
(I have not tried the debugger with gcc 3.4.5.) Last month, there was a MinGW Snapshot release of gdb-6.6.
After installing this release, everything seems to behave properly.
Good luck.