Did you enable optimization ?
Otherwise, you create a debug-build and that's mauch larger (and slower).
There is switch for the configure-script, I don't know exactly how it is named (not on my system), but I guess it was --enable-optimization.
Search for it with ./configure --help .
If you use makefiles directly, the switch is named ENABLE_OPTIMIZED=1 .