Debugging not working when using eclipse compiler

Although debug is set to "true" in the
eclipse compiler configuration, debugging the code as "Remote Java Application"
in eclipse doesn't work. The relevant sources for the classfiles generated by the
eclipse compiler aren't found.
It works fine when using the javac compiler. I debugged into the plexus eclipse compiler to make sure the
relevant eclipse compiler settings get set in EclipseJavaCompiler.java:

        if ( config.isDebug() )
        {
            settings.put( CompilerOptions.OPTION_LocalVariableAttribute, CompilerOptions.GENERATE );
            settings.put( CompilerOptions.OPTION_LineNumberAttribute, CompilerOptions.GENERATE );
            settings.put( CompilerOptions.OPTION_SourceFileAttribute, CompilerOptions.GENERATE );
        }

Any idea why debugging doesn't work when using the eclipse compiler?