Groovy compiler chokes on MBCS in the script

Have you tried compiling your program with a specific encoding? (using -c flag)

Also in what encoding this example is using?

The encoding used is UTF-8.
I did not compiled with any -c flag can you please elaborate what this flag is ?

Sorry, not the right flag, it's -e instead.

$ groovyc
usage: groovyc [options] <source-files>
options:
    --classpath <path>      Specify where to find the class files.
 -d <arg>                   Specify where to place generated class files.
 -e,--exception             Print stack trace on error.
    --encoding <encoding>   Specify the encoding of the user class files.
 -F <flag>
 -h,--help                  Print a synopsis of standard options.
 -J <property=value>
 -j,--jointCompilation      Attach javac compiler to compile .java files.
    --sourcepath <path>     Specify where to find the source files.
    --temp <temp>
 -v,--version               Print the version.

I need to compile the script in a java program. I am not using the command line groovyc instead using the GroovyShell class. Is there an API where I can set this? The only place I could set this was in the CompilerConfiguration.setEncoding

And where is the Groovy script coming from?
Is it put as is in the java class? Or is it coming from a file / database or elsewhere?

Yes, there's the CompilerConfiguration#setEncoding method that you can use to specify the encoding used.

Also, could you make the same test you're doing, but with Groovy 1.7-beta-2, please?
I made some changes somewhat related to that, and this may be fixed in 1.7-beta-2 already.

The groovy script is coming from a xml file, read in as a java string and the string is then parsed with the groovy parser as defined in the above program. The names of some binding variable in the script are the same as column names in a MBCS enabled database, hence the requirement.

I verified with groovy1.7 beta2 same error.

/opt/jdk16/bin/java -classpath /home/vredla/sample/groovy/Application2/Project1/classes:/home/vredla/groovy-1.7-beta-2/lib/ant-1.7.1.jar:/home/vredla/groovy-1.7-beta-2/lib/ant-junit-1.7.1.jar:/home/vredla/groovy-1.7-beta-2/lib/ant-launcher-1.7.1.jar:/home/vredla/groovy-1.7-beta-2/lib/antlr-2.7.7.jar:/home/vredla/groovy-1.7-beta-2/lib/asm-3.2.jar:/home/vredla/groovy-1.7-beta-2/lib/asm-analysis-3.2.jar:/home/vredla/groovy-1.7-beta-2/lib/asm-commons-3.2.jar:/home/vredla/groovy-1.7-beta-2/lib/asm-tree-3.2.jar:/home/vredla/groovy-1.7-beta-2/lib/asm-util-3.2.jar:/home/vredla/groovy-1.7-beta-2/lib/bsf-2.4.0.jar:/home/vredla/groovy-1.7-beta-2/lib/commons-cli-1.2.jar:/home/vredla/groovy-1.7-beta-2/lib/commons-logging-1.1.jar:/home/vredla/groovy-1.7-beta-2/lib/groovy-1.7-beta-2.jar:/home/vredla/groovy-1.7-beta-2/lib/ivy-2.1.0-rc2.jar:/home/vredla/groovy-1.7-beta-2/lib/jline-0.9.94.jar:/home/vredla/groovy-1.7-beta-2/lib/jsp-api-2.0.jar:/home/vredla/groovy-1.7-beta-2/lib/junit-4.7.jar:/home/vredla/groovy-1.7-beta-2/lib/servlet-api-2.4.jar:/home/vredla/groovy-1.7-beta-2/lib/xstream-1.3.1.jar project1.TestMBCSWithGroovy
org.codehaus.groovy.control.MultipleCompilationErrorsException: startup failed:
test: 1: unexpected char: 0x14 @ line 1, column 1.

^

1 error

at org.codehaus.groovy.control.ErrorCollector.failIfErrors(ErrorCollector.java:296)
at org.codehaus.groovy.control.ErrorCollector.addFatalError(ErrorCollector.java:143)
at org.codehaus.groovy.control.ErrorCollector.addError(ErrorCollector.java:113)
at org.codehaus.groovy.control.ErrorCollector.addError(ErrorCollector.java:125)
at org.codehaus.groovy.control.SourceUnit.addError(SourceUnit.java:353)
at org.codehaus.groovy.antlr.AntlrParserPlugin.transformCSTIntoAST(AntlrParserPlugin.java:97)
at org.codehaus.groovy.antlr.AntlrParserPlugin.parseCST(AntlrParserPlugin.java:69)
at org.codehaus.groovy.control.SourceUnit.parse(SourceUnit.java:249)
at org.codehaus.groovy.control.CompilationUnit$1.call(CompilationUnit.java:155)
at org.codehaus.groovy.control.CompilationUnit.applyToSourceUnits(CompilationUnit.java:810)
at org.codehaus.groovy.control.CompilationUnit.compile(CompilationUnit.java:470)
at org.codehaus.groovy.control.CompilationUnit.compile(CompilationUnit.java:449)
at project1.TestMBCSWithGroovy.main(TestMBCSWithGroovy.java:44)

And the XML is encoded in UTF-8 and properly parsed? (ie not parsed as some other 8-bit encoding)

XML is encoded UTF8, I will verify if it got parsed right and get back to you.

I wondering about 0x14. Even if the source was in UTF8 and it is now ASCII 0x14 would stay 0x14 and it would be invalid. I thought it might be the byte order mark, but that is using a differnt sequence. In 1.6 we transcoded the string, which could have lead to such problems, although I have still no idea where the 0x14 might be comming from. But in 1.7 we use the String as it is. If any encoding problem happens, then it is already in the string. In your first example you convert ", but that is ASCII 0x22, converted into UTF8 it is still 0x22 and not 0x14. Even UCS2 uses the ASCII code for this.