I expect these two scenarios to produce the exact same results.

 * includes - tests are included using **/Test*.java
 * suite-xml-class-per-test - tests are included using a suite xml file, there is one test per class so that results will be reported by class

Results

 * includes - all test classes are found but no test methods or configurations are executed
 * suite-xml-class-per-test - all test methods and configurations are executed as expected