Run "mvn test" with the attached project. The setup will fail as "setup" never runs. This test depends on junit:junit-dep rather than junit:junit. junit-dep is just like regular junit, except it doesn't bundle hamcrest in the junit jar; junit-dep.jar includes only junit.* stuff. The junit-dep pom depends on hamcrest-core 1.1. Surefire fails to detect junit:junit-dep and treats the test as a POJO test.