Sonar

Provide ability to record and display line coverage per test

Details

  • Type: New Feature New Feature
  • Status: Closed Closed
  • Priority: Major Major
  • Resolution: Fixed
  • Affects Version/s: 2.8
  • Fix Version/s: 3.5
  • Component/s: Code Coverage, Unit Test
  • Labels:
    None
  • Number of attachments :
    0

Description

I'm facing a problem regarding test coverage. I have a legacy project where the line coverage is 100%, what is very suspicious. The tests are mix of unit, component, integration and acceptance tests. I'd like to find out which tests are making the 100% coverage - and based on analysis split them out into categories. Moreover, I'd like to get rid of unit tests, what are covering too much lines.

It would be a great feature to have capability to do such kind of analysis, e.g.:

  • how many lines covered by a test
  • how much would be the coverage if the particular test would run alone

See http://markmail.org/thread/sgujhlvwucfq6ou2

Issue Links

depends upon

New Feature - A new feature of the product, which has yet to be developed. SONAR-4087 Java API to handle tests

  • Major - Major loss of function.
  • Closed - The issue is considered finished, the resolution is correct. Issues which are not closed can be reopened.
is related to

New Feature - A new feature of the product, which has yet to be developed. SONARJAVA-94 Provide JUnit Listener to record coverage per test

  • Major - Major loss of function.
  • Closed - The issue is considered finished, the resolution is correct. Issues which are not closed can be reopened.

New Feature - A new feature of the product, which has yet to be developed. SONARJAVA-95 Provide TestNG Listener to record coverage per test

  • Major - Major loss of function.
  • Closed - The issue is considered finished, the resolution is correct. Issues which are not closed can be reopened.

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Jason Huntley added a comment -

I would love to see this added as well.

Show
Jason Huntley added a comment - I would love to see this added as well.
Hide
Permalink
Fabrice Bellingard added a comment -

The idea is also to be able to find which exact lines are covered by a unit test (and not only the number of lines covered by this test).

Show
Fabrice Bellingard added a comment - The idea is also to be able to find which exact lines are covered by a unit test (and not only the number of lines covered by this test).
Hide
Permalink
Freddy Mallet added a comment -

Manually tested !

Show
Freddy Mallet added a comment - Manually tested !
Hide
Permalink
Julien Lancelot added a comment -

IT added

Show
Julien Lancelot added a comment - IT added
Hide
Permalink
Simon Brandhof added a comment -

This feature is language-agnostic but currently on Java projects using JaCoCo are supported. A JUnit or TestNG listener must be enabled when executing tests. See this example with Maven:
https://github.com/SonarSource/sonar/blob/66e50c1f2623232cd1dfc7cda314b7aaf1e40083/pom.xml#L1311

Show
Simon Brandhof added a comment - This feature is language-agnostic but currently on Java projects using JaCoCo are supported. A JUnit or TestNG listener must be enabled when executing tests. See this example with Maven: https://github.com/SonarSource/sonar/blob/66e50c1f2623232cd1dfc7cda314b7aaf1e40083/pom.xml#L1311
Hide
Permalink
Simon Brandhof added a comment -

Screenshot:
https://www.evernote.com/shard/s251/sh/bbe104e7-032b-4022-8fd7-573015bc9f29/05aaaf854b4012fea611f50391fed6e9?noteKey=05aaaf854b4012fea611f50391fed6e9&noteGuid=bbe104e7-032b-4022-8fd7-573015bc9f29

Show
Simon Brandhof added a comment - Screenshot: https://www.evernote.com/shard/s251/sh/bbe104e7-032b-4022-8fd7-573015bc9f29/05aaaf854b4012fea611f50391fed6e9?noteKey=05aaaf854b4012fea611f50391fed6e9&noteGuid=bbe104e7-032b-4022-8fd7-573015bc9f29
Hide
Permalink
Simon Brandhof added a comment -

TestNG is supported as well. The listener is org.sonar.java.jacoco.TestNGListener.

Note that the JUnit Ant Task does not support listeners but the TestNG Ant Task does !

Show
Simon Brandhof added a comment - TestNG is supported as well. The listener is org.sonar.java.jacoco.TestNGListener. Note that the JUnit Ant Task does not support listeners but the TestNG Ant Task does !
Hide
Permalink
Simon Brandhof added a comment -

Supported versions are :

  • JUnit 4.7+
  • Maven Surefire Plugin 2.4+
Show
Simon Brandhof added a comment - Supported versions are : JUnit 4.7+ Maven Surefire Plugin 2.4+

People

  • Assignee:
    Julien Lancelot
    Reporter:
    Mihály Nyeste
Vote (6)
Watch (6)

Dates

  • Created:
    Updated:
    Resolved: