Unicode entities from projext.xml are not shown in generated site in HTML or even in XML

Details

  • Type: Bug Bug
  • Status: Closed Closed
  • Priority: Major Major
  • Resolution: Won't Fix
  • Affects Version/s: None
  • Fix Version/s: 1.9.2
  • Labels:
    None
  • Environment:
    JDK 1.4.2, Linux 2.4.17, Debian Unstable

Description

Unicode entities from projext.xml are not shown in generated site in HTML or even in XML.
For example if there is a developer "name with letter ś",
in project.xml then in generated xml i html his named
"name with letter ?".

project.xml encoding does not matter here.

Setting any encoding e.g. ISO-8859-2, does not work either.

Issue Links

relates to

Bug - A problem which impairs or prevents the functions of the product. MAVEN-847 Umlauts in project.xml become garbage in generated site

  • Major - Major loss of function.
  • Closed - The issue is considered finished, the resolution is correct. Issues which are not closed can be reopened.

Improvement - An improvement or enhancement to an existing feature or task. MAVEN-382 POM encoding problem

  • Major - Major loss of function.
  • Closed - The issue is considered finished, the resolution is correct. Issues which are not closed can be reopened.

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Norbert Pabis added a comment -

After further investigation I found that it does not work
only in iso-8859-1 and utf-8 output encoding.

Show
Norbert Pabis added a comment - After further investigation I found that it does not work only in iso-8859-1 and utf-8 output encoding.
Hide
Permalink
Norbert Pabis added a comment -

I have resolved problem with entities.
When reading files SAX parser expands entities. Reading entities is not a problem. The problem is writing.
Reading a file in any encoding results in all strings in Unicode which is Java's internal encoding.
When writing files in maven.docs.outputencoding all these strings have to be encoded and here problems appear.
For example a copyright entity from site.jsl in xdocs plugin in is read correctly and expanded into specific Unicode character.
If output encoding is ISO-8859-1 copyright character can be written correctly,
but if it is not latin1 then there is no such character, and instead of copyright mark, "?" is written.
To avoid this, output encoding should be set to UTF-8 that can represent any character.

The problem is persistent, unless you use UTF-8 as output encoding or have
SAX parsers skip entities expanding.

IMHO this issue could be explained in FAQ, and this bug can be resolved as invalid as soon as http://jira.codehaus.org/secure/ViewIssue.jspa?key=MAVEN-382 is fixed.

Show
Norbert Pabis added a comment - I have resolved problem with entities. When reading files SAX parser expands entities. Reading entities is not a problem. The problem is writing. Reading a file in any encoding results in all strings in Unicode which is Java's internal encoding. When writing files in maven.docs.outputencoding all these strings have to be encoded and here problems appear. For example a copyright entity from site.jsl in xdocs plugin in is read correctly and expanded into specific Unicode character. If output encoding is ISO-8859-1 copyright character can be written correctly, but if it is not latin1 then there is no such character, and instead of copyright mark, "?" is written. To avoid this, output encoding should be set to UTF-8 that can represent any character. The problem is persistent, unless you use UTF-8 as output encoding or have SAX parsers skip entities expanding. IMHO this issue could be explained in FAQ, and this bug can be resolved as invalid as soon as http://jira.codehaus.org/secure/ViewIssue.jspa?key=MAVEN-382 is fixed.
Hide
Permalink
Lukas Theussl added a comment -

Problem gets fixed by changing system encoding, eg on FC3: export LANG=en_US.UTF-8
We'll document that in a FAQ.

Show
Lukas Theussl added a comment - Problem gets fixed by changing system encoding, eg on FC3: export LANG=en_US.UTF-8 We'll document that in a FAQ.
Hide
Permalink
Lukas Theussl added a comment -

A patch for the faq.

Show
Lukas Theussl added a comment - A patch for the faq.
Hide
Permalink
Lukas Theussl added a comment -

FAQ updatet in xdoc 1.9.2

Show
Lukas Theussl added a comment - FAQ updatet in xdoc 1.9.2

People

  • Assignee:
    Lukas Theussl
    Reporter:
    Norbert Pabis
Vote (1)
Watch (2)

Dates

  • Created:
    Updated:
    Resolved: