Integrate Catalog Resolver for HTML DTDs

Details

  • Type: Improvement Improvement
  • Status: Closed Closed
  • Priority: Major Major
  • Resolution: Fixed
  • Affects Version/s: None
  • Fix Version/s: HTTPBuilder-0.5.0
  • Component/s: HttpBuilder
  • Labels:
    None

Description

I was going to release RC1, then some unit tests started failing. It's because XmlSlurper is looking up the DTD every time, and W3C started blocking my IP/ User-Agent... See http://www.w3.org/blog/systeam/2008/02/08/w3c_s_excessive_dtd_traffic

TO DO - use Apache Resolver (http://xml.apache.org/commons/components/resolver/index.html) to catalog common DTDs and schemas, so they are not downloaded when the documents are parsed.

See also: http://www.xml.com/pub/a/2004/03/03/catalogs.html
DTDs are downloaded even when validation is set to 'false.' Yay.

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Thom Nichols added a comment - - edited

r757. TO DO - also allow additional catalog files/DTDs to be added. See:
http://xml.apache.org/commons/components/apidocs/resolver/org/apache/xml/resolver/Catalog.html#parseCatalog(java.net.URL)

Most common use case would probably be to pass a publicId or systemId + URl to local DTD. Probably doable through Catalog#addEntry(). But other things like URI rewriting would probably be desirable... Maybe just leave the option to pass additional Catalog files.

Show
Thom Nichols added a comment - - edited r757. TO DO - also allow additional catalog files/DTDs to be added. See: http://xml.apache.org/commons/components/apidocs/resolver/org/apache/xml/resolver/Catalog.html#parseCatalog(java.net.URL) Most common use case would probably be to pass a publicId or systemId + URl to local DTD. Probably doable through Catalog#addEntry(). But other things like URI rewriting would probably be desirable... Maybe just leave the option to pass additional Catalog files.
Hide
Permalink
Thom Nichols added a comment -

Catalog is integrated to parsers; should add API to add new catalog definitions. Probably for 0.5.1.

Show
Thom Nichols added a comment - Catalog is integrated to parsers; should add API to add new catalog definitions. Probably for 0.5.1.

People

  • Assignee:
    Thom Nichols
    Reporter:
    Thom Nichols
Vote (0)
Watch (0)

Dates

  • Created:
    Updated:
    Resolved: