GeoServer

PNG image palette error when requesting GeoTiff from Geoserver

Details

  • Type: Bug Bug
  • Status: Closed Closed
  • Priority: Major Major
  • Resolution: Fixed
  • Affects Version/s: 2.1.0, 2.1.1
  • Fix Version/s: None
  • Component/s: WMS
  • Labels:
  • Environment:
    Ubuntu x64, Apache Tomcat 6.0.2.4, Sun jdk1.6.0_24 64bit
  • Number of attachments :
    1

Description

When requesting a specific rasterlayer in PNG 24bit format I get an error like this:
com.sun.medialib.codex.png.PNGException: codecLib: image palette error. [PLTE].
To see this error please follow the link below and switch format to "PNG 24bit".
Link to OpenLayers-Preview
The raster the layer is based on is in GeoTIFF-format and has a size of about 50MB.

Here is the complete stacktrace for the error:

com.sun.medialib.codec.png.PNGException: codecLib: image palette error. [PLTE]
at com.sun.medialib.codec.png.Encoder.setPalette(Encoder.java:175)
at com.sun.media.imageioimpl.plugins.png.CLibPNGMetadata.writeMetadata(CLibPNGMetadata.java:2692)
at com.sun.media.imageioimpl.plugins.png.CLibPNGImageWriter.write(CLibPNGImageWriter.java:236)
at org.geotools.image.ImageWorker.writePNG(ImageWorker.java:2450)
at org.geoserver.wms.map.PNGMapResponse.formatImageOutputStream(PNGMapResponse.java:75)
at org.geoserver.wms.map.RenderedImageMapResponse.write(RenderedImageMapResponse.java:113)
at org.geoserver.ows.Dispatcher.response(Dispatcher.java:757)
at org.geoserver.ows.Dispatcher.handleRequestInternal(Dispatcher.java:238)
at org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:153)
at org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:48)
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:875)
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:809)
at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:571)
at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:501)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.geoserver.filters.ThreadLocalsCleanupFilter.doFilter(ThreadLocalsCleanupFilter.java:23)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.geoserver.filters.SpringDelegatingFilter$Chain.doFilter(SpringDelegatingFilter.java:74)
at org.geoserver.filters.SpringDelegatingFilter.doFilter(SpringDelegatingFilter.java:45)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.geoserver.platform.AdvancedDispatchFilter.doFilter(AdvancedDispatchFilter.java:49)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.vfny.geoserver.filters.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:109)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:394)
at org.springframework.security.intercept.web.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:109)
at org.springframework.security.intercept.web.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:83)
at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:406)
at org.springframework.security.ui.ExceptionTranslationFilter.doFilterHttp(ExceptionTranslationFilter.java:101)
at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53)
at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:406)
at org.springframework.security.providers.anonymous.AnonymousProcessingFilter.doFilterHttp(AnonymousProcessingFilter.java:105)
at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53)
at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:406)
at org.springframework.security.ui.basicauth.BasicProcessingFilter.doFilterHttp(BasicProcessingFilter.java:174)
at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53)
at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:406)

Issue Links

relates to

Bug - A problem which impairs or prevents the functions of the product. GEOS-5114 GeoServer generates invalid PNG files when using raster symbolizers with extended color map

  • Major - Major loss of function.
  • Open - The issue is open and ready for the assignee to start work on it.

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Andrea Aime added a comment -

I have seen this error when the source is 2 or 4 bits deep using PNG output, however that error should have been fixed in 2.1.1
Can you share the source data somehow?

I'm also confused, in the description you say "when requesting geotiff" (which is one of the supported output formats) however in the description and stack trace we have the PNG format instead.
Asking for a geotiff seem to never return though:
http://131.220.109.2/geoserver/GVP/wms?LAYERS=GVP%3AGVP_landcover-change_volta-basin_1990-to-2000_ras&STYLES=&FORMAT=image%2Fgeotiff&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&SRS=EPSG%3A4326&BBOX=-2.0215051574707,10.295365539552,-1.3517723693847,10.979803039552&WIDTH=501&HEIGHT=512

Show
Andrea Aime added a comment - I have seen this error when the source is 2 or 4 bits deep using PNG output, however that error should have been fixed in 2.1.1 Can you share the source data somehow? I'm also confused, in the description you say "when requesting geotiff" (which is one of the supported output formats) however in the description and stack trace we have the PNG format instead. Asking for a geotiff seem to never return though: http://131.220.109.2/geoserver/GVP/wms?LAYERS=GVP%3AGVP_landcover-change_volta-basin_1990-to-2000_ras&STYLES=&FORMAT=image%2Fgeotiff&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&EXCEPTIONS=application%2Fvnd.ogc.se_inimage&SRS=EPSG%3A4326&BBOX=-2.0215051574707,10.295365539552,-1.3517723693847,10.979803039552&WIDTH=501&HEIGHT=512
Hide
Permalink
Max Stephan added a comment -

Sorry for being a little bit unclear in the sentence. I wanted to say the source of the layer is a GeoTIFF, but IŽm requesting it in PNG-Format which is not working (JPEG does, GIF and PNG8bit donŽt work either). IŽll ask for permission to share the GeoTIFF with you and if possible IŽll upload it to our server or a sharing-platform on the internet.

Show
Max Stephan added a comment - Sorry for being a little bit unclear in the sentence. I wanted to say the source of the layer is a GeoTIFF, but IŽm requesting it in PNG-Format which is not working (JPEG does, GIF and PNG8bit donŽt work either). IŽll ask for permission to share the GeoTIFF with you and if possible IŽll upload it to our server or a sharing-platform on the internet.
Hide
Permalink
Max Stephan added a comment -

HereŽs the link to the original GeoTIFF: https://skydrive.live.com/redir.aspx?cid=44cc6581e68f1bd3&resid=44CC6581E68F1BD3!184.

Show
Max Stephan added a comment - HereŽs the link to the original GeoTIFF: https://skydrive.live.com/redir.aspx?cid=44cc6581e68f1bd3&resid=44CC6581E68F1BD3!184 .
Hide
Permalink
Andrea Aime added a comment -

Ah, it's a GeoTiff with a palette with 65000 entries. Looked quickly into into, the fix is not entirely trivial, even expanding in RGB prior to encoding does not work properly (my guess is that the RGB expansion code was not tested with this case).
It's odd that you have such a large palette for a file that only uses 11 colors though... what software generated the image?

Show
Andrea Aime added a comment - Ah, it's a GeoTiff with a palette with 65000 entries. Looked quickly into into, the fix is not entirely trivial, even expanding in RGB prior to encoding does not work properly (my guess is that the RGB expansion code was not tested with this case). It's odd that you have such a large palette for a file that only uses 11 colors though... what software generated the image?
Hide
Permalink
Andrea Aime added a comment -

Btw, not sure when I'll have time to develop a fix for this one, but when I do, can I use a small portion of that file for the tests?
In other words, is that file copyrighted or freely redistributable? (I would use only a 20x20 pixels portions anyways)

Show
Andrea Aime added a comment - Btw, not sure when I'll have time to develop a fix for this one, but when I do, can I use a small portion of that file for the tests? In other words, is that file copyrighted or freely redistributable? (I would use only a 20x20 pixels portions anyways)
Hide
Permalink
Max Stephan added a comment -

The raster is public domain, thus it should be no problem if you use parts of it for the bug fix. I donŽt know with which software the original GeoTIFF was created with but I know that it was reprojected with ArcGIS. IŽll see if we can reduce the colordepth in this process cause as you mentioned having such a huge palette for such a small number of classes doesnŽt make much sense and increases the file-size unnecessarily.

Show
Max Stephan added a comment - The raster is public domain, thus it should be no problem if you use parts of it for the bug fix. I donŽt know with which software the original GeoTIFF was created with but I know that it was reprojected with ArcGIS. IŽll see if we can reduce the colordepth in this process cause as you mentioned having such a huge palette for such a small number of classes doesnŽt make much sense and increases the file-size unnecessarily.
Hide
Permalink
Andrea Aime added a comment -

While you're at it I very much reccomend to add overviews to the file. I normally use gdaladdo on the command line to do that

Show
Andrea Aime added a comment - While you're at it I very much reccomend to add overviews to the file. I normally use gdaladdo on the command line to do that
Hide
Permalink
Daniel Langhans added a comment -

I get the same error...
Using 16bit greyscale GeoTIFF and requesting PNG24bit, but only if I use RasterSymbolizer to stretch the image like this:
<RasterSymbolizer>
<ChannelSelection>
<GrayChannel>
<SourceChannelName>1</SourceChannelName>
</GrayChannel>
</ChannelSelection>
<ColorMap extended="true">
<ColorMapEntry color="#000000" quantity="0"/>
<ColorMapEntry color="#ffffff" quantity="400"/>
</ColorMap>
</RasterSymbolizer>

jpeg works fine but I need the transparency

Show
Daniel Langhans added a comment - I get the same error... Using 16bit greyscale GeoTIFF and requesting PNG24bit, but only if I use RasterSymbolizer to stretch the image like this: <RasterSymbolizer> <ChannelSelection> <GrayChannel> <SourceChannelName>1</SourceChannelName> </GrayChannel> </ChannelSelection> <ColorMap extended="true"> <ColorMapEntry color="#000000" quantity="0"/> <ColorMapEntry color="#ffffff" quantity="400"/> </ColorMap> </RasterSymbolizer> jpeg works fine but I need the transparency
Hide
Permalink
Francesco Izzi added a comment -

Yes i have also this problem.

We tested both stable release (2.1.3) and trunk and we found a problem using extended attribute on ColorMap
when require png image. (24 and 8 bits).

Using native acceleration we have same Max Stephan's palette error but if we do not use the native JAI acceleration
the image is not rendered without show any error log (using GEOTOOLS_DEVELOPER_LOGGING).

Show
Francesco Izzi added a comment - Yes i have also this problem. We tested both stable release (2.1.3) and trunk and we found a problem using extended attribute on ColorMap when require png image. (24 and 8 bits). Using native acceleration we have same Max Stephan's palette error but if we do not use the native JAI acceleration the image is not rendered without show any error log (using GEOTOOLS_DEVELOPER_LOGGING).
Hide
Permalink
Nazzareno Sileno added a comment -

I confirm the bug also testing the layer sf:sfdem and requiring a 24bit PNG with extended colormap attribute value setted to true.

Show
Nazzareno Sileno added a comment - I confirm the bug also testing the layer sf:sfdem and requiring a 24bit PNG with extended colormap attribute value setted to true.
Hide
Permalink
Nazzareno Sileno added a comment -

Fixed bug for PNG 8bit and PNG 24bit using extended color map attribute (with a palette with 65K entries).

Feedback is appreciated

Show
Nazzareno Sileno added a comment - Fixed bug for PNG 8bit and PNG 24bit using extended color map attribute (with a palette with 65K entries). Feedback is appreciated
Hide
Permalink
Andrea Aime added a comment -

The patch is obviously unacceptable, as it will force every paletted data back in RGB mode negating the size advantage of such format.

Show
Andrea Aime added a comment - The patch is obviously unacceptable, as it will force every paletted data back in RGB mode negating the size advantage of such format.
Hide
Permalink
Andrea Aime added a comment -

Just tested the original dataset with the current 2.1.x nightly builds, no issues. I also see the original reporter has the dataset working with all forms of PNG too using GeoServer 2.1.3.
So the original bug is fixed already, the other reports are unrelated, I'll open a separate issue for it.

Show
Andrea Aime added a comment - Just tested the original dataset with the current 2.1.x nightly builds, no issues. I also see the original reporter has the dataset working with all forms of PNG too using GeoServer 2.1.3. So the original bug is fixed already, the other reports are unrelated, I'll open a separate issue for it.
Hide
Permalink
Andrea Aime added a comment -

Switching all issues that have been in "resolved" state for more than one month without further comments to "closed" status

Show
Andrea Aime added a comment - Switching all issues that have been in "resolved" state for more than one month without further comments to "closed" status

People

  • Assignee:
    Andrea Aime
    Reporter:
    Max Stephan
Vote (2)
Watch (6)

Dates

  • Created:
    Updated:
    Resolved: