GeoServer
  1. GeoServer
  2. GEOS-1570

Shapefile index building is very memory hungry

    Details

    • Type: Improvement Improvement
    • Status: Closed Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.6.0-RC1
    • Fix Version/s: 2.0-RC2
    • Component/s: WMS
    • Labels:
      None
    • Number of attachments :
      0

      Description

      Current shapefile index building code is adequate only for small and mid sized shapefile (less than 100MB). Trying to build the index for a 400MB shapefile resulted to be impossible even providing the VM with 2GB of memory.
      For the moment, tell users to generate the indexes using shptree, and then investigage what hsptree is doing and replicate it (shptree is generating indexes with a small amount or required memory).

        Issue Links

          Activity

          Hide
          Andrea Aime added a comment -

          Modified the code so that even a 1.1GB shapefile can be indexed with "only" 128MB of memory. Should be good enough, if not, we can point people use using the ShapefileIndexer from the command line.

          Show
          Andrea Aime added a comment - Modified the code so that even a 1.1GB shapefile can be indexed with "only" 128MB of memory. Should be good enough, if not, we can point people use using the ShapefileIndexer from the command line.

            People

            • Assignee:
              Andrea Aime
              Reporter:
              Andrea Aime
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: