Skip to content

Use libpostal service #106

Open
Open
@orangejulius

Description

Similar to pelias/api#1060, we want to modify this service to call a separate HTTP service for libpostal, rather than loading the 2GB of libpostal data in memory.

This would drastically increase efficiency as we could launch multiple interpolation service instances to scale without paying the cost of loading multiple copies of libpostal.

Since a full planet interpolation dataset is around 40GB, we can take advantage of the Node.js cluster module to allow several separate Node.js processes to use the same copy of the data. This would behave similarly to how we use it with the placeholder service, as mentioned in pelias/placeholder#72.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions