Skip to content
This repository has been archived by the owner on Apr 17, 2020. It is now read-only.

Project-EPIC/epic-osm-realtime

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Epic OSM Realtime

Processing a realtime stream of OpenStreetMap data can be considered similar to listening to / processing data from the Twitter Streaming API.

This repository discusses and implements different techniques for handling real-time OSM data.

Epic OSM is capable of realtime processing by using a sliding window for analysis. Since the base object is an analysis window, the sliding window is implemented by continually updating the bounds on an analysis window and changing the output directory to represent the current hour. Realtime Script Import Nodeways from OSM API

Planet-Stream by DevelopmentSeed

DevSeed has built Planet Stream (Blog post) to support collection and aggregation of editing statistics during Mapathons. The repository is here. An example of what it can power is the Missing Maps leaderboard page

PlanetStream is powered by osm-meta-util. Future work will consider using this stream in conjunction with PostgreSQL and redis for a near realtime cache of OSM edits, though this requires the overpass API to perform a lot of heavy lifting.

About

Epic-OSM in Spark

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published