FOSS4G-Asia 2024

Implementing ETL Processes with NDJSON for Spatial Data Integration
12-16, 16:30–16:45 (Asia/Bangkok), Room34-1102

Effective data management is essential for maximizing the value of spatial data in today’s data-driven landscape. This presentation provides an overview of implementing ETL (Extract, Transform, Load) processes using NDJSON (Newline Delimited JSON) for efficient spatial data integration. We will discuss the importance of robust data management, the benefits of using NDJSON for handling large and complex spatial datasets, and the practical applications of this approach.

Key topics include the steps of the ETL process with NDJSON, from extracting spatial data from various sources, transforming it into usable formats, to loading it into databases such as MongoDB and Elasticsearch. We will highlight the efficiency gains and flexibility provided by NDJSON in streaming and processing spatial data. Additionally, we will cover real-world use cases and best practices for optimizing spatial data integration with NDJSON.

Attendees will gain practical insights into the strategic and technical aspects of utilizing NDJSON in ETL processes, enabling them to implement effective spatial data integration within their organizations.