Data Sprawl

Overview
If you have ever been asked "How do I get this data that I need right now?" and you answered "It is complicated and it depends," you have made it to The Bad Data Place. Once you have more than one place where data is stored, the complexity and costs of your system can only go one direction: up (for now).

Data sprawl necessitates solutions that can reach across storage layers and databases. Instead of dealing with costly migrations, lengthy rewrites, and mazes of glue code, composable data systems rely on standards to make the data sprawl feel small.

Chapter 03

Data Sprawl

Estimated Read Time:
15 minutes

Topics:
  • Connectivity
  • Data Access
  • Data Transport

Tags:
  • Networking
  • Data Access
  • Serialization
  • Silos

Tools:
  • Arrow data format
  • Arrow Database Connectivity (ADBC)
  • Arrow Flight SQL
  • Arrow Flight RPC