The Composable Codex

Data Sprawl

If you’ve ever been asked 'How do I get this data that I need right now?' and you answered 'It is complicated and it depends,' you've made it to the bad data place. Once you have more than one place where data is stored, the complexity and costs of your system can only go one direction: up.

Data sprawl necessitates solutions that can reach across storage layers and databases. Instead of dealing with costly migrations, lengthy rewrites, and mazes of glue code, composable data systems rely on standards to make the data sprawl feel small.

Sign-up to receive an email when future chapters drop.

Get Notified
In the pipeline

Data Sprawl

What to expect in this chapter :
  • Connectivity

  • Networking
  • Data Access Patterns
  • Serialization
  • Silos

  • Arrow format in transit
  • Arrow Database Connectivity (ADBC)
  • Arrow Flight / Flight SQL