|

Discover the origins and technology behind composable data systems. Learn about the key layers of data systems, and how to build by reusing open source software components and open standards.

• 0.1Starting from zero

  • 0.1.1Micro trends
  • 0.1.2Macro trends
• 0.2Building a new composable frontier

  • 0.2.1Open source gives you more choices
  • 0.2.2Standards help you make better choices
• 0.3Composing the next frontier

  • 0.3.1What is a composable system?
  • 0.3.2Structure of a composable data system
  • 0.3.3Why now?
• 0.4Keep up with composable data systems

  • 0.4.1How can I keep up with Voltron Data?
  • 0.4.2Who is The Composable Codex for?
  • 0.4.3Who wrote The Composable Codex?
  • 0.4.4How can I cite The Codex?

Make good choices about standards and they will serve your system (and developers) well. Learn how composable standards like Substrait, Arrow, and ADBC glue your system together.

• 1.1Shifting to open standards

  • 1.1.1Hacking data interoperability
  • 1.1.2Seeking data standards that stick
• 1.2Targeting open standards: Arrow hits the mark

  • 1.2.1The Arrow format
  • 1.2.2Composable systems with Arrow
  • 1.2.3A composable ecosystem
• 1.3The data systems hierarchy of needs

  • 1.3.1Modular
  • 1.3.2Interoperable
  • 1.3.3Customizable
  • 1.3.4Extensible
  • 1.3.5MICE: Composability through open standards

Standards help teams bridge the divides between programming languages. Learn how intermediate representation preserves peace and promotes productivity in a composable data system.

• 2.1The complexity of finding common ground

  • 2.1.1The paradox of language choice
  • 2.1.2Language silos & illusions of choice
  • 2.1.3Trapdoor data pipelines
• 2.2Standards for language interoperability

  • 2.2.1Intermediate representation
  • 2.2.2IR in data systems
  • 2.2.3Composing data systems with Substrait
• 2.3Composable user interfaces

  • 2.3.1Modular
  • 2.3.2Interoperable
  • 2.3.3Customizable
  • 2.3.4Extensible

Composable data systems can simplify data sprawl and lower costs. Discover how to avoid costly migrations and lengthy rewrites by adopting open standards for data connectivity and transport.

• 3.1The complexities of data connectivity

  • 3.1.1Defining data connectivity in systems
  • 3.1.2Essential complexities of data connectivity
  • 3.1.3Database connectivity with asterisks
• 3.2Three essential data connectivity standards

  • 3.2.1A standard data format for connectivity
  • 3.2.2A standard data access layer
  • 3.2.3A standard data transport layer
• 3.3Composable data connectivity

  • 3.3.1Modularity in data connectivity
  • 3.3.2Interoperability in data connectivity
  • 3.3.3Customizing data connectivity solutions
  • 3.3.4Extending connectivity in data systems

Future-ready your data systems with accelerated hardware and composable engines. Learn how to jump over the performance wall and keep your systems running smoothly, no matter what the next hardware innovation brings.

• 4.1The Wall

  • 4.1.1Facing The Wall
  • 4.1.2Chipping away at The Wall
  • 4.1.3Why worry about The Wall?
• 4.2The Machine

  • 4.2.1A composable engine
  • 4.2.2Accelerator software and hardware
  • 4.2.3An accelerator-native system
• 4.3Standards make machines safer

  • 4.3.1The good news
  • 4.3.2The bad news
  • 4.3.3The solution is standards
• 4.4The MICE in the machine

  • 4.4.1Modular
  • 4.4.2Interoperable
  • 4.4.3Customizable
  • 4.4.4Extensible