The Wall & The Machine:
Accelerated hardware

The engine is the heart of any data system. But the heart is fickle. Optimizing system performance can feel like a game of whack-a-mole. The second you push forward on one performance area, another one becomes the bottleneck. Even if you make all the right moves, you will hit a performance wall with CPU-based systems.

Here is a hard truth: future data systems will have to jump over The Wall, sooner or later. They will do it by moving to machines that operate on accelerated hardware. To hit the next wave of hardware innovations, composable engines that can "run anywhere" will rely on software and hardware ecosystems that are built to evolve.

What is The Wall? Keep reading below.

Chapter 04

The Wall & The Machine:
Accelerated hardware

Estimated Read Time:
20 minutes

Topics:
  • Execution engine
  • Execution runtime

Tags:
  • Hardware
  • Accelerated hardware
  • CPUs
  • GPUs
  • Optimization
  • Distributed execution
  • Serialization

Tools:
  • Arrow memory format
  • Calcite
  • Velox