Numberly operates business-critical data pipelines and applications where failure and latency means "lost money" in the best-case scenario. Most of their data pipelines and applications are deployed on Kubernetes and rely on Kafka and ScyllaDB, with Kafka acting as the message bus and ScyllaDB as the source of data for enrichment. The availability and latency of both systems are thus very important for data pipelines. While most of Numberly’s applications are developed using Python, they found a need to move high-performance applications to Rust in order to benefit from a lower-level programming language.

Learn the lessons from Numberly’s experience, including:

  • Rationale in selecting a lower-level language
  • Developing using a lower-level Rust code base
  • Observability and analyzing latency impacts with Rust
  • Tuning everything from Apache Avro to driver client settings
  • How to build a mission-critical system combining Apache Kafka and ScyllaDB
  • Half a year Rust in production feedback


Speaker bios

Alexys Jacob, CTO, Numberly
Alexys is CTO at Numberly. He is an open-source contributor, a Gentoo Linux developer, and PSF contributing member. He enjoys sharing his experience on architecture design, distributed systems, fault tolerance and scaling Python and Rust based applications

Terms of Use    Privacy Policy   ©ScyllaDB

Apache®, Apache Cassandra®, are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. No endorsement by The Apache Software Foundation is implied by the use of these marks.