Quine Streaming Graph Overview

Quine was designed for real-time ETL pipelines. Combining a graph data model that scales to ingest millions of events per second with an actor-based compute model means Quine can find complex patterns in high-volume categorical data.

Graph data model

No other ETL system offers the rich query syntax of graph. Find relationships between objects. Stop discarding categorical data.

Scale beyond graph databases

Unlike graph databases, Quine can scale to ingest and query millions of events per second.

Query Historical Data in Real-time

Eliminate the limitations of time windows. Query across your entire historical data set in real time.

Deep graph traversal

Unlike most graph databases, Quine makes multi-hop queries fast, even for high-volume event streams.

Enterprise & OSS Versions

In addition to Quine's open source distribution, thatDot offers Quine Enterprise with 24 x 7 support, resilient clustering, and Novelty Detector.

Drop-in Integration

Add to Apache Kafka, Kinesis pipelines. Use the storage option that works best for you. Supports Cassandra, RocksDB, and other storage options.

Build Graph-Powered ETL Pipelines

In addition to incorporating the best properties of graph databases and event stream processing systems, Quine streaming graph has some important and unique features that offer significant benefits for ETL pipelines and event-driven applications:

An animated GIF showing data flowing through Quine and patterns being matched.
  • A data model optimized for complex pattern matching - Quine's property graph structure encodes relationships as edges, effectively pre-computing joins. This allows for highly expressive yet high performance N-hop queries.

  • Parallelized compute for fast writes (ingest and updates) - Quine's asynchronous, actor-based graph computation model provides very high throughput when processing complex events. It also makes possible our killer feature: standing queries.

  • Out-of-order data handling - Standing queries allow Quine to easily handle out-of-order data and late-arriving data. A standing query is a special query type that persists in the graph, incrementally updating as new data arrives.

  • No time windows - Quine lets you query historical data, incoming data, and even use a standing query to watch for matches in the future, all in real-time.

Scale without Time Windows

Quine also eliminates the tradeoffs. For instance, unlike Flink and ksqlDB, Quine is not limited by time windows. In fact, it is designed to find patterns in events spread our over days, months, and even years. Late-arriving and out-of-order data are no problem for Quine.

And if processing high volume event streams is critical to your business, Quine Enterprise provides clustering for both high availability and scale. Process millions of events per second reliably with a clustering system built on Akka.

Start Using Your Categorical Data

Categorical data is both incredibly useful and almost totally ignored in modern event processing applications. Quine allows you to express the relationships between common objects and information as a graph and look for critical patterns.

Categorical data is all non-numerical data. This graphic provides examples like proper names, email addresses, and parts of the day.

No other event processing system lets you extract and transform categorical data from event streams in real time and without lossy encoding.

Use categorical data from your real-time event pipeline for financial and authentication fraud detection, XDR/EDR applications, network observability, and recommendation engines.

Quine Enterprise includes Novelty Detector, which uses categorical data for anomaly detection.

Quine: Event Processing + Graph

Quine Streaming Graph incorporates the throughput and scalability of event stream processing systems like Flink and ksqlDB with the rich graph query syntax found in traditional databases like Neo4J and TigerGraph.

Quine streaming graph features expressed as a graph. Includes features Quine shares with event processing and GraphDB software.

Scale Out Architecture with Pluggable Storage

Quine Streaming Graph runs inline with existing real-time ETL pipelines. Use Cypher to extract data from Kafka or Kinesis streams or data warehouses and transform that data into graph nodes, properties, and relationships or edges.

Pluggable storage options include Cassandra for high-volume workloads or extra resiliency matter. When paired with Quine Enterprise's clustering for resiliency and horizontal scaling, you can process millions of events per second without the limitation of time windows.

Standing Queries Drive Real-Time Workflows

Standing queries make Quine unique, allowing you to monitor event streams for specific patterns of importance to you -- for instance, patterns suggesting fraud, impending system failures, or opportunities to make recommendations that increase revenue -- and take action on them the instant a match is made.

With traditional databases, you must continuously query to see if a match has occurred. This is inefficient when microseconds matter.

Standing queries maintain partial matches over long time intervals, allowing Quine to handle out-of-order data and eliminate time windows.

Once a standing query match is made, Quine can execute arbitrary code, write to a Kafka topic, update the graph, post an alert message to an API, or  whatever else your business logic demands. All in real time.