WSO2 is now Choreo LabsLearn more

Trusted AI Governance
Build

Create agents and AI apps with the tools and languages your teams already use.

Connect

Link agents securely to your APIs, data, models and business systems.

Run

Deploy, observe and operate agents and AI apps reliably at any scale.

Govern

Control identity, access, cost and policy for every agent in production.

Agent Management

Developer Platform

  • API Management Cloud

    Design, secure and publish APIs with governance and analytics built in.

    Sign Up Now
  • Integration Cloud

    Connect apps, data and AI agents with low-code and pro-code integration.

    Sign Up Now
  • Identity & Access Management Cloud

    Secure sign-in and access for customers, partners, workforce and agents.

    Sign Up Now
  • Agent Management Cloud

    Build, run and govern AI agents with full visibility and control.

    Sign Up Now
  • Developer Platform Cloud

    Ship cloud-native apps faster on an internal developer platform.

    Sign Up Now

Self-Hosted

Full control over your stack. Deploy directly to your own servers, bare metal, cloud, or Kubernetes environment. Your data never leaves your perimeter.

Product Downloads
Choreo Labs
AI Governance
Platform
Solutions
Resources
Article

Distributed stream processing with WSO2 stream processor

Distributed stream processing with WSO2 stream processor

Stream processing is inherently associated with fast data rates and can consume a lot of resources. Owing to growing business needs, when the incoming data rate exceeds 100k, a simple high available deployment of a stream processing solution would not be able to handle such a large amount of data. This has created the need for distributed stream processing.

WSO2 Stream Processor has the capability to execute Siddhi streaming applications in a distributed and parallel manner in multiple nodes. Users can annotate the Siddhi applications with distributed processing information, where the system then decomposes and run the applications parallelly in multiple worker nodes.

In this webinar, we will focus on the following key areas:

  • High-level architecture of WSO2 Stream Processor
  • Concepts for distributed processing
  • The deployment architecture for distributed stream processing
  • Writing a distributed Siddhi applications
  • Fault tolerance
  • Allocation and re-balancing algorithms
 

Presenters

Tishan Dahanayakage Associate Technical Lead, WSO2

Tishan is currently a member of the WSO2 Stream Processor team. He is a key contributor to Siddhi CEP and Distributed Stream Processing implementation. Apart from this Tishan provides consultation on customer engagements where he helps enterprises design and implement analytics solutions. Tishan is a published author of several papers related to distributed complex event processing.