Apache Airflow

Apache Airflow

The Apache Software Foundation

About

Airflow is a platform created by the community to programmatically author, schedule and monitor workflows. Airflow has a modular architecture and uses a message queue to orchestrate an arbitrary number of workers. Airflow is ready to scale to infinity. Airflow pipelines are defined in Python, allowing for dynamic pipeline generation. This allows for writing code that instantiates pipelines dynamically. Easily define your own operators and extend libraries to fit the level of abstraction that suits your environment. Airflow pipelines are lean and explicit. Parametrization is built into its core using the powerful Jinja templating engine. No more command-line or XML black-magic! Use standard Python features to create your workflows, including date time formats for scheduling and loops to dynamically generate tasks. This allows you to maintain full flexibility when building your workflows.

About

GlassFlow is a serverless, event-driven data pipeline platform designed for Python developers. It enables users to build real-time data pipelines without the need for complex infrastructure like Kafka or Flink. By writing Python functions, developers can define data transformations, and GlassFlow manages the underlying infrastructure, offering auto-scaling, low latency, and optimal data retention. The platform supports integration with various data sources and destinations, including Google Pub/Sub, AWS Kinesis, and OpenAI, through its Python SDK and managed connectors. GlassFlow provides a low-code interface for quick pipeline setup, allowing users to create and deploy pipelines within minutes. It also offers features such as serverless function execution, real-time API connections, and alerting and reprocessing capabilities. The platform is designed to simplify the creation and management of event-driven data pipelines, making it accessible for Python developers.

About

Powerful and affordable RPA platform. Use the flexibility of Python, the convenience of low code, and the potential of AI for intelligent automation. Python RPA is an easy-to-use platform for developing and managing bots in Python. The capabilities of Python make the platform an effective and powerful tool for automating business processes. Enterprise-grade orchestrator for managing Python scripts and low-code projects. Basic Python knowledge is enough to start your automation journey. Stay ahead with instant notifications and a status management board. Uninterrupted flow of process execution, keeping things running smoothly. Ensure secured and managed user access. Keep your credentials secured and ensure activities are being logged. Use any library or framework for creating your project. Develop your Python automation in any open-source Python development environment.

About

WarpStream is an Apache Kafka-compatible data streaming platform built directly on top of object storage, with no inter-AZ networking costs, no disks to manage, and infinitely scalable, all within your VPC. WarpStream is deployed as a stateless and auto-scaling agent binary in your VPC with no local disks to manage. Agents stream data directly to and from object storage with no buffering on local disks and no data tiering. Create new “virtual clusters” in our control plane instantly. Support different environments, teams, or projects without managing any dedicated infrastructure. WarpStream is protocol compatible with Apache Kafka, so you can keep using all your favorite tools and software. No need to rewrite your application or use a proprietary SDK. Just change the URL in your favorite Kafka client library and start streaming. Never again have to choose between reliability and your budget.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Anyone who wants to to programmatically author, schedule and monitor workflows

Audience

Developers wanting a tool to create event-driven data pipelines in minutes

Audience

Enterprises interested in a tool to manage their business processes and automate routine tasks

Audience

Organizations wanting a platform to manage and optimize their data streaming operations

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version
Free Trial

Pricing

$350 per month
Free Version
Free Trial

Pricing

$275 per month
Free Version
Free Trial

Pricing

$2,987 per month
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

The Apache Software Foundation
Founded: 1999
United States
airflow.apache.org

Company Information

GlassFlow
Founded: 2023
Germany
www.glassflow.dev/

Company Information

Python RPA
Founded: 2019
Kazakhstan
pythonrpa.org

Company Information

WarpStream
United States
www.warpstream.com

Alternatives

Alternatives

Alternatives

Alternatives

dbt

dbt

dbt Labs
Union Cloud

Union Cloud

Union.ai
Apache Airflow

Apache Airflow

The Apache Software Foundation
Amazon MSK

Amazon MSK

Amazon
Amazon MWAA

Amazon MWAA

Amazon
Azure Functions

Azure Functions

Microsoft
Amazon MWAA

Amazon MWAA

Amazon
Apache Kafka

Apache Kafka

The Apache Software Foundation

Categories

Categories

Categories

Categories

Integrations

AT&T Alien Labs Open Threat Exchange
Amazon Kinesis
Amazon MWAA
Apache ZooKeeper
Chalk
Datafold
GPT-4
Google Cloud Composer
Kubernetes
MaxPatrol
MinIO
Orchestra
Oxla
PyCharm
SAP Cloud Platform
Sifflet
Visual Studio
Weaviate
Yandex Data Proc
emma

Integrations

AT&T Alien Labs Open Threat Exchange
Amazon Kinesis
Amazon MWAA
Apache ZooKeeper
Chalk
Datafold
GPT-4
Google Cloud Composer
Kubernetes
MaxPatrol
MinIO
Orchestra
Oxla
PyCharm
SAP Cloud Platform
Sifflet
Visual Studio
Weaviate
Yandex Data Proc
emma

Integrations

AT&T Alien Labs Open Threat Exchange
Amazon Kinesis
Amazon MWAA
Apache ZooKeeper
Chalk
Datafold
GPT-4
Google Cloud Composer
Kubernetes
MaxPatrol
MinIO
Orchestra
Oxla
PyCharm
SAP Cloud Platform
Sifflet
Visual Studio
Weaviate
Yandex Data Proc
emma

Integrations

AT&T Alien Labs Open Threat Exchange
Amazon Kinesis
Amazon MWAA
Apache ZooKeeper
Chalk
Datafold
GPT-4
Google Cloud Composer
Kubernetes
MaxPatrol
MinIO
Orchestra
Oxla
PyCharm
SAP Cloud Platform
Sifflet
Visual Studio
Weaviate
Yandex Data Proc
emma
Claim Apache Airflow and update features and information
Claim Apache Airflow and update features and information
Claim GlassFlow and update features and information
Claim GlassFlow and update features and information
Claim Python RPA and update features and information
Claim Python RPA and update features and information
Claim WarpStream and update features and information
Claim WarpStream and update features and information