hazelcast-jet-contrib

This repository includes various community supported and incubating modules for Hazelcast Jet.

As a general guideline, the following types of modules are encouraged in this repository:

• Various connectors, including both sources and sinks
• Service Factories. that potentially integrate with other systems.
• Custom aggregations. These should be generic enough that they should be reusable in other pipelines.

Building from source

To build the project, use the following command

./gradlew build

To publish project modules to the Maven Local repository, use the command

./gradlew publishToMavenLocal

List of modules

InfluxDb Connector

A Hazelcast Jet Connector for InfluxDb which enables Hazelcast Jet pipelines to read/write data points from/to InfluxDb.

Probabilistic Aggregations

A collection of probabilistic aggregations such as HyperLogLog.

Redis Connectors

Hazelcast Jet connectors for various Redis data structures.

MongoDB Connector

A Hazelcast Jet connector for MongoDB for querying/inserting objects from/to MongoDB.

Kafka Connect Connector

A generic Kafka Connect source provides ability to plug any Kafka Connect source for data ingestion to Jet pipelines.

Twitter Connector

A Hazelcast Jet connector for consuming data from Twitter stream sources in Jet pipelines.

Pulsar Connector

A Hazelcast Jet connector for consuming/producing messages from/to Apache Pulsar topics.

XA Tests

Tests to check compatibility of the XA support in your JMS broker or JDBC database with Jet's fault tolerance.

Hazelcast Jet Spring Boot Starter

A Spring Boot Starter for Hazelcast Jet which auto-configures Hazelcast Jet if found on the classpath.

HTTP(S) Listener Connector

A Hazelcast Jet Listener Connector for listening incoming HTTP requests as a source and sending messages(websocket) or events(server-sent-event) to the listening clients as a sink.

Snapshot Releases

To access snapshot builds add the following dependency and repository declarations to dependencies and repositories sections in your pom.xml respectively.

<dependency>
  <groupId>com.hazelcast.jet.contrib</groupId>
  <artifactId>${module.name}</artifactId>
  <version>${module.version}</version>
</dependency>

<repository>
    <id>sonatype-snapshots</id>
    <name>Sonatype Snapshot Repository</name>
    <url>https://oss.sonatype.org/content/repositories/snapshots</url>
    <releases>
        <enabled>false</enabled>
    </releases>
    <snapshots>
        <enabled>true</enabled>
    </snapshots>
</repository>

Contributing

We encourage pull requests and process them promptly.

To contribute:

• see Contribution Guideline
• see Developing with Git for our Git process
• see README Template
• complete the Hazelcast Contributor Agreement

Submit your contribution as a pull request on GitHub.

License

This project is licensed under the Apache 2.0 license - see the LICENSE file for details