Skip to main content
Streemlined does not pre-package connectors that require users to accept a specific license agreement. If you need such connectors, you must first accept the license from the provider, then mount the plugin JARs yourself.
Streemlined is built on top of Kafka Connect, which means you can extend it with any compatible connector plugin. This guide explains how to add custom connectors to your Streemlined deployment.

​
Pre-packaged Connectors

The default Streemlined image includes the following Sink Connectors:
ConnectorLicense
Aiven JDBC Sink ConnectorApache 2.0
Aiven HTTP Sink ConnectorApache 2.0

​
Adding Custom Connectors

To add additional Kafka Connect connectors, you need to mount the connector JARs into the Streemlined container.

​
Step 1: Download Connector JARs

Download the connector plugin(s) you want to add. Connectors are typically distributed as:
  • A single JAR file
  • A ZIP archive containing the JAR and its dependencies
  • A directory with multiple JARs

​
Step 2: Mount the Plugins

You have two options for mounting connector plugins:
  • Override all connectors — Mount a directory to /home/app/plugins to completely replace the pre-packaged connectors with your own set
  • Add more connectors — Mount individual connector directories inside the plugins folder (e.g., /home/app/plugins/mongo) to keep the pre-packaged connectors and add new ones
Override all connectors:
docker-compose.yml
services:
  streemlined:
    image: streemlined/streemlined:latest
    ports:
      - "8080:8080"
    volumes:
      - ./application.yml:/home/app/application.yml
      - ./plugins:/home/app/plugins
Add connectors while keeping pre-packaged ones:
docker-compose.yml
services:
  streemlined:
    image: streemlined/streemlined:latest
    ports:
      - "8080:8080"
    volumes:
      - ./application.yml:/home/app/application.yml
      - ./mongo-connector:/home/app/plugins/mongo
      - ./s3-connector:/home/app/plugins/s3

​
Step 3: Organize Your Plugins Directory

Structure your plugins directory with each connector in its own subdirectory: 
plugins/
├── elasticsearch-connector/
│   ├── kafka-connect-elasticsearch-14.0.0.jar
│   └── ... (dependency JARs)
├── s3-connector/
│   ├── kafka-connect-s3-10.5.0.jar
│   └── ... (dependency JARs)
└── mongodb-connector/
    ├── mongo-kafka-connect-1.11.0.jar
    └── ... (dependency JARs)
Here are some popular sources for Kafka Connect connectors:

Confluent Hub

Browse hundreds of connectors from Confluent and the community

Aiven Open Source

Open source connectors maintained by Aiven

​
Next Steps

Configuration

Configure your Kafka clusters and databases

Nodes Reference

Learn about available pipeline nodes