README
¶
What is StreamSets Data Collector Edge?
The StreamSets Data Collector Edge (SDC Edge) enables at-scale data ingestion and analytics for edge systems. An ultralight, small-footprint agent, it is an ideal solution for use cases like Internet of Things (IoT) or cybersecurity applications that collect data from resource-constrained sensors and personal devices.
To learn more, check out https://streamsets.com/products/streamsets-data-collector-edge
License
StreamSets Data Collector Edge is built on open source technologies, our code is licensed with the Apache License 2.0.
Getting Help
A good place to start is to check out http://streamsets.com/community. On that page you will find all the ways you can reach us and channels our team monitors. You can post questions on Google Groups sdc-user or on StackExchange using the tag #StreamSets. Post bugs at http://issues.streamsets.com or tweet at us with #StreamSets.
If you need help with production systems, you can check out the variety of support options offered on our support page.
Useful resources
- Nightly Builds
- Quickstart
- Building StreamSets Data Collector Edge
- StreamSets Data Collector Edge Documentation
Origins
- Directory Spooler
- File Tail
- gRPC Client
- HTTP Client
- HTTP Server
- MQTT
- System Metrics
- WebSocket Client
- Windows Event Log
Destinations
- Amazon Kinesis
- Amazon Kinesis Firehose
- Amazon S3
- Apache Kafka
- Azure Event Hub
- Azure IoT Hub
- CoAP
- HTTP Client
- InfluxDB
- MQTT
- WebSocket Client
Processors
- Delay
- Expression Evaluator
- Field Remover
- HTTP Client
- JavaScript Evaluator
- Stream Selector
- TensorFlow Evaluator
Sample Pipelines
- System Metrics to HTTP
- Windows Event To Http
- Tail File To Http
- Directory Spooler to Http
- Bosch BME280 Humidity, Barometric Pressure, Temperature Sensor data to HTTP
- Stream Ripple Ledger Information
- MQTT To HTTP
- Dev Raw Data To Expression Evaluator to Kafka
- Random Data to MQTT
- Random Data to CoAP
- Random Data To Http
- HTTP Server To Trash
- Random Data To Identity Processor To Trash
Contributing code
We welcome contributors, please check out our guidelines to get started.
Documentation
¶
Overview ¶
Copyright 2018 StreamSets Inc. Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.
Source Files
Directories
¶
| Path | Synopsis |
|---|---|
|
container
|
|
|
stages
|
|
|
origins/windows/eventlogging
Copied from https://github.com/streamsets/windataextractor/tree/master/dev/src/lib/win/eventlog
|
Copied from https://github.com/streamsets/windataextractor/tree/master/dev/src/lib/win/eventlog |