topkapi

= Topkapi - Kafka Topic API

== Links
* https://www.cloudkarafka.com/[Cloudkarafka -  Managed Apache Kafka clusters]
* https://github.com/CloudKarafka/go-kafka-example[Apache Kafka Producer/Consumer example in Go] and https://www.cloudkarafka.com/docs/go.html[confluent_kafka_go recommendation]
* https://www.cloudkarafka.com/docs/kafkacat.html[kafkacat is a generic non-JVM producer and consumer for Apache Kafka ...]
* Example for https://www.cloudkarafka.com/docs/spring.html[Spring Boot Integration]

== Kafkacat
.kafkacat list brokers
[source,shell script]
----
kafkacat -b $KAFKA_BROKERS -X security.protocol=SASL_SSL -X sasl.mechanism=SCRAM-SHA-256 -X sasl.username=$KAFKA_SASL_USERNAME -X sasl.password=$KAFKA_SASL_PASSWORD -L
----

Optional debug args: `-v -X debug=generic,broker,security`

.kafkacat produce
[source,shell script]
----
echo "Hello Kafkakatz from AmazonLinux" | kafkacat -b $KAFKA_BROKERS -X security.protocol=SASL_SSL -X sasl.mechanism=SCRAM-SHA-256 -X sasl.username=$KAFKA_SASL_USERNAME -X sasl.password=$KAFKA_SASL_PASSWORD -P -t ${KAFKA_SASL_USERNAME}-hase
----

.kafkacat consume
[source,shell script]
----
kafkacat -b $KAFKA_BROKERS -X security.protocol=SASL_SSL -X sasl.mechanism=SCRAM-SHA-256 -X sasl.username=$KAFKA_SASL_USERNAME -X sasl.password=$KAFKA_SASL_PASSWORD -C -t ${KAFKA_SASL_USERNAME}-hase
----

== Kowl
.run Kowl https://github.com/cloudhut/kowl
[source,shell script]
----
docker run --rm -p 8080:8080 -e KAFKA_BROKERS=$KAFKA_BROKERS -e KAFKA_TLS_ENABLED=true -e KAFKA_SASL_ENABLED=true -e KAFKA_SASL_MECHANISM=SCRAM-SHA-256 -e KAFKA_SASL_USERNAME=$KAFKA_SASL_USERNAME -e KAFKA_SASL_PASSWORD=$KAFKA_SASL_PASSWORD quay.io/cloudhut/kowl:master
----

== Tips

TIP: Salted Challenge Response Authentication Mechanism (SCRAM), or SASL/SCRAM, is a family of SASL mechanisms that addresses the security concerns with traditional mechanisms that perform username/password authentication like PLAIN

* https://medium.com/swlh/a-free-apache-kafka-cloud-service-and-how-to-quickly-get-started-with-it-8f14520fff35[A Free Apache Kafka Cloud Service — and how to quickly get started with it]

* https://github.com/Shopify/sarama/blob/master/tools/kafka-console-producer/kafka-console-producer.go[Sarama Code for Console Producer]

* https://github.com/Shopify/sarama/issues/994[Sample code for header creation in sync producer]

* https://documentation.freshpaint.io/frequently-asked-questions/what-should-i-name-my-events[What Should I Name My Events?]
+
[quote]
____
Use a standard naming pattern for creating events. We recommend using the Noun + Verb + Object structure, as used in the following example:  `Checkout: Submit Order` . Choose a standard tense (either past or present) and  regular capitalization pattern.
____
* https://cloudevents.io/[CloudEvents - A specification for describing event data in a common way]
+
----
{
    "specversion": "1.0",
    "id": "",
    "source": "example/uri",
    "type": "example.type",
    "datacontenttype": "application/json",
    "data": {
        "action": "auth:test",
        "message": "Let's have some Huggy Coffee coffee"
    }
}
----