Kafka

Important

To save data to Kafka install garf-io with Kafka support

pip install garf-io[kafka]

kafka writer allows you to publish GarfReport to a Kafka topic.

clipython

garf query.sql --source API_SOURCE \
  --output kafka \
  --kafka.bootstrap_servers=localhost:9092

from garf.core import report
from garf.io.writers import kafka_writer

# Create example report
sample_report = report.GarfReport(results=[[1]], column_names=['one'])

writer = kafka_writer.KafkaWriter(bootstrap_servers='localhost:9092')
writer.write(sample_report, 'topic_name')

Parameters

Bootstrap Servers

By default it connects to localhost:9092. You can overwrite it with bootstrap_servers parameter.

clipython

garf query.sql --source API_SOURCE \
  --output kafka \
  --kafka.bootstrap_servers=broker1:9092,broker2:9092

from garf.core import report
from garf.io.writers import kafka_writer

# Create example report
sample_report = report.GarfReport(results=[[1]], column_names=['one'])

writer = kafka_writer.KafkaWriter(bootstrap_servers="broker1:9092,broker2:9092")
writer.write(sample_report, 'topic_name')