Using LogicLoop and Materialize with dbt and Redpanda/Kafka

Introduction

Prerequisites

Starting the demo project

# Clone the repository:
git clone https://github.com/bobbyiliev/materialize-tutorials.git
# Access the directory:
cd materialize-tutorials/mz-user-reviews-dbt-demo
# Start by running the Redpanda container:
docker-compose up -d redpanda
# Build the images:
docker-compose build
# Then pull all of the other Docker images:
docker-compose pull
# Finally, start all of the services:
docker-compose up -d
# Install dbt:
pip3 install dbt-core==1.1.0
pip3 install dbt-materialize==1.1.0
user_reviews:
outputs:
dev:
type: materialize
threads: 1
host: localhost
port: 6875
user: materialize
pass: pass
dbname: materialize
schema: analytics
target: dev
dbt debug
dbt run
dbt test

Overview

Add Materialize as a source to LogicLoop

Add an action destination

Create a rule

SELECT COUNT(*) FROM analytics.vipusersbadreviews;
SELECT * FROM analytics.vipusersbadreviews LIMIT 10;

Add an action

Conclusion

Useful links

Community

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Bobby Iliev

I am a professional System Administrator with a demonstrated history of working in the internet industry. I am a Linux lover