Going to setup a Kafka Stack using a Confluent Docker compose file with some modifications to join my Nifi network.
SUPPORT THE CHANNEL
Patron: https://www.patreon.com/stevenkoon
PayPal: https://www.paypal.com/donate/?cmd=_donations&business=GXADADKH859KW¤cy_code=USD&Z3JncnB0=
FIND ME ON THE WEB
Twitter: https://twitter.com/koon_steven
GitHub: https://github.com/skoonData/apacheNifi
LBRY: https://lbry.tv/@StevenKoon:c
Docker: https://docs.docker.com/
Portainer: https://www.portainer.io/
...
https://www.youtube.com/watch?v=0s0TzKZPZ-Y
Time to setup a Apache Nifi cluster in my docker
SUPPORT THE CHANNEL
Patron: https://www.patreon.com/stevenkoon
PayPal: https://www.paypal.com/donate/?cmd=_donations&business=GXADADKH859KW¤cy_code=USD&Z3JncnB0=
FIND ME ON THE WEB
Twitter: https://twitter.com/koon_steven
GitHub: https://github.com/skoonData/apacheNifi
LBRY: https://lbry.tv/@StevenKoon:c
Docker: https://docs.docker.com/
Portainer: https://www.portainer.io/
...
https://www.youtube.com/watch?v=czGxFkxB7JA
Let's create a loop in Nifi using our processors so that we can make sure we get all the pages from the Best Buy API.
Support the channel by Subscribing!
PATREON – Would you like to support the channel in other way? Then check it out.
https://www.patreon.com/stevenkoon
TWITTER
https://twitter.com/koon_steven
My github
https://github.com/skoonData/apacheNifi
...
https://www.youtube.com/watch?v=zMZSbserN4Y
In this video I continue to setup my sandbox by creating additional containers for Elasticsearch and Apache Cassandra.
SUPPORT THE CHANNEL
Patron: https://www.patreon.com/stevenkoon
PayPal: https://www.paypal.com/donate/?cmd=_donations&business=GXADADKH859KW¤cy_code=USD&Z3JncnB0=
FIND ME ON THE WEB
Twitter: https://twitter.com/koon_steven
GitHub: https://github.com/skoonData/apacheNifi
LBRY: https://lbry.tv/@StevenKoon:c
Docker: https://docs.docker.com/
Portainer: https://www.portainer.io/
Apache Cassandra Docker Image: https://hub.docker.com/r/bitnami/cassandra/
...
https://www.youtube.com/watch?v=fBkbWH_R7Xs
Setting up a new sandbox for working with Apache Nifi data flows. Using Docker and Portainer.io
SUPPORT THE CHANNEL
Patron: https://www.patreon.com/stevenkoon
PayPal: https://www.paypal.com/donate/?cmd=_donations&business=GXADADKH859KW¤cy_code=USD&Z3JncnB0=
FIND ME ON THE WEB
Twitter: https://twitter.com/koon_steven
GitHub: https://github.com/skoonData/apacheNifi
LBRY: https://lbry.tv/@StevenKoon:c
Docker: https://docs.docker.com/
Portainer: https://www.portainer.io/
...
https://www.youtube.com/watch?v=4vO7MNTlnAQ
That's right, In this video will review the json split error and fix it. Then we can insert the data into the mySql table I create.
Support the channel by Subscribing!
PATREON – Would you like to support the channel in other way? Then check it out.
https://www.patreon.com/stevenkoon
TWITTER
https://twitter.com/koon_steven
My github
https://github.com/skoonData/apacheNifi
...
https://www.youtube.com/watch?v=HGIEkNbnWwc
Check out some examples of how I use Jolt Json in my Apache Nifi dataflows.
Support the channel by Subscribing!
PATREON – Would you like to support the channel in other way? Then check it out.
https://www.patreon.com/stevenkoon
TWITTER
https://twitter.com/koon_steven
Jolt Transform Demo Site
https://jolt-demo.appspot.com/#inception
Chapters:
0:00 Intro
0:40 Jolt Transform Demo Site
2:06 Json Example Data
7:40 Accessing Nested Json with Jolt
...
https://www.youtube.com/watch?v=85ECb9yEMwc
In this dataflow I use a Nifi websocket server and listenWebSocket to ingest data from python.
Support the channel by Subscribing!
PATREON – Would you like to support the channel in other way? Then check it out.
https://www.patreon.com/stevenkoon
TWITTER
https://twitter.com/koon_steven
My github
https://github.com/skoonData/apacheNifi
Chapters:
0:00 Intro
1:00 Fix Dataflow from Part 1
04:27 PutWebSocket Setup
07:30 ListenWebSocket Text Relationship Flow
12:56 MySql Record Confirmation
...
https://www.youtube.com/watch?v=Kef_qhef_cQ
Want to ETL an entire table. Check out one of many ways to do it with Apache Nifi in this video.
Support the channel by Subscribing!
PATREON – Would you like to support the channel in other way? Then check it out.
https://www.patreon.com/stevenkoon
TWITTER
https://twitter.com/koon_steven
What is Apache NiFi?
Put simply NiFi was built to automate the flow of data between systems. While the term 'dataflow' is used in a variety of contexts, we use it here to mean the automated and managed flow of information between systems. This problem space has been around ever since enterprises had more than one system, where some of the systems created data and some of the systems consumed data.
...
https://www.youtube.com/watch?v=BTNL2vF6PJc