Nifi - Query twitter flowfiles in real time with query record processor

"Nifi - Using Jolt Transform Json to prepare your Big Data " https://www.youtube.com/watch?v=yEE7Tgc4bh8 --~-- NiFi a Apache project supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic. Some of the high-level capabilities and objectives of Apache NiFi include:

Web-based user interface
    Seamless experience between design, control, feedback, and monitoring
Highly configurable
    Loss tolerant vs guaranteed delivery
    Low latency vs high throughput
    Dynamic prioritization
    Flow can be modified at runtime
    Back pressure
Data Provenance
    Track dataflow from beginning to end
Designed for extension
    Build your own processors and more
    Enables rapid development and effective testing
Secure
    SSL, SSH, HTTPS, encrypted content, etc...
    Multi-tenant authorization and internal authorization/policy management

What is Apache NiFi?

Put simply NiFi was built to automate the flow of data between systems. While the term 'dataflow' is used in a variety of contexts, we use it here to mean the automated and managed flow of information between systems. This problem space has been around ever since enterprises had more than one system, where some of the systems created data and some of the systems consumed data.

Resources: Apache nifi - https://nifi.apache.org/ NiFi downlaod - https://nifi.apache.org/download.html NiFi Documentation - https://nifi.apache.org/docs.html Expression Language Guide - https://nifi.apache.org/docs.html Search Earthquake Catalog - https://earthquake.usgs.gov/earthquakes/search/ ... https://www.youtube.com/watch?v=YS9kjChHVsg