In my current project, I have been using apache nifi for some experiments purpose. When I have configured the first time. The nifi was running perfect (I was able to see the canvas, toolbar on Goog...

I am using Apache camel for quite long time and found it to be a fantastic solution for all kind of system integration related business need. But couple of years back I came accross the Apache Nifi...

I'm brand new to NiFi and simply playing around with processors. I'm trying to incorporate Wait and Notify processors in my testing, but I have to setup a Distributed Map Cache (server and client...

How effective is to use Apache NIFI for the ETL process having source as HDFS & destination as Oracle DB. What are the limitations of Apache NIFI compared other ETL tools such as Pentaho,Datast...

In NiFi, there exist a data flow to consume from MQTT (ConsumeMQTT) and publish into HDFS path (PutHDFS). I got a requirement to introduce 60 min delay before pushing the consumed data into HDFS pa...

I am wondering if there is any way to concatenate the values of JSON attributes into one new attribute using JOLT transformation. For example, I have the following JSON: { "name": "...

We are trying to run a spark program using NiFi. This is the basic sample we tried to follow. We have configured Apache-Livy server in 127.0.0.1:8998. ExecutiveSparkInteractive processor is used ...

I have flow in NiFi: Download file -> UnpackContent -> PutHDFS After all flowfiles put in HDFS, I need run shell script. How I can know or check that all flow files have been processed?

How can I add a attribute to the current flow file when developing an Apache NiFi cusom processor. What I want to do is adding a new attribute (or at least update a current attribute) to the curren...

I am new to apache NIFI. I was kind of wondering where is the save button. I tried a sample from a tutorial that I saw on youtube. I would like to save all the processors that I created for future ...

I'm a beginner with Apache NiFi, but until now All the tutorial that I read speak about the integration of kafka with Nifi. how it kafka is the complementary of Nifi? why we don't use Nifi directly...

I am new to Nifi and python i want to execute my python script. So used ExecuteScript and tried to import certain modules. I have imported like this: import json, sftp, paramiko Though i have s...

In the image, there are 3 GenerateFlowFile processors connected to a LogAttribute processor. I would like to know the need for Funnel. Please clarify. I understood one such use of funnel where i...

I used GetTwitter processor in Apache Nifi to process live tweets using UserId. Initially it works fine but after few hours no tweets is retrieved from Twitter. May I know why I am getting this iss...

I am trying to insert CSV records to Postgres database using nifi. Sample csv file : timenow,location '2019-10-21 15:13:11','colombo' When nifi scenario runs, it gives following error Error ...

I'm new to nifi and i want to connect SQL server database to nifi and create a data flow with the processors. how can I do this, can any one Help me with this clearly. Thanks in Advance sam

I have a endpoint would return response as follow. { "result": [ {}, .... {}] } I am trying to use invokeHTTP and enable “Put Response Body In Attribute” to keep origin flowfile and response...

I am attempting to write a file on disk with the MergeContent processor, but I'm getting significantly varying file sizes - anywhere from one line to 806 lines. I've repeated the process many times...

I have the below sequence for calling rest API. Generate FLowfile processor-->jsonpath processor-->text replace processor(for post data creation)---> InvokeHTTP--->XPATH processor for attribute---...

We have started using NiFi for a lot of our data pipeline jobs. One of things which is challenging in Nifi is to do regression testing of the changes to the flows. What are the common ways to handl...

I want to send Nifi flowfile to Spark and do some transformations in Spark and again send the result back to Nifi so that I can to further operations in Nifi. I don't want to write the flowfile wri...

I have below input JSON: { "id": "2ef8a2ee-054f-4b43-956a-8aa4f51a41d5", "type": "VOICE", "tags": [ { "id": "some id 1", "description": "some description 1" }, { "id": "some id 2", "desc...

Let's say I have 100 flow files produced by one processor, each of them contains a different line. I want to get a new flow file which contains 100 line. How can I did that? I have tried MergeCont...

I am currently trying to recover my flows from the below exception. failed to process session due to Cannot update journal file /data/disk1/nifi/flowfile_repository/journals/90620570.journal be...

I have multiple nifi servers that I would like to be able to POST templates to via the REST interface from a script The "/controller/templates" endpoint appears to be the proper REST endpoint to s...