Apache NiFi Developer
Description
Job Description
Key Responsibilities
-
Design & Implementation: Create and implement data flow solutions using Apache NiFi, including defining sources, destinations, and transformation processes.
-
Ingestion & Transformation: Manage data ingestion from files, databases, and APIs, and transform data into required formats for downstream systems.
-
Routing & Enrichment: Configure NiFi to route data to appropriate destinations and enrich with additional details (e.g., timestamps, location).
-
Scalability & Performance: Ensure data flows are scalable and performant to handle varying volumes and velocity.
-
Cluster Management: Maintain and optimize NiFi clusters, including configuration and troubleshooting.
-
Microservices Integration: Develop and integrate microservices to support data conditioning, validation, and transformation processes.
-
Troubleshooting & Resolution: Identify and resolve issues related to data flows, NiFi configurations, and integration processes.
Technical Skills
-
Strong expertise in Apache NiFi architecture (processors, controllers, data flow management).
-
Experience in data integration, ETL processes, and data modeling.
-
Proficiency in programming languages such as Java, Python, or other scripting languages.
-
Hands-on experience with databases, SQL, and data manipulation.
-
Familiarity with cloud platforms (AWS, Azure, GCP) and their integration with NiFi.
-
Knowledge of big data technologies like Apache Kafka.
Skills
Sign in to read and join the discussion.