Data Flow Engineer

We are looking for an external consultant, Data Flow Engineer, to join our team and support data integration, big data streaming, and flow management initiatives. The role focuses on designing, implementing, and maintaining complex data flows using modern data engineering tools and platforms, with emphasis on Apache NiFi, data streaming, and real-time data processing within enterprise environments.

Key Responsibilities

• Design, implement, test, and maintain complex data flows using Apache NiFi (Cloudera DataFlow)
• Build and optimise CDC-based data pipelines (real-time / near real-time)
• Integrate data flows with external systems using REST APIs, JDBC, Kafka, and other protocols
• Manage data ingestion, transformation, enrichment, routing, and delivery processes
• Configure and maintain data schemas, metadata, and lineage
• Implement and manage security and governance policies for data flows
• Monitor, troubleshoot, and optimise performance and reliability of data pipelines
• Collaborate with data engineers, architects, and business stakeholders
• Create and maintain documentation, SOPs, and runbooks
• Participate in platform upgrades, migrations, and continuous improvement activities