Data Engineer - Palantir - Contract- Mumbai
Role Overview\:
As a Data Engineer, you’ll play a crucial role in ensuring seamless data flow within Foundry. You’ll work closely with cross-functional teams to design, implement, and maintain robust data pipelines.Your expertise will contribute to the success of our organization’s data-driven initiatives. As a Data Engineer you will be involved in Business requirements, problem statements and developing end-to-end solutions using Palantir. Incumbent will play a paramount role in transforming the Organization on Palantir. This role is not limited to only Data Engineer as it also demands exciting responsibilities of Business analyst.
Responsibilities and Duties\:
Technical\:-
- 1. Data Integration\:
- Secure, scalable, and resilient integration of diverse data sources.
- Leverage 200+ data connectors using an extensible plugin-based paradigm.
- Configure flexible ingress topology (agent-based, REST, JDBC, etc.).
- API Integration\: Integrating Palantir with other systems and applications using APIs for seamless data flow.
- Handle multi-modal data (structured, unstructured, streaming, IoT, geospatial).
Treat data like code (versioning, branching, full change management).
2. Data Transformation\:
- Implement low-code/no-code transformations using tools like Preparation and Contour.
- Should have knowledge of Typescript, AIP Natural Language.
- Ensure full provenance through the Job Spec paradigm.
Machine Learning and AI\: Familiarity with integrating machine learning and AI capabilities within the Palantir environment for advanced analytics.
3. Pipeline Orchestration\:
- Design and manage data pipelines using Pipeline Builder and code repositories.
Generate applications using Workshop or Slate.
4. Ontology Management\:
- Create and manage ontology objects.
- Analyze data using tools like Code Workbook, Contour, and Quiver.
- Cybersecurity and Data Privacy\: Knowledge of cybersecurity principles and ensuring data privacy and security while working with sensitive information.
Debugging & Trouble shooting
Non Technical\:-
- Provide training and support to end-users to maximize the effective use of Palantir Foundry.
- Collaborate with stakeholders to identify opportunities for continuous improvement and innovation in data processes and solutions.
- Ensure compliance with data privacy, security, and regulatory requirements.
- Self-driven learning of technologies being adopted by the organization.
- Work as part of a team of developers, QA, support staff, and DevOps engineers in a highly collaborative fashion