Lead Data Engineer
Posted Updated
Description
- Design and develop scalable enterprise data solutions using Databricks, supporting large-scale data processing, transformation, and analytics.
- Build and optimize structured and unstructured data processing pipelines within the Databricks Lakehouse environment.
- Design and implement Retrieval-Augmented Generation (RAG) solutions using Databricks, LLMs, embeddings, and vector search.
- Develop and integrate Knowledge Graph solutions to connect enterprise and Life Sciences data and improve contextual information retrieval.
- Integrate Claude / Anthropic GenAI models with Databricks and enterprise data platforms for AI-driven Life Sciences use cases.
- Develop solutions for semantic search, document intelligence, knowledge retrieval, summarization, and GenAI-based information discovery.
- Work with structured and unstructured Life Sciences/Pharma data, including scientific, clinical, research, and enterprise datasets.
- Design integration patterns between Databricks, Claude/LLM platforms, APIs, enterprise applications, and other data sources.
- Implement appropriate data governance, security, access controls, and sensitive-data handling for Life Sciences data.
- Collaborate with business, data, architecture, and AI teams to translate Life Sciences requirements into scalable technical solutions.
- Troubleshoot performance, scalability, data quality, and integration issues across Databricks and GenAI workloads.
Provide technical leadership, solution design reviews, implementation guidance, and engineering best practices
Yovan
Senior Technical Recruiter
Momento USA
Email:
LinkedIn :
Note: Momento USA is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
Skills
Sign in to read and join the discussion.