Full-Stack Data Engineer II

About Archer

A new regulatory change lands somewhere in the world every six minutes, and agentic AI is outpacing most teams' ability to govern it. At Archer, we help the enterprises powering the global economy turn that pressure into an advantage.

Mandates like the EU AI Act and the SEC cybersecurity disclosure rules are driving the most significant GRC buying cycle we have seen in years. That demand is why we are growing this team.

This is hard work that matters. Our customers span energy, utilities, financial services, pharmaceuticals, and the public institutions communities depend on. People choose Archer because they get to partner with the most trusted brands in the world, on work that protects the customers and communities those brands serve.

If that sounds like your kind of work, let's chat.

The Role

We are looking for a forward-thinking Full-Stack Data Engineer II to join our team in Egypt. This is not a traditional ETL role; you will be at the forefront of the Data + AI era, leveraging DataBricks to build intelligent data products. You will be responsible for the end-to-end lifecycle of data, from ingestion and Lakehouse architecture to developing agentic AI workflows that allow our business systems to act autonomously based on data insights.

AI & Agentic Focus

Build and deploy LLM-based agents that utilize data tools to solve complex tasks, including implementing Retrieval-Augmented Generation (RAG) patterns and autonomous chains-of-thought for decision-making.

Stack: DataBricks & Agentic AI

What You'll Do

• Design and optimize Delta Lake tables within DataBricks using Unity Catalog for governance.
• Develop and deploy agentic workflows using LangChain, AutoGen, or DataBricks Mosaic AI.
• Build Python-based backend services (FastAPI) to expose AI-driven insights.
• Manage data pipelines using DataBricks Workflows and Delta Live Tables (DLT).
• Implement monitoring frameworks to ensure agent accuracy, safety, and performance.

You'll Thrive Here If You

• 2–4 years experience with PySpark and SQL
• Strong experience with DataBricks (Unity Catalog, DLT, Notebooks)
• Understanding of Lakehouse architecture
• Hands-on experience with LLMs and prompt engineering
• Experience building AI agents using APIs and tools
• Backend development in Python and Docker

Even Better If You Have

• MLflow for model tracking and deployment
• Vector databases (Pinecone, Weaviate, DataBricks Vector Search)
• Familiarity with Egyptian data localization requirements

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities and activities may change at any time with or without notice at management discretion based on business need.

Equal Opportunity

Archer is committed to the principle of equal employment opportunity for all employees and applicants for employment and to providing employees with a work environment free of discrimination and harassment. All employment decisions at Archer are based on business needs, job requirements and individual qualifications, without regard to race, color, religion, national origin, sex (including pregnancy), age, disability, sexual orientation, gender identity and/or expression, marital, civil union or domestic partnership status, protected veteran status, genetic information, or any other characteristic protected by federal, state or local laws. Archer will not tolerate discrimination or harassment based on any of these characteristics. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training. All Archer employees are expected to support this policy and contribute to an environment of equal opportunity.

If you need a reasonable accommodation during the application process, please contact talent-acquisition@archerirm.com. All employees must be legally authorized to work in the country they are applying for. Archer and its approved consultants will never ask you for a fee to process or consider your application for a career with Archer. Archer reserves the right to amend or withdraw any job posting at any time, including prior to the advertised closing date.

Please contact our Talent Acquisition team at Talent-Acquisition@archerirm.com for the range and related compensation details. Actual pay may vary based on location, experience, skills, and internal equity.