QA Tester / QA Developer
QA Automation Engineer | Fintech
About Us
We are building the future of finance, an AI-native fintech platform that leverages large language models (LLMs) and autonomous agents to re-imagine financial services. Financial systems require extreme precision, low latency, and uncompromised compliance. We are seeking a QA Automation Engineer who can build robust testing infrastructures capable of validating both deterministic core financial engines and non-deterministic AI agentic behaviors.
The Role
In this position, you won't just write basic UI scripts or API assertion checks. You will write test cases that evaluates real-time financial transactions, complex API contracts, and the safety, accuracy, and performance of our AI models and workflows.
Core Responsibilities
1. AI & LLM System Evaluation
Design, implement, and maintain LLM evaluation harnesses to measure output accuracy, factual grounding, hallucination rates, and safety guardrails across our AI features.
Test agentic workflows for proper tool calling, multi-step financial reasoning, and fallback behaviors.
Execute regression testing strategies for model upgrades, prompt changes, and system prompt iterations.
2. Fintech Core & API Test Automation
Build and scale automated test suites for REST/GraphQL APIs, microservices, and distributed ledgers.
Create deterministic data assertion checks for balance calculations, double-entry ledgers, interest routines, and transaction pipelines.
Ensure strict adherence to security protocols (OAuth2, mTLS, encryption, PII masking) and regulatory standards (PCI-DSS, SOC 2, KYC/AML).
3. E2E & Infrastructure Integration
Build scalable E2E automation frameworks using Playwright, Cypress, or Python (PyTest) integrated into modern CI/CD pipelines.
Implement synthetic data generation strategies to safely mimic realistic financial customer interactions without using production PII.
Conduct load, stress, and latency testing on critical financial execution paths.
Key Requirements
Experience: 4+ years in Test Automation / SDET roles, with at least 1–2 years working in Fintech or high-compliance environments.
AI/LLM Testing: Hands-on experience evaluating GenAI models or agentic workflows (using frameworks like DeepEval, Ragas, Promptfoo, or custom Python eval scripts).
Programming: Strong proficiency in Python or TypeScript/JavaScript.
API & System Testing: Expertise in API automation (Postman, Requests, Playwright API), schema/contract validation, and asynchronous event testing (Kafka, RabbitMQ, WebSockets).
CI/CD & Cloud: Deep understanding of Docker, GitHub Actions / GitLab CI, and AWS/GCP cloud environments.
Fintech Mindset: Obsession with edge cases, edge-value numerical precision, and race conditions in financial logic.