Synthetic Data Engineer for AI Training Pipelines
Summary
Designs and builds synthetic data pipelines for AI training, focusing on prompt engineering, dataset distillation, and bias mitigation to improve model performance.
Hyphen Connect Limited is seeking a talented and innovative Synthetic Data Engineer to design and implement specialized synthetic data generation pipelines. This role focuses on high-quality data management crucial for training loops and will significantly impact our data processing and model training success.
Responsibilities include designing SDG pipelines, automating quality scoring, and managing data pipelines feeding into SFT and DPO training. Ideal candidates should possess deep knowledge of prompt engineering and be familiar with dataset distillation and bias mitigation.