Data Engineer
Posted Updated
# AI Data Engineer
## Company Overview
*Not provided.*
## Job Summary
The AI Data Engineer will be responsible for developing and maintaining data pipelines, ensuring optimal data flow, and collaborating with data scientists to support data-driven decision-making processes within the organization. This role contributes to the overall success of the company by enhancing data accessibility and usability for analytical and operational functions.
## Responsibilities
- Design, construct, and maintain scalable data processing systems and pipelines.
- Collaborate with data scientists and analysts to understand data requirements and tailor data models accordingly.
- Optimize data delivery and transformation processes to ensure data accuracy and efficiency.
- Implement data quality checks to maintain the integrity and reliability of datasets.
- Analyze and troubleshoot data issues to enhance data solutions across the organization.
## Qualifications
- **Technical Skills:**
- Proficient in **Python** for data manipulation and pipeline creation.
- Familiarity with data storage technologies (e.g., SQL, NoSQL).
- Experience with data processing frameworks (e.g., Apache Spark, Hadoop).
- Knowledge of data visualization tools and techniques.
- **Soft Skills:**
- Strong analytical and problem-solving skills.
- Excellent communication and teamwork abilities.
- **Education:**
- Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field is preferred.
## Preferred Skills
- Experience with cloud platforms (e.g., AWS, Azure, Google Cloud).
- Familiarity with machine learning algorithms and data modeling techniques.
- Understanding of containerization technologies (e.g., Docker, Kubernetes).
## Experience
- Prior experience in data engineering or a similar role is advantageous, though specific years of experience are not defined.
## Environment
- Work setting is expected to be in Bangalore, with possibilities for flexible arrangements, although detailed location specifics are not provided.
## Salary
*Not provided.*
## Growth Opportunities
*Not provided.*
## Benefits
*Not provided.*
Skills
- Accessibility
- AI
- Airflow
- API
- AWS
- Aws Glue
- Azure
- Bash
- BigQuery
- Cisco
- CLI
- Cloud
- CloudFormation
- Containerization
- Data Engineering
- Data Modeling
- Data Pipelines
- Data Quality
- Data Science
- Data Visualization
- Data Warehousing
- Db2
- dbt
- Deep Learning
- Docker
- Embedded Linux
- Express.js
- Firewall
- GCP
- Gradle
- Hadoop
- IAM
- Java
- Jdbc
- JVM
- JWT
- Kafka
- Kubernetes
- Lambda
- Linux
- Machine Learning
- NoSQL
- Oracle
- PL/SQL
- PySpark
- Python
- Redshift
- RHEL
- SageMaker
- Scala
- Snowflake
- Spark
- SQL
- SQL Server
- SSIS
- SSRS
- Teradata