Sr Data Engineer
Summary
Senior Data Engineer builds and maintains scalable data infrastructure for analytics on a SaaS platform, using AWS services, Spark, and data warehousing tools.
Company: BeyondTrust Corporation
Location: Johns Creek, GA
Position Title: Senior Data Engineer (Req # 3389121)
Job Description
Data Engineers at BeyondTrust are the backbone of the company’s core data infrastructure that powers all analytics products running on our SaaS platform. Leverage AWS expertise to manage a wide array of cloud compute services like AWS Lambda as well as managing database solutions like AWS DynamoDB and AWS Neptune in order to compute results quickly. Extensive Datadog and AWS Cloudwatch monitoring to ensure that all aspects of infrastructure stays running as expected and niche data governance methods are applied to ensure that data outcomes remain consistent. Perform data modelling and database structuring. Create highly scalable and efficient ETL pipelines to populate our advanced data lake. Position is a fixed location based in Johns Creek office; however, telecommuting from a home office may also be allowed.
Job Requirements
Requires a Master’s degree (or foreign equivalent) in Information Systems or a directly related field plus four (4) years of experience in a Data Engineering role. Experience must include:
Four (4) years of experience in the following (experience may be gained concurrently):
- Petabyte-sized Data Lakes
- Deep AWS experience building end-to-end data applications
- Spark experience (RDDs, DataFrames, low-level optimizations)
- Spark optimization tools (Ganglia, Log4J, Spark UI)
- Data warehousing
- Data modeling experience
- SQL development
- Python
Three (3) years of experience in the following (experience may be gained concurrently):
- Snowflake experience
- AWS Athena serverless data warehousing
One (1) year of experience in the following (experience may be gained concurrently):
- Hadoop ecosystem
- Hive and Presto
- YARN resource management
Skills
As published by greenhouse · 18 questions
Basics
First Name, Last Name, Email, Phone, Resume/CV, Cover Letter, Location
Short answers (2)
- If you were referred to BeyondTrust please enter their name below optional
- What are your base salary expectations?
Pick from a list (16)
- How did you hear about this position?
- Please confirm the basis of your right to work in the country of employment:
- This position is located in office. Are you within a commutable range to our Johns Creek, GA office?
- Do you have a Master’s degree (or foreign equivalent) in Information Systems or a directly related field?
- How many years experience do you have in an Enterprise Data Engineering Role?
- How many years of enterprise experience do you have with Petabyte-sized Data Lakes?
- How many years of enterprise experience do you have with building end to end data applications in AWS?
- How many years of hands on enterprise expeience do you have using all of the folowing tools within Spark? Ganglia, Log4J, Spark UI
- How many years of hands on experience do you have with Python?
- How may years of experience do you have with Data modeling within a large enterprise data warehouse?
- How many years of experience do you have using Snowflake?
- How many years of experience do you have with Athena serverless data warehousing?
- How many years of experience do you have working with the Hadoop ecosystem?
- Experience with YARN resource management?
- Experience with Hive and Presto?
- Please review and acknowledge BeyondTrust's