Sr Data Engineer
Summary
Leads data pipeline architecture and optimization for a mortgage lender, designing ELT workflows in Snowflake/Informatica to integrate internal/external data sources (e.g., Zillow, CoreLogic) for analytics, reporting, and business insights while ensuring security, scalability, and cost efficiency.
Guild Mortgage Company, closing loans and opening doors since 1960. As a mortgage banking firm, we are dedicated to serving the homeowner/buyer. Our goal is to provide affordable home financing for our customers, utilizing the best terms available while providing a level of professionalism and service unsurpassed in the lending industry.
Position Summary
The Senior Data Engineer is a key technical position and plays an important role in the organization by leading and performing number of activities related to the company’s Information Technology functions. The role is primarily responsible, under limited supervision, for executing the data strategy and analysis efforts within the company’s enterprise data platform by expanding and optimizing data and data pipeline architecture, as well as optimizing data flow and collection from cross functional areas. Responsibilities include evaluating, designing and developing optimal solutions that support software developers, database architects, data analysts and data scientists on various data initiatives that accommodate long-term growth, are easy to maintain and audit while also ensuring optimal data delivery architecture.
Compensation
This role is an exempt position with a Targeted Salary Range of $109,000 to $156,000 annually.
Compensation at Guild is influenced by a wide array of factors including but not limited to local and federal minimum wage requirements, education, level of experience, and applicant’s geographical location.
Essential Functions
- Partner with key stakeholders, including the business unit leaders, Product, Data & Technology teams, to assist with their data-related technical issues and support their data infrastructure needs by collecting data from primary sources and optimizing the data architecture, improving quality of sourced data, and ensuring consistent delivery of data to key stakeholders in a timely manner.
- Extract, Load & Transform (ELT) data from various primary data sources (internal & 3rd party) into the data lake to create optimal data pipeline architecture utilizing Snowflake and Informatica tool suites.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and leading ELT tools. This will include set up and configure Informatica Intelligent Cloud Services Environment and Tools.
- Design and Implement Processes to govern usage of the tools and platform at enterprise level for performance, security and audit compliance.
- Design & Build analytics solutions that utilize the data pipeline to provide actionable insights into the business on Revenue, Operational Efficiency and Expense metrics.
- Keep our Personally Identifiable Information (PII) data separated and secured through table splitting, data masking, access control restrictions and redundancy (high availability across multiple zones).
- Create data tools for data scientist and analytics team members that assist them in building and optimizing data analysis and reporting.
- Improve the quality of data used for analysis by assessing the accuracy of new data sources and the effectiveness of new data gathering techniques.
- Develop processes and tools to monitor and analyze data warehouse performance and data accuracy.
- Contribute to the team of data professionals by using expertise to answer questions and share repetitive design patterns with less experienced teammates, enhancing skillsets and competencies of team members, and sharing technical knowledge throughout the team.
- Lead in stakeholder reviews and design sessions.
- Provide data, reports, and information to management as needed.
- Identify, track, and monitor trends and avoidable technology-related errors; work across functions to develop complex solutions, improvements, and stop-gaps.
- Focus on the continual improvement of policies, procedures, and processes falling under the scope of authority.
- Use expertise to resolve high level issues that cannot be solved by teammates.
- Stay abreast of latest technology trends and participate in high-level decisions impacting the direction of the Information Technology function.
- Consistently monitor and model platform usage, database sizes, compute resources and third-party costs to ensure that the data teams' spend is as cost-efficient as possible.
- Champion data transformation to new ways of working and generating insights.
- Drive strong communications, partnerships, and stakeholder management with senior leaders, functional managers and staff.
- Perform other duties as assigned.
Qualifications
- Bachelor's Degree, BS in Statistics, Computer Science, Data Science, or related quantitative field, required.
- Minimum five to seven years' experience in Data Engineer related role(s) and at least Minimum of three years spent in a senior technical level role(s) required.
- Highly proficient in building and optimizing Big Data pipelines, architecture, and data sets.
- Highly proficient with data loading, processing, and data warehouse design techniques: star or snowflake schema designs, etc.
- Well versed in Informatica Intelligent Cloud Services, Administration, Environment configuration and set up of various tool suite (Mass Ingestion, CDC, Data Catalog, Data Quality, Data Integration, API Management).
- Proven expertise in developing in Informatica Intelligent Cloud Services and various tools.
- Proven experience with data lake and warehouse best practices and leading products in the marketplace.
- Expert at creating data integrations using Extract, Transform and Load (ETL) tools and modern data pipes.
- Strong knowledge of Kafka, Sparks, ESB and/or other messaging queues, real-time data integration & stream processing technologies.
- Proven experience with querying and analyzing data from SQL relational databases such as AuroraDB, IBM DB2, MemSQL, MS SQL Server, MySQL, Postgres, Redshift or Snowflake, and NoSQL Databases such as Cassandra, DynamoDB, Redis, or MongoDB.
- Experience with data science languages such as R, and Python as well as general purpose languages such as Java, Scala, C# or JavaScript.
- Experience collecting structured, semi-structured and unstructured data in various popular formats and sourced from internal core systems as well as 3rd partner providers such as Google Analytics, Facebook Insights, Zillow, CoreLogic, MLS Data, Public Records, and Property Data.
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Strong analytical skills to build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Strong data governance skills to ensure highest quality of data is made available for data analysis and accuracy in reporting.
- Problem solver with an ability to guide the team towards a solution.
- Ability to prioritize multiple tasks in a deadline-driven environment, strong sense of urgency and responsiveness.
- Strong detail orientation and highly organized with proven ability to lead effectively and drive results in a matrixed management environment.
- Ability to think critically, including the ability to evaluate facts and data to draw conclusions, determine the downstream impact of decisions and associated risks.
- Excellent verbal and written communication skills plus demonstrate strong leadership capabilities.
- Strong interpersonal and team building skills.
- Self-starter with the demonstrated ability to learn/adapt to new technologies and techniques.
- Highly organized and detail-oriented; ability to work in a fast-paced, metrics-driven environment required.
- Proficiency in Microsoft Office Suite, Word, Excel, Wiki, collaborative cloud-based programs, and third-party software applications required.
- Commitment to company values.
- Customer Service - Proactive attention to each person.
- Integrity - Do and say what's right.
- Respect - Treat others with dignity.
- Collaboration - Listen and work together.
- Learning - Seek knowledge and strive for improvement.
- Excellence – Deliver the unexpected.
Supervision
-
Job Scope: Responsible for understanding the department/functional area objectives and goals and how own job contributes to achievement of these goals; may recommend changes and enhancements based on analysis and evaluation of circumstances
-
Complexity: General precedents may exist for most problems; conducts independent research/analysis to identify the appropriate approach
-
Impact: Decisions and actions primarily impact own work with limited impact on peers in their area, contributes as team member rather than leader
-
Interaction/Supervision: Acts as a mentor/guide to less experienced professional contributor staff in a similar role; works independently and only under general direction; guided by professional standards, desired outcomes, and project plan specifications
Requirements
|
Physical: Work is primarily sedentary; mobility in an office setting. |
|
Manual Dexterity: Frequent use of computer keyboard and mouse. |
|
Audio/Visual: Ability to accurately interpret sounds and associated meanings at a volume consistent with interpersonal conversation. Regularly required to accurately perceive, distinguish and interpret information received visually and through audio, e.g., words, numbers and other data broadcasted aloud/viewed on a screen, as well as print and other media. |
|
Environmental: Office environment – moderate noise, no substantial exposure to adverse environmental conditions. |
|
Mental: Learn new tasks, remember processes, maintain focus, complete tasks independently, and make timely decisions in the context of a workflow. This role requires effective adaptation to workplace stressors, including customer service complaints, security responsibilities, and competing priorities. Must be able to adhere to process protocol. Must be able to apply established protocols in a timely manner. |
|
Schedules: Work is primarily performed during the business week, Monday - Friday |
|
Travel: 5% or less |
Guild offers a pleasant work environment, competitive compensation and excellent benefits package, including medical, dental, vision, life insurance, AD&D, LTD and 401(k) with employer match.
Guild Mortgage Company is an Equal Opportunity Employer.
REQ#: SRDAT018414