Data Engineer IV in Arlington, Virginia at Airlines Reporting Corporation

It's a great time to join us at Airlines Reporting Corporation (ARC)! ARC accelerates the growth of global air travel by delivering forward-looking travel data, flexible distribution services and other innovative industry solutions. We are a leading travel intelligence company with the world’s largest, most comprehensive global airline ticket dataset, including more than 15 billion passenger flights. By working here, you can contribute to solutions and expertise that strengthen economies and enrich lives. We think big, embrace challenges and explore new ideas to lead the way for the travel industry.

We are looking for a Data Engineer IV to join our team! In this role you will be a key driver of technical excellence, strategy, and innovation with a central role in the success of our data projects. You will collaborate and mentor a team of application and platform engineers at the forefront of developing data products that harness the world's most comprehensive and accurate airline ticketing data. You will leverage cutting-edge data solutions and cloud-based services to contribute to the end-to-end process of architecting, designing, developing, and optimizing complex products and systems. You will ensure systems consistently meet and exceed the highest standards of quality and performance, making a substantial impact on our organization's technology landscape and its ability to deliver value to our clients.

1. Technical Leadership: Provide expert-level guidance and technical leadership to the development and platform engineering teams. Act as a subject matter expert in your domain. Demonstrate many of the skills associated with people leadership – communication, influence, relationship building, providing direction and coaching. Review table/object structures, queries, and performance. Be on call for incident response and production issues. Perform forensic analysis when necessary for breach and data loss situations.
2. Design: Lead the design and software development process of complex data systems, ensuring scalable, efficient, and robust solutions. Ensure that data platforms and pipelines operate efficiently for ARC products, systems, and services. Understanding of multi-region database/data platform architectures (e.g., Aurora RDS, Redshift) and supporting performance, resiliency, and high availability in collaboration with Ops teams.
3. Technology Evaluation: Explore, investigate, and recommend innovative tools, technologies, and platforms to enhance data infrastructure.
4. Data Strategy: Define and implement data strategies, best practices, and standards across the organization.
5. Data Governance: Develop and enforce data governance and compliance policies.
6. Innovation: Stay up to date with emerging technologies, trends, and best practices in software engineering and data engineering. Recommend and implement new tools and technologies.
7. Optimization: Continuously optimize data platform, data processes, data storage, codebase, and database performance.

• Bachelor’s Degree or equivalent work experience preferred; equivalent experience considered.
• 7+ years of experience designing and developing solutions for large-scale data systems, services, and platforms.
• 7+ years of experience with full cycle development (Full SDLC experience: design, development, delivery, etc.)
• 5+ years with Agile, Scrum, DevOps, and Continuous Integration and Continuous Delivery
• 7+ years of experience implementing modern data solutions using Cloud-based solutions and technologies - AWS developer environment including, but not limited to, Lambda, API Gateway, Security Groups, IAM Roles, Aurora (mySQL/Postres), S3, Cloudwatch, Secrets Manager
• Expert in implementing modern data and infrastructure design patterns, stream processing, building data pipelines, etc.
• Deep knowledge and experience with modern database technologies, platforms, and solutions including, but not limited to S3, Aurora, Python, Postgres, RDS, RDS Proxy, RedShift, NoSql databases, DynamoDB, etc.
• Deep knowledge and experience with data warehouse platforms (such as Redshift, Snowflake, and Teradata).
• Deep knowledge and experience with SQL, database design/structures, ETL/ELT design patterns, and data mart structures
• Expertise level experience with ETL Tools such as Glue, Kenesis, Athena, Ab Initio (preferred), Informatica or Talend.
• Experience with data lake and data lakehouse concepts and design patterns
• Experience in data profiling and data analysis to investigate and validate data accuracy.
• Experience with BI Technologies (such as AWS Quick, PowerBI, Tableau, Jasper, Cognos, Qlik, Looker, Metabase, and others)
• Deep knowledge and experience with monitoring tools such as Datadog, CloudHealth, and the Atlassian Suite
• Experience in data management and data governance
• Excellent leadership skills and experience leading projects with other engineers.
• Proven ability to lead a group through an architectural development process and collaborate with stakeholders at all levels
• Ability to discover and define functional and non-functional requirements and to transform them into technical requirements and solution definition.
• Proven ability to influence technology strategy and best practices across peer and leadership groups to support an agile development culture.
• Outstanding communication skills (verbal and written) and ability to communicate with internal and external customers and all levels of management, including communicating technical information to nontechnical audiences. Ability to design and document best practices and operations standard operating procedures.
• A strong intellectual curiosity to continually challenge what exists and to explore what should be changed to best meet evolving business and market.
• A strong passion to support peers and help meet timelines on larger projects.