Software Engineer (Big Data) in San Francisco, California at Quantcast
Explore Related Opportunities
Job Description
Contribute to the development and optimization of large-scale data workflows using technologies such as Apache Spark or similar frameworks
Develop and operate our large scale data processing systems, making them more elastic and fault tolerant, solving distributed data and compute challenges
Assist in deploying and maintaining production systems, including CI/CD workflows
Provide technical input into roadmaps for the team
Write clean, maintainable, and well-tested code
Recent graduate (0-1 years) with a Bachelor's Degree in computer science or equivalent experience
- You must be work-authorized in the United States without the need for current or future employer sponsorship. We are not currently able to engage candidates on OPT.
Familiarity with data processing frameworks such as Apache Spark, Hadoop, or similar.
Familiarity with containerization tools (e.g., Docker and Kubernetes)
Experience with workflow orchestration tools (e.g., Airflow) is a plus
Proficient in Java and/or Python programming languages
Linux system administration/automation is a plus
Strong problem-solving and debugging skills
Organized and detail-oriented
Hands-on experience with large-scale distributed systems in production
Exposure to real-world data science and modeling workflows
Best practices in building scalable and reliable data infrastructure
Collaboration across engineering and modeling teams