Senior Big Data Engineer at CBTS – Chennai, Tennessee

CBTS serves enterprise and midmarket clients in all industries across the United States and Canada. CBTS combines deep technical expertise with a full suite of flexible technology solutions--including Application Modernization, Managed Hybrid Cloud, Cybersecurity, Unified Communications, and Infrastructure solutions. From developing and deploying modern applications and the secure, scalable platforms on which they run, to managing, monitoring, and optimizing their operations, CBTS delivers comprehensive technology solutions for its clients' transformative business initiatives. For more information, please visit www.cbts.com.

OnX is a leading technology solution provider that serves businesses, healthcare organizations, and government agencies across Canada. OnX combines deep technical expertise with a full suite of flexible technology solutions—including Generative AI, Application Modernization, Managed Hybrid Cloud, Cybersecurity, Unified Communications, and Infrastructure solutions. From developing and deploying modern applications and the secure, scalable platforms on which they run, to managing, monitoring, and optimizing their operations, OnX delivers comprehensive technology solutions for its clients’ transformative business initiatives. For more information, please visit www.onx.com.

We are seeking a Senior Big Data Engineer to design, build, and optimize large‑scale data processing systems that power analytics, reporting, and data‑driven decision‑making. The ideal candidate has deep expertise in distributed data systems, cloud platforms, and modern data engineering practices, and can mentor junior engineers while collaborating closely with data scientists, analysts, and product teams.

• Design, develop, and maintain scalable, high‑performance big data pipelines for batch and real‑time processing
• Build and optimize data ingestion, transformation, and storage solutions handling structured and unstructured data
• Work with large datasets using distributed computing frameworks such as Apache Spark, Hadoop, Flink, or similar
• Develop robust ETL/ELT workflows with strong data quality, reliability, and monitoring
• Architect and manage data solutions on cloud platforms (Azure / AWS / GCP)
• Implement data modeling, partitioning, and performance tuning strategies
• Ensure data security, compliance, and governance best practices
• Collaborate with data scientists, analytics teams, and business stakeholders to enable advanced analytics and ML use cases
• Lead technical design discussions and mentor junior and mid‑level engineers
• Participate in code reviews and promote engineering best practices

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
• 6+ years of experience in data engineering or big data development
• Strong programming skills in Python, Scala, or Java
• Hands‑on experience with Spark (core, SQL, streaming) and distributed data processing
• Experience with data storage technologies (HDFS, Delta Lake, Iceberg, HBase, Cassandra, or similar)
• Solid understanding of SQL and NoSQL databases
• Experience building pipelines using Airflow, Azure Data Factory, or similar orchestration tools
• Strong knowledge of cloud data services (e.g., Azure Data Lake, Synapse, AWS S3/EMR, BigQuery)
• Familiarity with CI/CD, version control (Git), and DevOps practices
• Excellent problem‑solving and communication skills

• Experience with real‑time streaming platforms (Kafka, Event Hubs, Kinesis)
• Knowledge of data warehousing concepts and dimensional modeling
• Exposure to machine learning data pipelines
• Experience with containerization (Docker, Kubernetes)
• Understanding of data governance, lineage, and metadata tools
• Prior experience leading or owning end‑to‑end data platforms