or equivalent, with minimum 12-15+ Years of Overall IT experience. Design, develop, and optimize Spark applications using Scala.... Implement data quality checks, validation frameworks, and metadata management. Optimize Spark jobs for performance, memory...
in Databricks architecture including Delta Lake, Apache Spark, and MLflow, with strong experience implementing complex data...)? Have you implemented complex, production-grade data pipelines with Spark and Delta Lake? Have you architected and deployed data...
SOMERSET STAFFING ⚡ $132181 - 174478 per year ⚡ Thu, 30 Apr 2026 22:07:10 GMT
reliability Real-time systems Build streaming solutions using Kafka or Azure Event Hubs Use Spark Structured Streaming..., KSQL, or Spark Structured Streaming Software engineering and DevOps Strong Java and Spring Boot experience Kubernetes...
to design and build a containerized API layer that abstracts and governs interactions with engines such as Apache Spark through...-enabling consistent, secure, and scalable access to Spark and non-Spark based data pipelines. The ideal candidate...
Big Data Engineer
scalable data pipelines using Hadoop, Spark, Python, and Scala Build data ingestion, transformation, and storage solutions... Strong experience with Hadoop, Spark, Hive, Trino Programming: Python / Scala / Java Strong SQL skills (joins, window functions...
Akaasa Technologies ⚡ ⚡ Thu, 30 Apr 2026 22:07:21 GMT