, masking, audit logging, and secure PII handling. ·Apache Superset, Python analytics, and existing Azure or authorized..., masking, audit logging, and secure PII handling. ·Apache Superset, Python analytics, and existing Azure or authorized...

DevOps. Databases: SQL Server, Oracle, PostgreSQL, Delta Lake Big Data: Apache Spark Version Control: GitHub, Git...

Queue Design, Map Reduce Architecture, Shuffle and Sort, Apache Spark Architecture, Spark DAG Execution Plan, Spark... Techniques, Partitioning Bucketing ORC Parquet Internals, Impala Architecture, Apache Kafka Architecture, Kafka Performance...

using tools like Splunk, Grafana & Prometheus Managing and operating distributed database clusters including Apache... distributed database clusters, including Apache Cassandra, RabbitMQ, and Redis Cluster. Ensuring system security and implementing...

Aurora PostgreSQL, Aurora MySQL, MS SQL Server, SingleStore, Apache Cassandra, and Amazon DynamoDB. AWS Cloud Management...

and functional programming skills. Experience with PySpark and Apache Spark for high-performance distributed data processing. Depth...

-quality data solutions. Responsibilities Design, develop, and maintain scalable data pipelines using Databricks and Apache.... Required Skills 8+ years of experience in Data Engineering. Strong hands-on experience with Databricks , Apache Spark , PySpark...

Create and maintain performance scalability security and reliability test scripts using Apache JMeter Provide integration...

technologies such as IBM MQ, JMS, and Apache Kafka. Experience developing responsive web applications using HTML, CSS...

. Required Skills Strong AWS Data Architecture experience AWS Glue Apache Iceberg PySpark Amazon Aurora Amazon S3 ETL/ELT...

-on experience with modern data platforms such as Databricks, Snowflake, Delta Lake, Apache Iceberg, Spark, Kafka, or similar..., or agentic applications Familiarity with modern lakehouse technologies such as Delta Lake, Apache Iceberg, or Unity Catalog...

. Strong knowledge of Apache Kafka streaming concepts. Experience working with PostgreSQL databases. Experience...

background in RESTful API development (FastAPI, Flask) and data pipeline architecture (Apache Airflow, Kafka, Spark). Deep...

, Storage Data & Analytics: Synapse, Data Factory, Databricks, Apache Spark, SQL MI Security & Identity: Managed Identities...

Databricks Lakehouse Platform. The ideal candidate will have strong experience with Databricks, Apache Spark, PySpark/Scala, SQL...+ years of IT experience 8+ years of Databricks & Apache Spark Databricks Lakehouse Platform PySpark or Scala SQL & Python...

adoption of emerging technologies. Environment: Python, R, TensorFlow, PyTorch, Keras, Scikit-learn, Apache Spark, Databricks...

We are seeking a highly skilled Data Engineer with strong expertise in Azure Synapse Analytics, Apache Spark, and modern cloud-based... knowledge of Apache Spark architecture and distributed computing concepts. Extensive experience with PySpark and Spark SQL...

. Build and support ETL/ELT processes across AWS platforms, including S3, Hive, Apache Iceberg, and Amazon Redshift. Develop..., S3 Hive, AWS Glue, Lambda (Python), Kafka, Airflow, Apache Iceberg Spark (Scala/Python) Redshift SQL/PLSQL, MySQL Data...

, leveraging Apache Spark, Delta Lake, and Azure Data Lake Storage (ADLS Gen2) to enable reliable lakehouse architectures... platforms in Azure, AWS, or Google Strong proficiency with Python, SQL, and Apache Spark for data processing Proven experience...

. Exceptional communication skills for effective collaboration. Preferred Skills Experience with JMS, Apache Camel, Log4j...