, including: BigQuery Cloud IAM Cloud Run Cloud Composer / Apache Airflow Cloud Scheduler Cloud Logging Cloud...

troubleshooting. Hands-on experience with Apache Kafka, including topic creation and configuration, producer and consumer development...

, Pyarrow, Pytest, Scikit-Learn, and Boto3. Experience in implementing a Data Lakehouse using Apache Iceberg or Delta Lake... of modern data platform technologies including Apache Airflow, Kubernetes, and S3 Object Storage. Experience with AWS...

workloads from AWS S3 to GCP, so hands-on experience in both AWS and GCP. Required Skills: Apache Airflow, AWS, Spark/PySpark...

APIs, and microservices architecture. Experience with Apache Kafka, event-driven architecture, and distributed systems...

engineering or machine learning workloads, including platforms such as Databricks or Apache Spark. Relevant Microsoft Azure...

databases. Experience designing and supporting DAG-based workflows (e.g., Apache Airflow or similar orchestration platforms...

) development such as NPM Node.js, Javascript, Angular, Apache Camel,Spring Integration Knowledge of relational databases including...

, Ajax, Web Socket, jQuery,DOM, XML , Apache Tomcat Application server over various platforms (UNIX, Linux, and Windows...

to orchestrate and manage complex data processes. You should Optimize and tune Apache Spark jobs for performance and cost efficiency...

, maintain, and troubleshoot data flows using Apache NiFi or comparable data-flow platforms. Monitor application and platform... ingestion, integration, transformation, and pipeline development. Experience with Apache NiFi and Prometheus, or comparable...

: Kafka Administration Deploy, configure, and manage Apache Kafka clusters and AWS MSK environments. Monitor broker health..., audit, and regulatory requirements. Required Skills Apache Kafka Administration KRAFT and MSK AWS Cloud Services Linux...

. Design, deploy, and support enterprise messaging and queueing architectures utilizing technologies such as Apache Kafka, IBM..., and scripting. Deep practical expertise with enterprise messaging and streaming technologies, including Apache Kafka, IBM MQ...

, and automated recovery. Lakehouse and modern data warehouse architecture: Implement solutions using Amazon S3, Apache Iceberg/open... using tools such as Apache Airflow, dbt, AWS Step Functions or equivalent approved platforms, with dependency management...

expertise in Apache Kafka for event-driven architecture, messaging, asynchronous processing, and system integration...

: Design and implement end-to-end data pipelines using Cloud Dataflow (Python/Apache Beam) for batch and streaming data...

experience. Advanced SQL programming skills. Extensive experience with Apache Spark and PySpark. Strong experience... Management industry experience. Knowledge of Apache Iceberg, Delta Lake, or Hudi. Experience with Airflow. Knowledge of Kafka...

Formation permissions Working knowledge of Apache Spark and Amazon EMR administration troubleshooting scaling and performance...

with streaming architectures, event-driven designs (e.g., Apache Kafka, Google Pub/Sub), and CDN architectures (e.g., CloudFront...

Experience with Apache Spark and Scala. Programming experience in Python. Familiarity with AWS data services and cloud-based...