DeepEval LLM Evaluation MLflow Weights & Biases AWS SageMaker Azure ML Bedrock Databricks Snowflake Spark PySpark PostgreSQL...

adoption of emerging technologies. Environment: Python, R, TensorFlow, PyTorch, Keras, Scikit-learn, Apache Spark, Databricks...

Job Description Must Have Technical/Functional Skills Primary Skill: Spark, Java, Hive, SQL Secondary: Unix, Kafka, Python Experience: 10+ years... Roles & Responsibilities We are seeking a highly experienced Hadoop Spark Developer with 10+ years of expertise in Big...

We are seeking a highly skilled Data Engineer with strong expertise in Azure Synapse Analytics, Apache Spark, and modern cloud-based... PySpark and Spark SQL. Design and implement Data Lake solutions following Medallion Architecture (Bronze, Silver, Gold layers...

: Design, develop, and maintain scalable data pipelines using Spark (Scala/Python), AWS Glue, AWS Lambda, and Shell scripting..., S3 Hive, AWS Glue, Lambda (Python), Kafka, Airflow, Apache Iceberg Spark (Scala/Python) Redshift SQL/PLSQL, MySQL Data...

, tracing issues through orchestration metadata, Spark logs, and source systems to root cause. Framework improvement: Extend... proficiency with Azure Synapse Analytics: Spark notebooks, pipeline development, triggers, and serverless SQL pools...

, leveraging Apache Spark, Delta Lake, and Azure Data Lake Storage (ADLS Gen2) to enable reliable lakehouse architectures... schema evolution and time travel Develop high-quality PySpark / Spark SQL transformations, optimize joins, partitioning...

, PA 19355 Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture). Infrastructure... reliability. Qualifications: Bachelor's degree in Computer Science or related field. Strong hands-on experience with Apache Spark...

. Databricks: Hands-on experience with Databricks Lakehouse (Delta Lake, Unity Catalog, MLflow, Databricks Workflows), Spark-based...

-on experience with modern data platforms and large-scale data systems, including: Distributed processing: Apache Spark, Apache...

data stack technologies such as dbt, Airflow, Kafka, Spark, Fivetran, or Matillion. The base compensation range...

, cloud platforms (AWS, Azure, or Google Cloud Platform), and big data technologies (Spark, Kafka) Preferred Qualifications... AWS/Azure/Google Cloud Platform, Docker, Kubernetes, Terraform Data Spark, Kafka, Airflow, PostgreSQL, MongoDB, Redis...

, tracing issues through orchestration metadata, Spark logs, and source systems to root cause. Framework improvement: Extend..., including substantial hands-on work in Azure. Production proficiency with Azure Synapse Analytics: Spark notebooks, pipeline...

and infrastructure architecture disciplines Solid experience in Big Data technologies; (Spark, Impala, Hive, Redshift, Kafka...

with Apache Spark and PySpark for distributed data processing. Advanced SQL skills including complex query optimization...

, Unity Catalog, MLflow, Databricks Workflows), Spark-based data processing. Full-Stack Development: Working knowledge...

to build highly scalable and resilient systems. Work hands-on across the technology stack - including Java, Python, Spark... programming. Expertise in PySpark, and Apache Spark, with proven experience building high-performance distributed data processing...

Dataflow Dataproc Cloud Composer Data Engineering Python PySpark SQL Apache Spark Data Warehousing Data Lake...

ingestion pipelines (from on-prem to AWS and within AWS) using AWS services such as Glue, Redshift, S3, Lambda, EMR/Spark..., Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, Secrets Manager. Experience in serverless...

that spark enthusiasm and enrich people’s lives. Our areas of activity are every bit as diverse as our outstanding Bosch teams...