using Apache Kafka or an equivalent platform. Experience integrating heterogeneous systems through backward-compatible APIs...

microservices. Develop robust back-end integrations leveraging Spring MVC, Spring Data, Spring Security, JMS, and Apache Kafka.... Data & Messaging: Demonstrated experience with Apache Kafka, JMS, Oracle databases, and Elasticsearch. DevOps...

, and skills Experience with Apache Spark, Kafka, or similar distributed data processing frameworks in a large-scale enterprise...

. Mentor engineers and communicate technical tradeoffs to stakeholders. Technology Environment Data lakehouse: Apache... Iceberg, Apache Polaris, and Trino on Azure Data Lake Storage. Data and metadata services: PostgreSQL, OpenMetadata...

sources. Develop ingestion, transformation, and enrichment pipelines using Apache Flink, Kafka, Change Data Capture, SQL..., and Python/Java/Scala. Implement lakehouse data layers across landing, raw, conformed, and consumption zones using Apache...

like Delta Live Tables and Databricks Workflows to orchestrate and manage complex data processes. Optimize and tune Apache Spark...

, debugging, testing, and documentation. Nice-to-Have Skills: Relational and/or NoSQL database modeling and design. Apache...

data and AI-generated content Familiarity with open-source software and open-content licenses, such as MIT, Apache...

. Proficiency in Java, Spring Framework, Spring Boot, and Hibernate. Strong experience with Apache Kafka and event-driven...

engineering tools and frameworks such as dbt, Apache Airflow, or similar technologies. Experience contributing to the delivery...

engineering team. Hands-on experience with Apache Iceberg table format for large analytic datasets. Familiarity with enterprise...

, Apache Spark, Scala, Advanced Python, and SQL, with extensive hands-on development experience. Proven experience...

and Lake Formation permissions Working knowledge of Apache Spark and Amazon EMR administration troubleshooting scaling...

jobs using Control-M. Develop Simple Object Access Protocol (SOAP) based Web Services using technologies such as JAX-WS, Apache...

, Apache Camel, Maven, and Active MQ, Splunk, Dynatrace, Testing experience as well (at least some automation testing...

. Information retrieval: HDFS, HBase, Apache Lucene, Apache Solr, MongoDB. Ingesting and parsing varied data formats: XML, JSON...

, and maintaining software on Linux systems. Working knowledge of web technologies, such as Apache, mysql, PHP, and Drupal. Working...

-on experience with Apache Iceberg table format for large analytic datasets. Familiarity with enterprise observability...

tools including Apache, Selenium, JMeter, TestStand, or LabVIEW. Knowledge of diagramming software including Gliffy...

Responsibilities: Design, develop, and maintain scalable data engineering solutions using Databricks, PySpark, Spark SQL, and Apache... with Databricks and modern data engineering platforms. Strong expertise in PySpark, Spark SQL, Apache Spark, and Databricks Lakehouse...