Job Description

Senior Data Engineer (AI/ML, Cloud) - Full Time - Bay Area, CA

We are seeking a Senior Data Engineer to design and implement AI/ML-driven data solutions for enterprise cloud environments. You'll leverage modern data engineering, data warehousing, and data lake technologies on platforms like AWS, Azure, and GCP to optimize multi-cloud data workflows in a fast-paced, innovative setting.

Responsibilities

• Design and develop data pipelines, data lakes, and data warehouses using cloud platforms (AWS, Azure, GCP, Databricks) with a preference for Azure expertise.
• Experience with SQL, schema design, and dimensional data modeling to build scalable data solutions.
• Implement ETL/ELT processes using tools like Azure Data Factory (ADF), Informatica, Talend, and data warehousing technologies (Azure Synapse, Amazon Redshift, Snowflake, Google BigQuery).
• Utilize big data tools (Databricks, Spark) and programming skills in PySpark and Spark SQL to support AI/ML-driven data analytics.
• Collaborate with cross-functional teams to ensure data warehouse best practices, development standards, and methodologies are met.

Required Skills

• Minimum 5 years in modern data engineering, data warehousing, or data lake technologies on cloud platforms (AWS, Azure, GCP, Databricks)
• 10+ years with SQL, schema design, and dimensional data modeling.
• Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience).
• Hands-on experience with Azure (preferred), AWS, GCP, and Databricks for data solutions.
• Proficiency with ADF, Informatica, Talend, and technologies like Azure Synapse, Amazon Redshift, Snowflake, or Google Big Query.
• Strong experience with Databricks, Spark, PySpark, and Spark SQL for big data processing.
• Solid knowledge of data warehouse best practices, development standards, and Agile methodologies.
• Excellent communication, teamwork, and self-learning abilities in a fast-paced environment.

Preferred Skills

• Knowledge of Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Services, or Cosmos DB for advanced data streaming and storage.
• Experience with SAP ECC, S/4, or Hana for enterprise data integration.
• Intermediate proficiency in data visualization tools (e.g., Power BI) for actionable insights.
• Expertise in Azure DevOps, CI/CD deployments, and cloud migration methodologies.

• Proven track record of delivering scalable, AI/ML-enhanced data solutions in IT services environments.

Right Skale Inc, headquartered in Pleasanton, CA, is an emerging global product development and platform engineering company.

With a focus on digital transformation and cloud computing, we provide end-to-end technology solutions and services from strategy, architecture, and consulting to software development.

Job Tags

Similar Jobs