SantaClaraRecruiter Since 2001
the smart solution for Santa Clara jobs

Sr. Spark Developer with Python & Azure cloud

Company: Infogium Technologies, LLC
Location: Santa Clara
Posted on: March 27, 2020

Job Description:

Sr. Spark Developer with Python Azure cloud(ADF, Databricks, HDInsight) experience Santa Clara, CA Long Term Primary Skills Spark Developer with Python Azure cloud(ADF, Databricks, HDInsight) experience JD Data Specialist with exp in Spark, Python, Azure Cloud, Sql, Databricks, Data Factory Strong hands on knowledge on Spark (with Python as language) End to end implementation experience in data analytics solutions (data ingestion, processing, provisioning End to end implementation experience in data analytics solutions (data ingestion, processing, provisioning and visualization) for largescale and complex environments Strong experience in Azure ecosystem such as HDInsight, Azure Data Factory, Azure Data Lake and SQL DW Strong SQL knowledge Hands on experience developing enterprise solutions using designing and building frameworks, enterprise patterns, database design and development o End to end Cloud solution on Azure (Azure SQL DW, Azure Data factory, HDInsight, Cosmos DB, PostgreSQL, SQL on Azure) Batch solution and distributed computing using ETLELT (SSISInformaticaTalend Spark SQL Spark Data frameAWS Glue ADF) Distributed compute solution (Spark) Distributed storage and NoSQL storage Languages (Python, Scala) DWBI (MSBI, Oracle, Sql Server), Data modelling, performance tuning, memory optimization DB partitioning o Frameworks, reusable components, accelerators, CICD automation ----------------------------------------------------------------------------------------------------------- Sr. Spark Developer Location ndash Los Angeles, CA Job Description Experience minimum 5-6 years Implantation of Spark Core, Sparks and Spark Streaming Experience on Apache Kafka Integration with Apache Spark Implementing security for Spark Applications Solid understanding of big data environments Working with Spark in combination Hadoop Ecosystem Proven experience processing and aggregating over billions of rows Good working knowledge on Hive Experience publishing RESTful API s to enable real time data consumption Solid hands on experience with Spark Core, Spark Streaming, Spark SQL for real time data processing (at least one year proven experience) Developing Hive UDFs in Python or Java and integrating with Spark Integrating Spark with RDBMS (at least two mandatory) Working with Apache Kafka Should be able to fine tune performance of Spark applications Build and maintain performant, fault tolerant, scalable distributed software systems Demonstrated success working with cross functional teams Well versed in the development challenges inherent with highly scalable, highly available, and highly resilient systems

Keywords: Infogium Technologies, LLC, Santa Clara , Sr. Spark Developer with Python & Azure cloud, IT / Software / Systems , Santa Clara, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other IT / Software / Systems Jobs


Senior Software Engineer - San Ramon, CA
Description: Job Description Join Hired and find your dream job as a Senior Software Engineer at one of 10,000 companies looking for candidates just like you. Companies on Hired apply to you, not the other way around. (more...)
Company: Hired
Location: San Ramon
Posted on: 04/8/2020

Front-End Developer
Description: We are looking for a Front-end Engineer to join our R D Department in Tel-Aviv.As a Front-end Engineer, you will be responsible for the software behind the fastest NoSQL clusters on earth, supporting (more...)
Company: Viola
Location: Mountain View
Posted on: 04/8/2020

Technical Regulatory Program Director
Description: At Roche, we are passionate about transforming patients' lives and we are brave in both decision and action.-- Behind every presentation of each product sold by Roche is the involvement of Pharma Global (more...)
Company: Roche
Location: Pleasanton
Posted on: 04/8/2020


Backend Systems Developer
Description: Title: Backend Systems DeveloperDuration: 6 MonthsLocation: Mountain view, CAEducation: MS in Computer Science, or related field.Experience: 3 years of coding experience. Description: - The team is (more...)
Company: Tata Technologies
Location: Mountain View
Posted on: 04/8/2020

Senior Software Engineer - Palo Alto, CA
Description: Job Description Join Hired and find your dream job as a Senior Software Engineer at one of 10,000 companies looking for candidates just like you. Companies on Hired apply to you, not the other way around. (more...)
Company: Hired
Location: Palo Alto
Posted on: 04/8/2020

Software Engineer - Cluster Group
Description: We are looking for a Software Engineer to join the Redis Labs Cluster Group.As a cluster group member, you will be responsible for the software behind the fastest NoSQL clusters on earth, supporting over (more...)
Company: Viola
Location: Mountain View
Posted on: 04/8/2020

Product Manager, Mobile Application Platform
Description: We're looking for a Product Manager to join Snap Inc As a member of our Application Platform team, you'll develop the roadmap for our application wide frameworks and technologies that enable us to build (more...)
Company: Snap
Location: Mountain View
Posted on: 04/8/2020

Senior Software Engineer - Petaluma, CA
Description: Job Description Join Hired and find your dream job as a Senior Software Engineer at one of 10,000 companies looking for candidates just like you. Companies on Hired apply to you, not the other way around. (more...)
Company: Hired
Location: Petaluma
Posted on: 04/8/2020

Automation Developer
Description: We are looking for an Automation Developer to join our R D department in Tel-Aviv.--As an Automation Developer, you will be a part of our talented engineering and testing team, focused on transitioning (more...)
Company: Viola
Location: Mountain View
Posted on: 04/8/2020

Head of Talent Acquisition, Access, Google Fiber
Description: Minimum qualifications:Bachelors degree or equivalent practical experience.10 years of experience in full lifecycle recruiting6 years of experience hiring and leading a staffing team through business (more...)
Company: GOOGLE INC.
Location: Mountain View
Posted on: 04/8/2020

Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

Santa Clara RSS job feeds