SantaClaraRecruiter Since 2001
the smart solution for Santa Clara jobs

Lead Software Engineer

Company: Dermio
Location: Santa Clara
Posted on: June 8, 2021

Job Description:

Be Part of Building the Future

Dremio is the data lake engine company. Our mission is to reshape the world of analytics to deliver on the promise of data with a fundamentally new architecture, purpose-built for the exploding trend towards cloud data lake storage. Dremio eliminates the need for the complex and expensive workarounds that have been in use for decades, such as data warehouses (whether on-premises or cloud-native), structural data prep, ETL, cubes and extracts. We do this by enabling lightning-fast queries directly against data lake storage, combined with full self-service for data users and full governance and control for IT. The results for enterprises are extremely compelling: 100X faster time to insight; 10X greater efficiency; zero data copies; and game-changing simplicity. And equally compelling is the market opportunity for Dremio-with our newly attained unicorn status, we are well on our way to disrupting a $25BN+ market.

If you, like us, say "bring it on" to exciting challenges that really do change the world (no BS), we have endless opportunities where you can make your mark.

What you'll be doing

  • Architect, design, develop, and support a petabyte-scale multi-cloud data lake engine that is highly parallel and fault-tolerant
  • Design and implement complex, distributed platforms for storing data, scaling parallel algorithms, etc.
  • Analyze fault-tolerance and high availability issues, performance and scale challenges, and solve them
  • Build high-quality and highly reliable software services to meet the needs of some of the largest companies on the planet
  • Analyze and understand performance and scalability bottlenecks in the system and solve them
  • Work cross functionally with other teams to rapidly prepare the company for explosive growth
  • Mentor others to solve hard technical problems and be a pacesetter
  • Identify and implement novel query optimization or distributed data processing algorithms which allow Dremio to provide industry leading data lake engine capabilities
  • Pinpoint problems, instrument relevant components as needed, and ultimately implement solutions
  • Understand trade-offs between consistency, durability and costs to build solutions which can meet the demands of rapidly growing services
  • Evaluate and determine priorities with a critical understanding of where performance matters and where performance is irrelevant

What we're looking for

  • B.S. in Computer Science or in a related technical field; M.S. or PhD preferred
  • 15+ years hands-on software engineering experience
  • Background in database internals or building core components for large scale data processing systems (i.e. Hadoop, Spark) especially query execution/processing, and/or optimization
  • Strong database fundamentals including SQL, performance, multi-threading, and schema design
  • Strong CS fundamentals including data structures, algorithms, and distributed systems
  • Systems programming skills including multi-threading, concurrency, etc.
  • Fluency in C++, C, or Java preferred
  • Experience using big data storage technologies and their applications (HDFS, Cassandra, Columnar Databases, etc.)
  • Deep multi-faceted appreciation in building end-to-end customer facing products
  • Experience driving company initiatives towards customer satisfaction
  • Experience working with cross teams and product managers

Bonus points if you have

  • Experience with internals of distributed key value stores like FoundationDB and storage engines like RocksDB, InnoDB, BerkeleyDB etc.
  • Familiarity with containers and Kubernetes for orchestration and container management in private and public clouds (AWS, Azure, Google Cloud)
  • Data warehouse design, database systems, and large-scale data processing solutions like Hadoop and Spark

Possible teams / work focus areas:

  • Data Management Platform, Cloud Automation, Query Engine, Security, Governance, Data Services, Manageability, Metadata, Multi-cloud and Service Runtime
  • Open Source
  • High performance large-scale data processing
  • Large-scale distributed systems
  • Query compilation and optimization
  • Software-as-a-Service platform
  • Software frameworks for stability and performance testing

Dremio is an equal opportunity employer supporting workforce diversity. We do not discriminate on the basis of race, religion, color, national origin, gender identity, sexual orientation, age, marital status, protected veteran status, disability status, or any other unlawful factor.

#LI-Remote #LI-JW1

Keywords: Dermio, Santa Clara , Lead Software Engineer, Other , Santa Clara, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

Santa Clara RSS job feeds