One of our clients, a Global Market Research Company, is looking for talented Senior Data Engineers. Senior and Lead Data Engineers.
Permanent position with excellent compensation package and benefits.
This position can also be a contract to hire opportunity.
Location: 100% Remote position (HYBRID after Covid restrictions are lifted, will have option to commute, as needed, to one of company's multiple locations in NY, TX, VA, NC, IL, CA)
No H1 Visa Support For This Role
Please read the description below and to be considered immediately email your resume to email@example.com
Senior Data Engineer
Senior data engineering with hands on experience working with cloud and Big data platforms.
A BIG PLUS for a lead level: Manage and mentor a team of 3-5 data engineers
Responsible for data engineering, data analysis and user support primarily focused on Azure Databricks and Cloudera Hadoop.
Strong hands-on technical skills and mentor and train other Engineers with programming languages such as Python and Scala, including tuning complex big data spark applications.
Design, develop, and maintain highly scalable cloud-based data processing applications
Write efficient, reusable and well documented code
Deliver highly complex big data projects using Databricks, Data Factory and other Azure services
Maintain and tune existing Hadoop/Hbase applications and migrate to Azure cloud
5+ years of software development and design
A BIG PLUS: 2+ years of leading a team of 3-5 software developers
Experience in developing and tuning SPARK applications using Databricks
Excellent understanding of spark architecture, spark SQL, data frames and tuning big data spark applications
Excellent with Python, Scala, SQL and shell scripting
Hands-on experience with cloud platforms like Azure and AWS
Experience in Database Design and Data Modeling
Excellent problem solving and analytical skills
Strong diagramming skills – flowcharts and data flows
Solid written and verbal communication skills
Experience with Synapse, Snowflake or Google BigQuery is a plus
Bachelor's degree in Computer Science or related field