View all jobs

Senior Data Engineer

New York, NY · Information Technology
Senior Data Engineer

One of our clients, a Global Market Research Company, is looking for talented Senior Data Engineers. Senior and Lead Data Engineers.
Permanent position with excellent compensation package and benefits.
This position can also be a contract to hire opportunity.

Location: 100% Remote position (HYBRID after Covid restrictions are lifted, will have option to commute, as needed, to one of company's multiple locations in NY, TX, VA, NC, IL, CA)

No H1 Visa Support For This Role
Please read the description below and to be considered immediately email your resume to barryr@brainsworkgroup.com 

Senior Data Engineer

  • Senior data engineering with hands on experience working with cloud and Big data platforms.
  • A BIG PLUS for a lead level: Manage and mentor a team of 3-5 data engineers
  • Responsible for data engineering, data analysis and user support primarily focused on Azure Databricks and Cloudera Hadoop. 
  • Strong hands-on technical skills and mentor and train other Engineers with programming languages such as Python and Scala, including tuning complex big data spark applications.
  • Design, develop, and maintain highly scalable cloud-based data processing applications
  • Write efficient, reusable and well documented code
  • Deliver highly complex big data projects using Databricks, Data Factory and other Azure services
  • Maintain and tune existing Hadoop/Hbase applications and migrate to Azure cloud
  • 5+ years of software development and design
  • A BIG PLUS: 2+ years of leading a team of 3-5 software developers
  • Experience in developing and tuning SPARK applications using Databricks
  • Excellent understanding of spark architecture, spark SQL, data frames and tuning big data spark applications
  • Excellent with Python, Scala, SQL and shell scripting
  • Hands-on experience with cloud platforms like Azure and AWS
  • Experience in Database Design and Data Modeling
  • Excellent problem solving and analytical skills
  • Strong diagramming skills – flowcharts and data flows
  • Solid written and verbal communication skills
  • Experience with Synapse, Snowflake or Google BigQuery is a plus
Bachelor's degree in Computer Science or related field

Use this link to apply directly:
Or email: barryr@brainsworkgroup.com
Check ALL our Jobs: http://brainsworkgroup.catsone.com/careers


Keywords: spark hadoop databricks sql python scala cloud aws azure syapse snowflake bigquery shell
Powered by