logo

View all jobs

DATA ENGINEER

New York, NY · Information Technology
DATA ENGINEER

One of our clients, a Market Research Company that transforms
Consumer Packaged Goods (CPG) and Retail Industries into true data driven digital enterprises, is looking for a talented DATA ENGINEER.


Permanent (full time) position with excellent compensation package and benefits.

Location: 100% Remote position
Sorry, No H1b Visa Support for this role

Please read the description below and to be considered immediately email your resume to barryr @brainsworkgroup.com 

DATA ENGINEER


Requirements:
  • Build unique high-impact business solutions utilizing advanced technologies for use by the Consumer Packaged Goods (CPG) and Retail Industries.
  • Create and maintain the underlying data pipeline architecture for the solution offerings from raw client data to final solution output.
  • Create, populate, and maintain data structures for machine learning and other analytics.
  • Use quantitative and statistical methods to derive insights from data.
  • Guide the data technology stack used to build company’s solution offerings.
  • Combine machine learning, artificial intelligence (ontologies, inference engines and rules) and natural language processing under a holistic vision to scale and transform businesses — across multiple function and process.
  • Develop and enhance commercial-grade solution offering while creating and maintaining optimal data pipeline architecture, incorporating data wrangling and Extract-Transform-Load (ETL) flows.
  •  Assemble large, complex data sets to meet analytical requirements – analytics tables, feature-engineering etc.
  •  Build the infrastructure required for optimal, automated extraction, transformation, and loading of data from a wide variety of data sources using SQL and other ‘big data’ technologies such as Databricks.
  • Build automated analytics tools that utilize the data pipeline to derive actionable insights.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
  • Design and develop data integrations and data quality framework.
  •  Develop appropriate testing strategies and reports for the solution as well as data from external sources.
  • Configure data pipelines to accommodate client-specific requirements to onboard new clients.
  • Perform regular operations tasks to ingest new and changing data – implement automation where possible.
Skills:
  • 3+ years of hands-on experience as a data engineer or similar position
  • 3+ years of commercial experience with Python or Scala Programming Language
  • 3+ years of SQL and experience working with relational databases (Postgres preferred)
  • Knowledge of Databricks, Spark, Hadoop or Kafka
  • Demonstratable knowledge and experience developing data pipelines to automate data processing workflows
  • Demonstratable experience in data modeling
  • Demonstratable knowledge of data warehousing, business intelligence, and application data integration solutions
  • Demonstratable experience in developing applications and services that run on a cloud infrastructure (Azure preferred)
  • Knowledge of statistics and experience using statistical or BI packages for analyzing large datasets (Excel, R, Python, Power BI, Tableau etc.)
  • Experience with container management and deployment, e.g., Docker and Kubernetes a plus
  • Excellent problem-solving and communication skills
Bachelor’s Degree in Computer Science, Software Engineering, or other STEM fields.

Use this link to apply directly:
https://brainsworkgroup.catsone.com/careers/index.php?m=portal&a=details&jobOrderID=15728429
Or email: barryr@brainsworkgroup.com
Check ALL our Jobs: http://brainsworkgroup.catsone.com/careers




 

Keywords: data engineer scientist Python scala sql databricks spark hadoop kafka cloud azure kubernetes docker tableau power bi
Powered by