DATA ENGINEER
One of our clients, a Market Research Company that transforms Consumer Packaged Goods (CPG) and Retail Industries into true data driven digital enterprises, is looking for a talented DATA ENGINEER.
Permanent (full time) position with excellent compensation package and benefits.
Location: 100% Remote position
Sorry, No H1b Visa Support for this role
Please read the description below and to be considered immediately email your resume to barryr @brainsworkgroup.com
Requirements:
- 10 years hands on experience as a Data Engineer or similar position.
- 10 years of commercial experience with Python or Scala Programming Language
- 10 years of SQL and experience working with relational databases (Postgres preferred).
- Knowledge of Databricks, Spark, Hadoop or Kafka.
- Experience developing data pipelines to automate data processing workflows
- Experience in data modeling
- Knowledge of data warehousing, business intelligence, and application data integration solutions
- Experience in developing applications and services that run on a cloud infrastructure (Azure preferred)
- Excellent problem-solving and communication skills
Responsibilities:
- Build unique high-impact business solutions utilizing advanced technologies for use by world class clients.
- Create and maintain underlying data pipeline architecture for the solution offerings from raw client data to final solution output.
- Create, populate, and maintain data structures for machine learning and other analytics.
- Use quantitative and statistical methods to derive insights from data.
- Combine machine learning, artificial intelligence (ontologies, inference engines and rules) and natural language processing under a holistic vision to scale and transform businesses — across multiple function and process.
- Create and maintain optimal data pipeline architecture, incorporating data wrangling and Extract-Transform-Load (ETL) flows.
- Assemble large, complex data sets to meet analytical requirements – analytics tables, feature-engineering etc.
- Build the infrastructure required for optimal, automated extraction, transformation, and loading of data from a wide variety of data sources using SQL and other ‘big data’ technologies such as Databricks.
- Build automated analytics tools that utilize the data pipeline to derive actionable insights.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
- Design and develop data integrations and data quality framework
- Develop appropriate testing strategies and reports for the solution as well as data from external sources.
- Configure the data pipelines to accommodate client-specific requirements to onboard new clients
- Implement processes and tools to monitor data quality - investigate and remedy any data-related issues in daily solution operations.
Additional skills a big plus:
-
- Knowledge of one or more of the following technologies: Data Science, Machine Learning, Natural Language Processing, Business Intelligence, and Data Visualization.
- Knowledge of statistics and experience using statistical or BI packages for analyzing large datasets (Excel, R, Python, Power BI, Tableau etc.).
- Experience with container management and deployment, e.g., Docker and Kubernetes
Bachelor’s Degree in Computer Science, Software Engineering, or other STEM fields.
Use this link to apply directly:
https://brainsworkgroup.catsone.com/careers/index.php?m=portal&a=details&jobOrderID=16014494
Or email:
barryr@brainsworkgroup.com
Check ALL our Jobs:
http://brainsworkgroup.catsone.com/careers
Keys:Data Python Scala SQL Databricks spark hadoop kafka cloud Azure AWS Postgres ETL tableau