Senior Data Engineer - Fully Remote (EST)
The role will support the Data Science team through existing pipelines and processes to integrate towards best-in-class data management practices seamlessly.
Job Description
- Designs and implements standardized data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (e.g., scripts, programs, automation, etc.)
- Ensures quality of technical solutions as data moves across multiple zones and environments
- Provides insight into the changing data environment, data processing, data storage and utilization requirements for the company, and offer suggestions for solutions
- Ensures managed analytic assets to support the company's strategic goals by creating and verifying data acquisition requirements and strategy
- Develops, constructs, tests, and maintains architectures
- Aligns architecture with business requirements and use programming language and tools
- Identifies ways to improve data reliability, efficiency, and quality
- Conducts research for industry and business questions
Minimum Qualifications:
- Bachelor's Degree in Computer Engineering or related field
- 5+ years of experience working in a 'Big Data' ecosystem process data; includes file systems, data structures/data bases, , automation, security, messaging, movement, etc.
- 5+ years of experience working in a production cloud infrastructure
- 5+ years' experience in data programming languages such as Java, pyspark, R or Python
Preferred Qualifications:
- Proven track record of success directing the efforts of data engineers and data analysts with a deadline-driven and fast-paced environment
- Demonstrated experience working in an Agile environment as a Data Engineer
- Hands-on work with AWS, including creating Redshift data structures, accessing them with Spectrum, and storing data in S3
- Knowledge of SQL and multiple programming languages to optimize data processes and retrieval and proficiency with relational, graph and NoSQL databases
- Proven results using an analytical perspective to identify engineering patterns within complex strategies and ideas, and break them down into engineered code components
- Excellent interpersonal skills with proven ability to influence with impact across functions and disciplines
- Ability to manage multiple projects/deadlines, identifying the necessary steps, and moving forward through completion
- Skilled in Microsoft Office; including PowerPoint, Word, Excel and Visio
- Experience building out production level visualization dashboards using tools such as Tableau or QlikView
