Data Engineer III
Kueski
- Design robust, scalable data-driven solutions to support long-term needs with a deep understanding of technical best practices
- Develop complex data processing systems to meet data consumers requirements
- Create CI/CD pipelines to automate production deployments and monitoring
- Develop infrastructure as code for automated, clean, and organized infrastructure deployments
- Apply data cleansing techniques to improve data quality and facilitate consumption
- Show initiative and offer mentorship proactively to junior team members to enhance their solutions
- Mastery of the data stack and a profound understanding of data platform components
- Design complex distributed systems using batch and streaming fundamentals with a focus on delivering results
- Collaborate effectively with technical leaders, architects, and stakeholders
- Focus discussions on important aspects, drive team alignment, and actively participate in methodology meetings and code reviews, guiding others
- Proven ability to transform requirements into working software in production
- Ability to collaborate effectively within an interdisciplinary team
- Capable of leading medium to complex projects requiring multiple iterations and different technologies
- Strong understanding of a well-organized Software Development Lifecycle (SDLC)
- Proficient knowledge of integrating non-functional requirements into solution delivery
- Experience in designing, implementing, testing, and deploying production-ready code
- Expertise in designing and solving data processing problems
- Skilled in building and debugging Spark-based applications
- Ability to collaborate with data consumers to apply large-scale data analytics and machine-learning techniques
- Strong technical background in programming, preferably with Java and Python; Scala is a plus
- Proficiency in SQL traditional query development
- Solid experience and understanding of software design patterns
- Solid experience with database engines and distributed programming engines for data processing, particularly with Spark
- Proven experience in integrating, designing, and building data pipelines
- Solid experience in deploying and maintaining data pipelines in production environments
- Knowledge of big data AWS cloud services: S3, EC2, Glue, Athena, Lambda and EMR
- Experience developing high-level streaming solutions
- Experience working with distributed message brokers in production
- Experience with any non-relational databases, preferably Apache Cassandra
- Experience implementing data warehousing using data modeling techniques
- Knowledge of data architecture fundamentals
- Knowledge of data governance being actively participating in a program
- We have a mission-driven culture focused on customer value, teamwork, humility, and integrity
- Everyone is expected to have role clarity, career growth, and a personal development plan. Feedback and recognition are embedded in our company processes, systems, and practices
- We ensure competitive salary, medical insurance, and wellbeing through ample and flexible time off as well as mental healthcare benefits
- Everyone is an owner and eligible for competitive stock options with a company poised for success. We’re committed to building an inclusive and diverse team and we know this leads to incredible work
Source ⇲
remotive.com
To apply, please visit the following URL:https://remotive.com/remote-jobs/software-dev/data-engineer-iii-1927542→