Data Engineer, Early Career

Data software engineers contribute to the implementation, support, and maintenance of software systems that ingest, distribute, and visualize data from all systems in the company. The role focuses on developing data pipelining solutions for near real-time operational systems, generating critital business analytics to provide insights to our management team, and data reporting to our customers.   

The day-to-day

• Establish and build processes based on business and technical requirements to channel data from multiple inputs and store using any combination of distributed (cloud) structures, local databases or other applicable storage forms
• Develop and own technical tools leveraging Big Data to clean, organize and transform data via automation
• Develop solutions that are functional, reliable, maintainable, scalable and extensible
• Resolve complex issues that may impact multiple business areas
• Maintain relationships with internal and external stakeholders
• Collaborate with Data Engineers, eSoftware Engineers, and Data Scientists both within the team and across business units
• Monitor and optimize existing data pipelines for performance and reliability
• Ensure data quality and integrity through rigorous testing and validation processes
• Develop and maintain scalable data pipelines to support data processing and transformation
• Implement and manage ETL processes to extract, transform, and load data from various sources
• Collaborate with cross-functional teams to gather requirements and design data solutions
• Document data pipeline architecture, processes, and workflow for future referenc

What you'll need

• Completion of a Bachelor's degree or higher in engineering, data, or a related field
• Hands-on development experience with Python
• Experience with OLAP databases like Snowflake or Google BigQuery
• Hands-on experience with Airflow, Spark or Kafka
• Comfortable with relational databases and writing database queries in SQL
• Understanding of Continuous Integration and Continuous Deployment (CI/CD) development processes