We are seeking a highly skilled and motivated Data Engineer to design, implement, and maintain efficient and scalable data pipelines on the Google Cloud Platform (GCP). In this role, you will be responsible for managing data from MariaDB and Kafka sources, ensuring seamless integration into BigQuery, our primary data destination. Collaboration with cross-functional teams is crucial to understanding and meeting diverse data needs.
In this role, you will need to:
- Design, implement, and maintain robust data pipelines on Google Cloud Platform.
- Integrate MariaDB and Kafka as primary data sources for seamless data flow into BigQuery.
- Collaborate across departments to address unique data requirements aligned with organizational goals.
- Utilize Dataflow and Dataform for efficient data processing and transformation.
- Ensure data integrity through rigorous validation and cleansing processes.
- Optimize cloud-based infrastructure for speed and scalability.
- Implement monitoring tools for proactive system performance tracking and issue resolution.
- Provide ongoing support for data integrity and availability.
- Maintain comprehensive documentation of data architecture, updating regularly.
- Stay informed about the latest data technology trends.
- Evaluate and recommend new technologies/methodologies to enhance processing and analysis capabilities.
What are the key experience and personal attribute requirements?
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 2+ Hands-on experience relational database
- Proven experience in developing data pipelines and ETL processes.
- Strong SQL skills.
- Knowledge of data modeling and database design.
- Excellent collaboration and communication skills.
- Strong problem-solving and troubleshooting abilities.
- Ability to work independently and as part of a team.
- Continuous learner, keeping up with emerging trends in data engineering.
What are some of the benefits of working at WA Technology?
- 100% remote opportunity
- Flexible work environment
- Attractive remuneration package
- Opportunity to work with well-connected industry leaders.
- A leadership approach that fosters innovation, creativity, and trust.
- Opportunity to experience the buzz of highly driven and motivated work colleagues.
- Experience a start-up feel in a fast-paced growth-driven environment.
WA.Technology is a B2B provider of innovative iGaming solutions, recognised for its dynamic presence in emerging markets. With a rapidly growing portfolio of satisfied clients and strategic collaborations, WA.Technology Group offers a state-of-the-art iGaming platform, turnkey solutions, and standalone products, facilitating swift market entry and expansion for operators.
At the core of WA.Technology's offering is WA.Platform, a fully customisable iGaming platform featuring over 75 game providers, a vast library of 6400+ games, and support for multiple currencies and over 80 payment methods. With WA.Technology, operators have the power to build their very own casino, sportsbook, lottery, fantasy, or poker business exactly as they envision it.
WA.Technology enables operators to build their own casino, sportsbook, lottery, fantasy, or poker business precisely how they envision it.
Careers and Jobs at WA.Technology