Our client is a SaaS company specializing in customer engagement and loyalty services for top-tier property developers, shopping centers, and retailers worldwide. Our innovative solutions have contributed to generating over £1 billion in annual sales for our clients. With a presence in 24 countries and a customer base of more than 20 million shoppers across 1,800 brands, our reach is truly global. Our dynamic team operates from offices in Europe, the US, and the Middle East, driving our success in delivering exceptional services and driving business growth for our clients.
Role Overview: As a Data Engineer, you will be a crucial part of our team responsible for the maintenance, development, and expansion of multiple MySQL databases and data warehouses. You will play a key role in ensuring the health and performance of our data management systems, optimizing queries for data analysis, and supporting data synchronization between various sources and data store systems. Your expertise in database management will be instrumental in supporting our application development team and maintaining processes for failover and disaster recovery.
- Maintain, develop, and expand multiple MySQL databases and data warehouses.
- Ensure the health and performance of data management systems.
- Create and optimize queries for data analysis and day-to-day data operations.
- Support Data Analysts in transforming client data requirements into executable queries.
- Synchronize data between data sources (MySQL, 3rd Party data sources, etc.) and data store systems (MySQL, Exasol, etc.).
- Assist the application development team in building, validating, and optimizing database interactions.
- Maintain processes to ensure failover and disaster recovery.
- Support the development team with data operations to facilitate software deployments.
- Proven experience managing high-volume, high-performance MySQL databases in a multi-tenancy, SaaS environment.
- Proficiency in creating, optimizing, and maintaining SQL queries and processes, including triggers and stored procedures.
- Expertise in performance tuning, optimizing, and partitioning data while analyzing query performance.
- Experience designing and maintaining data replication processes into redundant databases and read-replica sets, including different database systems.
- Support for an application development team to ensure optimal data operations for business needs.
- Familiarity with columnar and non-relational databases.
- Experience in modeling and managing ETL/ELT processes on data flow systems (e.g., airflow, Azkaban) between tabular databases and data warehouses.
- Proficiency in scripting languages such as Python, bash, or similar.
- Strong problem-solving skills, independence, and attention to detail.
- Ability to work with non-data experts and stakeholders.
- Understanding of Enterprise Queues and pipelines, APIs, and agile methodologies.
- Advantageous skills include experience with non-relational and columnar databases (Exasol, ElasticSearch, NoSQL), performance tuning, data partitioning, knowledge of data infrastructures and architectures (Hybrid, SMACK), and Python scripting or similar scripting language.
- Competitive salary.
- Company stock options.
- 25 days of holiday plus statutory holidays.
- A day off to celebrate your birthday.
- A day off for your wellbeing.
- Shorter working hours on Fridays.
- A strong company values framework, including paid leave for volunteering with approved charities.
- Regular team-building activities.
- Training & development allowance.
- New employee referral scheme.