Senior Data Engineer
Full Time
full time
Architectural, Engineering, and Related Services
16 Jan 2025
York
About the job
About StarCompliance
StarCompliance is on a mission to make compliance simple and easy. Trusted globally by enterprise financial institutions, the user-friendly STAR platform empowers organizations to achieve regulatory compliance while safeguarding their integrity and business reputations. Through a customizable, 360-degree view of employee activity, the STAR software enables firms to automate the detection and resolution of potential areas of conflict while streamlining daily workflows and increasing efficiency.
Role
You will be responsible for enhancing our external Data Analytics platform to provide a consistent, quality product for our clients to utilise, providing data and dashboards to thousands of users across hundreds of clients across the globe.
As the Data Engineer, you will be hands-on, continually contributing to a data warehouse utilising Snow SQL, T-SQL, and JavaScript, building and designing new features, investigating and solving data issues, and constructing tooling within a team of developers and QAs. Our platform utilises a contemporary cloud-based tech stack, featuring Microsoft Azure, Snowflake, and ThoughtSpot, alongside in-house data-ingestion and automation tooling, and is built using and modern techniques through the use of custom tools and pipelines.
We are looking for individuals who will challenge ideas in a respectful manner in the pursuit of a better outcome. You should be passionate and take pride in your work with the ability to use initiative to make sure tasks are progressed and workload is prioritised accordingly
Responsibilities
- Design and build scalable, efficient, and fault-tolerant data products using predominantly Azure and Snowflake technology
- Work closely with the rest of the members of the Data team to identify, refine and build solutions to enhance the data analytics platform for our customers
- Continually contribute to the codebase and aid other engineers within the team by reviewing and advising/sharing best-practices
- Run spikes and POCs for new technical innovation when required and share back to the group
- Ensure the platform remains secure, well-monitored and performant
- Engage with stakeholders to understand requirements
- Play a key role in Agile ceremonies with input into backlog refinement and estimations, as well as ownership of the tech-debt backlog
Mandatory Skills, Knowledge or Experience
- At least 3 years of experience in data engineering in a fast-paced, large-scale production environment
- Demonstrable expert skills in SQL, including a knowledge of efficient and performant query design
- Experience of programming/scripting languages (e.g.C# / PowerShell / Python / JavaScript)
- Experience building production systems utilising cloud systems, with particular value in expertise with Microsoft Azure.
- Uses coding best practices and understands data architecture patterns
- Deep understanding/experience of data warehousing, and ETL/ELT processes
- Familiar with utilizing CI/CD processes(e.g.Azure DevOps) and Git-based code repositories
- Work in an Agile development environment
- Excellent communication, collaboration, and problem-solving skills
Desirable skills
- Experience of data modelling
- Experience of Snowflake cloud data warehouse including SnowSQL
- Experience defining, implementing or supporting software in financial services industry
- Cloud certification in Azure is particularly desirable
- Knowledge of data quality, data governance, and data security principles and practices
- Experience of Mend/SonarQube
Transferable Skills, Knowledge or Experience
Skills may be transferable from a role which includes software development.
Integrity and Ethics
All StarCompliance employees are expected to commit to a high standard of personal integrity and carry out their responsibilities in an ethical manner.
Last updated on Jan 16, 2025
