Azure SQL Data Engineer

Job Description: Data Engineer - Mission Critical

Overview

We are seeking a highly skilled Data Engineer with a strong DBA background, solid .Net and C# development experience, and proficiency in Entity Framework to join our mission-critical team at my client's company. This role involves working on a significant project aimed at revitalizing a legacy SQL Server database and migrating it to Azure SQL. The successful candidate will play a crucial role in ensuring the performance, reliability, and scalability of our data infrastructure.

Key Responsibilities

• Database Revitalisation

• Fix and optimize the legacy SQL Server database.
• Address performance issues, broken elements, and gaps, particularly those stemming from Entity Framework's code-first approach.

• Migration Planning and Execution

• Plan and execute the migration of the SQL Server database to Azure SQL within the first three months.
• Aim for a data-tier application for better maintainability and scheduled job engineering solutions.

• Performance Tuning

• Enhance database performance and ensure efficient data querying and management.
• Optimize SQL connection usage and data model management.

• SQL Server Agent Jobs

• Manage and optimize SQL Server Agent jobs, ensuring they run efficiently and without errors.

• Testing and Validation

• Conduct backend testing to ensure the robustness of the database and its readiness for migration.
• Set up integration environments and run Benchmark.NET tests.

• Data Integrity

• Ensure data integrity and consistency during the transition from the legacy system to Azure.

• Collaboration

• Work closely with other team members and stakeholders to align platform services and meet project goals.
• Profile both service and database performance, identifying hotspots in both the application and database.

• Key Qualifications
• Experience with SQL Server

• Proven experience with performance tuning and managing SQL Server Agent jobs.
• Ability to optimize slow SQL queries using tools like New Relic.

• Azure SQL Expertise

• Hands-on experience with Azure SQL, with a strong understanding of its features and migration processes.

• .Net and C# Development

• Solid experience in .Net and C# development.
• Proficiency in Entity Framework, with a focus on optimizing code-first approaches.

• Problem-Solving Skills

• Ability to identify and resolve issues within legacy databases and ensure smooth migration to new platforms.

• Data Performance Optimization
• Deep understanding of data performance and optimization techniques.

• Capability of setting up integration environments and running Benchmark.NET tests.
• Project Management
• Ability to manage and execute a project within specified timelines, particularly under mission-critical conditions.
• Government Data Experience
• Experience working with government data, particularly with HMRC, is a plus.
• Attention to Detail
• Keen attention to detail and commitment to data accuracy and integrity.
• Communication Skills
• Excellent communication skills to articulate issues, solutions, and progress to stakeholders.

Ideal Candidate

• Capable of setting up integration environments.
• Running Benchmark.NET tests.
• Profiling both service and database performance.
• Identifying hotspots in both application and database.
• Not just focusing on database profiling but also the C# end.
• Able to transition the system to a Platform as a Service (PaaS) database for better maintainability.
• Develops engineering solutions that allow general C# developers to maintain the system without ongoing data engineer intervention.

Additional Information

• Location Requirement: The position requires working on-site at least one day a week
• Project Duration: The initial contract is for 3 months, with the potential to extend based on project needs and performance.
• Urgency: This position is mission-critical with an expected start date as soon as possible. Applications will be reviewed on a rolling basis until the role is filled.