Job Description

Azure Solution Architect & Data Engineer
2 Month Contract (Jan 2025 start)
Location: Home / London
Rate: £600 - £650 per day (Inside IR35)

Skills: Azure Databricks, Python, CI/CD Pipelines, SC Clearance

We are looking to recruit an SC Cleared Azure Solution Architect & Data Engineer for a leading IT Consultancy. The role combines Solution Architecture & Data Engineering and you will lead the design, development, and deployment of a data-driven Azure-based application. This contract position offers an exciting opportunity to work with cutting-edge cloud technologies, with a focus on solution design, back-end data engineering pipelines, and integration with a React front end.

This is an initial 2 month contract however chances for extensions are likely. This is a hybrid role and you will be required to work onsite in London 2 days a week.

Key Responsibilities:

• Solution Design & Architecture:
  • Design an Azure-based solution connecting Databricks to a React front end hosted on Azure App Service using APIs managed via Azure API Management.
  • Develop a foundational skeleton of the solution in a sandbox environment to deliver a working pilot.
  • Oversee the deployment of Azure services, ensuring a scalable and secure architecture.

• Data Engineering:
  • Develop Python-based microservices using Azure Functions and FastAPI frameworks for efficient data retrieval from Databricks with minimal latency.
  • Manage and secure RESTful APIs through Azure API Management.
  • Integrate and automate data pipelines using GitHub Actions for CI/CD.

• Front End Integration:
  • Enable the React front end to consume backend APIs, ensuring seamless data flow and user experience.
  • Implement version control via a GitHub repository, maintaining a clear separation between front-end and back-end codebases.

• Monitoring & Security:
  • Utilise Azure Monitor for performance monitoring and logging.
  • Implement secure storage of secrets and configurations using Databricks Secrets and Azure Key Vault.

Essential Skills & Experience:

• Strong expertise in Azure Databricks for data storage and processing.
• Experience with Azure Functions and FastAPI for building scalable microservices.
• Proficiency in Azure API Management for managing and securing APIs.
• Hands-on experience with GitHub Actions for automating CI/CD pipelines.
• Knowledge of Azure App Service for hosting React-based front-end applications.
• Experience with secure configuration management using Azure Key Vault.
• Familiarity with Azure Monitor for logging and performance management.