SMART IT Providers Ltd requires Two Data Engineers to join
the company. Applicants must be experienced and have a proven track record that
demonstrates the ability to fulfill the following key functions of the role.
Key Duties
Liaise with the clients to analyse business procedure, clarify client’s requirements and define the scope of existing software, hardware and infrastructure provision.
Undertake feasibility studies for IT developments incorporating costs and benefits, and presents proposals to clients.
Work with stakeholders including the Executive, Product, Data and Design teams to support their data infrastructure needs while assisting with data-related technical issues.
Identify, design and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automate manual processes
Load data from Client SQL server to target Snowflake using ETL tool like Talend.
Tune SQL queries and optimize datawarehouse performance of Snowflake database.
Assemble large, complex sets of data that meet non-functional and functional business requirements
Build required infrastructure for optimal extraction, transformation and load data from various data sources using AWS and SQL technologies
Provide end to end orchestration of data using the pipeline tool like Dataops along with CI/CD and automated testing across all environments - Dev, QA and Prod
Build analytical tools to utilize the data pipeline, provide actionable insight into key business performance metrics including operational efficiency and customer acquisition.
Track day to day activities in Jira Ticketing tool using Agile methodology.
.
Key Skills The successful candidate must hold any bachelor’s degree with demonstrable experience as Data Engineer within Azure, AWS and GCP environments. Good to have certifications in Snowflake, Oracle PL/SQL, MS SQL. Must have good experience in Azure Document Intelligence API tool Must have good version management knowledge using tools like Github or equivalent Must have strong knowledge of visualization techniques in Tableau and Power BI. Must have experience in Design, develop and implement a large-scale Snowflake data warehouse for Client resulting in migration of data from on prem SQL Server to Snowflake. Must have Knowledge of ETL processes and data modelling techniques. Must have working experience with ETL tools, REST APIs, and data integration techniques. Working experience of programming languages such as Java, Python, and Ruby on Rails. Must have working knowledge of data warehousing, data lakes, and cloud computing. Must have experience with relational database systems (RDBMS) and non-relational databases (NoSQL). Good to have familiarity with machine learning algorithms. Must have excellent understanding of Agile process management principles. Must have experience in collaborating with cross-functional teams (Business Analysts and Developers) to capture user requirements and translate them into actionable technical solutions. Must have data architecture best practices and ensured compliance with data governance standards. Must have been involved in migration project from Talend 7.0 version to the latest Talend 8.0 version and scheduling them in TMC Must have extensive experience on query optimisation and develop Talend jobs and supporting it. Must have experience in Building dataops tool which is an end to end orchestration of environment mgmt, CICD, automated testing and ELT all in one pipeline using modelling tool like DBT. Must have strong teamwork abilities and strong problem-solving skills and attention to detail. Good communication skills in English and Commitment to Quality, flexibility, prioritization skills and a demonstrable ability to deal with clients are mandatory.
Please apply with an up-to-date CV by email to HR@smart-it-providersltd.com Posting date: 12/08/2024 Closing Date: 23/08/2024