Work-Force
We are seeking a highly skilled Data Specialist to join our CDS Team. This role is critical for developing and maintaining efficient and scalable data pipelines using our in-house developed data framework, built and maintained in Python. The ideal candidate will have a deep understanding of data pipeline development, proficiency in Source Control, T-SQL, Python, and excellent documentation skills.
Key Responsibilities:
- Data Pipeline Development:
- Develop and maintain data pipelines using our in-house developed data framework, leveraging technologies such as Azure Synapse, Blob Storage, and Redis.
- Write efficient, scalable, and maintainable code for data processing and integration.
- Technical Expertise:
- Demonstrate proficiency in Source Control and T-SQL.
- Utilize Python to create and manage data pipelines, ensuring high performance and reliability.
- Collaboration and Integration:
- Work collaboratively with cross-functional teams to integrate data pipelines seamlessly into existing systems.
- Troubleshoot and resolve issues related to data pipelines, ensuring minimal disruption to operations.
- Documentation:
- Create and maintain comprehensive technical documentation for all data pipelines and processes.
- Ensure that documentation is up-to-date and accurately reflects the current state of the data pipelines.
- Problem-Solving:
- Apply excellent problem-solving skills to identify and address issues in data pipelines.
- Pay close attention to detail to ensure data accuracy and integrity.
Qualifications:
- Experience:
- At least 3 years of experience in data engineering or a related field.
- Proven expertise in Source Control, T-SQL, Python, and data pipeline development and management.
- Education:
- Bachelor’s degree in Computer Science, Data Science, or a related field.
- Skills:
- Deep understanding of data warehousing, ETL processes, and big data technologies.
- Experience with Azure Architecture, including Synapse, Blob Storage, and Redis.
- Excellent problem-solving skills and attention to detail.
- Ability to work collaboratively with cross-functional teams.
Additional Information:
- Role Suitability: This role is not suitable for full-stack or frontend developers. We are looking for a highly specialized data specialist who is passionate about creating efficient and scalable data pipelines.
- What You Will Be Doing:
- Developing and maintaining data pipelines.
- Writing efficient, scalable, and maintainable code.
- Collaborating with cross-functional teams.
- Troubleshooting and resolving issues.
- Creating and maintaining technical documentation.
If you have the required skills and experience, we would love to hear from you. Join us to make a significant impact on our data infrastructure and contribute to our continued success.