Data Engineer II
Data Science
Bengaluru, Karnataka, India
Posted 6+ months ago
Job brief
We are looking for a Data Engineer 2 for our Platform team to use data and technology to transform the way Cleartax understands the data. From researching progressive systems solutions to evaluating their impact, our ideal candidate is a detailed planner, expert communicator, great leader, and top-notch analyst. They should be wholly committed to the discovery and development of innovative solutions in an ever-changing data landscape.
Objectives of this Role
Drive identification of requirements across business units and identify substandard systems processes through evaluation of TB’s of data
Interact with Business Analyst/Product Manager/Dev team across the company understand the requirement & get the requirement role up at the platform level
Perform, evaluate, and communicate thorough quality assurance at every stage of systems development
Determine and develop user requirements for systems in production, to ensure maximum usability
Conduct daily systems analytics to maximize effectiveness and troubleshoot problems
Ability to communicate effectively with external vendors understand their data and come up with an effective solution to onboard them to ClearTax
Ability to lead a team to get the work done.
Develop and test ETL components to high standards of data quality and performance as a hands-on development lead
Familiarity with Data Lakes, Data Warehouses, MDM, BI, Dashboards, AI, ML
Experience in data modeling, metadata support, development, and testing for enterprise-wide data solutions
Design data architecture patterns and ecosystems including data stores (operational systems, data lakes, data warehouses, data marts), ingress patterns (API, streaming, ETL/ELT), and egress patterns (analytics/decision tools, BI tools). Lead, consult or oversee multiple architectural engagements
Skills and Qualifications
Bachelor’s or Master’s degree in IT or Computer Science (Comp. Science degree preferred not mandatory)
3+ years of proven experience in an analytics and systems development capacity
Experience in designing Big Data/Cloud Solution Designs, data models
High proficiency with SQL language, Python(Pandas), and database management
Expertise in Data Engineering, Data Governance, Data Quality, Data Lake, Data Warehousing and Reporting/Analytics concepts
Should have strong knowledge on Spark, Presto, Athena
Knowing Clickhouse, Elastic Search, Cassandra DBT is an added advantage
Proven analytical abilities
Practical experience generating process documentation and reports
Excellent communicator with the ability to translate data into actionable insights
Extensive experience with data visualizationD for