Senior Data Engineer @ Commonwealth Bank

Wait 5 sec.

Organization: At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great thingsJob Title: Senior Data EngineerLocation: Bangalore-Manyata Tech Park (Hybrid)Business & Team: Financial Crime Technology – Enterprise Data Platform Impact & contribution: You will work with Product Owner /lead engineer in the squad working towards impact of Enterprise Transformation Program across key applications.Roles & Responsibilities: In your role as a Senior Data Engineer, you will be reporting to a Data Engineering ManagerUtilizing Big Data technologies to solve our customer data centric problems.Working closely with the Senior Data engineer, Solution Designers and Business Analysts to understand and perform Data Ingestion, Enrichment and EgressionWorking across the Group Data Warehouse (GDW), Big Data Platform (Omnia) & AWS Cloud PlatformBuilding group data products by integrating diverse data from hundreds of internal and external sourcesAdopting tools, programming languages and templates to improve our data quality and efficiencyBuilding and optimizing Big Data pipelines, architecture and data setsEnd to end ownership and accountability of the business requirements, identify technical / performance issues and solve them.Learn and adapt to new technologies to solve problems and improve existing solutionsRequired to maintain and build excellent relationships with CDAO peers and stakeholders as well as actively contribute to business outcomes and team cultureEssential Skills:Minimum of 7+ years of hands-on experience in Software Engineering or development to build solution in Hadoop, Hive and Spark technologies.Strong hands-on experience in any of the language (Scala/Python) with spark ETL development.Good experience in any…