Talent.com
69028 Data Engineer (ADF & Databricks)
69028 Data Engineer (ADF & Databricks)half the sky • Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
69028 Data Engineer (ADF & Databricks)

69028 Data Engineer (ADF & Databricks)

half the sky • Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
30+ hari lalu
Penerangan pekerjaan

About Avanade

Avanade is the leading provider of innovative digital, cloud and advisory services, industry solutions and design-led experiences across the Microsoft ecosystem. Every day, our 59,000 professionals in 26 countries make a genuine human impact for our clients, their employees and their customers.

We have been recognized as Microsofts Global SI Partner of the Year more than any other company. With the most Microsoft certifications (60,000+) and 18 (out of 18) Gold-level Microsoft competencies, we are uniquely positioned to help businesses grow and solve their toughest challenges.

We are a people first company, committed to providing an inclusive workplace where employees feel comfortable being their authentic selves. As a responsible business, we are building a sustainable world and helping people from underrepresented communities fulfil their potential.

Majority owned by Accenture, Avanade was founded in 2000 by Accenture LLP and Microsoft Corporation. Learn more at www.avanade.com .

As a Data Engineer , you will support the implementation of projects focused on collecting, aggregating, storing, reconciling, and making data accessible from disparate sources to enable analysis and decision making. This role will also play a critical part in the data supply chain, by ensuring stakeholders can access and manipulate data for routine and ad hoc analysis. Additionally, you will support the full lifecycle of data from ingesting through analytics to action.

Key Role Responsibilities :

Day-to-day you will :

  • Translate business requirements to technical solutions leveraging strong business acumen
  • Analyze current business practices, processes and procedures as well as identifying future business opportunities for leveraging Microsoft Azure Data & Analytics PaaS Services
  • Support the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments.
  • Deliver of architectures for transformations and modernizations of enterprise data solutions using Azure cloud data technologies.
  • Design and Build Modern Data Pipelines and Data Streams.
  • Design and Build Data Service APIs.
  • Develop and maintain data warehouse schematics, layouts, architectures and relational / non-relational databases for data access and Advanced Analytics.
  • Expose data to end users using PowerBI, Azure API Apps or any other modern visualization platform or experience
  • Implement effective metrics and monitoring processes.

Skill & Capability Requirements :

  • Around 5 years of working experience as a Data Engineer
  • Demonstrated experience in turning business use cases and requirements into technical solutions
  • Experience in business processing mapping of data and analytics solutions.
  • Ability to conduct data profiling, cataloging and mapping for technical design and construction of technical data flows
  • The ability to apply such methods to solve business problems using one or more Azure Data and Analytics services in combination with building data pipelines, data streams, and system integration.
  • Ability to leverage a variety of programming languages & data crawling / processing tools to ensure data reliability, quality & efficiency
  • Experienced in Cloud Data Transformation using ETL / ELT tools such as Azure Data Factory, Databricks
  • Experienced in Dev-Ops processes (including CI / CD) and Infrastructure as code fundamentals.
  • Experienced in Data Governance tools like Unity Catalog / Purview, Master Data Management (MDM) and Data Quality tools and processes
  • Knowledge of business intelligence tools such as Power BI, Tableau, Qlik, Cognos TM1
  • Knowledge of Azure Data Lake, Azure SQL DW, and Azure SQL, Azure App Service is required. Azure IoT, Azure HDInsight + Spark, Azure Cosmos DB & Azure Stream Analytics are a plus.
  • Knowledge in data modeling and database management, such as performance tuning of the Enterprise Data Warehouse, Data Mart, and Business Intelligence Reporting environments, and support the integration of those systems with other applications
  • Knowledge of Python is a plus.
  • Experience preparing data for Data Science and Machine Learning.
  • Experience preparing data for use in Azure Machine Learning / Azure Databricks is a plus.
  • Experience preparing data and building data pipelines for AI Use Cases (text, voice, image, etc).
  • Designing and building Data Pipelines using streams of IoT data.
  • Knowledge of Lambda and Kappa architecture patterns.
  • Strong team collaboration and experience working with remote teams.
  • Working experience in Visual Studio, PowerShell Scripting, and ARM templates.
  • Azure certifications (AZ-900, AZ-200, and 201), Databricks certification, DevOps certifications
  • What we offer you

    Come for the distinctive experiences you have helping forward-thinking corporations, non-profits, and governments push the boundaries of digital innovation. Stay for the limitless learning opportunities that encourage you to master Microsoft and pursue big ideas. Enjoy ambitious growth for yourself as part of Avanade's people-first culture with benefits like employee share purchasing, flexible work arrangements, a commitment to diversity and inclusion, and competitive pay.

    Buat amaran kerja untuk carian ini

    Data Engineer • Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

    Pekerjaan berkaitan
    Lead Engineer

    Lead Engineer

    Soft Space Sdn Bhd • Seremban, Negeri Sembilan, Malaysia
    We are seeking a technically strong leader based in Malaysia to head our North America region projects.The Lead Engineer will take ownership of regional delivery, technical solutioning, and team le...Tunjukkan lagi
    Kemas kini terakhir: 19 hari yang lalu • Dinaikkan pangkat
    WD30192620 Senior Financial Analyst

    WD30192620 Senior Financial Analyst

    half the sky • Klang, Selangor, Malaysia
    Assist and backup Finance controller.Responsibilities include consolidations, annual planning and monthly P&L, free cash flow forecasts / outlook as well as financial reporting (closing task).Work wi...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu • Dinaikkan pangkat
    Data Engineer

    Data Engineer

    2COMS Consulting Pvt Ltd • Puchong, Selangor, Malaysia
    Quick Apply
    Candidates should be based in Malaysia.What is this role all about? What does the applicant have to do?).Develop and maintain data models (customer 360, product, network, usage).Work with data lake...Tunjukkan lagi
    Kemas kini terakhir: 1 hari yang lalu
    Lead / Senior Data Engineer

    Lead / Senior Data Engineer

    Capcon Asia • Kuala Lumpur, Malaysia
    Quick Apply
    Regulated and trusted by financial institutions globally.Pioneers in mobile point-of-sale (mPOS) solutions focusing on low-cost acceptance payment. Secured US$30M Series B funding.Rapid growth : scal...Tunjukkan lagi
    Kemas kini terakhir: 22 hari yang lalu
    Senior Data Engineer

    Senior Data Engineer

    ZALORA SOUTH EAST ASIA PTE LTD • Kuala Lumpur, Kuala Lumpur, MY
    Quick Apply
    ZALORA Group is looking for a Senior Data Engineer to join its Data Science Team.As a Senior Data Engineer, you will : Work daily with machine learning problems.For this purpose, y...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu
    Senior Sales Engineer

    Senior Sales Engineer

    Sophos • Seremban, Negeri Sembilan, Malaysia
    Sophos is a global leader and innovator of advanced security solutions designed to defeat cyberattacks.The company acquired Secureworks in February 2025, creating the largest pure‑play Managed Dete...Tunjukkan lagi
    Kemas kini terakhir: 8 hari yang lalu • Dinaikkan pangkat
    Senior / Staff / Principal Engineer

    Senior / Staff / Principal Engineer

    Canonical • Sepang, Selangor, Malaysia
    Canonical Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Join or sign in to find your next job.Senior / Staff / Principal Engineer. Canonical Kuala Lumpur, Federal Territory of Kuala Lumpur, ...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu • Dinaikkan pangkat
    Data & Finance Support Engineer

    Data & Finance Support Engineer

    Sperton Global AS • Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
    Provide application support to various business users.Attend to business queries and business requests promptly.Follow through the business requests to a proper closure. Work on timely resolution fo...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu • Dinaikkan pangkat
    Data Engineer

    Data Engineer

    Link Compliance • Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
    My client is one of the leading digital banks in Malaysia.Design, develop, and maintain reliable and scalable data pipelines using Apache Airflow. Implement data ingestion, transformation, and valid...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu • Dinaikkan pangkat
    Senior Web Engineer

    Senior Web Engineer

    Canonical • Nilai, Negeri Sembilan, Malaysia
    Canonical Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Join or sign in to find your next job.Canonical Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.Be among the first 25 a...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu • Dinaikkan pangkat
    65097 Data Architect

    65097 Data Architect

    half the sky • Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
    Responsible for data lake design and providing technical direction to data engineer, data analysts, data integration developers and database administrators. Provide input, monitor, and coordinate th...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu • Dinaikkan pangkat
    Associate Director

    Associate Director

    Newbridge • Kuala Selangor, Selangor, Malaysia
    Oversee the accuracy and timeliness of financial reports and forecasts, ensuring alignment with business objectives.Identify trends, analyze variances, and develop improvement plans to optimize fin...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu • Dinaikkan pangkat
    Global Market Data & Trade Support Engineer

    Global Market Data & Trade Support Engineer

    Sperton Global AS • Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
    Work within the Bank System support team to provide proactive, timely, effective and efficient support to the application. Supporting during business hours and 24x7 on-call support.Provide Level 2 s...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu • Dinaikkan pangkat
    64308 Machine Learning Engineer

    64308 Machine Learning Engineer

    half the sky • Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
    As ML Engineer, you will be part of team to develop analytics solutions based on machine learning & statistical predictive algorithms for clients of Data & AI. We are looking for experienced machine...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu • Dinaikkan pangkat
    IT ADMINISTRATOR

    IT ADMINISTRATOR

    Iswanah Resources Sdn Bhd • Batu Caves, Selangor, Malaysia
    Diploma in Computer Science, Information Technology or a related field.IT Admininstrator, Network Administrator or similar role. Strong Understanding of TCP / IP, DNS, DHCP, VPN, Firewalls, and routin...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu • Dinaikkan pangkat
    Regional Data & Analytics Head

    Regional Data & Analytics Head

    SCIENTE • Kuala Lumpur, Kuala Lumpur, Malaysia
    Director - Global Talent Acquisition (Services & Projects).Lead the regional Data & AI strategy, governance, and delivery to drive innovation, compliance, and measurable business impact.Define and ...Tunjukkan lagi
    Kemas kini terakhir: 8 hari yang lalu • Dinaikkan pangkat
    64995 Data Modeler

    64995 Data Modeler

    half the sky • Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
    Avanade is the leading provider of innovative digital, cloud and advisory services, industry solutions and design-led experiences across the Microsoft ecosystem. Every day, our 59,000 professionals ...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu • Dinaikkan pangkat
    QAQC and Research Development Manager

    QAQC and Research Development Manager

    Sperton Global AS • Seremban, Negeri Sembilan, Malaysia
    Ensure food manufacturing process (UHT / Pasteurised / Retort) for DAIRY / MILK product is safe by monitoring and controlling the production process from raw ingredient intake until packaging of finished...Tunjukkan lagi
    Kemas kini terakhir: 30+ hari yang lalu • Dinaikkan pangkat