Talent.com
Tawaran kerja ini tidak tersedia di negara anda.
69028 Data Engineer (ADF & Databricks)

69028 Data Engineer (ADF & Databricks)

half the skyKuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
30+ hari lalu
Penerangan pekerjaan

About Avanade

Avanade is the leading provider of innovative digital, cloud and advisory services, industry solutions and design-led experiences across the Microsoft ecosystem. Every day, our 59,000 professionals in 26 countries make a genuine human impact for our clients, their employees and their customers.

We have been recognized as Microsofts Global SI Partner of the Year more than any other company. With the most Microsoft certifications (60,000+) and 18 (out of 18) Gold-level Microsoft competencies, we are uniquely positioned to help businesses grow and solve their toughest challenges.

We are a people first company, committed to providing an inclusive workplace where employees feel comfortable being their authentic selves. As a responsible business, we are building a sustainable world and helping people from underrepresented communities fulfil their potential.

Majority owned by Accenture, Avanade was founded in 2000 by Accenture LLP and Microsoft Corporation. Learn more at www.avanade.com .

As a Data Engineer , you will support the implementation of projects focused on collecting, aggregating, storing, reconciling, and making data accessible from disparate sources to enable analysis and decision making. This role will also play a critical part in the data supply chain, by ensuring stakeholders can access and manipulate data for routine and ad hoc analysis. Additionally, you will support the full lifecycle of data from ingesting through analytics to action.

Key Role Responsibilities :

Day-to-day you will :

  • Translate business requirements to technical solutions leveraging strong business acumen
  • Analyze current business practices, processes and procedures as well as identifying future business opportunities for leveraging Microsoft Azure Data & Analytics PaaS Services
  • Support the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments.
  • Deliver of architectures for transformations and modernizations of enterprise data solutions using Azure cloud data technologies.
  • Design and Build Modern Data Pipelines and Data Streams.
  • Design and Build Data Service APIs.
  • Develop and maintain data warehouse schematics, layouts, architectures and relational / non-relational databases for data access and Advanced Analytics.
  • Expose data to end users using PowerBI, Azure API Apps or any other modern visualization platform or experience
  • Implement effective metrics and monitoring processes.

Skill & Capability Requirements :

  • Around 5 years of working experience as a Data Engineer
  • Demonstrated experience in turning business use cases and requirements into technical solutions
  • Experience in business processing mapping of data and analytics solutions.
  • Ability to conduct data profiling, cataloging and mapping for technical design and construction of technical data flows
  • The ability to apply such methods to solve business problems using one or more Azure Data and Analytics services in combination with building data pipelines, data streams, and system integration.
  • Ability to leverage a variety of programming languages & data crawling / processing tools to ensure data reliability, quality & efficiency
  • Experienced in Cloud Data Transformation using ETL / ELT tools such as Azure Data Factory, Databricks
  • Experienced in Dev-Ops processes (including CI / CD) and Infrastructure as code fundamentals.
  • Experienced in Data Governance tools like Unity Catalog / Purview, Master Data Management (MDM) and Data Quality tools and processes
  • Knowledge of business intelligence tools such as Power BI, Tableau, Qlik, Cognos TM1
  • Knowledge of Azure Data Lake, Azure SQL DW, and Azure SQL, Azure App Service is required. Azure IoT, Azure HDInsight + Spark, Azure Cosmos DB & Azure Stream Analytics are a plus.
  • Knowledge in data modeling and database management, such as performance tuning of the Enterprise Data Warehouse, Data Mart, and Business Intelligence Reporting environments, and support the integration of those systems with other applications
  • Knowledge of Python is a plus.
  • Experience preparing data for Data Science and Machine Learning.
  • Experience preparing data for use in Azure Machine Learning / Azure Databricks is a plus.
  • Experience preparing data and building data pipelines for AI Use Cases (text, voice, image, etc).
  • Designing and building Data Pipelines using streams of IoT data.
  • Knowledge of Lambda and Kappa architecture patterns.
  • Strong team collaboration and experience working with remote teams.
  • Working experience in Visual Studio, PowerShell Scripting, and ARM templates.
  • Azure certifications (AZ-900, AZ-200, and 201), Databricks certification, DevOps certifications
  • What we offer you

    Come for the distinctive experiences you have helping forward-thinking corporations, non-profits, and governments push the boundaries of digital innovation. Stay for the limitless learning opportunities that encourage you to master Microsoft and pursue big ideas. Enjoy ambitious growth for yourself as part of Avanade's people-first culture with benefits like employee share purchasing, flexible work arrangements, a commitment to diversity and inclusion, and competitive pay.

    Buat amaran kerja untuk carian ini

    Data Engineer • Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

    Pekerjaan yang berkaitan
    Data Engineer

    Data Engineer

    Two95 International Inc.Kuala Lumpur, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    Hiring Local Malaysians only - CONTRACT JOB - 12 MONTHS (EXTENDABLE).DATA ENGINEER - IT with Extensive experience in "Healthcare ". With Minimum Experience - 3 years & Maximun Experience - 15 ye...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
    • Dinaikkan pangkat
    • Baharu!
    Data Engineer

    Data Engineer

    Bjak Sdn BhdKuala Lumpur, Kuala Lumpur, Malaysia
    Transform Language Models into Real-World Applications.We're building AI systems for a global audience.We are living in an era of AI transition - this new project team will be focusing on building ...Tunjukkan lagiKemas kini terakhir: 16 jam yang lalu
    Data Engineer - Snowflake

    Data Engineer - Snowflake

    Oxydata SoftwareKuala Lumpur, Malaysia
    Quick Apply
    Greater Kuala Lumpur, Malaysia.Our client is a global leader in sustainable building materials, generating multi-billion annual revenue with operations in over 40 countries and a workforce exc...Tunjukkan lagiKemas kini terakhir: 29 hari yang lalu
    • Dinaikkan pangkat
    Data Engineer, Ikano Retail

    Data Engineer, Ikano Retail

    IKEAPetaling Jaya, Selangor, Malaysia
    The IKEA vision is to create a better everyday life for the many people.We do this by offering a wide range of well-designed, functional home furnishing products at prices so low that as many peopl...Tunjukkan lagiKemas kini terakhir: 29 hari yang lalu
    Senior Data Engineer

    Senior Data Engineer

    ZALORA SOUTH EAST ASIA PTE LTDKuala Lumpur, Kuala Lumpur, MY
    Quick Apply
    ZALORA Group is looking for a Senior Data Engineer to join its Data Science Team.As a Senior Data Engineer, you will : Work daily with machine learning problems.For this purpose, y...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
    • Dinaikkan pangkat
    Data Engineer

    Data Engineer

    Link ComplianceKuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
    My client is one of the leading digital banks in Malaysia.Design, develop, and maintain reliable and scalable data pipelines using Apache Airflow. Implement data ingestion, transformation, and valid...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
    • Dinaikkan pangkat
    • Baharu!
    Data Engineer

    Data Engineer

    Michael PageKuala Lumpur, Kuala Lumpur, Malaysia
    Superb benefits and career growth opportunities.This opportunity is with a large organization in the financial services industry, known for leveraging technology to deliver innovative solutions.Dev...Tunjukkan lagiKemas kini terakhir: 16 jam yang lalu
    • Dinaikkan pangkat
    Data Engineer

    Data Engineer

    LPSKuala Lumpur, Kuala Lumpur, Malaysia
    LPS Wilayah Persekutuan Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia.LPS is a leading E2E solution provider dedicated to unlocking IT systems across regions. This role offers an excitin...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
    • Dinaikkan pangkat
    Senior Data Engineer

    Senior Data Engineer

    QuantexaKuala Lumpur, Kuala Lumpur, Malaysia
    Add expected salary to your profile for insights.It isn’t often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can.Our tech...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
    Lead Data Engineer

    Lead Data Engineer

    QuantexaKuala Lumpur, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    It isn’t often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle ser...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
    Senior / Mid Data Engineer (ZALORA)

    Senior / Mid Data Engineer (ZALORA)

    GLOBAL FASHION GROUP SGP SERVICES PTE LTD.Kuala Lumpur, Kuala Lumpur, MY
    Quick Apply
    ZALORA Group is looking for a Senior Data Engineer to join its Data Science Team.As a Senior Data Engineer, you will : Work daily with machine learning problems.For this purpose, y...Tunjukkan lagiKemas kini terakhir: 29 hari yang lalu
    • Dinaikkan pangkat
    warehouse executive

    warehouse executive

    DP SISTER LOVE SDN BHDSungai Buloh, Selangor, Malaysia
    Required to assist customers with ladies' garments.Taking inventory of goods in stock.Education : STM / STPM (Preferred). Location : Sungai Buloh (Required).Experience Required : Min 0 Year / s.Tunjukkan lagiKemas kini terakhir: 15 hari yang lalu
    Data Engineer ( Spark & Hive)

    Data Engineer ( Spark & Hive)

    Unison GroupKuala Lumpur, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    The ideal candidate will have strong expertise in.You will work closely with data scientists, analysts, and business stakeholders to deliver high-quality data solutions that support business decisi...Tunjukkan lagiKemas kini terakhir: 17 hari yang lalu
    • Dinaikkan pangkat
    • Baharu!
    Data Engineer - Snowflake

    Data Engineer - Snowflake

    CollaberaShah Alam, Selangor, Malaysia
    Manage and monitor the performance of the Modern Data Stack (MDS).Troubleshoot any issues or discrepancies within the data infrastructure. Develop and enforce robust security protocols to protect se...Tunjukkan lagiKemas kini terakhir: 16 jam yang lalu
    • Dinaikkan pangkat
    Data Engineer

    Data Engineer

    BusinesslistKuala Lumpur, Kuala Lumpur, Malaysia
    Develop, test, and maintain scalable data pipelines to support analytics and business intelligence needs.Collaborate with cross-functional teams to gather and analyze requirements for data integrat...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
    Hiring for Data Engineer / Data Scientist

    Hiring for Data Engineer / Data Scientist

    Two95 International Inc.Kuala Lumpur, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    Drive the full lifecycle of Data Science projects : from gathering and understanding the end-user needs to implement a fully automated solution. Develop and provision of Data pipelines to enable self...Tunjukkan lagiKemas kini terakhir: 30+ hari yang lalu
    Data Engineer (Spark, SQL)

    Data Engineer (Spark, SQL)

    Unison GroupKuala Lumpur, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    We are looking for a proficient Data Engineer with strong skills in Spark and SQL to join Unison Group.The successful candidate will be responsible for designing, building, and managing data pipeli...Tunjukkan lagiKemas kini terakhir: 17 hari yang lalu
    Data Engineer (SQL, Python, Spark, Hive, Hadoop)

    Data Engineer (SQL, Python, Spark, Hive, Hadoop)

    Unison GroupKuala Lumpur, Federal Territory of Kuala Lumpur, MY
    Quick Apply
    The ideal candidate will have strong expertise in.SQL, Python, Apache Spark, Hive, and Hadoop.Design, develop, and maintain scalable. Develop automation scripts and data processing workflows using.W...Tunjukkan lagiKemas kini terakhir: 17 hari yang lalu