Talent.com
This job offer is not available in your country.
BI / Reporting Engineer

BI / Reporting Engineer

Arrow ElectronicsPenangMalaysia, Penang, Malaysia
3 hours ago
Job description

BI / Reporting Engineer at Arrow Electronics

Location : MY-Penang, Malaysia (Jalan Sultan Ahmad Shah)

Employment type : Full-time

Job category : Information Technology

Overview

Join Arrow Electronics as a BI / Reporting Engineer. The role focuses on developing Spark-based data pipelines, performing data extraction, transformation, and loading (ETL), and enabling analytics across Azure Databricks environments.

What You’ll Be Doing

  • Develop Spark applications using PySpark and Spark SQL in Databricks for data extraction, transformation, and aggregation from multiple file formats to analyze and transform data and uncover insights into customer usage patterns.
  • Extract, transform, and load data from source systems to Azure Data Storage services using Azure Data Factory, T-SQL, Spark SQL, and U-SQL Azure Data Lake Analytics. Load data into Azure Data Lake, Azure Storage, Azure SQL, or Azure Synapse Analytics and process it in Azure Databricks.
  • Estimate cluster size, monitor, and troubleshoot Databricks clusters; apply the Spark DataFrame API for data manipulation within Spark sessions.
  • Collaborate with delivery leadership to deliver projects on time, adhering to quality standards; contribute to Azure practice solutioning for prospects.
  • Possess strong problem-solving, interpersonal, and communication skills; act as a self-starter to learn relevant Azure services in the Analytics space.

What We Are Looking For

  • Bachelor’s degree in IT or a relevance field.
  • Minimum 6–8 years of related experience; 6+ years as a developer using Databricks / Spark ecosystems.
  • Hands-on experience with unified data analytics in Databricks, Databricks Workspace UI, managing notebooks, Delta Lake with Python, and Spark SQL.
  • Strong understanding of Spark architecture with Databricks, Structured Streaming; experience configuring Azure Databricks environments and managing clusters; knowledge of the ML lifecycle.
  • Experience in data extraction, transformation, and load (including schemas, corrupt-record handling, parallelized code), and production optimization / automation.

    • Technical Skills

  • Spark DataFrame API
  • Python for Data Science
  • Spark Programming
  • SQL for Data Analysis
  • Data analysis with Python
  • Databricks cluster management and administration
  • ETL and data loading
  • Partitioning, MapReduce concepts
  • Azure Databricks setup
  • Linux command line

    • What’s In It For You

    Competitive compensation and a solid benefits package, including medical and life insurance, performance bonuses, growth opportunities, and a 5-day work week.

  • Medical Insurance
  • Life Insurance
  • Year-end bonus
  • Performance Bonus
  • 5-Day Work Week
  • Growth Opportunities

    • About Arrow

    Arrow Electronics, Inc. (NYSE : ARW) is a Fortune 154 company and one of Fortune Magazine’s Most Admired Companies. Arrow supports innovation for over 220,000 technology manufacturers and service providers, with 2024 sales of USD $27.9 billion. Learn more at

    For more job opportunities, please visit

    Referrals

    Referrals increase your chances of interviewing at Arrow Electronics.

    #J-18808-Ljbffr

    Create a job alert for this search

    Reporting • PenangMalaysia, Penang, Malaysia