Improver

Contact Details

E-mails & Phone

Prabhat Diwaker

Prabhat Diwaker

Staff Data Engineer at Walmart | Ex Adobe

Bengaluru, Karnataka

• Strong experience in Big data/Hadoop, Datalake and ETL developments.

• Hands-on experience in developing analytics solutions using Big Data technologies like Hadoop, Hive, Spark, Spark-Streaming, Kafka, Druid, and Presto.

• Experience in developing, optimizing, testing, and monitoring both batch and near real-time ETL applications.

• Designing and Implementation of Google cloud infrastructure (GCP projects, GCS, IAM Policies, Ephemeral Dataproc clusters, BigQuery and Google Analytics).

• Strong understanding of modern-day data lake and lakehouse patterns, architecture, and best practices like Data governance (Collibra), Metadata & Lineage management (Using Erwin and Apache Spline) and Transaction ELTs(using Apache HUDI)

• Strong understanding of the principles of Data Warehousing using Fact, Dimensions, Slowly Changing Dimensions, Star & Snowflake schema modeling.

• Implementing CI/CD process using Git, Jenkins, and Looper and Scheduling workflows using Apache Airflow and CA-Automic.

• Creating Proof-Of-Technology/Concept (PoT& PoC) on emerging technologies in the Big Data landscape.

• Experience in business stakeholder management, requirement gathering, planning, estimation, and other Agile practices.

• Enabling self-serve and reporting solutions for the business using Google BigQuery, Looker, and Tableau.


Experience:

  • Staff Data Engineer (Walmart Global Tech)
  • Big Data Analyst For Apple iTunes Projects (Cognizant Technology Solutions)
  • Software Engineer for Optus telecom Projects (Tech Mahindra)
  • Sr. Software Engineer (Big data) (Walmart Global Tech)
  • Sr. Data Engineer (Big Data Analytics) at Adobe (Adobe)

Skills:

People also viewed these profiles

People also viewed these profiles

Gurvinder Singh

Product and Engineering Executive | Strategy | Digital Transformation | @ San Francisco Bay Area

People also viewed these profiles

Marina Shilman

Strategic Alliances Partnership Manager at Facebook | Ex-Google @ San Francisco Bay Area