Above 12 years of experience with Big Data, machine Learning Algorithms, Internet of Things (IOT)
and Robot Process Automation(RPA) with Cloud experience(Aws & Azure).
Experience in Azure Cloud , Azure Databrics & Azure Data factory
Creating Azure Databricks workspace, ETL operations ,Delta Lake& data pipeline with Azure Databricks.
Worked on both structured and unstructured data.
Experience in Big Data / Data Lake implementations for large clients.
Event and Streaming process using spark streaming and kafka
Has implementation experience AWS, AWS Lambda functioons, AWS S3.
ETL processing using Apache Spark & AWS Glue, AWS Athena
Solid hands-on experience in designing Db & NoSQL Db solutions.
Experience with REST APIs
Good experience scripting languages like Python,Pandas, pyspark, Scala , SQL & Unix Scripting.
Understanding the usage of various data visualizations tools like Tableau, Grafana.
ETL process implementation for various projects using spark for batch & real time data.
Getting data from various systems like RDBMS, Files & messaging systems, apply various transformations & actions to perform data cleansing & analysis and retrieve KPI as per business requirements.