Big Data Pipelines on Azure

This session will be detailing the architecture options , build hybrid big data pipeline on Microsoft Azure cloud using IaaS and PaaS services. The session will focus on Cortana Intelligence Suite using HDInsight, Data lake named Azure Data Lake Store, Cloud Integration using Azure Data Factory and Data Management Gateway and detail the challenges enterprises face in today’s world in building big data pipelines on Azure, customer use cases, lessons learnt and best practices for successful Azure Big data pipeline implementation

Highly experienced Data architecture professional with a track record of Architecting, Engineering and Managing mission critical, distributed and large scale systems in IaaS, Paas, SaaS in Cloud in Microsoft Azure and on-premise. Strong knowledge in Data Management, Data Architecture, Data Analytics, Data Governance, Data Visualization, Data Integration, Data Quality, Data Synchronization, Data Security other data related paradigms. Exposure to variety of products and software applications in e-commerce, Banking, Supply Chain, Telecommunications and Healthcare. • Deep Experience in building Data and Analytics solutions in Microsoft Azure • Strong Knowledge of BigData Hadoop Architectures, Notification/Event Hubs, Lambda Architecture • Strong knowledge of Cassandra, Couchbase & Hbase NoSQL DBs • Strong knowledge and experience in architecting high performance, high transaction, high revenue OLTP systems, DSS systems and Analytics platform and systems • Strong Experience in Oracle, MS SQL Server, MySQL, RDBMS architectures • Strong knowledge and understanding of streaming, real-time messaging and data replication solutions • Strong, Leadership and Managerial skills • Practical Expertise using UML & IE Notations for Data modeling concepts like 3NF, Star-Schema Modeling, Snowflake Schema Modeling, Fact and Dimension tables, Slow Changing Dimensions, NoSQL KV, Columnar & Document modeling • Experience in handling Regulatory compliance requirements including PCI, DSS etc., • Strong knowledge and Experience in Enterprise Data Governance • Expert level performance tuning knowledge and experience • Work with business analyst and customers for analysis, reverse and re-engineer complex business models and processes. Domain : SaaS Banking, e-Commence, Manufacturing, Supply Chain, Tele Communications, Healthcare, Hospitality Startup • Founded 2 startups namely Avid Technologies & Solutions (2005 - 2014) Ojas Advertising (2013 - 2016)