Senior Software Developer
As a data engineer I am developing data platform solutions for our company which targets to analyse over one lakh transactions per day (an approximation).
- IFTTT Notification: Developed a notification system for generating alerts for all systemsin organisation. Provided extendable web-hooks to execute an alert action according to user preference by leveraging QueryAdmin.Designed framework to efficiently push notifications using Clevertap tool.
- ETL Pipelines: Designed and implemented pipelines for extraction of data from Postgres, transform data using Pandas Library and load data in Google BigQuery warehouse. Developed the data workflow management tool using of Luigi framework in Python.
- Data Visualization: Created charts and graphs to depict data in QueryAdmin using D3.js library. Design framework to create REST APIs to integrate Data Visualization service with any data platform.
- SAS Migration: Designing migration strategy from SAS platform to data platform by providing an user experience similar to SAS or better. Undertook major design decisions to improve past SAS users experience on new data platform.