About

Amal G Jose is an Architect with a strong focus on the design and development of scalable systems that can handle large sized data. Amal has more than 13 years of experience in data technologies, Unix administration, Python, Docker, Kubernetes, DevOps, Cloud Technologies, Data Center Engineering & Industrial Internet of Things, also keenly interested in learning new technologies.  He is currently working as a Big Data, Cloud and Industrial IoT Architect. Amal likes to share his knowledge through his blog, Stack Overflow, Google groups, LinkedIn groups, mailers list where he is contributors in cutting edge Technologies. Amal also likes Electrical, Electronics and Mechanical related technologies.

Amal was one of the key members of a successful startup which is recently acquired by a Fortune 500 company. In his startup journey, he has worked in all areas of software consulting and product development. The startup experience gave a big boost to his knowledge in all areas. He has done the complete networking of their office space which has a seating capacity of 600 people and also build a data center that is hosting critical workloads. This makes his portfolio a rare blend of hardware and software technologies.

Amal has architected and deeply involved in the design and development of several large software products. Those applications are still in production serving large workloads.

Some of his key projects are listed below.

One of the largest IoT platform that collects environment data from all the industries across a country was architected and implemented by Amal. It is currently handling the data from 30000+ monitoring stations in around 3000+ industries across the country with a historic storage of around 15 years. The data from several thousands of sensors are collected every minute and the insights are generated at real-time. The system is perfectly running without any performance issues.

An IoT based smart ticketing system where the events from several thousand machines were collected and analyzed to automatically create tickets within few seconds. This was a modernization project where the platform was already developed by some other team and resulted in a disaster due to scalability issues. Amal has redesigned the product with a new set of technologies and developed it without changing the user experience and deployed in production within a short period of 4 months. The performance improvement was drastic and the app was able to handle the full load with historic data and live data. Also the footprint of the application reduced to almost 1/20th. The old system was using a large cluster of machines that totals around 2400 GB of RAM and several CPUs. The new system is running with a low foot print of about 120 GB RAM. The new system is able to handle the complete load and can accommodate the future load without any manual housekeeping activity. The data gets moved from hot tier to the cold tiers based on its age and it ensures best performance & reduces the running cost. The modernized system is in production since 2020 and it is running without any issues.

An online platform for managing Extended Producer Responsibility for Plastic Waste. This was a challenging project due to various factors. Despite of all the challenges, the project was successfully delivered within a short period of time accommodating 15000+ industries across the country. The platform was designed using scalable technologies that can be scaled horizontally to accommodate any number of users. A digital currency system was created internally for the secure transaction of EPR credits between the parties. The crypto currency was designed with complete traceability so that every transaction in its lifetime can be tracked at any point of time.

Apart from this, Amal has experience in conducting professional trainings. Amal has trained several 1000s of professionals across the globe in the areas of data and cloud technologies.

Apart from technology side, his hobbies include exploring places, cycling, trekking, long drives, music etc.

This is a blog to share his experience and also to keep notes for future reference. Most of the posts are very simple. All these tips are based on his experience. Hope this will help someone struggling with similar problems. If you have any questions or feedback, feel free to comment below the post. 

I do this in my “free-time”, not as a representative of any company or my employer. All views and opinions expressed are my own. – Amal G Jose