Building a real-time data analysis platform for an industrial data provider

The client needed to develop a new application for analyzing and generating statistics from their data. The primary goal was to give their customers a customizable and interactive method for visualizing data collected from their industrial equipment. The project began with an empty code base and lacked a detailed design, which meant our team was responsible for the full development process from the initial concepts. 

A key technical hurdle was handling the continuous, high-volume flow of real-time data, which updated frequently, sometimes multiple times per second. An initial graphics library selected for the project was not sufficient for this workload, requiring our team to swiftly switch to a new library without disrupting progress. The project also had a tight deadline, demanding a quick and efficient development cycle. 

Our team at Honeycomb Software addressed these challenges by building a robust and flexible real-time data analysis platform. We focused on creating a user-friendly interface that allowed the client’s customers to visualize data and make informed decisions on the spot. The solution was built from the ground up and included: 

• Frontend development: Based on the client’s design deliverables, we developed and implemented a customizable dashboard interface. We created a system where users could add and configure various types of charts and diagrams. The design allowed for complete customization, including the ability to name data sources, assign specific colors, and set data ranges. This provided a way for users to build their own visual representations of the data that was most important to them. 

• An integrated alert system: We implemented a system that automatically notifies users when a data value, such as pressure, crosses a predefined boundary. The alerts would appear in a side-panel modal window and could be resolved or forwarded to another team member. 
• Dashboard management and sharing: The platform included tools for managing dashboards, allowing users to save, edit, and delete their customized views. A key feature was the ability to copy a dashboard’s configuration as a JSON object, making it easy to share with other users at the same industrial site. 
•  A collaborative development approach: We worked closely with a developer from the client’s backend team, who provided the real-time data via websockets. This close partnership, combined with our ability to seamlessly handle technical issues like switching graphics libraries, ensured the project stayed on a fast track and met the client’s business needs. The highly responsive and flexible approach allowed us to adapt as their data models changed, ensuring a proper ingestion of their data stream. 

Honeycomb Software successfully delivered a fully functional, real-time data analysis platform for the client. The project was completed in approximately two months with a two-person team. 

Key outcomes of this partnership include: 

• Enhanced customer empowerment: The client’s customers now have a powerful tool to analyze diverse data streams and make confident, data-driven decisions. 

• Proactive issue detection: The integrated alert system provides immediate notification of potential problems, enabling quick responses and proactive safety measures. 

• Improved collaboration and adaptability: The platform’s ability to share and manage dashboards streamlines teamwork, while its flexible nature ensures it can be customized to suit various operational requirements. 

• Fast and agile execution: The rapid progress of the project and the smooth resolution of technical challenges demonstrated our team’s agility and expertise, which was highly valued by the client. 

The completion of this initial phase has provided the client with a strong base for real-time data analysis. While the immediate development work is finished, there is potential for future development phases.