The HxGN MineProtect Operator Alertness System (OAS) is a leading-edge solution that combines an in-cab device, sensor technology, machine-learning image processing, and advanced algorithms developed by Hexagon to detect and manage risks of operator fatigue and distraction, one of the leading causes of mine accidents. The solution also offers timely interventions and supports continuous operational improvement by connecting onboard technologies with a cloud service for real-time notifications and data analytics.
Mining Magazine gained more insights on the winning entry from Sean Perry, Senior Vice President, Material Movement, Hexagon Mining division.
How accurately can the system detect fatigue and distraction in various real-world mining scenarios (e.g., different lighting conditions, noise levels)?
There is a very high level of performance and accuracy of Hexagon's OAS in real-world mining scenarios in both surface and underground environments.
How effective is the system at minimising false detections of fatigue or distraction, which could disrupt operations?
False positives are minimised through machine learning and advanced algorithms that are uniquely able to differentiate types of head movements and eye closure to discern actual fatigue events - for example, proven capability to distinguish a look-down from a microsleep.
Can the system be customised to different operator profiles and types of mining equipment?
OAS is the market leader in operator profiling: Whilst face recognition is a convenient method, it is not one that is acceptable in some countries and cultures, so we utilise our own fleet systems and any competitor system to automatically identify operator ID and assign profiles accordingly. Such profiles allow us to address the uniqueness of a person's face as well as other factors, such as facial hair or prescription glasses.
About 95% of our OAS systems are installed in haulage equipment; we have customised brackets and configurations to fit all OEM manufacturers.
How is operator data collected, stored, and accessed, and what safeguards are in place to protect privacy?
The system does not stream video, record sound, or directly report events to supervisors or management without validation. Only when a fatigue or distraction event occurs does someone review the footage, minutes later, and each "event" recorded is only about 10 seconds. The system overwrites video approximately every 10 days on board the computers based on resolution settings. Individual events are stored on a server only for as long as determined by the customer. We work with companies to address their individual privacy concerns. Some of our customers allow data to be captured, stored and reviewed only on site, whilst others prefer cloud-based solutions utilising our global network of remote monitoring centres.
How does the system integrate with existing mine automation and safety systems?
Our OAS utilises both an operator-facing and forward-facing camera, and our class-leading collision avoidance system (CAS) works with OAS to provide video when critical collision events occur, allowing mines to verify the accuracy and criticality of CAS as well as the circumstances leading up to the incident. Just as with most vehicle accidents on public roadways, collisions and near misses at mining operations often occur because the operator was distracted or fatigued.
How does the system prevent operators from becoming desensitized to fatigue and distraction alerts?
The computer vision algorithm within OAS leverages machine learning to reduce false alarms, and when the operator is alerted, it's in real time and through an audible and haptic alert. In addition, training and onboarding for OAS includes support to operators to help them better understand the serious effects of fatigue and distraction.
What is the best approach to operator training on fatigue management and safe practices?
Hexagon provides partnership to our clients to support them in simple but meaningful onboarding and change management when adopting our solutions. Operators need a chance to ask questions and have concerns assuaged as well as gain a clear understanding of the effects of lapsed vigilance/situational awareness, and it is obviously essential to be very clear with operators about the seriousness of the risks. For example, research has shown that operating with severe fatigue is equivalent to operating with a blood alcohol content of .08.
Training on OAS is simple and straightforward, and operators are provided with a view to what fatigue detection looks like in the "eyes" of the algorithm, so that they understand what it is and isn't monitoring—and can see just how quickly risks can manifest. They are also given insight into the policies and procedures for their operations, aligning with the idea that fatigue is a natural occurrence and should be addressed non-punitively.
Can you quantify the potential cost savings and safety improvements the system can offer to mining operations?
Hexagon does not put a value on someone's life. We are about sending all people home safe and well each day: This is sustainable mining.
What are the future plans for the system's development, including new features or functionalities?
Hexagon continues its Power of One strategy to combine our sensors and data into a single ecosystem. We are the only provider of technology for all stages of mining, with class-leading solutions from mine planning, fleet management, and safety through to autonomous operations.
How does the HxGN MineProtect Operator Alertness System compare to other similar solutions in the market?
Hexagon's OAS is the market leader in built-for-purpose, ruggedised, in-cab operator fatigue and distraction systems in the mining industry, offering an end-to-end solution for haul trucks and light vehicles in both surface and underground operations. We have won multiple head-to-head comparisons with our competitors. With six remote monitoring centres in four different time zones supporting more than 50 OAS mining operations alone, Hexagon is the global leader in operational safety.
