Get a Free Quote

Intelligent Video Analysis System for Personalized Home Automation

The client, a UK-based smart home startup, envisioned an intelligent system that would rely on advanced video analysis to track and recognize users as they move around the house. It would also monitor user activity and daily habits to learn their preferences. Based on that information, the system would respond with personalized settings, sending commands to smart lights, home entertainment systems, climate control devices and other smart electronics.

The client, a UK-based smart home startup, envisioned an intelligent system that would rely on advanced video analysis to track and recognize users as they move around the house. It would also monitor user activity and daily habits to learn their preferences. Based on that information, the system would respond with personalized settings, sending commands to smart lights, home entertainment systems, climate control devices and other smart electronics.
Technologies & tools
C++, Lua, Objective-C, Bluetooth Low Energy, Modbus, Arduino, Raspberry Pi
Project team
2 iOS developers, 2 C++ developers, 1 PM, 1 system architect

Solution

To get funding for further development of the project, the client needed an MVP of the user recognition system, as well as tablet and mobile demo apps that would showcase smart home functionality. In line with the product design concept, the solution was planned to be marketed as a premium light fixture. It would take advantage of built-in professional video cameras to get a granular image and precision with video object detection from as far from an object as a 12-meter distance. The R-Style Lab team elaborated and designed the solution architecture, and employed its embedded system engineering skills to develop both hardware and software parts of the home automation MVP. To achieve the results that would meet the client's requirements and expectations, we created:

  • customized Arduino and drivers for camera mounts repositioning. A motor controller on camera mount chassis gets commands to enable 360-degree rotation and tilt of the professional HD Sony cameras within the light fixture and to ensure that a user is always in a camera focus.
  • image acquisition library. In order to achieve efficient image processing at the CPU capacity, the team selected a custom library over OpenCV, which would otherwise use up more resources and result in noticeably slower performance.
  • integration with proprietary image recognition library. The obtained image data is fed into the library, which returns an image recognition level-of-confidence score.
  • customized Raspberry Pi with motion detectors. To get accurate user presence detection, motion-triggered camera position management and eventually efficient image recognition, R-Style Lab evaluated several motion sensor options. Doppler radar and PIR sensors imposed some serious constraints for motion sensing and motion direction detection. Their performance was hindered either by unacceptably slow response rates or low noise reduction ability. The final choice to complete the task was made in favor of video camera sensors and Raspberry Pi.
  • Bluetooth Low Energy communication. Using BLE protocol we provided for communication in a low power mode for users' mobile phones and smart home devices that made part of the client's home automation solution.

Having successfully implemented the user recognition component of the system that underlay the client's idea of full-blown automation with no human assistance, they needed to demonstrate the potential of the solution-to-be. Our team created for this purpose some of the planned automation features.

Demo Smart Home Functionality:

  • integration with Milight and a TV set - interfaced via the controller API and a COM port, lights and TV program settings adjusted for each user that was tracked in the home automation solution as they entered a room;
  • voice control - allowed users to take incoming calls in a hands-free mode via in-home smart speakers;
  • call roaming via smart speakers - the challenge of this task was that Bluetooth did not support roaming. There was no way to transfer mobile-to-smart-speaker connection from one speaker to another as a user moved around the house. Eventually, audio packets were routed via PoE adapter or Ethernet connection, and audio streaming flowed from speaker to speaker as the video-enabled object recognition system followed a user from room to room.

The MVP has been successfully released. The client is planning to expand its functionality into a fully fledged smart home automation solution as he completes the next investment round.

Do You Have Your Own Project to Discuss?
We are Here to Help You!

Testimonials

Marc Zirka, CEO
Telcovision Group
"Working with R-Style is a pure example of software development outsourcing. It was a great pleasure working with a competent and flexible team, where the focus is on the quality and the timeliness of the deliverables. R-Style developed for us the backend for FROGO our new Dating Mobile Application where the outcome was more than satisfactory. Moreover, R-Style team and leadership were providing us at all times their support and were available to answer any questions we had. Working with them gave us a great level of comfort and trust"  
Hunter Jensen, CEO
Barefoot Solutions, Inc.
"Having worked with a lot of USA and non US-based development teams, R-Style Lab software development company is hands down the best I've seen. They have a high level of professionalism, excellent communication skills, thorough quality assurance practices, and superb technical expertise. I have been very satisfied with the quality of the software products that they have delivered, and everything has been delivered on time, on budget, and to spec."
Bolatbek Ospanov, Founder, CBDO
Smart Satu
"The success of any startup depends on its solid team and their commitment. We’ve found the perfect level of commitment with R-Style Lab. Besides stellar technical expertise, they have this striking passion for technology which enables them to think outside the box. R-Style Lab has developed a comprehensive business platform for us to facilitate cooperation between suppliers and their clients. This project has won startups competition in Kazakhstan which was organized by a Swiss company Seedstars World and will compete for a 1 mln dollar prize in the World Competition. The smartsatu.kz system is already popular not only in Kazakhstan, but in Kirgizstan and Bulgaria as well."  
Sergey Kiruschin, Head of IT department
Aeroflot
“Work of R-Style Lab's specialists is a classic example of successful IT-outsourcing. We’ve been fully satisfied with the professional level of the work done.”  
Anton Karzhavin, Project Manager
Rive Gauche, perfume and cosmetics chain
“R-Style Lab solution allowed us to improve the quality of communication in the company. After the project completion, we have managed to reduce the costs for long-distance communication by 10%. I’d like to thank R-Style Lab team for the professional and flexible approach to the project implementation”  
Mark Valentini, CIO of “Red Square” Ltd.
Eurovision, Song Contest 2009 in Moscow
“The project on the deployment of “Eurovision-2009” IT-infrastructure has been undoubtedly large-scale and labour-intensive. Its realization demanded for engaging a huge part of the company’s resources in a very limited time. Moreover, the project required for maximum focus as well as consolidation of all the company’s potentials. R-Style Lab specialists have fulfilled the task assigned to the full extent of their power. All the works were completed on a very high professional level.”  
Alexander Arikainen, Administrative Director
Dentsu-Smart
“Reorganization of the company’s IT-infrastructure has allowed for improving customer service, optimizing employees’ work and structuring data processing. In the result of the project implementation, we’ve got a single point of managing access rights, servers, users, printing, applications, e-mails and other resources at all the Dentsu-Smart subsidiaries. Besides, R-Style Lab specialists have developed a fault-tolerant and easy-scalable system.”  
Andrey Golovchanov, Project Manager at Uhrenholt
Uhrenholt
“The implemented project allowed for improving the security level of the information system, made it more reliable and failsafe, increased its flexibility and scalability as well as reduced costs for administration. According to our estimates, the R-Style Lab's delivered project let us lower the operational costs by almost 2 times.”  

Other Related Projects

Get a Free Quote

Initial response in 12 business hours



Name shouldn't be empty

Email shouldn't be empty


Field shouldn't be empty

By sending this message you agree to our Privacy Policy