The project
Overview
A platform for naturally controlling all the devices around you.
Inspired by the original
Iron Man movie
Description
In this experimental project, I explored how I would build a
personal assistant similar to that of Tony Stark in the movie. I
aimed for it to be very customisable and be able to control
pretty much any device you would like. The project was built in
C# and through Mono it could be run on Windows, Linux, and macOS
— in the cloud, at home, or on a device.
It featured a plug-in-based system with core features added by
default. Vision, speech synthesis and recognition, intent
recognition, natural language parsing, storage as well as
identity management. The plug-in system featured a built-in
auto-update service
Unattended
to enable developers to automatically update their plug-ins
wherever they are installed.
A plug-in registered itself with the core system and provided
various "triggers" called intents that the system should pass to
them. A coffee machine, for example, would register the intent
"make coffee" and the system would initiate the plug-in for
phrases such as "make me a cup of coffee".
The intent recognition engine was fairly basic, but a lot could
be achieved with it. Unfortunately, the demo site is no longer
available, please see the video below to understand the
capabilities of the first version.
