Jetson Conversational Pod

What problem are you going to solve?

My conversational pod uses the Jetson to model a GenAI algorithm to enable voice conversation with a person at home.

What are you going to build to solve this problem? How is it different from existing solutions? Why is it useful?

My conversational pod is able to connect to existing smart devices in a home, for instance, a weight scale, collect all sensor data into a "home database" and use it to start a conversation with a person at home, for instance, to provide useful insights about health, for instance, to provide useful insight about power utilization all while having a human-like conversation. The key difference of my solution is that it is an open hardware and open-source code solution this means its owner can define where he/she wants to store their personal data, collected from all smart devices while at the same time making it compatible with all other open solutions, for instance, home assistant, and also commercially available solutions such as Apple Home & Google Home.

How does your solution work? What are the main features? Please specify how will you use Nvidia’s Jetson Developer Kit in your solution.

My Jetson SoC will be connected to custom hardware electronics I'll be prototyping myself that has audio and microphone capabilities to actively listen to a person's voice and do voice conversation. At the same time has onboard wireless capabilities (WIFI, Bluetooth BLE) and is able to connect to existing smart devices such as smartwatches; weight scales; power outlets, power meters, HVAC systems, smart refrigerators, etc.

Finally, the hardware electronics to be prototyped will be made to fit an existing, Bluetooth speaker sold on AliExpress for good external looks.

The main feature of my conversational pod is the ability to initiate a human-like conversation while at the same time using personal and even intimate data, for instance, health data, to provide useful insights during a conversation. It has mood and emotional capabilities, for instance, to detect stress. For instance, detect a person crying…. etc.

I’ll be using Nvidia’s developer kit to write the GenAI model and also all the necessary code to make the hardware work as a conversational pod. Finally, this project will be hosted on a public repository on GitHub for anyone to download and use.

The Jetson Pod

The pod for my NVidia AI challenge the "Jetson Pod" arrived today....Great sound ! (find it on AliExpress). Still, I'll be disassembling it... Remove all electronics inside and replace it with my own hardware . Featuring a NVidia Jetson nano system on a module (SoM).

Stay tuned for more!Help me complete this project faster and consider supporting. Links below. Thank you.

one final note about the author

The PCB Design Files I provide on GitHub for anyone to use are free. If you like this Smart Device or use it, please consider buying me a cup of coffee, a slice of pizza or a book to help me study, eat and think to work on new PCB design files.

Make a donation on PayPal and get a TAX refund*.