A Windows desktop AI assistant built in Python. Assistant (without tools) is ~1000 lines of python code, with super simple chat UI inspired by the original AI, SmarterChild. Uses Windows COM automation to interface with Microsoft Office (Word, Excel), Images, and your file system. Perfect for Windows users looking to explore AI-powered desktop automation.
Simple-Demo-SK.mp4
- Toggle between voice and text input modes
- Interface with Word, Excel, Images, and your file system (Windows only)
- Cute draggable interface elements
- Windows OS
- Python 3.7+
- OPENAI_API_API key for AI responses
- Microsoft Office (for Word/Excel features)
- Virtual environment (recommended)
- Clone the repository
- Create and activate a virtual environment:
python -m venv venv # On Windows: .venvScriptsactivate # On Unix/MacOS: source venv/bin/activate
- Install dependencies:
pip install tkinter pillow pyaudio httpx python-dotenv
- Create a
.envfile in the root directory with your API keys:# API Keys OPENAI_API_KEY=your_openai_api_key_here # Paths DATALAKE_DIRECTORY=path/to/your/datalake
- Run the application:
- Click the microphone icon to toggle voice input
- Click the message icon to toggle the chat interface
- Drag the robot or chat window to reposition them
- Press ESC to exit the application
smartest_kid.py: Main application and robot animation logicchat_interface.py: Chat UI imple
5 Comments
ExxKA
This is wild! If you want, this could become a great contender to the RPA products out there. I know people who are trying to build AI for RPA, but this seems like a much more solid approach.
Let me know if you are interested in turning this into a startup, happy to direct you to some relevant people.
p_ing
FYI the Office product group considers COM deprecated. The "new" version of Outlook has no COM support, for example. While Word/Excel may be many years off, it's something to consider if you do move this forward.
I would also suggest moving to a compiled binary at some point. Very few Windows users are going to want to figure out Python in any capacity.
abrichr
Thanks for sharing!
There is an open issue in OpenAdapt to implement COM support: https://github.com/OpenAdaptAI/OpenAdapt/issues/873
This could be a valuable reference.
com2kid
This is the type of innovations that AI should be used for. The fact that this type of product wasn't the very first thing Microsoft tried to create is unfortunate.
Microsoft is kinda-sorta pushing for machines that can do AI stuff locally with their copilot branded PCs, but I don't see any evidence that they are willing to go all in on AI powered locally controlled everything with no SaSS model attached.
RebeVC
[dead]