Experimental AI chessboard with computer vision

If you are interested in the project you can go to 4makers.org

This is a classic wooden chessboard with 3D-printed pieces. We also have a version with built-in magnets that hold the pieces on the board, which can be especially useful when traveling. The chessboard also includes a stand for a mobile phone. The phone is placed above the chessboard and uses computer vision to detect the moves made.

The recorded moves are then converted to FEN format and sent to the Stockfish chess engine, which suggests the best possible move for the opponent. The suggested move is communicated to the player by voice using the Web Speech API for text-to-speech and speech-to-text. The player can also communicate with their opponent, who can also be a teacher or partner. The project integrates generative artificial intelligence, currently offering the option to use AI from Anthropic (Claude) or Google (Gemini) for interactive communication. In addition, it is possible to set the character of your opponent.

The entire chess game can also be controlled using only voice without computer vision, which allows you to play on your own chessboard. The project also offers the option to integrate your own TensorFlow model for recognizing chess pieces, which enables computer vision functionality on your chessboard. By combining traditional gameplay with modern technologies such as generative AI, computer vision, APIs (Stockfish, Anthropic Claude AI, Google Gemini AI), and speech-to-text conversion, we aim to demonstrate how these technologies can be practically applied.

Our goal is to showcase, in an engaging way, how these technologies can be practically used, not only for children and students but also for adults who are interested in technology. You can play chess against the computer, and if you are interested in these technologies, you can learn how the individual components work and how to use them in your own projects.

This project is for anyone who is interested in modern technology. If you want to explore the potential of artificial intelligence, computer vision, and other innovations, or just have a bit of fun, this project is for you.

If you are interested in the project you can go to 4makers.org

Everything is available for free. You can also see there video about the project. It is available in multiple languages. After your registration you will be able to download required files to print the chessboard pieces and all the other components. Anyway you can test the capabilities also without the computer vision and only communicate with the web app with your voice.

Have a great fun. I will be happy to see your comments and experiences.