Seeed Monthly Wrap-up for September 2024: Bringing LLMs into Physical World
By Ellie Cai 3 months agoBoost your knowledge with 10 in-depth tech explorations offering expert insights, 4 weekly livestream recaps, and 9 product and service showcases. Stay updated with 9 highlights on Seeed’s latest news and events, and explore the vibrant open-source community with 8 inspiring projects that showcase the future of innovation.
Hey community,
Welcome to the latest edition of Seeed Monthly for September 2024! This month, we’re diving into bringing LLMs into the physical world.
In this edition, boost your knowledge with 10 in-depth tech explorations offering expert insights, 4 weekly livestream recaps, and 9 product and service showcases. Stay updated with 9 highlights on Seeed’s latest news and events, and explore the vibrant open-source community with 8 inspiring projects that showcase the future of innovation.
📚 I. In-depth Feature & Tech Exploration
01. SenseCAP Watcher: World’s First Physical AI Agent for Smarter Spaces
SenseCAP Watcher is the world’s first physical LLM agent for smarter spaces. It understands voice commands, comprehends scenes, triggers actions, and offers human-like interactions. Utilizing on-device tinyML models, it detects objects and actions. By integrating with LLMs (either on the cloud or deployed locally), it provides deep scene analysis, capturing detailed behaviors and statuses.
SenseCAP Watcher is LIVE on Kickstarter! Click to back us, and help spread the word. Check Out today.
03. Add SenseCAP Watcher to Smart Home
SenseCAP Watcher can understand the scene and perform specific actions based on what’s happening, like turning on a light when someone is reading, dimming the light when someone is sleeping, and interacting in a human-like manner. Watch the video.
04. reComputer Jetson Orin Beginner Guide
Master YOLOv8 from scratch! Our Jetson beginner’s guide has got you covered! Whether you’re a beginner or aiming to develop a product for the industry, this guide is all you need. We cover the contents of:
- Different computer vision tasks;
- Training YOLOv8 models use datasets like Microsoft COCO, Roboflow, or your custom datasets;
- Deploying to Jetson using DeepStream for video analytics pipelines, get benchmarks on Jetson;
- Utilizing the latest Jetson Platform Service (VST) to build an AI NVR.
05. Next-Gen AI Gadgets: Rabbit R1 vs SenseCAP Watcher
Both Rabbit R1 and SenseCAP Watcher are products that tap into advanced LLM technology. We think it is good to have them stand together to take a look. It is not a battle, our intention is just to share some of our insights we have gained in building an AI gadget. Find more details here.
06. Run Ultralytics YOLO Platform Service on NVIDIA Jetson Orin (Supported YOLOV11)
Deploy all Ultralytics YOLO task models on Nvidia Jetson Orin devices with one click. This setup enables object detection, segmentation, human pose estimation, and classification. It supports uploading local videos, images, and using a webcam, and also allows one-click TensorRT model conversion.
07. reCamera: Build Vision AI Platform for Everywhere!
reCamera, a fully open-source, programmable AI camera designed with developers in mind. Featuring a modular design with 1 TOPS AI performance, it’s easy to swap camera sensors and interface boards for expanded functionality. reCamera comes with a custom Linux OS and a built-in web UI for quick setup. Explore more details.
08. Train and Deploy Your Own AI Model with Just a Few Clicks
Seeed Studio SenseCraft AI Platform is a browser-based AI Solution. It empowers users to effortlessly train and deploy their own models onto their edge devices, and to better understand the performance of algorithms through visualizations generated during the training process. Try Now.
09. Getting Started with Gapi on NVIDIA® Jetson Devices
Gapi is an embeddable API gateway that creates streaming integrations between AI micro services and the systems that users leverage everyday. The project is to accelerate the speed of creating pilots and demos of Jetson AI Lab achievements into real world environments. Learn more.
10. Get Started with T1000-E Tracker
SenseCAP Card Tracker T1000-E, the world’s first IP65-rated Meshtastic device with built-in GPS and onboard sensors. We’ve prepared a series of videos and Wiki user guide to help you get started with the SenseCAP T1000-E Tracker quickly. Check out today.
🎬 II. Weekly Livestream: Making Next Gadget
Our renewed livestream “Making Next Gadgets” is back! Each livestream will feature a different tech theme, with our product dev teams sharing the latest product updates, project demos, and exclusive deals. Join us on a journey through the tech revolution happening right now!
01. What Alpha Testers Say About SenseCAP Watcher
Wanna hear third-person perspectives on SenseCAP Watcher, the world’s first physical AI agent for smarter space? We are honored to invite 3 Alpha Testers Flavio, Hendra, and Jaime to join us. During this livestream, the 3 speakers demostrated their cool projects with SenseCAP Watcher and shared their ideas, reviewed and commented about this physical AI agent device. Watch the Video.
02. Back to the Factory
Seeed has continously innovating agile manfuacturing process for innovative professional devices from its early batch, and has a “Agile Manufacturing Center” since early days . Watch the livestream to find out: How are the new AI gadgets produced from scratch? What’s changing Seeed’s factory? How professional devices like weather sensors are built? How the supply chain works around the “Agile Manufacturing center. Watch the Video.
03. How to Build 5000 Pcs AI Gadgets in 30 Days?
As an AI hardware partner, Seeed Studio offers comprehensive electronic services (E²Ms) and electronic products. Based on our modular solution and service offering, we develop and produce both customer-specific (ODM) Products and our own products (OEM). We invited Nik Shevchenko to share the story of Omi (prev. Friend). Watch the Video.
04. reBuild a Relay Box for XIAO (Part 1)
Can you design and layout a 6 channel relay box under 60 min? Our Hardware Enginners Ruiwen and Jienian demonstrated the professional way of the same tasks, and challenging themselves to accomplish it within 60 mins, with the help of new AI native PCB design tools. Come to check out the progress about hardware design! Watch the Video.
📰 III. Product & Service Showcases
Discover new tools, platforms, and services designed to streamline your workflow and accelerate innovation in your projects.
01. Meet our new reServer Industrial J501 carrier board
The reServer Industrial J501 for Jetson AGX Orin™ is a carrier board specifically designed for building autonomous machines. J501 features 10G Ethernet for smart security and supports hybrid connectivity, including WiFi, 4G/5G, and LoRaWAN. Camera add-on expansion boards will be available to interface directly with high-density MIPI CSI interfaces. Additionally, an optional GMSL extension board supports advanced vision AI with up to 8 GMSL cameras. Get one Now.
02. Implementing MQTT and OPC UA on Raspberry Pi-powered reComputer
Explore MQTT and OPC UA with reComputer R1000, our Raspberry Pi-based AIoT device. Discover key features and differences in our flyer for insights into these two protocols. Please note that the details are limited for clarity. Find out more here.
03. Connecting Siemens PLCs Using the S7 Protocol with reComputer R1000
Explore how to use Node-RED on a Raspberry Pi-powered reComputer to interface with Siemens PLCs using the S7 Protocol. This setup allows for efficient and flexible integration of industrial automation systems with modern IoT platforms. Read more.
04. Deploy Frigate On a reComputer(NVIDIA Jetson) device
Check out our wiki guidance for this project pipeline:
✅ Pull Frigate Docker image optimized with TensorRT on the reComputer Jetson Xavier NX
✅ Setup Frigate configuration files for camera streamings and detection settings
✅ Deploy Frigate through Docker Compose. Read more.
05. Flash Jetpack 6 to Jetson Orin Devices: Tutorial & Demos!
Our reThings Jetson series now supports the latest JetPack6! Discover JP6 and NVIDIA Robotics Jetson Platform Service (JPS) highlights in this video. Watch the video.
06. Build a local ChatGPT with AnythingLLM and Jetson Orin deploy easily
Build a custom local AI assistant on Jetson Orin using AnythingLLM, an all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities. Watch the video.
07. reComputerJ4012 NVIDIA Jetson Orin NX 16GB on theBbalena Platform
Sharing this fantastic guide from balena, which showcased reComputer J4012 Jetson Orin NX 16GB unboxing and how to flash balenaOS in ease! Now you can deploy container-based AI/ML applications to fleet of edge devices with balenaCloud platform without complex configuration and maintainance. Watch the video.
08. Connect Your SenseCAP T1000 Tracker to ThingsBoard
Looking to scale your IoT projects with an open-source platform? Our latest wiki guides you through integrating the SenseCAP T1000 Tracker with ThingsBoard using The Things Industries’s The Things Stack (TTS). Read more.
09. Raspberry Pi CM4-Powered Intelligent Supermarket System
The whole system is integrated and controlled by reComputer R1000, CM4-powered edge IoT controller & gateway. R1000 serves as the central hub for data processing and control in the supermarket. Discover More.
👩💻 IV. News & Event Highlights
Get the inside scoop on recent events and news. Gain valuable insights, key takeaways, and highlights from industry experts and thought leaders at the forefront of ML innovation.
01. Seeed Studio at The Things Conference 2024
On 25-26 September, we attended The Things Conference 2024 in Amsterdam. Organized by The Things Industries, TTC has been a well-known event in the ecosystem for years. As the silver sponsor, Seeed Studio had an incredible time meeting all our amazing partners and sharing our latest innovations in LoRaWAN and AIoT technologies. From showcasing new products to exciting live demos, it was a fantastic experience! Read the recap by our BD Manager Violet Su.
02. Leveraging AI Tools for Conservation Ecology: A hands on approach
On September 2nd and 3rd, our Ranger Hendra Kusumah had the opportunity to conduct a two-day workshop introducing TinyML to biologists and zoologists at the BRIN center in Bogor, Indonesia. More info.
03. Celebrating the First Seeed Studio Ranger IoT LoRaWAN Workshop in Cameroon
Our Ranger Dessap Loic has successfully hosted a workshop in Cameroon (Douala and Yaoundé)! The event was a collaboration between TmeEducation_Cameroon, Robotsave, Inchtech, Coveriot, LightGroup , KandaWeather and HardwareCommunity. Over 49 attendees from various milieus came and joined us. Find out more.
04. AIoT Xperience Day in Düsseldorf: Unlock the Power of AI and IoT
We had the pleasure of joining the exciting AIoT XPERIENCE DAY in Düsseldorf co-organized by Techbros, UPLINK Network GmbH, heliotics, Infinetics, and Seeed Studio. We’ve conducted hands-on workshops where the participants dived into Meshtastic with the SenseCAP T1000-E Tracker and created no-code AI Vision sensors using XIAO ESP32S3 Sense. Read more
05. Hands-on Workshop in Amsterdam: Meshtastic and No-Code AI with XIAO
We got the pleasure of hosting a hands-on workshop thanks to the unwaving support of our local community partner Sensemakers in Amsterdam on September 24, 2024. Our VP Joey Jiang dived into Meshtastic and no-code AI using our SenseCraft AI platform. More info.
06. Everything About XIAO Newsletter Debut Episode
We are thrilled to unveil the debut episode of our Everything About XIAO Newsletter, covering all the latest and greatest from August 2024. Find out more. Subscribe to the Everything About XIAO Newsletter today and get the latest products, cool projects, and exclusive news delivered right to your inbox.
07. Seeed at Ultralytics YOLO Vision Event: reCamera – The First Open Source Programmable Al Camera with Native YOLO
Thrilled to join the Ultralytics YOLO Vision event again! This year our product marketing lead Elaine Wu has brought reCamera – the next-gen AI camera for the future. It’s integrated with YOLO natively, open-source, programmable, and built on a RISCV SoC with a flexible modular design. Perfect for tackling computer vision tasks everywhere! Watch the recap.
08. AWS Showcasing Seeed AI hardware at the AI Hardware and Edge AI Summit 2024
Our partner Amazon Web Services (AWS) demonstrated Seeed Studio’s latest AWS greengrass compatible edge AI solutions as well as the SenseCAP Watcher at the AI Hardware and Edge AI summit 2024. More
09. Seeed at Maker Faire Tokyo
At MF Tokyo 2024, we showcased a demo integrating reComputer R1000, XIAO MUCs, SenseCAP Watcher demo that combined the strengths of tinyML with LLM. Find out more.
🌈 V. Community Project Spotlight
Celebrate the creativity and ingenuity of our community members with featured projects and ideas in machine learning. From open-source libraries to DIY solutions, there’s no shortage of inspiration to be found among our talented community.
01. XIAO RA4M1 Mouse
Using the Seeed Studio XIAO RA4M1 and Grove Thumb Joystick, this project shows you how to control a computer’s cursor with simple hand movements. From connecting the hardware to writing the code in Arduino IDE, you’ll learn step-by-step how to set up your own custom mousee. Check it out
02. Third Eye for Blind
Md. Khairul Alam has developed an AI-powered assistive tool designed to enhance the mobility of visually impaired individuals. The “Third Eye for Blind” project leverages the power of our XIAO ESP32S3 Sense and Raspberry Pi 1 Model B+ to provide real-time object detection and text-to-speech conversion, enabling users to navigate their surroundings with greater independence. Learn more.
03. DOOR-E™: Your Portable Door Assistant
Inspired by a close friend’s struggle with mobility, Mike Soniat created DOOR-E™, a portable door assistant that allows users to effortlessly control doors via native phone app, voice (Amazon Alexa) or a remote control key fob. Seeed Studio XIAO ESP32C3 acts as the compact brain of the device, offering built-in WiFi and low power consumption. Find out more.
04. Paul’s Mooij Smart Glasses
Introducing Paul Mooij’s Smart Glasses, where you can DIY your way to IoT greatness with a little help from an old pair of sunglasses. Based and inspired by the legendary Google Glass and powered by Seeed’s Grove system and XIAO ESP32C3, this DIY kit is perfect for smart device enthusiasts and AI dreamers who want 100% more tech nerd street cred. Read more
05. Spongebob that can detect drowsiness
Mondal’s project, “Spongebob that can detect drowsiness,” uses our XIAO ESP32S3 Sense and MQ135 sensor to monitor CO2 levels in the room. As CO2 rises, Spongebob’s eyelids slowly close, letting you know it’s time to open a window for fresh air. Learn more.
06. LCD Dashboard for Raspberry Pi (System Monitor)
This project by Robert Mordzon easily installs a Seeed color LCD screen in the case to display key system parameters like CPU usage, temperature, RAM usage, and more. Find out more.
07. Announcing the winners of the September Monthly Campaign
Time to announce the winners of our Monthly Campaign-September! In September, the top three winners are:
1. Paul Stefaan Mooij Smart Glass which gained 26 likes
2. Hexapod Robot made by Shen Haoyu which gained 21 likes
3. Strider Camera Robot V8 by 陳亮 which gained 20 likes
Congratulations to our winners! We will provide free services to help make these projects available as products in our store soon. Watch more details about projects on YouTube.
That’s all for today, thank you all for reading through this September Monthly Wrap-up in your spare time. If you wanna share what projects you’re working on, shoot us a tweet @seeedstudio, let us know on LinkedIn and Discord, or publish your project on our Project Hub on Hackster.
#Notes
If you’re new to this session, here is a brief intro. We have gotten dozens of requests over the years for a Seeed Monthly Newsletter. Although we already have a newsletter for weekly updates, we still need a place to host overall information about what’s happened on a monthly basis. It can offer an efficient and friendly way to get updated for the whole community. And that’s what we expect for our Seeed Monthly Wrap-ups. Instead of putting it as a subscribe-to-read format, we’re publishing them on our blog, so as to keep it as open and accessible as possible for the whole community. For each entry, we will cover awesome projects from the community, campaigns that we are running, new products, IIoT Solutions, and even secret recipes for prototyping and manufacturing.
Previous Monthly Wrap-ups:
This is a casino site that every player in India should try – https://1win-india-official.in/ . The site has a user-friendly interface and offers a large selection of games, including live games with real dealers. I was very impressed with the speed of withdrawals and the generosity of bonuses. The winning odds are high, which makes the game even more exciting. The site also offers regular promotions and discounts, which makes it even more attractive to players. If you are looking for a quality casino, this is the place for you.