Seeed Monthly Wrap-up for July 2024: Exploring New Breakthroughs in Edge AI and More
Boost your knowledge with 12 in-depth tech exploration offering expert insight, 4 fascinating livestream recap, 10 product and service showcases that will leave you in awe. Plus, prepare for 7 latest Seeed news and event highlights. Dive into the vibrant open-source community with 4 inspiring projects.
Hey community,
Welcome to the latest edition of Seeed Monthly for July 2024! This month, our focus shifted to the rapidly evolving field of Edge AI. We will explore the notable advancements, emerging trends, and impactful innovations.
Boost your knowledge with 12 in-depth tech exploration offering expert insight, 4 weekly livestream recap, 10 product and service showcases that will leave you in awe. Plus, prepare for 7 latest Seeed news and event highlights. Dive into the vibrant open-source community with 6 inspiring projects. Let’s jump right in!
📚 I. In-depth Feature & Tech Exploration
01. Finetune LLM by Llama-Factory on Jetson
Finetune LLM by Llama-Factory on Jetson Orin! Now you can tailor a custom private local LLM to meet your requirements.
✅ Llama-Factory: an efficient tool to unify efficient Fine-Tuning of 100+ LLMs.
✅ Jetson-examples: a comprehensive toolkit for deploying containerized applications on NVIDIA Jetson devices.
✅ Workflow: use the alpaca_zh dataset to fine-tune the Phi-1.5 model, enabling it to have Chinese conversational capabilities. More info at Jetson examples GitHub.
02. NVIDIA TAO Now Running on MCU – Grove Vision AI V2
Short for Train, Adapt, Optimize, TAO is a set of open-source toolkit developed by NVIDIA. It is built on TensorFlow and PyTorch, utilizing transfer learning to simplify the model training process without compromising the inference throughput. You can now use NVIDIA TAO on MCU – Grove Vision AI V2. How? Find more details here.
03. Deploy YOLOv10 on NVIDIA Jetson Orin with a One-Line Command: Real-Time End-to-End Object Detection
Jetson-example offers one-line deployment projects and edge AI applications, including generative AI models like Ollama and Llama3, as well as computer vision models like YOLOv8 and YOLOv10. We have pre-configured all environments for you to enable single-command deployment of projects. Read more.
04. Raspberry Pi AI: YOLOv8 Object Detection on reComputer R1000 with Hailo-8L
This video demonstrates object detection using YOLOv8 on reComputer R1000 with and without Raspberry-pi-AI-kit acceleration. The Raspberry Pi AI Kit enhances the performance of the Raspberry Pi and unlock its potential in artificial intelligence and machine learning applications, like smart retail, smart traffic and more. Although the Raspberry AI Kit is designed for Raspberry Pi 5, we have experimented it on our CM4-powered edge gateway. Excited about turning our edge device into an intelligent IoT gateway! Walk through wiki.
05. YOLOv8 Pose Estimation on reComputer R1000 with Hailo-8L
Running real time pose estimation on a CM4-powered edge IoT controller. You’ll be amazed by the remarkable improvements in CPU utilization and reference speed when comparing performance with and without the Hailo AI accelerator. Without the AI kit, the processing speed is limited to 0.5 frames per second (fps), but with the AI kit, it skyrockets to an impressive 27 fps. Read the Tutorial.
06. YOLOv8s Object Detection with Int8 Format Using M.2 Coral Accelerator on RPi 5
The Coral M.2 Accelerator with Dual Edge TPU is an M.2 module that brings two Edge TPU coprocessors to existing systems and products with an available M.2 E-key slot. This wiki we will show you how to install Coral M.2 Accelerator to Raspberry Pi 5 , demonstrating the performance difference when running object detection on a Raspberry Pi 5 equipped with the Coral M.2 AI accelerator. Learn more.
07. How to run A-LOAM 3D SLAM on reComputer
This wiki provides detailed steps to set up and run the A-LOAM (Advanced LOAM) algorithm on reComputer Jetson Series using a RoboSense RS32 LiDAR sensor. A-LOAM is an advanced implementation of LOAM (Lidar Odometry and Mapping in Real-time) that utilizes Eigen and Ceres Solver for efficient and real-time mapping and localization. Check out today.
08. reComputer R1000 with fuxa to achieve SCADA
reComputer R1000, the Raspberry Pi edge IoT controller and gateway, is fully compatible with FUXA, allowing you to integrate and leverage its capabilities seamlessly. 🙌 Check this working flow we designed using the charts and circular gauges provided by FUXA. Check out now.
09. Pose-Based Light Control with Node-Red and Raspberry Pi with AI Kit
This wiki will guide you on how to run YOLOv8 using an AI kit, use YOLOv8 to monitor your posture, and ultimately control your lights based on your posture. The detected pose is then streamed in real-time to reTerminal DM using gstreamer. Discover More.
10. Local AI Assistant : Deploy Ollama and AnytingLLM on Jetson
Local AI Assistant is an artificial intelligence application that runs on local hardware and software, offering intelligent interaction and data processing capabilities. It operates independently of cloud services, protecting user privacy while providing quick response times and high levels of customization.
In this wiki, we will demonstrate how to set up a local knowledge base on Jetson devices with ollama and AnythingLLM. By leveraging the powerful capabilities of large language models, we aim to enhance our work efficiency. Read more.
11. How to Run VLM on reComputer with Jetson Platform Services
Vision language models (VLMs) are multi modal models supporting images, video and text and using a combination of large language models and vision transformers. This wiki provides a tutorial on how to run VLM on reComputer J4012 Jetson Orin NX. More info.
12. How to Run Zero-Shot Detection on reComputer with Jetson Platform Services
Generative AI vision transformers such as CLIP have made it possible to build zero shot detection models capable of open vocabulary object detection. This wiki provides a tutorial on how to run Zero-Shot Detection on reComputer J4012. Find out more.
🎬 II. Weekly Livestream: Making Next Gadget
Our renewed livestream “Making Next Gadgets” is back! Each livestream will feature a different tech theme, with our product dev teams sharing the latest product updates, project demos, and exclusive deals. Join us on a journey through the tech revolution happening right now!
01. IoT into the Wild with Meshtastic
This week, our amazing colleagues Joey Jiang (VP) and Violet (BD Manager) shared the latest updates from Seeed for the open-source Meshtastic. They revealed exciting new parts for Meshtastic, including GPS, trackers, displays, HMI, dev kits, IP65-rated devices, and more. They also explored LoRa, LoRaWAN, and their relation with Meshtastic. Watch the video.
02. AI Boosted RPi for Real World Applications
This week, our colleagues Jenna and Aidan explored with you together about the power of Raspberry Pi in the AI world. We prepared a series of benchmark demos and the potential real-world applications Raspberry Pi AI usher in, upgraded power distribution, smart retail, and more! Watch the video.
03. Software Backbone of SenseCAP Watcher, Next Physical AI Agent for Smarter Space
Our expert speakers Shuyang Zhou and Kevin Yang explored the software backbone of SenseCAP Watcher, unveiling new features, the interaction with SenseCraft software, task orchestration, and how the software’s open source nature supports further development. Additionally, discover how SenseCAP Watcher collaborates with local LLMs. Watch the video.
04. Monthly Campaign to Scale Your AI Gadgets
We launched our exciting monthly campaign to help you scale your AI gadgets. Our CEO Eric and Community Manager Alison guided you through the process of transforming your brilliant projects into profitable products featured in our online marketplace. They unveiled the new landing page for the campaign and showcase some of the coolest products we’ve co-created with our fantastic community. Watch the video.
📰 III. Product & Service Showcases
Stay up-to-date with the latest product releases from Seeed. Discover new tools, platforms, and services designed to streamline your workflow and accelerate innovation in your projects.
01. Unboxing & Plug in reComputer J4012 – Powered by NVIDIA Jetson Orin NX
Curious about our hottest reComputer J4012 edge device? Join us as we unbox the AI computer, power it up, and explore its incredible capabilities in computer vision and large language models for diverse applications, such as robotics, automation, video analytics, and Generative AI. Watch the video on YouTube.
02. Release: Jetpack 6 is now available for Seeed’s Jetson Orin Devices!
NVIDIA JetPack SDK powers NVIDIA Jetson modules, offering a comprehensive solution for building end-to-end accelerated AI applications. JetPack 6 expands the Jetson platform’s flexibility and scalability with microservices and a host of new features. It is now available for Seeed’s Jetson Orin Devices! Read more.
03. BeagleY®-AI: Open-Source, Budget-Friendly SBC
BeagleY®-AI is an advanced SBC with an industry-standard form factor developed by BeagleBoard Foundation. Powered by the Texas Instruments AM67A ARM-based Vision Processor, it’s now fully stocked in our US warehouse, priced at just $70 per unit. Get one now.
04. Introducing Wio Tracker 1110 Dev Kit for Meshtastic, Building Open-Source, Off-Grid, Decentralized, and FREE LoRa Mesh Network
Ever wanted to join an open-source, off-grid, decentralized and FREE LoRa mesh network for reliable long-range, low-power communication? This is where the Wio Tracker 1110 Dev Kit for Meshtastic shines! This powerful development kit offers a plug-and-play user-friendly solution to build a long-range low-power Meshtastic tracker device. With native Arduino compatibility, it’s perfect for developers to custom-build reliable wireless Meshtastic LoRa Mesh networks for remote adventures like asset tracking, decentralized communication, and outdoor activities. Find out more here.
05. Let’s Fritzing: Announcing XIAO Fritzing Parts!
We are super excited to announce that XIAO Fritzing parts are now available on our GitHub repository! A big shout-out to our amazing contributor, Gokul, for all the hard work and dedication in creating these parts. Check out now.
06. It’s Your Call – Join Seeed Studio XIAO Open Roadmap!
We are inviting everyone to join us in shaping the Seeed Studio XIAO Open Roadmap, bringing more and better XIAO products to the community in an open, efficient, and collaborative manner. Read more.
07. Meet ReSpeaker Lite, Speak to Automate Your Home, Office, and More
Discover the new ReSpeaker Lite Series! Control your smart home with natural language, integrate with OpenAI, and activate custom wake words. Explore ReSpeaker Lite 2-Mic Array and Voice Assistant Kit for advanced voice interaction and automation in Home Assistant. Ideal for AIoT applications with high-quality voice capture and recognition. Find out more here.
08. Watcher to Node-RED Integration
The “Node-RED Integration” of the SenseCAP Watcher wiki focuses on integrating Watcher with various messaging platforms and services to enable alerts and notifications. This part is particularly useful for users who want to stay informed about the status of their Watcher devices or receive important updates from their monitoring tasks. Check out today.
09. Watcher As a Grove sensor
SenseCAP Watcher is now pre-launched on Kickstarter. Throughout this wiki, we will dive into the details of reading and interpreting the data output from Watcher’s UART interface, provide comprehensive tutorials on how to parse and utilize this data using popular development boards and platforms, including XIAO, Arduino, Raspberry Pi, and Jetson. Discover More.
10. Alpha Test Registration for reCamera
We are bringing a new programmable camera – reCamera. It’s moduler design on-device AI camera with 1 TOPS AI performance. Shipping with reCamera OS, you can quickly set up with built-in web UI. We’re on the lookout for IoT developers, AI engineers, system architects, and tech enthusiasts to join us as alpha users. If you’re interested, please fill out the questionnaire.
👩💻 IV. News & Event Highlights
Get the inside scoop on recent events and news. Gain valuable insights, key takeaways, and highlights from industry experts and thought leaders at the forefront of innovation.
01. SenseCAP Watcher is Now Pre-Launched on Kickstarter
Big news, the pre-launch Kickstarter page for our SenseCAP Watcher is now LIVE, proudly getting the official KS “Project We Love” badge. Click to notify on the official launch in mid-August now to get the first-hand update!
02. Green TechMaker Live Mentoring Session
Hendra Kusumah, one of our Ranger, shared a recap of his mentoring Session at the Green Techmaker event at Fab Lab Bali in Jimbaran Hub, Bali, Indonesia from July 13th to July 15th. Read the blog.
03. First Seeed Studio Ranger Workshop in Spanish in LATAM
We are thrilled to share the success of our first Ranger workshop in Spanish and the first in Latin America. This event, organized in collaboration with Gabotrix, took place at the CHEC Grupo EPM facilities in Manizales, Colombia. Find out more.
04. Find Bugs, Win Coupons!
We’re thrilled to unveil our newly upgraded official mobile website, packed with enhanced features designed to elevate your browsing experience. We invite you to participate in our “Find Bugs, Win Coupons” event! Help us ensure a flawless user experience by reporting any bugs you encounter. Your feedback is invaluable to us, and as a token of our appreciation, we’ve prepared special coupons for bug finders. Join Now.
05. Announcing Winners & Cool Projects of Seeed Studio Vision Challenge!
Discover the winners of the Seeed Studio Vision Challenge! After three thrilling months, we reveal the top projects using Grove Vision AI V2 Modules and XIAO ESP32C3 units. Explore innovative AI Computer Vision solutions in automation, conversation, home security, smart assistants, music composition, smart agriculture, and more. Check out now.
06. Seeed Studio Sponsors UIST 2024 SIC Challenge: Makers of Future Interactive Devices
Seeed Studio is sponsoring the UIST 2024 Student Innovation Contest, themed “Makers of Future Interactive Devices“. This year’s challenge is set to push the boundaries of prototyping intelligent and interactive systems for wearables, smart environments, and more. Find out more.
07. Turn Your Prototypes into Profitable Products: Join Seeed’s Monthly Campaign
During our weekly livestream, we’ve launched our exciting monthly campaign to help you scale your AI gadgets. What exactly is the Monthly Campaign to Scale Up Your AI Gadgets? It is a long-term event where makers submit projects and can turn them into real products. We’re offering a $100 Fusion coupon each month from August to October 2024 to the first participant! Join Now.
🌈 V. Community Project Spotlight
Celebrate the creativity and ingenuity of our community members with featured projects and ideas in machine learning. From open-source libraries to DIY solutions, there’s no shortage of inspiration to be found among our talented community.
01. Transferscope: Using Gen AI and XIAO RP2040 to Transform Real-World Images
Transferscope, developed by Christopher Pietsch, is a XIAO RP2040 and Raspberry Pi powered tool that allows users to directly use their physical environments, bypassing the need for predefined prompts or extensive digital input and forming a prompt that captures textures, patterns, and concepts from real-world objects and applying them to other surfaces. Check it out.
02. Air Quality Alerting System with Particle Boron and AWS
Mithun Das created a cost-effective, portable air quality monitoring system using the Particle Boron microcontroller and Grove sensors. Read the guide.
03. Computer Vision (and more) for Alvik Robot
Check out this project by Roni Bandini where he added computer vision to Arduino’s Alvik Robot using our XIAO ESP32S3 Sense. Roni trained a model with Edge Impulse using pictures of Lego figures and exported it as an Arduino library. Find out more.
04. MeMic, The AI Wearable That Only Listens and Records Its Owner Speak Powered by XIAO nRF52840 Sense
A team of engineers consisting Cayden Pierce, Wazeer Deen Zulfikar, and Pattie Maes at MIT Media Lab have developed MeMic, a wearable device that actually activates its microphone only when the wearer speaks. This innovative solution aims to make wearable recorders more socially acceptable by easing privacy worries. Discover more.
05. Innovative LED panel controlled by hand gestures
Alejandro Puig integrates AI and RGB lighting to create a smart, interactive display. Using components such as an LED matrix, Grove Vision AI Module V2, XIAO ESP32C3 (or even ESP32), and a Raspberry Pi Camera, he demonstrates how to control the LED panel with simple hand gestures. Learn more.
06. Speed Clicker – Credit Card-sized Reaction Time Gaming Device
A portable credit card-sized reaction time game device. You can play this game by clicking the button that lights up as fast as possible to measure your reaction time. The button that lights up will be random in each round. After 4 rounds, the average reaction time will be shown on the OLED screen. More
That’s all for today, thank you all for reading through this July 2024 Monthly Wrap-up in your spare time. (It is indeed a fruitful month!) If you wanna share what projects you’re working on, shoot us a tweet @seeedstudio, let us know on LinkedIn and Discord, or publish your project on our Project Hub on Hackster.
#Notes
If you’re new to this session, here is a brief intro. We have gotten dozens of requests over the years for a Seeed Monthly Newsletter. Although we already have a newsletter for weekly updates, we still need a place to host overall information about what’s happened on a monthly basis. It can offer an efficient and friendly way to get updated for the whole community. And that’s what we expect for our Seeed Monthly Wrap-ups. Instead of putting it as a subscribe-to-read format, we’re publishing them on our blog, so as to keep it as open and accessible as possible for the whole community. For each entry, we will cover awesome projects from the community, campaigns that we are running, new products, IIoT Solutions, and even secret recipes for prototyping and manufacturing.
Previous Monthly Wrap-ups:
About Author
