IoT Application

AgriTalk

AgriTalk provides comprehensive platform with sensors and control module of your farm well,and customizes precise forecast to provide scientifive-driven decision to farmers.

FrameTalk

On FrameTalk, there are two exsisting games - "猜猜看" and "搖搖看". The game uses a smartphone as an input device and interacts with Frame through the player's operation.

MapTalk

A digital map maps visual representations (cyber representations) to physical objects in the real world, and allows users to interact with these physical objects through their virtual representations.

EduTalk

EduTalk is a teaching platform that combines IoTtalk and 3D interactive programming. Using the IoT characteristics, this platform teaches programming with physical hardware devices controlling/interacting and 3D animations. In this way, EduTalk let learning programming more fun, makes the learning process less tedious, and improves students' learning interest and motivation.

Theses & Dissertations

A Study on Water Dispenser Power Consumption with IoTtalk Platform

Author: 陳亮融
Researchers create value for smart water dispensers by analyzing and processing sensor data. However, as the time range of sensor data increases, the trends in sensor values may become less apparent. Without the assistance of charts, it becomes challenging to discover long-term or complex trends. To address this issue, this study utilizes the IoT platform IoTtalk, the map platform MapTalk, and a Dashboard to collect and present sensor data from 13 water dispensers at National Yang Ming Chiao Tung University. The study explores the structure and operation principles of water dispensers and analyzes the water and power usage patterns of one dispenser from September 2021 to January 2022 as an exam

MedicTalk: Lightweight Model with IoT for Pill Recognition

Author: 莊東昇
To reduce medication errors in healthcare, improving healthcare personnel's medication knowledge and ensuring accurate administration were crucial. To achieve this goal, this paper introduces MedicTalk, aimed at providing electronic medication training for healthcare professionals. MedicTalk consisted of two components: MedicTalk Platform and MedicTalk Edge Device, forming a online education platform along with a physical pill recognition device. MedicTalk Platform digitized the medication training process

TraceTalk: A People-flow Counting Platform With IoT

Author: 霍湛軒
With the development of time and technology, people-flow counting systems have received increasing attention. The technology of people counting has been applied in various fields, for instance, aiding businesses in observing customer traffic and dwell time within stores, and understanding how individuals use urban spaces to enhance infrastructure and optimize spatial design. However, people counting is a product that integrates different technologies. It requires object detection to locate individuals in an area, object tracking..

MapTalk3.0: Integrated Operation Center for IoT Applications with Self-defined Map

Author: 王謙毓
This study focuses on MapTalk3.0, an integrated operation center for IoT applications based on IoTtalk. Compared to its predecessor, MapTalk2.0, MapTalk3.0 incorporates more enriched and flexible self-defined map features, introducing the concept of recursive design. Utilizing the “ImageMapType” feature in the Google Maps Javascript API, the platform can accurately render specialized regions such as smart buildings or healthcare facilities.

Smart Agriculture IoT Device Inspection System Based on Image Recognition

Author: 黃旭寬
In recent years, smart agriculture has been modernizing traditional, labor-intensive farming by integrating IoT-controlled automated machinery. However, conventional IoT frameworks often fail to detect mechanical malfunctions or operational issues. To address this, our paper proposes a cost-effective smart agricultural IoT device inspection system based on SSIM image recognition. It uses webcams to monitor end devices in real-time, providing a more comprehensive smart agriculture solution.

Detecting Rare Events of Phalaenopsis Orchid Disease in a Well-Controlled Greenhouse

Author: 吳冠潔
Existing non-image-based solutions for detecting plant diseases rely on time domain analysis of environmental conditions. These solutions are suitable for loosely controlled open farm fields. Conversely, orchid diseases are infrequent events in Internet of Things (IoT)-based smart greenhouses, where environmental conditions are well-controlled. Within such tightly regulated environments, existing time domain analysis solutions are inadequate for detecting rare orchid disease events. We observed that the influence of temperature and humidity on orchid fungus within

AvatarTalk: A Real-time Virtual Puppetry Performance Platform with IoT

Author: 黃詠惠
Puppetry, a traditional performing art in Chinese culture, has experienced a gradual decline in recent years, primarily due to the rapid advancement of technology. To combat this concerning trend and preserve this invaluable cultural heritage, we propose an innovative approach that merges information and communications technology with traditional puppetry. Through this integration, we aim to create a new and captivating form of performance while ensuring the longevity of this art form. Our study revolves around the seamless combination of motion capture technology and 3D virtual puppets.

EduTalk v3: Enhanced Cyber-Physical Interaction

Author: 劉松霖
Since the COVID-19 pandemic, many courses have shifted from physical classes to online, leading to numerous online smart learning platforms. In the past, we proposed an IoTtalk-based programming education smart learning platform called EduTalk v2. This platform allows students to learn Python programming syntax, 3D animation design, and basic IoT knowledge, in conjunction with core science subjects such as mathematics, physics, and biology, without the need to purchase or install additional software or hardware.

IoTtalk implemented based on Kubernetes architecture

Author: 張芷婷
In recent years, there has been a growing demand for the development of cloud industries and using containers to run services has become a trend. Kubernetes, as a platform for managing containers, provides many benefits such as service discovery, fault tolerance, and self-healing. IoTtalk is an IoT device management system that can use containers to run services. However, simply using containers cannot take advantage of the benefits provided by Kubernetes. If IoTtalk system can be deployed on Kubernetes, it can utilize the advantages of Kubernetes to enhance the service stability of the IoTtalk system.

FactoryTalk:Monitoring production line working hours with IoT devices and YoloTalk

Author: 王彥婷
Image recognition plays a big role in various fields. In the semiconductor and electronics industries, it has been an important tool for improving production effi- ciency and quality. Previously, tasks that required manual inspection, such as check- ing the component placement of Printed Circuit Board Assembly (PCBA) in board factories, but now, utilize AOI equipment combined with Al deep learning for the recognition. It took at least 15 to 20 minutes for a human to inspect a single PCBA, but with image recognition, this can be accomplished within 30 seconds to 1 minute, and it is with very few errors by mistakes.

X-AItalk: Developing an Abstract Data Type for integrating Classification APIs among Third-party AI Platforms

Author: 鍾奇豫
AItalk is an AIoT application platform developed by our team based on IoTtalk, which can import AI algorithms to process IoT time series data. With the advancement of technology and the improvement of GPU compute capability, a number of state-of-the-art and complex deep learning models have been developed. However, high hardware costs or the low compute capability of affordable GPUs make it difficult to provide widely and low-cost AI solutions in various fields. In this paper, two third-party AI platforms developed by partner companies are Advantech's WISE-AIFS/AutoML and Quanta Computer's QOCA® AIM. We observe that neither of them provides a method for processing IoT time series data, but both provide classification models. Therefore ...

FenceTalk An Object Detection Platform with IoT and SSIM

Author: 洪健菖
Deep learning models are often trained with a large amount of labeled data to improve the accuracy for target objects detection in new fields. However, the model may not robust enough due to insufficient training data in the new field, resulting in some target objects not being successfully detected. Training with data that are not successfully detected by the deep learning model can effectively improve the accuracy for the new filed, but it is costly to retrieve the image data containing the target objects from millions of images per day to train the model. Therefore, our study proposes a system called FenceTalk, which compares the difference be-tween the current frame and the background image based on SSIM, and automatically selects suspicious images with moving objects that are not successfully detected by the Yolo model, so that ...

VoiceTalk: a voice recognition and control system with IoT

Author: 李湘勤
Many smart home products can be controlled through voice assistant services. These services leverage the voice-based Internet of Multimedia Things (IoMT) to control applications with voice. However, the development of voice assistant services faces the following difficulties: First, the development process is lengthy. The developers must write additional programs according to a specific API format to build services. Second, the degree of service customization is limited. Developers can only use the modules provided by the platform. Third, the deployment results are restricted. The deployment results can only be presented through the relevant mobile APP or smart speakers.Based on the IoTtalk IoT platform, this research constructs a web-based voice control system, VoiceTalk, to implement...

Web API Verifier for IoTtalk and Its Applications

Author: 林文郁
With the vigorous development of Internet of Things (IoT) applications, many IoT applications based on IoTtalk, such as EduTalk, ScratchTalk, and other X Talk systems, have been created in recent years. Most of these IoT applications are developed using Web application programming interface (API) and thus enable web browsers to transfer data to applications. But in the development stage, unknown errors or unexpected results may occur. It is hard to manually design test cases to detect such flaws efficiently, and automatic testing tools often require much domain knowledge. This thesis combines Fuzzing technology to develop a graphical user interface (GUI) test system, Web API Verifier (WAV), for IoTtalk and X Talk developers to automatically test their applications easily. WAV integrates Swagger Editor and RESTler fuzzer. According to the uploaded source codes, it generates the corresponding drafts of OpenAPI documents. By filling...

EduTalk v2: Cyber-Physical Interaction System and Real-time Reproduction of IoT data

Author: 陳冠宇
Students are forced to study at home during the recent coronavirus disease pandemic. How to effectively improve the learning experience and effectiveness while reducing the cost of learning is a common issue in all smart learning environments. In the past, we have proposed a program education smart learning environment developed based on IoTtalk and implemented by a web application - EduTalk. Students can learn Python programming, 3D animation drawing, and basic IoT knowledge on this platform through a browser without purchasing additional hardware and installing other software. Based on the past EduTalk, this paper proposes several improvements. EduTalk v2 expands the flexibility of lecture development, allowing users to adjust the binding between physical features and cyber variables at any time according to various usage scenarios, and use the sensor data to interact with 3D animations...

BugTalk: Online Prediction for the Life of Spodoptera litura (Common Cutworm)

Author: 陳立献
Due to climate change, Spodoptera litura has the potential to become an increasingly severe pest because of increased habitat suitability. To support precision agriculture, it is essential to accurately predict the life cycle of Spodoptera litura, and use the information for pest control. This paper proposes BugTalk to predict the life of Spodoptera litura (Common Cutworm). Based on the Internet of Things (IoT) technology, BugTalk is a realtime prediction version of modified Insect Life Cycle Modeling software (ILCYM), an open-source software package that implements the functions used in the four models of the four life stages of Spodoptera litura. In this paper, we significantly improve the ILCYM functions and several models of the previous studies to improve the accuracy of the prediction...

IoT-based Bacillus Number Prediction in Smart Farms Using Small Datasets

Author: 葉日翔
The Bacillus genus is one of the most commercially exploited bacteria in the agro-biotechnology industry, and the Bacillus information is very useful for crop growth. Most existing studies on the analysis for the amount of Bacillus were conducted in the laboratories. Performing such a task on open field farming is difficult because only a small dataset is available during a ling observation period for the soil analysis of Bacillus. For example, turmeric growth takes 9 months with one soil sample per month, and we found that increasing the frequency of soil analysis for turmeric growth is not practically useful. Therefore, we can only collect a very small dataset for AI training. This paper proposes the AgriTalk approach that predicts the amount of Bacillus based on IoT and machine learning technologies...

An Empirical Study of Project Management: An IoT Research Team Example

Author: 郭柏妍
Project management is a series of methods and processes used to help track teamwork and achieve project goals. With the popularization of the Internet and software, related software of project management tools is constantly being introduced over the world, which shows the importance of project management. In the past, the lack of a unified management platform caused many inconveniences during the development of the IoTtalk project at the National Yang Ming Chiao Tung University, so we introduced the project management software into the campus laboratory to solve the problems.We investigated the way to select good tools and compared the differences between project management tools and selected Jira project management software as our research tool after considering the laboratory needs...

DeviceTalk: A No-code Low-code IoT Device Code Generation

Author: 彭宣儒
The deployment of a client-server based distributed intelligent system involves application development in both the network domain and the device domain. In the network domain, an application server (typically in the cloud) is deployed to execute the network applications. In the device domain, several Internet of Things (IoT) devices may be configured as, for example, wireless sensor networks (WSNs), and interact with each other through the application server. Developing the network and the device applications are tedious tasks that are the major costs for building a distributed intelligent system. To resolve this issue, a low-code or nocode (LCNC) approach has been purposed to automate code generation. As traditional LCNC solutions are highly generic, they tend to generate excess code and instructions, which will lack efficiency in terms of storage and processing...

SensorTalk3: A Machine Learning Approach for Calibration of Soil Electrical Conductivity Sensors

Author: 陸柏勳
Smart agriculture utilizes Internet of Things (IoT) technologies to enable low-cost Electrical Conductivity (EC) sensors to support farming intelligence. Because of aging and changing of weather and soil conditions, the EC sensors are prone to long-term drift over years of op-eration. Therefore, they must be recalibrated on a regular basis to guarantee data accuracy. In most existing solutions, an EC sensor is calibrated by the standard sensor to build the cal-ibration table. This paper proposes SensorTalk3, an ensemble approach of machine learning models including XGBOOST and Random Forest, which can be executed at an edge device (e.g., Raspberry Pi) without GPU acceleration...

MPtalk: A Real-Time Human Pose Tracking Platform with IoT

Author: 葉俊廷
In recent years, with the spread of the novel coronavirus disease (COVID-19) outbreak, using public touch screen kiosks increases the risk of infection. Due to hygiene concerns, using body language to interact with the user interface becomes a suitable solution. However, when users who are not experts at artificial intelligence(AI) methods try to develop applications for human pose detection and tracking, they are likely to encounter difficulties in environment setting, data transfer, data transferring, programming, etc., which will greatly delay the development time and process. To resolve this problem, we propose a platform—MPtalk, a web-based human pose tracking platform...

Smart Lock base on AIoT

Author: 鄭勝耀
Most smart electronic locks on the market are mainly powered by batteries, although you won’t be locked outdoor during their power outage, the information of their battery lifespan is still worth your attention. The general battery lifespan reminder will issue a tone or flash when the electronic lock is almost out of power. The thesis aims to state the mechanisms of providing more battery lifespan information using Wi-Fi connections...

Prediction of Queue Dissipation Time for Mixed Traffic Flows with Deep Learning

Author: 吳易蓉
Queue dissipation has been extensively studied about traffic signalization, work zone operations, and ramp metering. Various methods for estimating the intersection’s queue length and dissipation time have been reported in the literature, including the use of car-following models with simulation, vehicle trajectories from GPS, shock-wave theory, statistical estimation from traffic flow patterns, and artificial neural networks (ANN). However, most of such methods cannot account for the impacts of interactions between different vehicle types and their spatial distributions in the queue length on the initial discharge time and the resulting total dissipation duration...

Design and Implementation of IoTtalk AA Subsystem and Account Subsystem

Author: 張彧豪
Internet of Things (IoT) has made our lives more convenient in the recent years. However, with convenience comes the bothering security issues. Thus, acquiring balance between convenience and security is a challenge for developers. We proposed the Authentication and Authorization Subsystem. (AA Subsystem). It is a subsystem implemented in the IoTtalk platform and manag-es security information and permissions that each IoT device connecting to IoTtalk uses...

YoloTalk: An Object Detection Platform with IoT

Author: 徐綺蔚
With the advancement of science and the development of computer technology, artificial intelligence (AI) has been used in many aspects. Object detection combining artificial intelligence and computer vision is also one of the very popular issues. However, when users who are not experts at AI methods try to implement object detection, they are likely to encounter difficulties in programming, environment setting, etc., which greatly delays the development time and process. To resolve the problem above, we propose YoloTalk, a web-based object detection platform...

A Food Ordering System with Response Time Prediction

Author: 陳品劭
In recent years, people are facing human resources shortage due to the population aging and low fertility. Moreover, with the outbreak of Covid-19 in 2019, it has become a trend to use machines to replace manpower and reduce human contact. This paper proposes a food ordering system that uses an IoTtalk platform to connect customers and restaurant. Users can access the website by scanning a QR code without any special setup...

ScratchTalk: An Open-source Programming Education Platform with IoT

Author: 溫子翔
Nowadays, programming education has become vital, and the age of students learning to program has also dropped to junior high and elementary schools. However, traditional programming courses teach students to write programs using text editors or Integrated Development Environment (IDE) for coding. The tedious learning process causes students to lose their enthusiasm for programming. This thesis proposes a web-based programming education platform—ScratchTalk...

Calibration for farming sensors

Author: 陳冠文
Detecting sensor failure in an Internet of Things application is important. When a sensor in an IoT application starts producing inaccurate data, it is crucial that we detect and resolve the issue. This thesis talks about sensor failure detection and introduces a mechanism for calibrating sensors. The idea is to use the relationship between corresponding sensors and actuators to detect anomalies through analytical and statistical methods. Once a sensor failure is detected, the calibration process will begin....

The Design and Implementation of IoTtalk ControlBoard

Author: 鍾昀諠
With the vigorous development of Internet of Things applications, more and more domains have introduced the IoT (Internet of Things) technology to better solve problems. For example, PLCs (Programmable Logic Controller) are introduced in smart agriculture as a decision center to realize the automatic management of physical device like drips or fertilizers. However, traditional hardware methods are difficult to be applied to large-scale IoT applications such as smart cities due to the hardware costs...

In-Situ Symbolic Execution for Running Processes and Its Application

Author: 呂翰漳
In recent years, information security vulnerabilities have emerged endlessly. To find the conditions that can trigger these vulnerabilities, we must increase code coverage. Symbolic execution is one of them. However, symbolic execution still has many limitations, making most large systems unable to be used usually. If many third-party function libraries are used or called with the system, it is easy to cause unstable factors in the symbolic execution engine, resulting in an incorrect execution state...

VerificationTalk: Verification of IoT Applications

Author: 許尹睿
At the heart of graphical IoT device management platforms, such as IoTtalk, is a graphical user interface (GUI), which makes it easy to describe interactions between IoT devices. IoT applications are defined by dragging-and-dropping devices and specifying how they are connected. IoTtalk also provides join functions, which can perform some operations on the data transmitted between IoT devices. While IoTtalk is flexible enough to develop a wide range of applications, it often allows too much flexibility...

MapTalk2.0: Integrated Operation Center for IoT Applications

Author: 童柏勛
With the spread of the new coronavirus, the zero-touch industry demand has strongly driven the vigorous development of Internet of Things (IoT) applications. However, most of the IoT applications face the problems of complex, fragmented and unfriendly data for users, which result in difficulties for merging different applications. To solve this problem, this thesis proposes MapTalk2.0, an Integrated Operation Center (IOC)....

GardenTalk: A Management Platform for Interaction between Humans, Landscapes and the Environment

Author: 徐大賢
With the vigorous development of Internet of Things technology (IoT), IoT technology has been widely used in many fields, including smart home and smart agriculture. However, IoT solutions for original problems in landscape architecture have not been found. This paper proposes GardenTalk, an IoT device management system suitable for green spaces. Through this system, we can quickly build a smart park that can interact with people and the environment...

Automatic deployment of a cloud-based physics experiment platform and processing of large scale physics experiment data

Author: 陳瑩穎
EduTalk, a 3D interactive programming education platform with IoT, enables heterogeneous connection for different sensors and provides users to do physics experiments on it. But it lacks the functions to process large scale physics experiment data. Therefore, in this thesis, we describe how to record large scale physics experiment data in EduTalk with the FileLogger device and to export them to the Excel files...

EduTalk: A 3D Interactive Programming Education Platform with IoT

Author: 胡育旋
In recent years, programming education becomes important worldwide, and programming course has been compulsory for high school students in Taiwan. However, it takes a lot of time to setup environment. We propose EduTalk, an out-of-the-box web-based education platform. Users may write VPython programs to render 3D animation in the browser without installing software or purchasing any hardware...

Design and Implementation of an Energy-Saving Scheduling Algorithm for Elevator Group Control System Using ElevatorTalk

Author: 趙子翔
This thesis proposes the Energy-Saving Scheduling Algorithm for Elevator Group Control that uses a shortest-path calculation as the determination for dispatching a proper car when the passenger arrives. The two performance metrices that we consider simultaneously are the average passenger journey time (i.e. the duration between the passenger arrives until he/she leaves the elevator) and the energy consumption...

Integration of Internet of Things and Aquaculture Technologies

Author: 曾浤鈞
Over fishing has caused the depletion of marine resources, so the new technology for aquaculture is essential. This dissertation proposes a fishing farm system (including sensors, actuators, and cameras) that integrates Internet of Things (IoT) technologies and telecommunications networks (including LTE and WLAN aggregation technologies (LWA) and narrow-band Internet of Things (NB-IoT)). In addition, take the possible large-scale deployment into consideration in the future, we develop a management platform (NB-IoTtalk)...

ElevatorTalk: A Smart Elevator Platform and Its Extension to Other Applications

Author: 吳宗翰
This dissertation proposes ElevatorTalk, an elevator development and management system based on an IoT approach called IoTtalk. This system modularizes the software into elevator components so that flexible and scalable car scheduling algorithms can be developed. ElevatorTalk consists of three subsystems: Cars, Scheduler and the Elevator Car Operating (ECO) Panel. ECO Panel receive the requests issued by the passengers. Scheduler subsystem is responsible of scheduling the car group controlled by Cars subsystem...