Kobayashi Laboratory’s philosophy is to create a fair information society without generating disadvantages, even if you are not familiar with using IT equipment to acquire and use information. We set the following 4 goals:
To realize the world where web services themselves approach humans without user’s efforts to approach web services on the internet.
To realize the world where people who have not ever been connected now can enjoy communication.
To realize the world where you can take care of yourself without depending on others.
To realize the world where AI respects the individuality of each person and pulls out the power of humans.
For recent years, attractive web services for users have increased with the expansion of cloud services and the development of broadband networks. At the same time, user-friendly devices such as tablets or smartphones enable the beginners of web services to easily use them on the internet, which widens the users. However, contents and web services on the internet are used in the uniform environment, although each user’s taste or value is totally different. As population ages, the number of people who are not able to use the latest devices such as smartphones has been increasing. This makes it difficult for the elderly who cannot use smartphones to enjoy communication with the young, even if convenient network services are offered. Due to the falling birthrate and depopulation, it is becoming difficult to expect administrative services at the same level as before. It is the urgent need of realizing the world where you can take care of yourself as much as possible.
Under our philosophy, the Kobayashi Laboratory clarifies the challenges to be solved and works on them by using technologies such as IoT technology, Artificial Intelligence and big data.
To enjoy contents and web services, users need to learn skills to search and use the necessary services by themselves in the uniform environment.
Whether a user can search the desired services from a huge amount of services on the internet heavily depends on a user’s skills. The gap in information management becomes apparent.
To respond to this challenge, we aim to realize a new web browser (user-adaptive) having a characteristic that contents change every moment according to user’s use, focusing on information filtering and web technology.
We aim the basic infrastructure that is not only fair to all people but also useful for humans and society by implementing this web browser in conjunction with a cloud system.
Trend Surfing System on Multi-screen
Just by tapping one of automatically extracted rising search words, the related contents are shown on the other screen.
All you have to do is tap the screen in order to search and display the related information one after another, even if you cannot input nor think of search keywords.
This video shows the information related to trendy TV dramas is displayed on multi-screen.
The Kobayashi Laboratory has engaged in developing a sightseeing information providing system which contributes to the promotion of tourism in Nagasaki for 3 years. In collaboration with the Nagasaki film commission, this system provides the information of films and dramas which were shot in Nagasaki to the whole world in many languages.
Most of the existing systems focus on introducing sightseeing spots and have not been providing the information meeting the needs of each tourist. There are also problems that it costs to update or translate contents to many languages or the system needs to be constructed by content.
Therefore, we suggest a self-expanding sightseeing support platform. This realizes flexible information retrieval matching the tourist’s needs by RDF of contents. Taking in tourists’ tweets in real time corresponding to a respective language enables self-expansion and adaptation to other sightseeing contents at low cost.
Demonstration of the “Nagasaki Location Navigation”
Due to the spread of COVID 19, the number of people who stay home has been increasing. These movements of stay-at-home especially hit the food service industry hard. To cover the decreased number of visitors coming to shops, more and more shops start services of take-away. However, small and medium businesses in this industry have no means to appeal their take-away menus. For this reason, this causes a problem that it is hard for customers to know which shop offers the service of take-away and what menu is available for take-away. Therefore, we developed an application, “Mottekoh” that widely appeals the menu of take-away to customers only with the simple operation of smartphones.
This application uses the technology of Robotic Process Automation and consists of a function that businesses register the menu of take-away and the other function that customers can choose the menu. This application enables businesses to appeal their menus of take-away only with a smartphone without using their own web sites. In addition, customers can choose their favorite menus that their nearby shops offer, from many options. Our developed application matches the needs of businesses who want to offer their take-away menus and customers who like to eat something delicious by professional cooks at home.
For more information, see https://n-admin-iot.xyz/nagasaki-takeout/
Left: user’s screen Right: user’s QR code
IT literacy, the ability to use IT equipment, depends on a person. In particular, the elderly people tend to have low IT literacy. For this reason, it is difficult for the young who make full use of SNS to easily communicate with the elderly.
In addition, communication network interruption would prevent lifesaving rescue operations in case of a large-scale disaster.
To respond to this challenge, we have developed a Social Media Agency Robot by taking advantage of IoT technology.
Just by talking to the humanoid robot, the elderly can communicate with the young who use SNS. The existing watching services for the elderly are mostly designed to confirm their safety by informing the use of home electronics in the houses of the elderly to their families. We aim to promote active social participation of the elderly, as this Robot supports two-way communication.
At present, the Robot uses LINE as social media and communicates by using it. We implement a function which estimates destinations from the contents of messages. This enables the elderly to send a message to an appropriate destination just by talking to the Robot, as if they talked to someone.
#this study is partially supported by the Strategic Information and Communications R&D Promotion Programme (9524).
To respond to this challenge, we have developed a Flying Cloud Server by taking advantage of IoT technology.
By mounting a single board computer and implementing a wireless LAN base station, and Web server on a drone, we can share drone footage on the web browsers of smartphones or chat in case of the mobile network disconnection immediately after a large-scale disaster.
This enables rapid life-saving by using a personal smartphone without a special application being installed, even if there are no dedicated devices such as a transceiver.
To respond to this challenge, we have developed a Moving Cloud Server by taking advantage of IoT technology.
When a large-scale disaster such as the Great East Japan Earthquake occurs, it becomes unable to share information using cloud servers because of mobile network disconnection. For this reason, information has been shared using traditional, physical bulletin boards at evacuation centers where many and unspecified people gather. However, it has caused problems that the new and old information coexisted and incorrect information was provided since anybody could write in the board. The Moving Cloud Server has been developed to solve these problems.
This system provides the function of cloud servers by making an arm band that is worn by a leader of an evacuation center a IoT device. The battery-powered Raspberry Pi is embedded in this arm band.
The functions of the web server and wireless LAN are mounted on the Raspberry Pi. By locally connecting evacuee’s own smartphone to the Moving Cloud Server via the wireless LAN, information can be shared when a mobile network is down. By “moving” a cloud server, which is normally fixed beyond a network, this idea is to share information in case of a network disconnection.
For example, a leader and an assistant leader chat using this Moving Cloud Server with their own smartphones.
Leader: "Do we have any bread?"
Subleader: "We have 100 loaves of bread."
Leader: "I see, I will share this information."
As the leader taps the share icon by selecting the chat of the assistant leader, the information is automatically displayed on the electronic bulletin board, which is opened to all of the evacuees, along a time series.
Demonstration of the “Moving Cloud Server”
Due to the advancement of aging society with falling child birthrates, it is difficult for us to depend on government as in the past to solve various social problems.
Therefore, we have developed a barrier-free map for wheel chair users, the operation of a vehicle carrying an emergency patient, the decontamination system of algal blooms which adversely affect the environment around lakes, and a wearable device to prevent a mental illness caused by overworking or stress”.
To respond to this challenge, we have developed a Barrier-Free Street View by taking advantage of IoT technology.
By running a usually-used wheelchair on which an omnidirectional camera and a smartphone are mounted, this system automatically photographs street views. The data are automated to be uploaded to a server and converted to Street View and fed back via browsers. When it finds steps, the system not only memorizes and captures the images of the very position but also feeds back the information.
For example, this enables users to browse the images within the same day that show puddles after the morning rain on the street. Wheelchair users can acquire information by themselves and provide the information to anyone who needs it by mounting this device on their wheelchairs.
We have developed an “Emergency Transporting Information Sharing System by Citizen Using Map Application”.
By informing the location information of the ordinary vehicle carrying an emergency patient to the vehicles near it, this innovative system enables the ordinary vehicle to transport an emergency patient to hospital like an ambulance.
This was awarded a gold prize by 2016 Sosei project of Nagasaki University and a special prize by the 14th Gakusei Monozukuri Idea in Toyama.
Demonstration of the “emergency transporting by an ordinary vehicle”
We have developed an Independent Algal Blooms Removal Robot to perform the sedimentation treatment of floating algae through the joint research with professor Ikuo Yamamoto from Organization for Marine Science and Technology, Nagasaki University and the Ebisu Marine Co.,Ltd.
The developing concept of this robot is a self-completion system with functions to monitor the condition of water surface, detect algal blooms, move to the places where algal blooms are occurring, perform sedimentation treatment and supply energy. This system can autonomously move and precipitate algal blooms in water around the shoals or drifts where the existing fixed type systems cannot deal with.
Using IoT technology which makes every device connect to the internet, you can remotely control this system with a tablet device.
Demonstration of the “Independent Algal Blooms Removal Robot”
We have developed a wearable medical device which contributes to women’s health improvement. We have studied on the improvement of medical treatment quality, working with the Department of physiology 2, Nagasaki University Hospital.
This study uses a T-shirt type wearable device developed by collaboration with GOLDWIN INC., Toray Industries, Inc. and NIPPON TELEGRAPH AND TELEPHONE CORPORATION (NTT). We aim to prevent mental illness caused by overwork or stress by wearing the device.
Demonstration of “collecting biological information by a T-shirt type wearable device”
When a home delivery destination is absent, redelivery based on the delivery slip is requested. This causes overwork of delivery persons with the increase of online shopping.
The receivers of the packages are also required to arrange redelivery with a long number on the slip, which causes delivery delay or increases labor of receivers.
Therefore, we have developed a LINE Door Phone. The door phone is now the IoT device and it can connect to the LINE, widespread as the Social Network Service (SNS) just by embedding the Raspberry Pi in it. Wherever you are, you can know through your smartphone that your package has arrived.
For example, following the instruction of the Line
Door Phone, the delivery person scans the QR code on a package over the Door Phone. The photograph of the delivery person, converted phone number from the QR code, and the URL to arrange redelivery are informed to the application of the receiver’s smartphone. The receiver of the package can call to the delivery person directly just by tapping the phone number displayed on the smartphone and ask him/her to leave the package with neighbors.Furthermore, the arrangement of redelivery can be made just by tapping the URL to arrange without putting the package number.
The service of the door phone connected to the internet that notifies who has visited your home while you are out via a smartphone has been offered. While the existing services require exclusive applications, all you need for our developed system is LINE, which is usually used. This means our system does not need any exclusive applications. Moreover, what makes our system different from the existing is QR codes. The QR code enables notification of the phone number of the delivery persons or the URL to arrange redelivery.
Demonstration of the “LINE Door Phone”
AI should be used for humans. For this reason, we need to realize the humanely oriented AI that thinks hard what can do for humans.
For example, an AI robot that teaches English conversation corresponding to the ability or interest of each child, an AI robot that properly feed aquaculture fish in a cage on behalf of an aquaculturist.
Interests and abilities of English vary from child to child. To arouse their interests in English and enhance their motivations for leaning, AI needs to grasp each character and perform lessons tailored to each child.
All the students in the class have received the same lessons so far. Now the robot plays a role of a teacher and gives lessons according to the student’s learning level.
Or the robot can guide the conversation matched with the interest of a child. For example, the robot talks about soccer to the child who likes to play soccer.
This realizes the new primary education that does not make children dislike English.
If a television with a large screen and a personal smartphone are connected, what can we do?
You can display a movie that you searched on your smartphone.
You can buy items that are introduced on TV with using your smartphone.
The mere thought of it makes exciting new ideas occur in our minds. The Kobayashi Laboratory has developed a smart TV system that can make this happen.
Let’s try our developed smart TV system!
This video shows the example as follows. When you could not follow the topic of the popular TV drama at school, now you can catch up conversation with your friends just by automatically retrieving the scenes or theme song of the drama and simultaneously displaying them on several screens.
As you see, just by tapping the screen on the tablet, the system can simultaneously display scenes of some TV dramas on several screens. This enables those who are not familiar with using internet to easily acquire information.
To play the video, a browser that supports video tag is needed.
Now let me show you the demonstration of sequentially displaying several related videos on several screens just by tilting a tablet.
The demonstration shows the example of simultaneously displaying several videos to understand an actress or idol that you don’t know well, the unfamiliar word of “three-dimensional switchback”, or vegetables named cauliflower. “Three-dimensional switchback” is a railway track in which the train travels in a reverse direction at each switch. You can correctly grasp the meaning of the word by seeing the actual moving images
To play the video, a browser that supports video tag is needed.
Now I will show you the demonstration of displaying of information retrieval or retrieval results only by voice.
This demonstration shows the scene that the system simultaneously displays the related web pages or several videos related to know an unfamiliar actress. As you see, this is all done only by voice.
To play the video, a browser that supports video tag is needed.
How did you like it?
Those are realized by using world cutting-edge web standards technology. For this reason, all you need is only a web browser on your device. You do not even need to download any special applications. You can enjoy your device as an information displaying device!