Source: DigInfo TV/YouTube

YSEC, with support from the government, and in partnership with national research institution AIST and small- to medium-sized companies in Niigata Prefecture with superior technology in metal processing and control systems, and based on its own proprietary cutting technology, has developed a small jet engine for use in unmanned aerial vehicles.

A UAV with two of these engines would weigh about 100 kg, and be able to carry about 100 kg of cargo, depending on fuel load.

“To date, we have achieved our goal of 100,000 rpm, and met the target specification for a maximum thrust of 18 kg force. The part at the intake port is called the impeller, which doesn’t get hot so we used magnesium alloy there. This is an extremely light and strong alloy. The turbine, at the jet exhaust side, gets extremely hot. For that part, we used Inconel alloy, an ultra heat resistant alloy, the same as is used on engines for ordinary passenger jets. We used hang glider sails for the wing.”

A UAV with two of these engines can fly 100 km at a height of 200 meters. For takeoff and landing the plane needs a straight path of about 25 meters, so a typical school ground would provide sufficient space. YSEC is targeting usage in UAVs to carry supplies to isolated islands or disaster areas.

Source: DigInfo TV/YouTube

“Rather than building and selling airplanes, we think the most practical business scenario is for us to develop a vehicle to meet a user’s specific needs, and then sell or lease a full system, including us providing pilot services. We have also received inquiries from schools that want to use our technology for student research; we think we can probably sell a few, maybe ten or more, per year.”

If you liked this article, you may also be interested in:

• How might drone racing drive innovation?
• FAA issues waivers for real estate and agricultural UAVs
• Small UAV coalition applauds the FAA’s release of the proposed suas rule as a good first step for industry

See all the latest robotics news on Robohub, or sign up for our weekly newsletter.

Source: DigInfo TV/Youtube

In a collaborative research effort, Enomoto Kogyo, Shizuoka University of Art and Culture, and software company C&G Systems have developed Japan’s first 5-axis hybrid 3D printer, capable of continuously performing lamination and cutting using 5-axis control technology.

“Conventional (3D) printers are primarily planar lamination printers, but this machine is capable of not only planar lamination, but also 5-axis lamination,” said Kawamura Takehire, Enomoto development department chief director. “Ordinarily, undercutting can’t be performed with 3-axis control type NC, but with 5 axis, tilt and rotation functions are added. In other words, control is implemented for the X, Y, Z, tilt and rotation axis, and as a result, we’re able to print very complex shapes.”

“Our (3D) printer was produced as a machine for use in R&D by professionals rather than everyday users. We want to cultivate a wide-range of various applications and would like to hear from customers about what types of applications they would like to jointly develop, or in other words, what types of items they would like to print with this machine.”

Conventional 3D printers typically need the use of a support material to prevent material from drooping when a sphere is modeled. However, since this printer is capable of performing lamination on 5 axis, the use of a support material is not required, so material costs are reduced. It is well-suited for prototyping prosthetic leg parts, other products in the medical care field, and aircraft parts, since it combines lamination and machining in the manufacturing process.

If you liked this article, you may also be interested in:

• Autonomous mobile additive manufacturing robot runs circles around traditional 3D printers
• Hacking your 3D printer to make an air hockey robot

See all the latest robotics news on Robohub, or sign up for our weekly newsletter.

Komekurayama Solar Power Plant owned and operated by TEPCO in Kofu, Yamanashi Prefecture. Source: Sakaori via Wikimedia Commons.

Japan’s power industry is currently centralized, but it aims to deregulate by around 2020. Coupled with this major structural market change, the expansion of thermal, nuclear and renewable power generation will place additional demands on the management of the country’s energy market. Researchers from the Namerikawa lab at Keio University are working with control engineers, power engineers and economists to designing mechanical and control algorithms that can manage this large-scale problem.

The Namerikawa Laboratory of the Department of System Design Engineering in the Keio University Faculty of Science and Technology is conducting theoretical research of distributed control and cooperative control, as well as research concerning social applications in network systems thereof. As applied research, the Namerikawa Lab is conducting world-leading research in the areas of distributed and cooperative control of large-scale, complex systems connected to a network, formation control of unmanned aerial vehicles, and energy management of power networks.

“Since the earthquake and tsunami disaster of March 11, 2011, energy has become an extremely important issue that now involves the problems of nuclear power generation and the use of renewable energy. With all these areas, we no longer have centralized management by power companies as we did in the past, and instead, various companies can now supply energy. In addition, we also now have the option of selecting the company that is best suited for our needs from amongst various energy companies. Hence distributed management is becoming a key issue. “

Japan is aiming to deregulate the power industry by sometime around the year 2020, and with this deregulation, the power network is expected to become extremely complex. In the past, information was consolidated and managed based on centralized management, but after deregulation, it will be necessary to analyze power systems on the demand side and the supply side to ensure stabilized frequency tuning, and an appropriate power market must be created.

Frequency controllers are used to control power generators, and by running the generator itself at a constant rotational speed, we should be able to obtain power with a stable 50 Hz, 100 V supply voltage. However, when we add renewable energy and other power sources to the power network, they act in a form that is like noise, so the first thing that we need to do is implement feedback control with respect to those additional power sources so that a 100 V supply voltage can be continuously maintained at 50 Hz.

In addition to thermal power generation and nuclear power generation, an expansion of renewable energy is also expected to occur in the future. With that expansion, the power supply side will need to implement frequency control in order to maintain a stable supply of power, while the demand side will need to be managed based on a new control theory.

“The second area we need to look at is controlling demand using what is called demand response. Basically, what we want to do is achieve a balance between supply and demand. We want to change the behavior of consumers by changing the price. By doing this, we can shift demand peaks and level out power usage, and as a result, we are basically able to control consumers. This isn’t merely a mechanical and electrical control problem. It also pertains to economic activity, so it is an economic problem and an electric power problem. Trying to figure out how to design the power market in order to deal with these issues has become an extremely large-scale problem, namely a market design problem. When a full deregulation of power transactions has been achieved, there will be a demand to design a power market that is fully capable of supporting this type of deregulation. Therefore, right now we’re working with control engineers, power engineers, researchers, and economists to research new mechanisms for power transactions.”

With consideration of the standpoints of both the power demand side and supply side, the Namerikawa Lab is leading the world in research to develop algorithms to find the most appropriate compromise between the two sides and to quantify satisfaction levels. The lab is also focusing its efforts on research to build sensor agent and multi-agent systems to determine in real time the status of spatially and temporally distributed energy and environments.

“We’re conducting research with a major goal of fusing together this type of energy technology and UAV control technology to achieve optimum management and optimum control of social systems and social infrastructures in the future.”

If you liked this article, you may also be interested in:

• Why is Japan the first to get Dyson’s new 360 Eye?
• Japan’s new robotics push: Funding and deregulation
• Fukushima photo essay: A drone’s eye view
• ShanghAI Lectures: Weidong Chen “Modeling and Control of Mobile Robot Networks”
• The Distributed Flight Array: Modular robots that self-assemble, coordinate and take flight

See all the latest robotics news on Robohub, or sign up for our weekly newsletter.

Researchers from the Keio Institue of Pure and Applied Sciences (KiPAS) are working to reveal the mechanism by which newly acquired knowledge and information is transmitted and evolves among organisms with intelligence. This research is being done through pseudo-augmentation of body structures using a brain-machine interface, to investigate the process by which groups of individuals adapt to novel bodies and environments, using methods from the natural sciences.

Junichi Ushiba and Giulia Cisotto explain their work:

“Originally, I was very interested in the fact that we ourselves evolved from monkeys. The form of a body changes gradually through the process of evolution – for example, having a tail or not having a tail – and species that survive are using that specially evolved body effectively. Thinking about what this implies, even if a body changes, unless the brain that controls the body has the ability to adapt to the change, then naturally, an organism can’t utilize the adaptation effectively like the rest of its body. So, I think that one important keyword Concept in evolution is that the brain itself actually has the ability to adapt flexibly to external objects even more than we think it does. That’s precisely why I think there may be a process where a part of the body that has suddenly changed is incorporated, as if it was a part of the organism’s body, and the organism adapts and evolves accordingly. I wondered if this kind of process couldn’t actually be verified using methods from the natural sciences, and that was the motivation for this research.”

The method used in this research is to observe, in the laboratory, a group of about ten people who have an artificial tail, which can drive a brain-machine interface, attached to their body. Participants learn how to move the artificial tail, and attempt to use it skillfully, like their own body, through trial and error. They also share the ways in which they’ve learned to use the brain-machine interface with other people.

“In the beginning the person doesn’t know how to use the tail, but with some sort of training it’s possible for the person to modulate his or her brain activity in a way to control the tail.

The second step will be to study, using the same technology, some sort of heredity, so some sort of transfer of these new acquired skills to other people. So in the second step we will have more than one person in the same room and the first person, who has already acquired the skill to correctly move the tail, by moving around the room and talking with the other people, can transfer these acquired skills to the other people. So that in a certain period of time, all the other people gradually acquire the same skills, probably in another way, but with this technology we can monitor how each person, individually, can acquire the new skill.”

In physical training methods for sports, dance, and music, and in traditional arts and crafts, there are a variety of long-established approaches and styles, so universal principles for passing on such techniques have not been established. By contrast, the results of this research will provide scientific principles regarding control laws, learning processes, and ways of transmitting knowledge to other people. So, this research could contribute to scientific advances in industrial and cultural activities.

“Unless there are mechanisms that enable information that’s been correctly acquired by the mind to be transmitted to other people reliably, cultural activities that get sustained for hundreds of years, or go on to evolve further, couldn’t exist. Through this kind of research using tails, what I really want to understand is the process by which intangible information is created in the mind and transmitted to other people, so we can reveal some aspects of how culture and civilization took shape, using methods from the natural sciences.”

At JIMTOF 2014, Sugino Machine unveiled the JCC503 Robo, a CNC precision washer that positions parts with a numerically-controlled robotic arm and utilizes a high pressure washer to remove chips as small as 0.6 mm generated during machining processes.

“In order to achieve a washing precision to the level of 0.6 mm, steadily targeted washing is required. The process of steady targeting washing requires a device equipped with small but rigid machine tool technology that is capable of accurate positioning. The washing section of the device also combines technologies for various washing techniques such as high pressure washing, submerged washing, and the ability to select the pressurized flow rate from a variety of nozzles.”

This washer performs conveying, washing, and drying, and is connected directly with a machining line to process large parts such as an engine block. Compared to ordinary articulated washing robots, the precision washer’s cycle time is significantly shortened and the installation space is reduced to two-thirds while maintaining general versatility. This is achieved by adopting a robotic arm that is highly rigid and capable of rapid and agile movement.

“With conventional robotic washers the robots themselves are installed inside the washing rooms, and because of that relationship problems occur with the robots due to water permeation. The JCC503 Robo has all of the electrical components positioned outside the washing environment, so there are absolutely no problems due to water permeation.”

The robotic washer can be programmed using the universal CNC programming language, which has become a global standard, and as a result it can be easily incorporated into production lines.

“The JCC503 Robo was also exhibited at the 2014 IMTS Chicago show in the United States, and as a result, we are receiving a lot of inquiries and questions from leading automakers. With the adoption of this washer by these types of global companies, we hope to contribute to increasing vehicle engine performance through precision washing, as well as helping to resolve everyday environmental issues.”

Oriental Motor has developed the αSTEP AZ Series of closed-loop stepping motor & Driver packages, which contain its patented mechanical absolute sensor, the ABZO Sensor.

“The ABZO Sensor in the motor is able to record the current position of the motor in the sensor itself. So, it enables high-precision positioning and homing without a home sensor or a limit sensor.”

With the majority of stepping motors, a backup battery is needed to store position data, and because batteries have a limited life, data can’t be stored for a long time. But the AZ Series doesn’t need a battery, so storing data isn’t a concern, even if the production equipment is stopped for a long time, or the unit is shipped overseas.

“What is so special about this new product ? Firstly, it enables you to set up an absolute system without the need for a battery. This feature eliminates the battery replacement cycle for the customer, making it possible to achieve a maintenance-free absolute system.”

By eliminating batteries and external sensors in this way, the AZ Series can reduce set-up costs, electrical connections, and footprint.

“In addition to the current line-up, Oriental Motor is planning to release a model with a gearhead. It also intends to develop variations by attaching mechanisms to the motor, similar to motorized actuators, using the current AZ Series. Ultimately, Oriental Motor plans to release these products overseas as well.”

Murata Manufacturing recently unveiled a team of 10 robots, called the Murata Cheerleaders, which dance in formation while balancing on top of balls. The Murata Cheerleaders are Murata’s fourth generation of robots, following the bicycle-riding MURATA BOY in 1991, the second MURATA BOY in 2005, and the unicycle-riding MURATA GIRL in 2008.

All of these robots incorporate Murata’s proprietary core technology.

In addition to being equipped with attitude control technology adapted from the previous robots, the new robots incorporate group control technology to perform in synchronization while accurately identifying their relative positions.

“The robots have three main technical features. The first is inverted-pendulum control technology to maintain stability. This was first used in MURATA BOY and the MURATA GIRL, and now a more advanced version has been developed for the Murata Cheerleaders.”

The robot body is equipped with three gyro-sensors to detect pitch, roll and yaw for 360-degree control. Gyro-sensors also are used for camera image stabilization, car navigation, and electronic stability control in automobiles.

“The second technical feature is synchronization. The robots are equipped with group control technology to perform group tasks in unity. To achieve beautiful formations without collisions, a host computer calculates the next position of each robot and then sends commands to each one. The result is a magnificently beautiful formations.”

“The third feature is ultrasonic measurement of positions using sensing and communication technology. The head of each robot contains five ultrasonic microphones and four infrared sensors. Two transducer beacons simultaneously emit ultrasonic waves and infrared light. Since sound and light travel at different speeds, distances can be detected according to the times that the reflected signals return to each robot.”

Ultrasonic sensors are also used for backup sonar in vehicles. In the robots, the sensors enable respective positions to be identified in real time within a four-meter square area. The group control technology was developed through joint research with Professor Fumitoshi Matsuno’s laboratory at Kyoto University.

“Group control technology also can be used in transportation systems to coordinate vehicle movement smoothly. Such control could alleviate traffic congestion and prevent collisions at intersections with poor visibility. Using wireless communication technology, one of Murata’s strengths, we aim to support communication both between cars and between cars and communication information posts at intersections.”

The Murata Cheerleaders will perform at the Murata booth during CEATEC 2014, which will take place at the Makuhari Messe convention center in Chiba Prefecture, Japan from October 7 to 11.

“At my lab, research is focused particularly on mechanics and mechanisms in the area of mechanical engineering. Mechanisms and machinery are part of a field of learning that has the longest history amongst areas that pertain to mechanical engineering. This field is basically an area of learning that considers the relationship between two things, or in other words, the mutual relationship between one object and another and how to best achieve relative motion between the two.”

Based on the general concept of robotic engineering, various high performance parts centered on motors are used to convert one movement into another. As a result, costs can increase, and a robot can become very expensive even when it is being built to perform a simple action.

However, at the Morita Lab, researchers are aiming to achieve higher performance, lower cost robots with energy savings by considering robotic design from the mechanism level based on entirely new concepts.

“When we rely on motors, the performance of the robot can change based on the performance of the motor for example. In other words, the overall performance of a system varies according to the performance of the individual parts, and the result is a design that is dependent on the parts. However, by considering what type of machine you want and the mechanisms for the conversion of movement, you may be able to achieve more rational and beneficial movement. That’s the basic thought behind our research. Our research is focused on design methods that manifest some sort of movement using original mechanisms without relying on actuators and sensor technology where possible.”

New mechanisms that don’t rely on increasing the performance of the parts themselves are becoming visible and can be applied in a variety of situations. One of those mechanisms is a device called a self-weight compensation device.

This device uses spring force instead of motors and batteries to counter the weight of the arms and constantly maintain an appropriate posture.

With this device, even a heavy object can be moved with a small amount of force, and thus the device is helpful in lightening the load of a robot or operator and in improving precision.

“Put simply, we’re thinking about mechanisms and coming up with ideas. In other words, as we observe the mechanisms and natural world around us on a daily basis, we’re constantly thinking of ideas and wondering about trying new things. As we do this, sometimes we have what you could call inspiration as we come up with ideas that could possibly be put into practice. However, if we don’t confirm those ideas ourselves to determine if they are actually correct, we won’t know if they will function properly when we build them. What becomes important in a time like this is fundamental study. It basically becomes a field of learning.

When we consider things with focus on mechanical kinematics and dynamics, we can examine in advance whether or not the ideas that we come up with are actually reasonable. Then, if we feel confident that an idea will likely go well, we actually design and verify the idea, and we confirm the resulting designs by conducting tests to determine if they reliably function how they should. We’re conducting a lot of research like this.”

In the future as well, the Morita Lab intends to continue proposing new concepts of value for the creation of next-generation products using creative mechanisms.

The Hagiwara Lab in the Department of Information and Computer Science of Keio University’s Faculty of Science and Technology is trying to realize a robotic brain that can carry on a conversation, or in other words, a robotic brain that can understand images and words and can carry on thoughtful communication with humans.

“Even now, significant progress is being made with robots, and tremendous advancements are being made with the control parts. However, we feel like R&D with regards to the brain has been significantly delayed. When we think about what types of functions are necessary for the brain, the first thing that we as humans do is visual information processing. In other words, the brain needs to be able to process what is seen. The next thing is the language information processing that we as humans implement. By using language capabilities, humans are able to perform extremely advanced intellectual processing. However, even if a robotic brain can process what it sees and use words, it is still lacking one thing, specifically, feelings and emotions. Therefore, as a third pillar, we’re conducting research on what is called Kansei Engineering, or affective information processing.”

The Hagiwara Lab has adopted an approach of learning from the information processing of the human brain. The team is trying to construct a robotic brain while focusing on three elements: visual information processing, language information processing, and affective information processing, and an even more important point is integrating these three elements.

“With regards to visual information processing, by using a neural network as well, we’re trying to recognize items through mechanisms based on experience and intuition in the same manner that is implemented directly by humans without having to use three-dimensional structures or perform complicated mathematical processing. In the conventional object recognition field, patterns from the recognized results are merely converted to symbols. However, by adding language processing to those recognized results, we can comprehensively utilize knowledge to get a better visual image. For example, even if an object is recognized as being a robot, knowledge such as the robot has a human form, or it has arms and legs can also be used. Next will be language information processing because processing of language functions is becoming extremely important. For example, even as a robot, the next step would be for it to recognize something as being cute, not cute, mechanical, or some other type of characteristic. Humans naturally have this type of emotional capability, but in current robotic research, that type of direction is not being researched much. Therefore, at our lab, we’re conducting research in a direction that enables robots to understand what they see, to use language information processing to understand what they saw as knowledge, and to then comprehensively use the perspective of feelings and emotions like those of humans as well.”

The robotic brain targeted by the Hagiwara Lab is one that is not merely just smart. Instead, the lab is targeting a robotic brain with emotions, feelings, and spirit that will enable it to interact skillfully with humans and other environments. To achieve this, the lab is conducting a broad range of research from the fundamentals of Kansei Engineering to applications thereof in fields such as entertainment, design, and healing.

“Most of the robots thus far move exactly as they are programmed to do. However, within the next 10 years, and perhaps even sooner, I believe that robots will be steadily introduced into the home. And when that happens, the interface with humans, which are the users, will be extremely important. For example, if you have a robot that can undergo a variety of movements rather than being a robot like this that doesn’t move, and if amongst those various movements, there is movement that looks like fluctuation, then communication is occurring amongst that movement, or if the contact time with the robot becomes longer, then of course the robot will be able to understand even the user’s feelings and personality, and it can then respond and act accordingly. We’re trying to build a robot that is capable of that type of attentiveness.”

Taihei Environmental Science Center has developed a system that automatically performs water quality testing, and can detect bacteria such as E. coli. In the past, this work had to be done manually. The system uses three robots to completely automate all stages of the process, from collecting a predetermined amount of the sample, injecting agar, agitating, coagulating and inverting, to the placement and storage of the culture in incubators. This level of automation not only eliminates human error, substantially improving test accuracy, but it also increases processing capacity.

“Firstly, the system must be installed in an atmosphere completely free of bacteria. So, it is installed in a clean room. Only the air which passes through a 0.3-micron HEPA filter can enter the clean room, so the system is virtually free of bacteria. Due to this, the testing is done in an extremely clean environment.”

This system can perform the test 50% faster than conventional manual work, and can test 100 samples in two hours. All samples are managed using QR codes, eliminating human errors like mislabeling or taking the wrong sample. The current system is for detecting ordinary bacteria and E. coli in water, but it can be designed in a variety of configurations, so it could be used for other types of bacteria or various other testing applications.

“The system costs 25-35 million yen (US$250,000-350,000), but if users test a lot of samples, they can recover the cost in 5-10 years. In that case, this system could save users quite a lot of money. We do a lot of testing in the evening and at night, which has been a big burden on employees. This system has reduced that burden considerably, resulting in our staff being more cheerful and motivated. In other words, the best thing about this system is that it has made employees keen to become the driving force behind our company.”

Taihei is marketing this system to certified environmental surveyors and food manufacturers. They aim to sell 4-5 units during fiscal 2014. In the future, the company plans to extend sales to the global market.

The precision of manufacturing technology has advanced from the micrometer to sub-micrometer level, and recently, to the nanometer scale. In the near future, manufacturing techniques are expected to reach the precision level of operating individual atoms.

At Keio University, the Yan Laboratory, in the Department of Mechanical Engineering (Faculty of Science and Technology), is researching ultra-precision manufacturing technologies based on machining and material processing at the nanometer scale, and even at the atomic level.

In high-precision machining and nano processing, the aim is to maximize material functions, and create entirely new functions to materials that transcend their inherent characteristics. The goal is to maximize the added value of important industrial products.

“Conventionally, creating a smooth surface is the objective of machining. But we recently changed the target to the rapid precision machining of extremely small depressions, protrusions, and surface microstructures, to discover and create new functions for increasing added value of products. That’s our main approach.

For example, in electrical discharge machining to fabricate diamond micro-cutting tools, we’ve confirmed that processing efficiency and accuracy can be improved many times if we incorporate chemical reactions effectively into the electrical discharge machining process. Another example is mechanical machining will inevitably cause a damaged layer in materials. Conventionally, the damaged layer was removed by removing a surface layer from the material by polishing. But we direct a laser beam on the material, which restores the damaged layer back to its original state instantaneously. This is called laser recovery technology. We’re proposing new technologies like this.”

As well as micro-electrical discharge machining and laser processing technologies, the Yan Laboratory conducts a range of interdisciplinary R&D projects. For example, by forming extremely small depressions, protrusions, and grooves on material surfaces precisely using machining techniques at the micro and nanoscales, the Lab is creating various new surface functions, including water-repellent surfaces, micro-lens arrays for optical control, and micro-channels for protein analysis.

In addition, the lab is now working to develop a new type of lithium-ion battery, using waste silicon powders produced in large amounts during semiconductor manufacturing.

Through such research, the Yan Laboratory intends not only to create new products with higher added value, but also to help society conserve resources and energy.

“A feature of our lab is, we combine fundamental research and applied research effectively. We not only do academic research, but also conduct developments for practical applications, to enable our new technologies to be used in industry timely.

In the research of manufacturing technology, I think collaboration between industry and university is extremely important. No matter how hard you have worked to develop a new technology, it is meaningless if it isn’t used. This is why we do collaborative research with a range of companies. Through such collaboration, we aim to apply the results of our research to industry as soon as possible.”

Creating value, creating knowledge, and creating human resources…
The Yan Laboratory will keep pursuing its R&D, aiming to achieve social contributions through research and education.

“Our research has three research projects : image processing, audio signal processing, and biometric signal processing. In image processing, we’re researching how to embed and extract motion. In audio signal processing, we construct the systems which divide into the scores automatically. And in biometric signal processing, we determine the meaning of brain waves(EEG) and convert thoughts to text.”

In image signal processing research, the Mitsukura Lab works on position matching between real and virtual space, which is the basis for AR technology. These researchers are developing a method for estimating the orientation of a face at high speed with high precision, to link the motion of an actual person with an animation. Another research topic at the Mitsukura Lab is expression recognition, using information about changes in the eyebrows and corners of the mouth. The Lab is also researching how to overlay virtual data used in head-mount displays in the real world.

In audio signal processing research, we studied the ability to automatically determine which direction a sound is coming from, by using multiple mic signals. The researchers are developing a system to automatically direct the mic toward the person talking in a videoconference, and a robot to track a talking person. The Lab is also working to develop a system for inputting information by whistling.

In research on biometric signal processing, the Lab is developing a system to operate computers and devices by reading brain waves(EEG) and EOGs.

In brain-wave(EEG) signal processing, the Lab is doing a wide range of R&D. One research project is a system to determine the user’s likes / dislikes and convert them to text form. Another research project is to evaluate sound quality from brain waves(EEG).

Signal processing technology using EOGs, obtained around the eyes, is being utilized in R&D on steering a wheelchair by winking.

Signal processing technology is expected to have a diverse range of applications, including healthcare, entertainment, and wearable devices.

In the Mitsukura Lab, the researchers are using the many algorithms they’ve developed so far to advance such R&D further, in ways that contribute to society.

“At the present stage, for example, it’s said that Google Glass will become very popular, but with that, you have to wear glasses. Wearing glasses itself is unnatural for people. The same is true for brain-wave(EEG) systems; if something’s unnatural, people won’t do it for long. The first thing we have to do is create a system that can read brain waves(EEG) in a natural manner. Next, in conjunction with that, we need a system that can communicate emotions between people, in a way that resembles using the telephone to communicate thoughts. I think we might be able to communicate emotions even without a telephone.”

At Keio University in Japan, the Ishigami Laboratory, in the Faculty of Science and Technology, Department of Mechanical Engineering, is investigating robotic mobility systems. The main mission of this group is to perform fundamental and applied research for application to extreme environments, notably lunar and planetary rovers.

“In our lab, we focus on field robotics that works for extreme environments.”

“For example, we investigate the interaction mechanics between robots and sandy surfaces, taking into account “off-the-road locomotion.”Also, because such robots would be deployed in unknown environments, we also work on vision systems such as cameras and laser rangefinders.”

In this research, there are three key concepts: vehicle-terrain interaction mechanics, autonomous mobility systems, and robotic device development.

In vehicle-terrain interaction mechanics, the researchers analyze vehicle behavior using a dynamic simulator. They’re also developing vehicle-slip compensation systems and in-wheel-sensor systems.

“In the study of interaction mechanics, we first focus on a wheel itself using a “single-wheel testbed.” We put just one wheel on the testbed, and perform experimental runs to obtain wheel force data under different sets of slip parameters. Meanwhile, we numerically calculate wheel force based on a wheel-sand interaction model we developed. Then, we compare the experimental results with the numerical ones, so we can evaluate how valid the interaction model is. Applying this approach to a whole robot-vehicle system, it is possible to simulate how the robot behaves dynamically in an unknown environment. That’s the key approach in this research.”

“Sand flow investigation has received especially close attention in recent years. In our lab, of course, we’ve recently taken such an approach, called particle image velocimetry, or PIV, which has been widely used in fluid mechanics. PIV enables us to clearly determine the sand flow, helping to develop a well-defined interaction model.”

In the area of autonomous mobility systems, the Ishigami Lab is working on environment recognition using laser rangefinders and camera images, as well as robotlocalization, path planning, teleoperation, and integrated sensory processing systems.

“For example, in an unknown environment, there aren’t any road signs, saying ‘there’s an obstacle here,’ or ‘turn right at the next intersection.’ Such obstacles should be detected by onboard cameras, or laser rangefinders which operate based on the time-of-flight principle (measuring the time from a laser emission to detection of the reflected laser.). In our research, we effectively utilize such devices to obtain 3D distance data or 3D environment information. Based on these data, the robot itself decides how to travel. Such systems are called autonomous mobility systems.”

“One typical point of our lab is, I would say, we’re focusing on mechanics as well as autonomous mobility, applying both hardware and software approaches.. In general, one lab has one specific point of interest for research, and looks more deeply into that, but in our lab, we work on mechanics and also on autonomous mobility systems, so we pursue several topics in parallel. Robots consist of integrated technology, so we consider them as total systems.
In addition, another feature of our research is, we consider that field tests are extremely important. We actually take our robots to outdoor environments such as volcanic regions on Izu Oshima and Mt. Aso, and operate them in rough terrain, to test how they act in actual environments.”

“The field of robotics comprises a variety of technologies. So, rather than sticking to a single academic discipline, we’d like students to do research from a broad perspective.”

Keystone Technology’s LED vegetable garden system is a cultivation system for indoor plant factories that uses LED lighting instead of sunlight. The most defining feature of the system on display at the company’s showroom in Yokohama is its 3-dimensional use of space. “This is a 5-tiered cultivation system. For smaller heads of lettuce, you can harvest about 1,500 heads in one month. If this were to be fit into a container of about 20 feet (6m), it would be equivalent to 970 sq. meters. Thus with 16 sq. meters, you could produce an amount that is on par with 970 sq. meters.”

LED lighting has three different wavelengths of red, blue, and green. This system can control the illumination strength according to the stage of plant growth. So, cultivation that would require two and a half months with land cultivation can be reduced to less than one month of cultivation and harvesting.

“In most cases, lettuce grown indoors is crisper and does not have the coarse quality of lettuce grown in sunlight. Because it is softer, it is a vegetable that is easy to eat even for elderly people. Although this may be unexpected, as for the nutritional components or more accurately the functional ingredients, it is possible to obtain a larger content by percentage of vitamins and polyphenols than with vegetables grown in sunlight.”

With this system, there will be differences in production capacity depending on the shape of the plant. Because plants with leaves that spread sideways take up more space, the number of such stalks that can be cultivated is reduced. On the other hand, plants that grow upwards can be planted with smaller intervals so a greater number of stalks can be cultivated.

“This plant factory itself has been here for over 20 years, but there is very little history of plants grown with LED lighting. In particular for plants grown with red, blue, and green lighting, the produce displayed at a plant factory exhibition in July 2010 was our company’s first ever.”

Commercially available since 2010, this system has been installed in various factories, offices and eateries nationwide, such as by a leading eating establishment that has installed 48 units in its processing factory in Kanagawa Prefecture. As workers in Japan’s agricultural industry age, it is becoming more difficult to obtain safe and delicious vegetables through traditional farming techniques. Keystone Technology will continue to offer new lifestyle ideas that provide cities with production capacity and integrate consumption and production.

KOSMEK has developed a robotic hand changer that can switch between robot tools automatically – and with high precision.

“Our aim is to enable a single robot to be used for many purposes. With this hand changer, one robot can handle a whole series of tasks, from processing to assembly or inspection.”

“Our tool changer has three main features: high precision, high rigidity, and long life. For docking, we’ve incorporated a technology called dual contact surface resting. This has a structure called a movable taper sleeve, which enables docking with very high precision, reducing clearance to zero.”

Eliminating clearance between the master cylinder and tool adapter has made it possible to reduce the backlash and tip deviation that occur with ordinary changers, resulting in more accurate work.

Associate Professor Toshiaki Tsuji’s Laboratory at Saitama University has developed R-cloud, a rehabilitation support robot that enables users to view how their own muscles move during rehabilitation and training.

“This rehabilitation support robot is used for strengthening the arms. Its moving parts use pneumatic muscles, and it provides support with gentle movements so it is very safe. Another distinguishing feature is haptic signal processing, a technique that estimates muscular force during training and makes this information visible. It also has a feature that quantifies and evaluates the effect of training.”

R-cloud calculates subtle muscle movements and quantifies this into data, which enables physical therapists to provide accurate instruction on movement, and patients to confirm their own movements.

“This robot has a force sensor and a sensor to measure the arm angle. Based on data collected from these sensors, calculations are made on the force of muscle contraction within the arm, as well as on the amount of calories consumed by each muscle during training. So the robot is equipped with technology that quantifies the degree of effectiveness of training. In addition, we use augmented reality technology to make these results visible.”

By databasing measurement data collected during training, the Tsuji Lab is constructing a rehabilitation cloud system which will promote efficient rehabilitation.

“We would like to see these robots used for rehabilitation training in hospitals, nursing homes, and private homes after an injury, or for use as a preventive measure prior to injury. “

Honda has developed a low-cost, automatic valet parking system that uses parking lot surveillance cameras to help park cars automatically.

In this demonstration, when a car is left in the drop-off area of a parking lot, it receives information about which spaces are available, then drives itself to an empty space and parks. This system can automatically park multiple cars efficiently. Honda sees a lot of potential in a system such as this, especially if it is implemented in the large parking lots of suburban shopping centers.

“If a store introduces this system, customers can drop their car off in front of the store, and the car will go to a parking space automatically, in cooperation with the parking lot. Then, when customers come out with all their shopping, they can just wait in front of the store, and the car will come to them. That’s the situation we’re demonstrating here.”

“As the number of cars increases, it’ll become essential to move them around efficiently. So, we think this kind of system will become increasingly necessary.”

As cars equipped with rear cameras only are the most common type in Japan, Honda decided to use them in this first prototype. Vision from the rear camera is supplemented with that from surveillance cameras to create a system that can see more around the car.

“The information that’s used to move the cars, such as white lines, is sent to the cars as maps. Here, we’re demonstrating that kind of concept, and showing that it could actually be implemented as easily as this.”

Honda plan to create a specification which combines car cameras and parking lot management systems, and develop ways to operate them smoothly. Honda believe that this system could be practical by or before 2020.

The Aerial Imaging (AI) Plate, developed by Asukanet, is a next-generation display device which can form an image which appears to be floating in midair from light that passes through it. By combining this device with sensors, it is also possible to interact with the projected images.

The viewing angle of the display is plus/minus 20 degrees from an axis at 45 degrees to the plate, so the image can only be seen by people within that area. So for example, if this display is utilized for bank ATMs, the image can only be seen by the current ATM user, preventing others from seeing what data is input. Another advantage is that because the device itself isn’t touched, the display won’t get covered in fingerprints.

“At first sight, our AI Plate just looks like a sheet of glass. But in fact, it’s an optical device, designed to reflect light twice. An ordinary mirror just reflects things, but the AI Plate forms an image from light passing through the plate, at the same distance beyond the plate as the object is from the plate. Unfortunately, with a 2D camera, the floating object doesn’t actually appear to be floating, so it looks as if it’s just stuck to the glass.”

“Of course, one way of using this plate is digital signage, to show advertisements in the air. But our next development theme will be finding applications if the plate is made interactive, by combining it with sensors. For example, if an image of sushi is floating in the air, and you order some, the plate could become a point of sale device and take your order. The biggest feature of the plate is that if you switch it off, you get a flat table with nothing on it. So you can then eat your food right there, for example.”

Asukanet is also developing new technology, as an evolution of the AI Plate.

“Our new technology uses a focus-free pico-projector to create objects that move backwards and forwards. So, for example, it could be a prototype for a slot machine, where things like three sevens, which until now moved only sideways, can be moved up and down. We’d also like to see what we can achieve by changing the image distance ratio from the original 1:1 to 1:n, and using a closer light source. Currently the image quality is still quite low and it doesn’t yet produce realistic images, so another new challenge for us is forming an image further from the plate.”

“In fact, we’ve supplied prototypes to most automakers, housing makers, and slot machine makers. So, I think they’ve all been able to make mock-ups. We’re at the stage of seeing what products can be made and sold if a variety of manufacturers use the AI Plate.”

Sharp has developed a health care support chair that combines a range of sensors for checking the user’s health. It can simultaneously record your blood pressure, temperature, body motion, and pulse waveform, storing the data in the cloud.

“When we talked to people, they often said that measuring each health indicator separately is time-consuming and bothersome. If possible, people want to obtain all their health data in one go. The equipment needed to do that is still large, but we’ve made it as compact as possible. Our idea is that people could check their health data regularly, in places they often visit, and consult a physician promptly if there’s any change.”

“We’re considering a system that enables people to videoconference with a physician if they’ve detected anything abnormal. Because the data is all saved, the physician can give suitable advice, while looking at the information the user has obtained so far.”

“Rather than people who are ill going to the doctor, our idea is for healthy people to think about how to stay healthy, prepare for any emergencies, and improve their day-to-day lifestyle.”

These three gears, rotating at 4,500 rpm, are completely in sync, and are running on an AC servo system developed by Mitsubishi Electric.

“Here we’re demonstrating how even if three gears overlap like this, they can be completely prevented from interfering, by moving them with exactly the same timing. This can be done because the motors are controlled with micron-level accuracy. So, there’s no interference, even when they’re running at such high speed.”

“As servo systems are motors, they’re used to drive a variety of machines. Nowadays, they’re used for applications that require extremely high precision, such as mounting smartphone components and coating the glass panels in LCD TVs.”

“This system uses three motors. First, there’s a linear motor, which runs in a straight line downwards. Then, there’s a direct-drive motor, which rotates horizontally, and finally, there’s the motor that turns this gear. By making the timing of the three correspond completely, we can achieve this kind of demonstration. In this demo, the rev rate is 4,500 rpm. The top speed is 6,000 rpm.”

As the three motors in each unit are being controlled by a single multi-axis servo amp, if the timing is correct, the braking energy of one axis can be used as energy for another, in the same way as a regenerative braking system, reducing energy usage.

“This system is currently used in the automotive, chip-making, printing, and food industries. From now on, we think it will be extended to purposes apart from factory automation, such as healthcare.”

Yaskawa Electric has developed an ankle assist walking device, to help people who’ve had a stroke to walk more easily, by encouraging a longer and more confident gait.

“What we’ve done is, we’ve attached a motor to the type of brace that’s usually used in rehabilitation after a stroke. The motor produces the force needed to raise and lower the toes, so the wearer can tread more strongly. There’s a sensor in the shoe, to detect when the wearer is treading, and by raising the ankle in time with that movement, this enables the wearer to take bigger steps.”

“The human foot uses a phenomenon called the stretch reflex. When the ankle is raised, muscles behind the knee reflex. When the ankle is bent by the assister, the knee bends naturally, and the knee’s bending raises the thigh. By skillfully utilizing the physiology of the foot muscles like this, we aim to raise the foot effectively, just by bending the ankle. Also, raising the toes is the most important aspect of helping stroke patients take bigger steps. So, with our system, we assist the ankle alone.”

Yaskawa Electric is currently undergoing preliminary patient trials which have shown that the device has an immediate positive effect. Next, they will run formal clinical trials to confirm the therapeutic effects, with the release of a commercial version slated for around 2015.

OAK, which stands for ‘Observation and Access with Kinect’, is a software application for use by people with severe disabilities. It has been developed by RCAST at the University of Tokyo, in collaboration with Microsoft Japan, and is available from assist-i corporation.

“The Kinect camera detects, in three dimensions, where people are and what posture they have. We’ve used that capability to develop a system called Air Switch. This system creates virtual switches in the air. For example, if a person has a cervical injury, and can only move from the neck up, you can put a switch next to their head. The switch can be worked by any part of the body, so it can be used by moving the head, like this.”

“Air Switch works by detecting how far away an object is. The system also has a Motion History capability, which detects color changes. For example, if Motion History detects that you’re moving your mouth, the system can put a switch near your mouth. In fact, I’m moving my mouth quite a lot right now, and this system can detect motion with millimeter precision. So, for people who’ve been thought of as totally immobile until now, this system could open up a lot more possibilities, based on scientific data, such as shoulder movements, for example.”

Another option is called Face Switch, which keeps detecting facial movements even if the neck moves to some extent. It can be set so that the switch activates when you open your mouth, or it can also be controlled by sticking out your tongue, blinking or changing the orientation of your face.

“This system was released in April. It’ll soon be available in North America and Europe, too.”

Researchers at Wakayama University are developing a system that manipulates the color, tone and contrast of printed materials, and could be used as an aid for users with vision impairments such as low vision or color blindness.

“In this research, we use a projector and camera to freely manipulate the tone and contrast of printed materials like this, by shining light onto them.”

“Right now, white light from the projector is hitting the material. In this device, there’s a camera, which photographs the scene. By controlling the projected light based on the scene, we can make the colors more vivid, for example, like this. The way the system works is, to put it very simply: Blue light is projected onto blue parts, and red light onto red parts, making the colors more vivid.”

“By changing the image processing, we can change color tones as well, like this. We can also make the picture monochrome, make the brightness uniform, or increase the contrast.”

“The point about this technology is, this kind of processing can be done dynamically. In other words, even if the printed material is moved, the system can track it and emphasize the colors.”

“When the light is projected, the actual color tone changes. So, the camera captures the altered color tone. The problem with that is, you can no longer tell how many real colors there are, or how many colors should be projected next. In this research, the system calculates the physical reflectivity of the captured image and the projected image. That estimation is a major feature of this technology.”

“One possible application for this is augmenting human vision. For example, if a person is colorblind, this system could adjust color tones so colors can be distinguished, even if there are combinations of confusing colors. Or a person with cataracts could be helped to see other people’s expressions, by emphasizing outlines.”

Also, by arranging the camera and projector into the same position optically, this image processing technique can be applied to 3D objects as well.

“We’ve added a texture adjustment algorithm, to make opaque objects look semi-transparent, or emphasize their luster, to make them look metallic.”

“We’re currently looking for businesses that might have applications for this technology.”

Researchers from Asia and Europe have developed the world’s lightest and thinnest organic circuits, which in the future could be used in a range of healthcare applications.

Lighter than a feather, these ultrathin film-like organic transistor integrated circuits are being developed by a research group led by Professor Takao Someya and Associate Professor Tsuyoshi Sekitani of the University of Tokyo, who run an Exploratory Research for Advanced Technology (ERATO) program sponsored by the Japan Science and Technology Agency (JST), in collaboration with Siegfried Bauer’s group at the Johannes Kepler University (JKU) Linz, Austria.

This prototype device is a touch sensor featuring a 12×12 array of sensors on a 4.8 cm x 4.8 cm circuit. It is made up of two layers, an integrated circuit layer and a tactile sensor layer.

“The new flexible touch sensor is the world’s thinnest, lightest and people cannot feel the existence of this device. I believe this development will open up a wide range of new applications, from health monitoring systems, wearable medical instruments, and even robotic skins in the future.”

The circuits are extremely lightweight, flexible, durable and thin, and conform to any surface. They are just 2 microns thick, just 1/5 that of kitchen wrap, and weighing only 3g/m^2, are 30 times lighter than office paper. They also feature a bend radius of 5 microns, meaning they can be scrunched up into a ball, without breaking. Due to these properties the researchers have dubbed them “imperceptible electronics”, which can be placed on any surface and even worn without restricting the users movement.

The integrated circuits are manufactured on rolls of one micron thick plastic film, making them easily scalable and cheap to produce. And if the circuit is placed on a rubber surface it becomes stretchable, able to withstand up to 233% tensile strain, while retaining full functionality.

“This is a very convenient way of making electronics stretchable because you can fabricate high performance devices in a flat state and then just transfer them over to a stretchable substrate and create something that is very compliant and stretchable just by a simple pick and place process.”

With the development of these plastic electronics, the possibility for flexible, thin, large area electronics has been realized. In the future, the group would like to expand the capabilities of these circuits.

The results of this research were published in the July 25, 2013 issue of the journal Nature.

“A feature of the slave robot is, it’s powered entirely by air. Nearly all conventional robots are electrically powered, but by driving this robot pneumatically, we’ve made it possible to gently absorb the force when the robot touches something. The force on the tip of the robot is estimated from the air pressure data, and that information is sent to the surgeon’s master robot. So, it can be fed back to the surgeon’s hand. Alternatively, a large force can be produced by a very lightweight, compact unit. An advantage of this system is, the robot overall can be made extremely compact.”

“Here, the user is operating the master robot. This demonstration enables you to experience, for example, how you can feel the reaction force when you pull the rubber band.”

“Of course, you can eliminate shaking of the hand, change the motion ratio, and change the force feedback factor. So, depending on the medical staff and the situation, the parameters can be varied, to make the system easier to use on the spot.”

“Currently, we aim to build this system for one-third to one-tenth the cost of the da Vinci surgical system. So, we think we can make it better in terms of cost as well.”

“Right now, we’re working with surgeons, who are actually using this system and giving us feedback on how to improve it. We’re receiving support from MEXT, and we aim to achieve a practical version within 4 to 5 years.”

This industrial mixing system, developed by OMC, uses a multi-axis robot from Nachi.

In contrast with conventional mixing systems that rotate the container along two axes, using this multi-axis multi-directional robot enhances the stirring effect, mixing and dispersing materials in a shorter amount of time.

The mixing capacity is dependent on which robot is used, with a maximum capacity of around 700kg.

In the future, OMC plans to expand the use of this system into areas such as food production and pharmaceutical manufacturing.

Kawasaki Heavy Industries has developed the world’s first all stainless steel robot with seven degrees of freedom.

It will be used in the drug discovery and pharmaceutical fields to automate experiments which use dangerous chemicals.

Due to its stainless steel body, it can be sterilized using Hydrogen Peroxide gas, for work in sterile environments.

Kawasaki plan to launch this robot in January next year.

This robot is being developed to automate the management of laboratory animal colonies used by pharmaceutical companies and research institutions, primarily those that raise from 10,000 to 30,000 mice or rats. It’s currently under development by Nikkyo Technos and Yaskawa Electric.

“The biggest problem in raising animals is that diseases can spread from people to the animals. If that happens, all the animals have to be killed and replaced with new ones. So, infection by people must be prevented. By managing animals using robots in an enclosed space, it’s basically possible to eliminate the spread of diseases from animals to people or from people to animals.”

This six-axis, vertical, multi-jointed robot can mimic the motions of a human. It can change cage sheets, top up the food, and change the water. Taking out cages, changing sheets, and topping up food are each done with separate tools, which the robot picks up in turn. In this model, the amount of food remaining isn’t taken into account. But in the next model, a camera will be used to see how much food is left, so the robot can add the right amount.

“Mice, especially, are nervous animals, so the robot handles the cages gently. These tasks account for about 80% of the work involved with lab animals. So, our aim is to automate the hard, dirty, and dangerous task of dealing with so much dust and droppings.”

This robot can also work in coordination with a robot that carries cages from the rack to the workbench, and a monitoring system for the animal facility. In this way, it can automate all aspects of animal raising, from surveillance to care.

“The animals can be monitored with cameras 24/7. So, people can check their own cages from the monitoring station. The animals’ body temperature can also be managed. It takes about two hours for the cages to come back from the lab, but data can be viewed directly from a PC in the monitoring room. So, people can see the cages they want right away, wherever they are.”

“Doing this work with robots makes it much faster, so lots of cages can be handled in a short time. Also, using cameras to monitor food and water is safer and more reliable than having people do it. We’d like to complete the system this year, and next year, we’d like to produce several sets, so we can make at least a provisional start.”

This remote medical care robot for use in emergency situations, is under development by a research group at Waseda University, led by Dr. Hiroyasu Iwata.

“If a person receives an impact in an accident, there is a possibility that they could have internal bleeding. In emergency rooms, there’s a diagnostic method called FAST, using ultrasound imaging to check for internal bleeding. But that can’t be done until the patient reaches the hospital. So our idea is that this robot can be put on the patient in an ambulance, and while on the way to the hospital, it can be controlled by a doctor in a remote location. As there is ultrasound probe attached, this robot can be used to check for internal bleeding.”

This robot, which weighs 2.2 kg, can be attached to the chest area using a belt, and can be used anywhere as long as there is a network connection. So it could also be used in the home or remote areas.

To enable a physician at a remote location to operate the robot intuitively, it’s controlled using an iPhone, with the robot’s rotation and the ultrasound probe angle controlled by touch.

“The ultrasound probe is attached here, and as it moves, the ultrasound image appears like this. If there’s bleeding, that appears as black shadows like this. If the patient has internal bleeding, they’re in danger unless they get to a hospital. This system lets the physician know that.”

“One point about this robot is, you can change the probe angle freely, keeping the probe in contact with the body. So, even if the patient is moved, the robot moves with them. This means images can continually be sent to the physician at a remote location.”

“Before this robot can be used in emergency care, legal barriers must be overcome. So, what we’d like to do initially is use it for pregnancy check-ups. By doing that, if we make one more prototype version, we think the robot will become practical. In that case, we think this system could become practical within three years.”

Lands Work, a manufacturer of tofu-making machinery, has developed a robot that can pick up very soft foods such as tofu.

“First, the robot checks which way the tofu is facing, and how big it is, using a camera. The images are analyzed by a computer, and the robot works out which way to orient the tofu. Once it picks the tofu up, it then puts it in a package. A feature of this robot is the hand, which can gently carry very soft, fragile things without damaging them. This hand uses a special surface processing, which was developed by our company.”

“If tofu is carried quickly, it breaks. So, the robot moves tofu quite slowly, shifting only 1,200 to 1,500 pieces per hour. But firmer items, such as fried tofu, can be carried at a rate of 2,500 per hour.”

“We are using mainly firm tofu in our demonstration but it can also handle soft tofu. We’ve also included some soft tofu here, so this system can even handle delicate things like that.”

“We’ve only just developed this system. People have asked about using it for seafood, eggs, and meat, and we think it could be used for all kinds of foods. The robot itself is a very general-purpose model. So, for example, if we reduce production volume on one line, we could use the robot on another line, just by changing its program. That’s the best thing about using robots.”

This camera system can track very fast moving objects, keeping them in the center of the screen at all times. Currently under development by the Ishikawa Oku Lab. at the University of Tokyo, this latest version captures Full HD video and can be used outdoors.

“Ordinarily, to change the direction a camera faces, you move the camera mechanically. But in this system, it’s not the camera that moves, it’s the mirrors. This makes it possible to change where you’re looking really quickly. In this demonstration, we’re tracking a table tennis ball. The ball moves extremely fast, but this system can keep compensating for the ball’s motion, so the ball stays in the middle of the image.”

This device consists of two mirrors for pan and tilt, and a group of lenses. The Saccade mirrors can be controlled at high speed, on the order of milliseconds. The mirrors move independently, so this system doesn’t lose its high-speed response even if it’s connected to a large, heavy camera.

Also, by connecting a projector instead of a recording device, images can be projected onto a fast-moving object. This could also be used in AR applications, showing interactive content on moving objects.

“Using a rotating mirror is a common method, but usually, the mirror is in front of the camera, so a very large mirror is needed. But a feature of this system is, it can even capture wide-angle images with a small mirror. That’s because the system contains special optics called a pupil shift system.”

“Another important point is, this system does very fast image processing to recognize the subject. It captures and processes an image every 1/1000th of a second. In this way, it can track the subject stably and continuously, simply by feeding back the subject’s position, without particularly predicting its behavior.”

“For example, this system can record, in great detail, the instant a player hits a home run, including how the bat bends and the ball reacts, and the ball’s subsequent path. Or in soccer, it can record things like penalty kicks in amazing detail. We think this will make it possible to shoot sports in a really compelling way.”

“Right now, we’re actually taking this outdoors to where sports are played, to check how accurately it works. We hope it will be usable for actual broadcasting in about two years.”

This multi-viewpoint robotic camera system, under development by NHK, links the motion of eight sub-cameras to that of an individual camera, so that all the cameras film the same moving object.

“Using this system, you can create the effect of stopping time, and moving the viewpoint all around the subject.”

“Previous methods used a fixed camera, so they could only capture subjects moving in a narrow or limited space. But this multi-viewpoint robot camera system can film dynamically moving sports, or subjects at lots of locations in an extensive space.”

Each robot camera has two motors, for pan and tilt. The cameras also share lens data, so they can zoom in unison.

“Pictures taken with robot cameras inevitably have discrepancies in direction control. So simply switching between them doesn’t give smooth pictures. To solve that problem, we’ve brought in a computer, which redoes the direction control virtually. Image processing is done, to virtually orient the cameras in the direction of the subject, making it possible to switch between the cameras.”

“Pictures from this system can be sent out about one minute after filming is finished. First of all, we intend to use this for live sports broadcasting. We’d like to make it easy to understand what’s happening, by providing multi-viewpoint pictures instead of the current slow-motion replay.”

This multi-viewpoint robotic camera system can also be used as an image capture system for integral 3D TV, under development by NHK. By generating integral 3D video from multiple-viewpoint footage, 3D video of sports events will be viewable on integral 3D TV.

With the aim of implementing a television service which allows viewers to touch virtual objects, NHK is developing a tactile system which applies stimuli to five points on one finger, making objects feel more real than when using previous systems.

“This device assists people with a visual disability, through what’s called the tactile or kinesthetic sense. It communicates a 3D shape or 2D graph of an object shown on a TV, such as a work of art, as a sensation felt by the hand.”

“The system detects spatial position data for the fingertip in 1/1000 of a second. The finger moves freely if there isn’t anything present, but when it approaches something, it becomes unable to go into the object. By tracing with your finger like this, you can feel that there’s a continuous rough surface there. Also, the jagged feeling of the tooth makes the sensation similar to that of touching an actual object.”

In previous systems, a force was applied to the entire fingertip, and when angular parts of an object were presented, the fingertip tended to deviate from the virtual object, making it hard to understand the object’s shape. But this device makes the corners of an object, in particular, feel natural, by generating a force at five points.

“Now, Domo-kun’s body is one object, while the tooth is another object. The texture can be changed for each object. Here, the tooth alone has been made slightly hard. In that case, if we create a different object using CG, we can do this kind of thing.”

“This is slightly different from a texture that’s actually felt by the skin. For instance, if you hold a pen, you can perceive textures through the pen. This system reproduces that kind of sensation.”

“From now on, we’d like to simplify this device. We want to extend the range of movement of the fingers so that curved surfaces are also recognizable, while keeping the advantages of the current version.”

Fujitsu has developed technology which can measure a person’s pulse in real time by analyzing video of their face.

“As blood circulates through the body, the amount of light absorbed by the face varies, depending on how much blood there is in it. The first point about this technology is, it identifies minute changes in light intensity on the face, and converts them to a pulse. Also, it accurately detects people’s movements, to distinguish noise. Consequently, it can make a measurement in as little as five seconds.”

When the user is sitting still, the system continuously detects changes in light intensity on the users face, as shown by the green waveform. The red waveform shows the resulting wave with noise associated with movement removed. Fujitsu has found that that accuracy of the system is within about three beats per minute.

“The main point about this technology is, it can make the measurements naturally. All the person needs to do is be in front of the camera, without operating a device. For example, when you’re working on a computer, you often stop moving for at least five seconds while you’re thinking. We think that, by detecting those moments and measuring your pulse rate, this system could be used to support health management, by recording changes throughout the day.”

“In the case of a security camera, it might be possible to detect suspicious persons, based on the assumption that people about to do something risky have a high pulse rate. However, we don’t think that can be done using this technology alone. We think it might be possible through all-round analysis, by combining this with other technologies.”

“We’d like to release this as a device embedded in our products. Right now, we’re working to bring such products out this year, including smartphones as well as PCs.”

A group at Tokyo Institute of Technology, led by Dr. Osamu Hasegawa, has succeeded in making further advances with SOINN, their machine learning algorithm, which can now use the internet to learn how to perform new tasks.

“Image searching technology is quite practical now. So, by linking our algorithm to that, we’ve enabled the system to identify which characteristics are important by itself, and to remember that what kind of thing the subject is.”

These are pictures of rickshaws, taken in India by the Group. When one of these pictures is loaded, the system hasn’t yet learned what it is. So, it recognizes the subject as a “car,” which it has already learned. The system is then given the keyword “rickshaw.” From the Internet, the system picks out the main characteristics of pictures related to rickshaws, and learns by itself what a rickshaw is. After learning, even if a different picture of a rickshaw is loaded, the system recognizes it as a rickshaw.

“In the case of a rickshaw, there may be other things in the picture, or people may be riding in the rickshaw, but the system picks out only those features common to many cases, such as large wheels, a platform above the wheels, and a roof, and it learns that what people call a rickshaw includes these features. So, even with an object it hasn’t seen before, if the object has those features, the system can recognize it.”

“With previous methods, for example, face recognition by digital cameras, it’s necessary to teach the system quite a lot of things about faces. When subjects become diverse, it’s very difficult for people to tell the system what sort of characteristics they have, and how many features are sufficient to recognize things. SOINN can pick those features out for itself. It doesn’t need models, which is a very big advantage.”

The Group is also developing ways to transfer learned characteristic data to other things. For example, the system has already learned knives and pens, and possesses the characteristic data that they are “pointed objects” and “stick-shaped objects” respectively. To make the system recognize box cutters, it’s made to look at the similarities between box cutters, and knives and pens, which it has already learned. And it’s made to transfer the basic characteristic of being stick-shaped and pointed. If characteristic data for box cutters can be obtained from other systems, SOINN can guess from the transferred data that the objects are box cutters.

“Here, you’ve seen how this works for pictures. But SOINN can handle other types of information flexibly. For example, we think we could teach it to pick out features from audio or video data. Then, it could also utilize data from robot sensors.”

“With previous pet robots, such as AIBO, training involved patterns that were decided in advance. When those possibilities are exhausted, the robot can’t do any more. So, people come to understand what it’s going to do, and get bored with it. But SOINN can remember an amount of changes. So, in principle, it can develop without a scripted scenario.”

Panasonic, together with the Belgium-based research institution IMEC, has developed a DNA testing chip that automates all stages of obtaining genetic information, including preprocessing.

This development is expected to enable personalized, tailor-made therapy to become widespread.

“This is the chip we’ve actually developed. As you can see, it’s less than half the size of a business card. It contains everything needed for testing DNA. Once a drop of blood is inserted, the chip completes the entire process, up to SNP detection.”

SNPs are variations in a single DNA base among individuals.

Detecting SNPs makes it possible to check whether genetically transmitted diseases are present, evaluate future risks, and identify genes related to illness.

“By investigating SNPs, we can determine that this drug will work for this person, or this drug will have severe side-effects on that person. Investigating SNPs enables tailor-made therapy. But with the current method, it has to be done in a specialized lab, so it actually takes three to four days. In the worst case, it takes a week from sending the sample to getting the result. Our equipment can determine a patient’s SNPs in just an hour after receiving the blood.”

Testing is done simply by injecting the blood and a chemical into the chip, and setting it in the testing system.

First of all, the blood and chemical are mixed. DNA is then extracted from the mixed solution. The regions containing SNPs are then cut out and amplified. DNA amplification uses technology called PCR, which cuts out the desired sections by varying the temperature. With the conventional method, this process took two hours.

“Through careful attention to thermal separation design, we’ve achieved high-speed PCR, where 30 temperature cycles are completed in nine minutes. We think this is one of the fastest PCR systems in the world.”

The amplified DNA is then sent through a micropump to a DNA filter. Here, the DNA is separated for each section length. Then, a newly developed electrochemical sensor identifies SNPs while the DNA is dissolved in the chemical.

“To implement this system on one chip, and make detection easy, the first thing we focused on was the actuators. This system requires a very small, powerful pump. In our case, we used a conductive polymer for the actuators. A feature of these actuators is they’re powerful, yet extremely compact. They can exert a pressure of up to 30MPa.”

“Ultimately, we’d like to make this system battery-powered. We think that would enable genetically modified foods to be tested while still in the warehouse.”

This Smart Trash Can, developed by Minoru Kurata, an engineer at a Japanese auto maker, won an Excellence Award at the Japan Media Arts Festival.

“When you toss trash at it, a sensor detects the position of the trash, and sends the information to a PC. The PC calculates where the trash will fall, and communicates it to the can via wireless connection.”

“The trash can has to move autonomously. To achieve that, I created a special mechanism, with a single axis for both the wheel rotation and the change in angle. So even if the wheels rotate, the position of the can itself doesn’t change. That mechanism, the circuitry, and the motor controller all fit within the diameter of the can. If the center of gravity is high, the can will fall over, so I made the can low, narrow, and compact, to keep the center of gravity as low as possible.”

“I’ve received inquiries about turning this into a commercial product. Right now, I’m working to patent the technology for the Smart Trash Can.”

“The probability that the trash will go in is not very high, only 10-20%. Even making full use of the current sensor, it still has errors. So I’d like to improve the success rate. I want to either improve the sensor, or upgrade the control by reducing the error through a program.”

Professor Takashi Kawai’s lab at Waseda University’s School of Fundamental Science and Engineering is conducting research on a cross-modal perception technology employing multi-sensory integration in which participants perceive tactile sensation from visual stimulation. In a visual-evoked “minute tactile sensation” presentation system prototype, a very simple mechanism is used to enable the phenomenon of tactile sensation perception, despite the lack of any physical contact, simply by viewing a video image.

“One element of the system is the use of a see-through head-mounted display to present a stereoscopic image. Unlike when typically viewing an image on a display, it is important here for the image to be viewed in space. An extremely important aspect in constructing this system is that the participant is able to observe in a natural manner a part of his or her body such as the hands making contact with the image.”

First, a commercially available see-through head-mounted display is worn. An image of an object floating about 30cm in front of the eyes becomes visible. Presently this object is displayed as a ball of fire or ice to represent temperature sensation. The participant places his hands as if touching the viewed object so that the ball of fire or ice is observed resting on the hands. By adjusting the hands so that the object is touching the palms and then by gently shaking the head left and right so that a slow-speed motion is perceived, he can experience a subtle tactile sensation such as a slight breeze or cool or warm sensation.

“Feasible areas of application are entertainment or communication, or as a new form of media for producing visual content to induce tactile illusion. Or for more serious applications, there are various possibilities for consideration including rehabilitation as well as training and education where this type of system can be used effectively.”

With the prototype system, the research group has discovered that the participant’s perceived tactile sensation will change qualitatively, such as a sensation of warmth or cold, according to the content of the video image. The group will continue to conduct research on video content with associated tactile sensation and search for effective utilization of tactile sensation in fields such as education and social welfare.

The GeneLEAD from Precision System Science (PSS) is a fully automatic genetic testing device that completely automates the genetic testing process that ordinarily would require manual intervention. This device, which handles the complete process up to genetic amplification, has a small form factor at 34 cm tall, 41 cm long, and 19 cm wide, and is envisioned for use in various medical and research facilities.

“As long as there is even a small space, the device can be used in any type of hospital. It is just about the same size as a computer, so one of its features is being easily usable in any location. The technology to miniaturize the device is complicated, but I believe we were able to achieve this size by keeping it as simple as possible. As for ease of use, it has been designed based on the concept of being usable wherever it is located, so it is an easy to use machine.”

At this time, genetic testing is typically only conducted at large research facilities, but PSS aims to create an environment where genetic testing devices can be used at more medium-sized hospitals, emergency testing hospitals, and even small clinics.

“Under the concepts of companion diagnostics and personalized medicine that have recently become popular topics in the US as well as Japan, the idea is to use medicine suited to the patient and conduct genetic testing for that purpose. As these types of devices become widespread, even the town doctor will be able to conduct these tests. We aim to create a world in which tests can be done right there so that patients can safely take their medicine. “

PSS, which is searching for a way to roll out the GeneLEAD globally including through OEM sales, is along with this also considering marketing test reagents it has developed. PSS aims to release the GeneLEAD between the end of this year and the beginning of next year at a price as affordable as possible.

Professor Yoichiro Kawaguchi of the University of Tokyo Interfaculty Initiative in Information Studies is building a robot of a swimming jellyfish based on the theme of “space jellyfish.” To artistically express the ambience of a wriggling jellyfish, he selected the theme of a jellyfish swimming in space.

“I don’t believe there have been many soft-bodied creatures of this type that have been made into a robot. It requires creating numerous delicate movements. We put together simple configurations and focused on creating the elegant movements of the jellyfish. While skillfully integrating repeated wavering motions, for the future I would like to make it so that it can elicit various emotions. For this exhibit I would be satisfied to have people see both the design and movements.”

“This model is made of a ceramic pottery known as Satsuma porcelain. I once asked the most famous local Satsuma porcelain artisan named Chin Jukan to make a CG model for me. I thought this could be further improved, which has led to the current model made.”

Kawaguchi ultimately wants to make not just traditional handicraft but rather something capable of space travel.

“For the future I am thinking of incorporating traditional handicraft in the manufacturing process, so I am also considering lacquering. I am thinking of using previously unused combinations to draw out new possibilities.”

With an eye towards creating a new industry and exporting Japanese traditional handicrafts to the world, Kawaguchi is considering the incorporation of high tech in future product development.

This power amplification robot, called Power Loader, is currently under development by Activelink, a Panasonic subsidiary venture.

The aim is to achieve a robot that can freely utilize power beyond human strength, in emergencies or on construction sites. Power Loader’s role is to link people with construction machinery.

“Power Loader receives the force input by a person through its force sensors, and amplifies it using motors. In this way, it assists the person, by producing a large force that the person can’t achieve alone. The concept we’ve used to develop Power Loader is, you get into it, rather than wearing it. Using this concept makes it safer to operate.”

When Power Loader was first developed, Activelink made a very large version. But following the accident at the Fukushima Daiichi nuclear plant, development has shifted to Power Loader Light, a more compact version.

“In each sole, there’s a six-axis force sensor. In line with the force vectors detected there, three axes for each leg are used to control motors in the ankle, knee, and hip, exerting a force in the direction of support.”

“We want to make Power Loader capable of carrying 50-60 kg while moving with agility. The legs could be used to support something very heavy, such as a radiation suit, and we think it could also carry 50-60 kg easily using the robot arms.”

This equipment serves as a platform for research on power loader control, which is being considered by Activelink and the Japan Atomic Power Company. It can be used to carry 30 kg with one arm, while exerting a minimum of effort.

“This is a trial harness, for use in designing a connection to the Power Loader Light legs. We’ve made it as compact as possible while producing this much power.”

“After that, we’re considering a very large version. The big Power Loader, which we were developing before, uses 22 motors. We’d like to achieve an exoskeleton with that kind of all-axis assist. When we do that, we think we’ll have a robot that can carry at least 100 kg easily.”

Solidray, which is involved in virtual reality production, has released an immersive crossmodal system incorporating visual and tactile feedback, enabling the user to see and feel flowing water in a virtual space.

“When you put on the 3D glasses, the scene appears to be coming towards you. You’re looking at a virtual world created in the computer. The most important thing is, things appear life-sized, so the female character appears life-sized before the user’s eyes. So, it looks as if she is really in front of you. Also, water is flowing out of the 3D scene. When the user takes a cup, and places it against the water, vibration is transmitted to the cup, making it feel as if water is pouring into the cup.”

The glasses have a magnetic sensor, which precisely measures the user’s line of sight in 3D. This enables the system to dynamically change the viewpoint in 3D, in line with the viewing position, so the user can look into the scene from all directions.

The tactile element uses the TECHTILE toolkit, a haptic recording and playback tool developed by a research group at Keio University. The sensation of water being poured is recorded using a microphone in advance, and when the position of the cup overlaps the parabolic line of the water, the sensation is reproduced. The position of the cup is measured using an infrared camera.

“Here, we’ve added tactile as well as visual sensations. Taking things that far makes other sensations arise in the brain. You can really feel that you’ve gone into a virtual space. All we’re doing is making the cup vibrate, but some users even say it feels cold or heavy.”

“We’re researching how to make users feel sensations that aren’t being delivered. We’d like to use that in promotions. For example, this system uses a cute character. Cute characters are said to be two-dimensional, but they can become three-dimensional. We think it’s more fun to look at a life-sized character than a little figure. So, we think business utilizing that may emerge.”

This table helps you to draw precise freehand circles and lines. It is under development by a group in the Yasuaki Kakehi Lab at Keio University.

By using a computer to control the XY position of a magnet under the surface of the table, it implements, on paper, drawing methods utilized in computer graphics.

“I’ll place an ordinary ballpoint pen on the table. Now, I can semi-automatically draw a precise circle, or a straight line, or an illustration prepared in advance. In other words, while I draw with the pen, this system lets me switch to accurate rendering like in computer graphics, such as drawing a precise circle, by assisting me with the pen.”

When drawing, you can use a regular ballpoint pen with a metal tip, or a digital pen. If you use a ballpoint pen, the position where you start drawing has to correspond with the origin on the XY grid, but if you use a digital pen, the system recognizes its location and you can start drawing from any position.

“The digital pen understands the coordinates of the pen position. So, you can start from where you want, and also save and copy the picture you’ve drawn. This means you can copy and paste your original drawing repeatedly.”

“Apart from drawing figures that require precision, we think this system will have various applications. For example, in distance education, students could learn to draw by feeling the sensation of how a teacher draws.”

“Rather than limiting ourselves to pens, we’d like to extend this project to other items used with paper, such as scissors and compasses. We hope to bring in digital technology to assist users with those, too.”

Transience is an artwork by the Wakita Lab at Keio University. It is intended to represent a harmony between calligraphy and computers, by dynamically altering the color of calligraphy on paper.

“At first sight, it’s hard to understand, but if you watch for about two minutes, I think you’ll see how the color gradually changes. We suspected that this kind of transient effect could be achieved by combining calligraphy with the computer.”

To change the color of the ink on the paper, the research group did numerous tests, using several kinds of functional ink and conductive materials. In the process, they developed this unique coloring system.

“We’re using ink that changes color with temperature. But we’ve devised a way to change the temperature by printing conductive ink on the back of the paper, and not requiring the previous actuators. This enables us to control the color without losing the look and feel of paper. That’s the major point about this technology. We control the color by using that mechanism and a microcontroller.”

Currently, the computer is programmed to change the color of four rows of characters at a time, but the characters can also be controlled individually.

“For art on paper, an extensive culture has accumulated, including typesetting, woodcuts, and calligraphy. We’d like to keep expressing ideas on paper, while thinking about how to combine that extensive culture with computers.”

Technos has introduced the Super5000K 7K Model neuro-visual sensor. This is the world’s highest precision visual inspection system, and can detect spots 0.05mm in size at a distance of 2m, with a 1.4m field of vision. This is 1,000 times the resolving power of a conventional 4,000 pixel line sensor CCD camera, and 4,000 times that of a full HD camera.

“For industrial applications, this product has recently been used in many automotive-related situations, but it is also used in the steel, electronics, and flat-panel display industries. Typical manufacturing processes end with a visual inspection; we can fully automate that. Our sensor has high speed and high precision. It operates on the same principles as the human eye, but with 100 times the precision. It can perform automatic inspections with 1,000 times the precision of conventional CCDs. In principle, it emulates the movement of cells in the human eye; your eye vibrates up and down 80 times per second, and we emulate that vibration using electronic circuits.”

Conventional CCD-based equipment has had difficulty detecting color variations. By applying the principles of human vision, Technos has achieved a sensor with 100 times the precision of human eyes, making it possible to detect color variation.

“Color variation is a problem in a variety of settings; this sensor is used in industrial applications, but is also used in maintenance applications such as inspecting highways or oil storage tanks. This technology for rapidly picking up small details will be even more widely used in the future, and we plan to develop those applications.”

Pricing for the minimum configuration starts at an equivalent of $240,000, and runs up to between $470,000 and $730,000, depending on the particular specifications. Technos estimates that about 240 companies listed on the first section of the Tokyo Stock Exchange will need equipment with this level of precision. The company aims to sell about 10 units per year to the automobile, steel, semiconductor, and liquid crystal industries. Technos has been awarded patents in 14 countries around the world. With inquiries coming from foreign countries, it is looking to expand overseas as well.

Sharp have updated their Cocorobo line of intelligent robot vacuum cleaners, with a new smaller model, as well as a Cocorobo Navi function, which allows the robot to be controlled when the user is outside the home.

Cocorobo Navi can be used to visually map out your house creating a floor plan, letting the robot know where objects are placed, so you can directly specify where the robot should go.

Sharp also unveiled a controller, which connects to the Cocorobo via it’s USB port, and can be used to control a range of household devices. Currently, Sharp TVs, air conditioning systems, LED lights and their Slim Ion Fan can all be controlled via the smartphone app, with support for competing companies products to be rolled out in future updates.

The new, smaller Cocorobo, the RX-V60, is 29.9cm in diameter, 4.7cm less than the current model, but with similar performance.

It features the power vacuum system, which can suck up dust from the gaps in wood floors, and due to it’s reduced size, can comfortably maneuver around small spaces such as in between the legs of dining room chairs.

It will go on sale in Japan on the 13th of December for approximately 75,000 yen (US$900) and Sharp will manufacture 8,000 units per month.

Researchers at the CNRS-AIST Joint Robotics Laboratory and the CNRS-LIRMM Interactive Digital Human group, are working on ways to control robots via thought alone.

“Basically we would like to create devices which would allow people to feel embodied, in the body of a humanoid robot. To do so we are trying to develop techniques from Brain Computer Interfaces (BCI) so that we can read the peoples thoughts and then try to see how far we can go from interpreting brain waves signals, to transform them into actions to be done by the robot.”

The interface uses flashing symbols to control where the robot moves and how it interacts with the environment around it.

“Basically what you see is how with one pattern, called the SSVEP, which is the ability to associate flickering things with actions, it’s what we call the affordance, means that we associate actions with objects and then we bring this object to the attention of the user and then by focussing their intention the user is capable of inducing which actions they would like with the robot, and then this is translated.”

“He is wearing a cap which is embedded with electrodes, and then we read the electric activities of the brain that are transferred to this PC, and then there is a signal processing unit which classifies what the user is thinking, and then as you see here there are several icons that can be associated with tasks or you can recognize an object that will flicker automatically, and with different frequencies we can recognize which frequency the user is focussing their attention on and then we can select this object and since the object is associated with a task then it’s easy to instruct the robot which task it has to perform.”

“And the applications targeted are for tetraplegics or paraplegics to use this technology to navigate using the robot, and for instance, a paraplegic patient in Rome would be able to pilot a humanoid robot for sightseeing in Japan.”

NEC has developed a marketing service that utilizes facial recognition technology to estimates the age and gender of customers, and accumulates the data, along with the dates and times that customers visit stores. This data is then used to analyze trends in customer behavior and visit frequency.

This service is provided in Japan via NEC’s cloud computing technology, only requires a regular PC and video camera, and is available for approximately $880 (70,000 yen) per month per store.

“This service is mainly intended for retailers that have several stores. It provides retailers with customer attributes based on facial images. That information is helpful for sales strategies.”

This service can also detect repeat customers across multiple stores. It uses a face detection and comparison engine developed by NEC, called NeoFace.

“NeoFace ranked top in tests by the USA’s NIST. Here, we’re using this high-precision facial recognition technology in a marketing service. But NEC is also developing various other services, such as intruder surveillance, using facial recognition technology.”

Face data is encrypted in real time and converted into characteristic data sets for analysis. Because face data can’t be restored from characteristic data, there’s no risk that face data will be inadvertently disclosed.

“Retailers can find out how many customers visit their stores at each time of day, and what customers’ attributes are. This enables them to fine-tune their sales strategies. For example, the data could be used to run campaigns targeting men and women in their 20s.”

The Gocen is a device which scans and plays handwritten sheet music in real time. It is being developed by a group at the Tokyo Metropolitan University led by Assistant Professor Tetsuaki Baba.

“First, the system looks at the stave, then at the notes, then at the position of the notes, to determine the high notes. In addition, it directly reads words such as piano or guitar. The computer automatically recognizes them, and changes the instrument. Also, for example, if this melody is in F minor, rather than C major, when the system reads the letters Fm, it has the ability to add four flats.”

The sheet music image is analyzed using the OpenCV library in combination with a unique algorithm. While the play head is above a note it will continue to sound that key, and in the case of stringed instruments, if you move it up and down it can make the pitch fluctuate. Also, the size of the notes determines the volume level and it can handle chords as well.

“This idea arose when we were talking with music publishing companies. Until now, sheet music was really only used by placing it on a stand to play an instrument. But it could be played by computer in real time, and given various expressions. We think a system like this will make it easier for children and beginners to learn about musical notation.”

“Lots of people use computers to compose music, but it’s been found through research that paper works well at the initial stage, for deciding what kind of composition, or what kind of melody. In that regard, I feel that this system is very effective as a composition support system.”

A system that makes the backseat of a car look transparent is currently being developed by a research group at Keio University.

The system applies optical camouflage technology, using recursive reflection, to vehicles. The technology was developed by Professor Masahiko Inami. This system has been optimized to make the backseat look transparent from the driver’s viewpoint.

“The main feature of our system is, it makes things look as if you can really see through them, rather than giving an indirect view of what’s behind. For example, with a system that shows things on a monitor, you can understand your car’s position and where any obstacles are. But the point about our system is, it gives a sense of depth, by making things appear where they actually should be when you look back.”

In this system, video from the rear cameras is projected onto the backseat using a half-mirror. The video is processed by a computer to make things appear actual-sized, making the driver feel as if the back seat really is transparent.

“The screen is made of a special material called a recursive reflector. Optically, it has an interesting characteristic because it reflects light back in the direction of incidence. When we thought of applying it to automobiles, the advantage was, it gives a clear image in daylight, rather than in a dark place like this.”

Currently, only the backseat has been made transparent, but ultimately, the aim is to make the car’s interior completely transparent through 360 degrees, with no blind spots.

“Currently, the system shows one point clearly. But from now on, we’d like to keep increasing the number of viewpoints. We plan to enable the system to be easily used by anyone.”

“We’re discussing the possibility of collaboration with automakers. There are lots of issues in this research, so we’d like to collaborate with a variety of businesses. Regarding a commercial version, we hope we’ll be able to offer one in about five years.”

This simulator can represent the complex pulsation of the heart. It is being developed by a group including members from National Cerebral and Cardiovascular Center and Riken.

Until now, simulating heart pulsation has required huge amounts of computing, done by supercomputers or offline. But this new system makes it possible to visualize heart pulsation on a notebook PC in real time, by applying computer graphics technology.

“Previously, simulation methods were based on mechanics. Our method is completely new because we use technology called shape matching, based on shape constraints. To put it simply, we divide a heart model into 7,000 parts, and make each part contract independently. The main point about this method is that it calculates the shape of the heart overall by minimizing contradictions between the contracted parts.”

“The 3D heart model can be created by extracting regions from a patient’s CT scan. The course of the cardiac muscle fibers has already been designed. The timing of contraction can be specified through this graph. Normally, the atrium contracts first, then the ventricles.”

Because the heart model runs in real time, it’s possible to deform the heart by applying tension, and to observe cross-sections. Additionally, heart attacks can be simulated by stopping the motion and painting a region. This also makes it possible to create virtual heart disease.

“First of all, we’d like to utilize this simulator in clinical practice. Its primary purpose is to help physicians and patients communicate with each other. Another purpose is to help train physicians. We’d also like to use it simply for elementary education.”

The remaining issues that need to be overcome include, reducing the complexity of creating individual patients heart models, as well as finding ways to handle complex patterns such as ventricular fibrillation.

At the University of Tokyo, the Hirose Tanikawa Group has developed an AR system that can manipulate the user’s feeling of having eaten enough, by changing how big the food appears.

This system features a head-mount display with a camera, and uses image processing to make food look bigger than it actually is. The size of the food in the hands can be changed in real time, while keeping the size of the hands constant. The system creates a natural image by using a deformation algorithm, to alter the shape of the hands in line with the size of the food.

“This technology can stimulate a feeling of having eaten enough visually. We’ve found that when food looks bigger, you feel full right away, but when it looks small, you don’t feel full even if you eat a lot.”

“In the US, obesity is a huge problem, so there’s a lot of research on obesity. For example, it’s been shown that the amount people eat varies depending on the size of plates and packages. As part of such studies, we’ve been able to confirm that the amount eaten actually changes when the size of the food does.”

“So far, we’ve done tests involving 12 subjects, under quite strict experimental conditions, to see if the amount eaten actually changed. When food was magnified 1.5 times, the amount eaten decreased by about 10%. When it was made to look two-thirds its actual size, the amount eaten increased by about 15%.”

“Currently with this head-mount display, the picture is chroma-keyed using a bluescreen. But we’d like to make this system usable in the home, by using smarter image-processing technology, so it could be used for any food on various kinds of tables. In the future, we hope to develop technology that encourages healthy eating habits without the need to think. For example, high-calorie foods that shouldn’t be eaten much could be automatically magnified by the computer, and foods that should be eaten in larger amounts could be made to look smaller so people will eat more.”

At the University of Tokyo, the Naemura Group is developing paper computing technology, which can automatically erase, copy and print hand-drawn sketches on paper.

As well as using a camera and computer, this system uses a laser and UV light, making it possible to work directly with the hand-drawn sketches using the computer.

So for example, the user can leave only the edges of hand-written characters, creating 3D like text, or draw a figure by hand and color it in automatically.

“This is one technology for truly turning ordinary paper into a display. Until now, it’s been possible to project things onto paper and use it as a screen, or import things drawn on paper to PC by using a digital pen. But the first method uses light, so the results can only be seen in the dark, and with the second method, even if you can import things, you can’t access them on paper from the computer.”

The pen for sketching uses Frixion thermo-sensitive ink, which becomes transparent when heated, and sketches drawn by the Frixion pens are lit from behind by a laser to erase them. The ink can be erased to a high level of accuracy, at intervals of 0.024 mm.

The paper is coated with a photochromic material, which changes color when it absorbs light, and a DMD-driven UV projector with a resolution of 1024 x 768 pixels is used to print the image onto the paper.

“The idea is to do computing on paper. But in the future, we’d like to enable several people to create one document, like with Google Docs, actually using real-world paper while far apart. We’d also like to enhance the rendering that’s possible through collaboration between people and computers. For example, by giving more detailed access than you get by hand, and enabling you to draw large areas at once.”

Panasonic has developed a prototype dry head spa robot, which in the future could be attached to a desk or bath. It uses robot hand technology previously developed for use in their hair washing robot.

“For kneading the scalp while the hair is dry, people use dry head spas. So, we’ve added a robot hand we’d already developed for washing hair, and developed this, as a model for seeing how such therapy might feel.”

To start the dry head spa, you first adjust the head fitting, and record your hairline position. Then, the robot hand applies slight pressure to recover a 3D scan of your head.

A 3D tracking mechanism enables the 24 fingers to follow the shape of your head automatically, with the arms expanding and contracting, to make sure they reach the center of your scalp. As well as gently kneading your scalp, this machine can be used in conjunction with a massage chair to give a full-body experience.

“We’d like to develop this hand unit further, in a variety of ways. For example, it could be attached to a bathtub or a desk.”

“We’ve only just created this, so we don’t yet have a timeline for releasing it. We’d like to use this version for fine-tuning the technology, to check that it provides optimal sensation and movement.”

This compact explorer robot, called Sakura, being developed by the Future Robotics Technology Center (fuRo) at the Chiba Institute of Technology, is the latest in their line of disaster response robots, and has been designed so it can enter and survey the basements of the damaged Fukushima nuclear reactor buildings.

“Sakura’s mission is to go into the underground levels of nuclear power plants. It’s very compact, as it has to go down stairways just 70 cm wide, and turn around on landings that are also 70 cm.”

“Coolant water is leaking from somewhere inside the reactor, because no matter how water much is pumped in, the level doesn’t stay above 60 cm. But unless that space can be filled with water, the melted-down fuel rods can’t be removed safely. So, Sakura’s first job is to find out where the cracks are.”

Sakura will use its camera to look for cracks, but as the camera can’t see everywhere, Sakura also has a directional microphone to detect the sound of water.

An additional obstacle is that the stairway below ground is steeper than that above. So, Sakura also has improved climbing performance to handle steep gradients.

“The part above ground slopes at 40 degrees, and that below ground at 42 degrees. This difference of just two degrees is very hard for a robot to handle. What’s more, Sakura has to climb down, and then climb up, to the top of the suppression pool. That stairway slopes at 53 degrees.”

To minimize the operator’s exposure to radiation, Sakura has an automatic extension and retraction device for communication cables, and a plug-in charging system. Sakura is also made from specially selected materials, with the aim of making it maintenance-free for three years.

“To make the robot radiation-hard, the previous model, Rosemary, has a 2mm aluminum plate on the bottom, but Sakura has a 5mm stainless steel plate. Radiation is expected to be high in the underground areas, so the bottom surface is designed to provide at least some shielding.”

“We’ve only just got Sakura to move, so for the next month, we’ll be testing its mobility and durability. Once that’s done, we’ll test its ability to carry the necessary equipment on a stairway. Then, we plan to fine-tune Sakura by testing it with TEPCO.”

Tokai Rubber Industries has developed the world’s first all-rubber speaker. This speaker utilizes Smart Rubber, which conducts electricity and can freely expand or contract, to generate sound.

Previously, the company developed flexible, all-rubber touch sensors using Smart Rubber. This all-rubber speaker arose from the company’s new line of development: materials for artificial muscles.

Q. “Until now, thin speakers have been piezoelectric and film types, as used in smartphones and tablets. But those don’t produce low-frequency sounds. By contrast, the rubber speaker we’ve developed does produce low frequencies. It’s the first speaker of this kind in the world.”

This speaker consists of a piece of non-conductive rubber sandwiched between two rubber electrodes. When a voltage is applied between the rubber electrodes, static electricity is generated, causing the sheet to expand. Sound waves are generated by the repeated expansion and restorative force of the rubber sheet.

“Of course, technology is needed to make rubber conduct electricity. What our technology does is give the rubber a uniform surface charge. Another thing needed is insulating rubber between the pieces of conductive rubber. Each type of rubber has to be flexible, and the insulating rubber mustn’t change its resistance when it expands. That’s a key technology in this speaker.”

“Wearing headphones is a bit of a hassle, so we’d like to use the flexibility of this speaker to build it into chairs and the like. That way, people could enjoy audio in open settings.”

“Currently, we don’t have a specific product roadmap. We’d like to think about needs and applications together with potential customers, including those at CEATEC. Then, we’d like to turn this speaker into a commercial product.”

Alps Electric has developed a next-generation vehicle interface, created using its own sensors and input devices. The interface consists of a Multi-Modal Commander, allowing for direct and gesture based input, as well as a Haptic Shifter which changes settings according to the situation.

The Multimodal Commander is a hemispherical device with a capacitive sensor and a near-infrared sensor. It can be operated intuitively not only by touch, but also by moving your hand around it. It also supports gesture input, using the space at the top of the device.

“The system has to detect whether the user is really reaching out to use it, or is just moving their hand nearby. This detection is done by creating a kind of curtain with infrared. If a hand goes inside the curtain, and gets close to the Commander, the system deduces that the hand is approaching to use it.”

On the other hand, the Haptic Shifter, a next-generation shift lever, enables the shift gate and load settings to be changed, in line with the user’s preferences.

“Haptic technology means we can create a variety of sensations. This device can change the shift gate from I to H shaped. It can also guide the user automatically when changing from low gear to second.”

In addition, those operations can be predicted, through the behavior-predicting IR sensor. This enables the device guidance capability to be called up before a device is touched. This is achieved using optical flow to detect hand motion vectors. The system can also guess who the user is, so it can provide different menus for the driver’s and passenger’s seats.

“We’d like to release this in 5 to 6 years. We’d like to market it not only for operating all kinds of equipment, but also as a way of making cars adapt to people. That would make cars fun to drive, by combining entertainment with driving.”

Yamaha Motor has developed an electrical assist unit for wheelchairs, called the JWX-2.

The JWX-2 applies PAS technology from assisted bicycles to wheelchairs. The electric assist works in line with the load on the wheelchair’s hand rims, enabling it to operate smoothly on slopes, where the load is high, and on carpets.

“We currently offer a unit called the JW-II, but this one differs in two main ways. In the previous version, the motor was pillbox-shaped and stuck out, so there were some cases where it couldn’t be attached to the wheelchair. Here, we’ve made the pillbox motor flat, so the surface it’s attached by is flat. This means the JW-II can be attached to virtually any wheelchair.”

This newly developed, flat AC servomotor also enables the axle position to be adjusted in the up-down and front-back directions. Plus, it’s more efficient, which increases the travel range by about 20%.

“We previously offered three types, to match the user’s physical condition. For example, users could choose Type A or B depending on their grip strength. But this new unit can be connected to a PC, enabling the user to create settings with software called JW Smart Tune. For example, hardly anyone has exactly the same strength in their left and right arms. So, people who are weaker on the left can get stronger assistance on the left, enabling them to move straight ahead.”

The assist is switched on and off simply by pressing a button. Additionally, the left and right buttons can be used to set different assist levels, which can be used on steep and gentle slopes.

“We’ll be releasing this in spring 2013, as we’re still developing it. We haven’t decided the price yet, but it’ll be based on those of current models.”

At the Chiba Institute of Technology, a group led by Shuro Nakajima has developed a robot wheelchair that can climb over steps.

This robot can make a variety of movements, using its four-wheel drive and five axes. Normally, it rolls along on its wheels, but if there’s a step or ditch, it can get over the obstacle by using its wheels as legs. All the user needs to do is tell it which direction to go, using a joystick. The robot automatically assesses the surrounding terrain and moves appropriately.

Also, when moving on uneven ground, the robot controls the seat to make sure it remains level.

“The robot has sensors on its feet, to see if there’s anything nearby. It can also see how far it is from a step. It actually has various sensors, and it uses them in combination, to assess how big a step is. Even if the sensors are in error, and the wheels touch an obstacle, the wheel torque can vary, so the robot can use that as back-up, too. In this way, the robot can detect the road surface reliably.”

“If a sensor detects a step, the robot calculates whether it can lift that leg. It can’t raise its wheels right away, so the steering system at the rear makes preparatory motions to gain stability. When the wheels can be raised stably, the robot lifts its legs.”

In addition, this robot can line its wheels up, and extend stabilizers to the left and right, enabling it to turn a circle. This makes it easy to reverse, even in a narrow space.

“We were particular about using wheels, because this kind of vehicle will mostly move on ordinary paved surfaces. The most efficient way of getting around on paved surfaces is to use wheels, like a car. So, this robot mainly uses wheels, but the wheels can become legs.”

“For now, we’re presenting this system and form as a concept, and the motion has mostly been worked out. So, we’re at the stage where we can show this robot to the world. In the next phase, we’ll get a variety of people to try it, so we can fine-tune the user experience.”

A research group at Keio University, led by Seiichiro Katsura, has developed the Motion Copy System. This system can identify and store detailed brush strokes, based on information about movement in calligraphy. This enables a robot to faithfully reproduce the detailed brush strokes.

This system stores calligraphy movements by using a brush where the handle and tip are separate. The two parts are connected, with the head as the master system and the tip as the slave system. Characters can be written by handling the device in the same way as an ordinary brush.

Unlike conventional motion capture systems, a feature of this one is, it can record and reproduce the force applied to the brush as well as the sensation when you touch something. Until now, passing on traditional skills has depended on intuition and experience. It’s hoped that this new system will enable skills to be learned more efficiently.

“What’s new is, there’s a motor attached to the brush, so while the person’s moving, the motion and force are recorded as digital data using the motor. What’s more, with this technology, the recorded motion and force can be reproduced anytime, anywhere using the motor.”

“We’ve succeeded in using the motor to record the movements of a veteran calligrapher, and to actually reproduce them. So, I think we’ve demonstrated that, to record and reproduce human skills, it’s necessary to record not just motions, but also how strongly those motions are made.”

Looking at the graph of position and brush pressure, the position of the master system and the motion of the slave system are consistent, and also, the pressure shows the opposite waveform. This shows that the law of action and reaction is being artificially implemented between the master and slave systems.

“Currently, multimedia only uses audiovisual information. But we’d like to bring force, action, and motion into IT, by reproducing this kind of physical force via a network, or storing skills on a hard disk for downloading. So, with this new form of IT, you’d be able to access skill content.”

On October 11, NTT Docomo will start the Utsushite Honyaku service, which instantly translates foreign-language restaurant menus when you point a smartphone’s camera at them.

Utsushite Honyaku is a commercial version of a service that’s been available as a trial version. As well as menus, the new service can now handle signs. It works between Japanese and four languages: English, Korean and both simplified and traditional Chinese.

“For example, suppose you visit Korea, and you can’t read signs in Korean at all. You can start up this app, select the Korean dictionary, and use it just by pointing your smartphone’s camera at the writing you can’t read. The translation is shown over the Korean text, so when you use this app, it feels as if you’re looking at a sign in Japanese.”

“This service doesn’t use cloud translation, so instead, the app itself and the dictionary are downloaded to the phone. This means it can be used for free, without having to access the mobile network.”

The user can choose two translation modes. In one mode, the whole translation is superposed on the actual picture, and in the other, it’s shown line by line in a separate window.

This service can also translate from Japanese into the four languages. So, it’s helpful not only for Japanese Docomo users, but also for foreign Android smartphone users visiting Japan.

This autonomous driving system, developed by Nissan, can automatically drive and park your car in a shopping center parking lot.

The EV used in this demo, the NSC-2015, contains technology for recognizing the environment around the car using all-round cameras, and a remote monitoring system using 4G communication. When the driver gets out at the entrance to a parking lot, they can use a smartphone to instruct the car to park automatically. Then, the car automatically drives to the parking area, finds a space, and parks.

“In the case of a shopping center, it’s said that people wait, on average, ten minutes to get into the parking lot. We’re giving this demonstration of an automatic parking system to show how things could be made a bit more convenient in such time-consuming, stressful situations.”

To retrieve the car from the parking lot, the driver can summon it using a smartphone. The car detects the driver’s position, and drives there automatically.

“As this is an indoor demo, we can’t use GPS. The system is receiving parking lot information from the smartphone via the cloud. When the car actually drives, it will recognize white lines or roads using its cameras, and find an empty space in the parking lot.”

The remote monitoring system can also function as a security camera. So if the car’s cameras detect suspicious movement nearby, it can notify the driver’s smartphone automatically.

“Technologically, we’ve established various aspects of this system. Overall, though, we think it’ll take some time to become practical. We’ve called the car the NSC-2015 to signify that we think such vehicles may be achieved within 2-3 years. We think this is a technology of the fairly near future.”

“Currently, non-contact charging systems are technically possible, and we think they’ll be used in cars in the near future. To utilize them, parking must be done precisely, so if a person’s driving, it may take several attempts to get the car on the plate. If this system can be used to park in one go, we think progress may be made with non-contact charging. So, we think this system could lead to the implementation of a variety of technologies.”

“For robots to operate in ordinary living spaces, the most important factor is their size. So, in developing this one, we’ve prioritized making it compact.”

“The picture from the robot’s camera is shown on the user’s tablet. We’ve achieved a capability where, if there’s a dropped object in the picture, the user can tap it, and the robot automatically picks the object up. As for fetching things, it’s currently very difficult for robots to find and bring back objects in ordinary environments. So, for now, we’ve achieved a system where the user puts their favorite things in specific boxes, and registers the boxes, so the robot can automatically fetch things from there.”

The robot’s height can vary between 83cm and 1.3m, so it can reach things in high places. When the robot picks something up, it can also use a suction mechanism, so it can handle thin objects like paper as well.

“Regarding capabilities, we actually surveyed people with disabilities, together with the Japan Service Dog Association, to find out what capabilities users want a robot to have. The results showed that there’s a strong need for robots that can pick up dropped objects, fetch wanted objects, and communicate remotely, to report an emergency, for example. So the first thing we’ve done in developing this robot is, we’ve given it those three capabilities.”

“We’ve done a trial with Yokohama Rehabilitation Center, and we’ve already found some issues that need thinking about. So, the first thing we’ll do now is, we’ll implement capabilities to handle those. For example, people would like the robot to operate switches and open doors. We’ll be testing capabilities like that in our trials.”