Category robots

Conferences and trade shows, held in interesting locations around the world, can be entertaining, informative and an opportunity to explore new places, meet new people and renew acquaintances. Three recent examples: Xponential, the mostly defense-related unmanned land, sea and air show, held in Dallas; Innorobo, focused on service robotics, in Paris; and ICRA, the IEEE’s premier robotics conference, in Singapore.

ICRA

The 2017 IEEE International Conference on Robotics and Automation (ICRA), the IEEE’s principle forum for robotics researchers to present their work, was held this year at the Marina Bay Sands Hotel and Convention Center in Singapore. ICRA continues to have the highest number of cited research papers in the robotics field of all the various global conferences (including IROS).

In an IEEE/Spectrum review of that portion of the conference that was biomedical-related, a swallowable capsule robot capable of needle aspiration, guided by magnets, and an autonomous snake-like colonoscopy robot were two of the hits. Another reviewer found the rehab exoskeletons, haptic interfaces, modular robot components and many of the ROS-enabled solutions of merit. Overall, almost 3,000 robotics researchers attended ICRA 2017 and most found many things of interest (including Singapore and the Marina Sands Hotel).

Xponential – all things unmanned

The Association for Unmanned Vehicle Systems Internation, AUVSI, annual trade show and conference, Xponential, held this year in Dallas, Texas, showed the changing nature of the industry and offered suggestions (guesses) as to where they were going. 170,000 visitors attended while 100 speakers and over 650 exhibitors put on this choreographed show of military weaponry, defense and security systems and equipment, and commercial unmanned air, land and sea systems.

AUVSI’s membership fees are discounted for members of the military and first responders and the exhibitor list continues to favor military/defense-related companies, but most of those companies now have a growing commercial component.

Autonomous vehicles have always been the constituency of AUVSI but with all the money flowing into autonomous car startups, and the talent search to corral people to make this new industry happen, a small portion of this Xponential show was devoted to the prospect of that future (see chart above).

The folks at The National Robotics Education Foundation (NREF) produced a gallery of over 300 interesting photos from Xponential. They also produced a special set of pictures of UAS engines from the show. Unmanned vehicles used by the military, for search and rescue, in support of agriculture and mining, for infrastructure inspection, and in a variety of other circumstances must stay aloft for long periods, hence the interest in engines that can support that amount of air time.

Innorobo

I visited Innorobo. It is a necessary show in a rapidly changing arena. Over 7,000 visitors perused an eclectic group of 170 startups, integrators, component manufacturers and service robot providers exhibiting a wide range of products and services at a site on the outskirts of Paris. Over the 3-day show, 50 speakers explored topics from robotics-related AI to philosophical discussions about law and ethics to the latest innovations in personal and professional service robotics.

The IFR (International Federation of Robotics) says that robot installations in France increased by 22% to 1,400 units in 2016 (compared to 700 units in the UK), particularly within the car industry. France ranks 2nd within the EU for robot density (the UK is 10th). Innorobo started as a show to promote France’s robotics industry (there are 225+ French companies in The Robot Report’s Directories and on our Global Map). Held in Lyon, the show grew to its present size through the hard work and willpower of a small group of inventive women entrepreneurs. It grew and relocated to Paris where it’s been for the last two years. As the focus expanded from promoting in-country robotics to displaying global innovations in robotics of the startup companies, research labs and service robot companies beginning to make inroads aroud the world – the show has become a valuable mainstay for the European press, investors, business executives, students, and roboticists alike.

Events, Directories and The Robot Report’s Global Map

From time to time it becomes relevant to toot the horn of the free resources available on The Robot Report. Our events calendar, directory of companies and educational institutions involved in the robotics industry, and the global map for job seekers and researchers alike are free and always updated.

There are still 28 robotics-related events remaining in 2017. Check them out:

• Hamlyn Symposium on Medical Robotics, June 25-28, London, UK
• Autonomous Systems World, June 26-27, Berlin, Germany
• Conf on Flexible Automation & Intelligent Manufacturing (FAIM), June 27-30, Modena, Italy
• Automation and Robotics Conference, June 28-29, San Diego, CA
• Industrial Automation Shenzhen (IAS), June 28-30, Shenzhen, China
• Forbes AgTech Forum, June 28-29, Salinas, CA
• RoboUniverse Seoul, June 28-30, Seoul, Korea
• Intl Symposium on Automation & Robotics in Construction (ISARC), June 28-July 1, Taipei, Taiwan
• China Intl Robot Show (CIROS), July 5-8, Shanghai, China
• Toward Autonomous Robotic Systems (TAROS), July 19-21, Guildford, UK
• RoboCup, July 25-31, Nagoya, Japan
• World Robotic Conference, August 23-27, Beijing, China
• Farm Progress Show, August 29-31, Decatur, IL
• InterDrone, September 6-8, Las Vegas, NV
• European Conf on Mobile Robotics, September 6-8, Paris, France
• Conf on Field and Service Robotics, September 12-15, Zurich, Switzerland
• RobotWorld, September 13-16, Seoul, Korea
• IEEE AFRICON 2017 and Robotics and AI, September 18-20, Cape Town, South Africa
• ROSCon, September 21-22, Vancouver, Canada
• IEEE Intl Conf on Intelligent Robots and Systems (IROS), September 24-28, Vancouver, BC, Canada
• RoboBusiness, September 27-28, Santa Clara, CA
• Drone World Expo, October 3-4, San Jose, CA
• China Industrial Automation and Robotics Show, November 7-11, Shanghai, China
• AgriTechnica, November 12-18, Hanover, Germany
• Conference on Robot Learning (CoRL 2017), November 13-15, Mountain View, CA
• Collaborative Robots & Advanced Vision Conf, November 15-16, San Jose, CA
• Asian Robotics Exhibition AREX, November 23-24, Singapore
• iREX 2017, November 29-December 2, Tokyo, Japan

WeRobotics Global has become a premier forum for social good robotics. The feedback featured below was unsolicited. On June 1, 2017, we convened our first, annual global event, bringing together 34 organizations to New York City (full list below) to shape the global agenda and future use of robotics in the social good sector.  WeRobotics Global was kindly hosted by the Rockefeller Foundation, the first donor to support our efforts. They opened the event with welcome remarks and turned it over to Patrick Meier from WeRobotics who provided an overview of WeRobotics and the big picture context for social sector robotics.

I’ve been to countless remote sensing conferences over the past 30 years but WeRobotics Global absolutely ranks as the best event I’ve been to – Remote Sensing Expert

The event was really mind-blowing. I’ve participated in many workshops over the past 20 years. WeR Global was by far the most insightful and practical. It is also amazing how closely together everyone is working — irrespective of who is working where (NGO, UN, private sector, donor). I’ve never seen such a group of people come together this away. – Humanitarian Professional

WeRobotics Global is completely different to any development meeting or workshop I’ve been to in recent years. The discussions flowed seamlessly between real world challenges, genuine bottom-up approaches and appropriate technology solutions. Conversations were always practical and strikingly transparent. This was a highly unusual event. – International Donor

The first panel featured our Flying Labs Coordinators from Tanzania (Yussuf), Peru (Juan) and Nepal (Uttam). Each shared the hard work they’ve been doing over the past 6-10 months on localizing and applying robotics solutions. Yussuf spoke about the lab’s use of aerial robotics for disaster damage assessment following the earthquake in Bukoba and for coastal monitoring, environmental monitoring and forestry management. He emphasized the importance of community engagement and closed with new projects that Tanzania Flying Labs is working on such as mangrove monitoring for the Department of Forestry. Juan presented the work of the labs in the Amazon Rainforest, which is a joint effort with the Peruvian Ministry of Health. Together, they are field-testing the use of affordable and locally repairable flying robots for the delivery of antivenom and other medical payload between local clinics and remote villages. Juan noted that Peru Flying Labs is gearing up to carry out a record number of flight tests this summer using a larger and more diverse fleet of flying robots. Last but not least, Uttam showed how Nepal Flying Labs has been using flying robots for agriculture monitoring, damage assessment and mapping of property rights. He also gave an overview of the social entrepreneurship training and business plan competition recently organized by Nepal Flying Labs. This business incubation training has resulted in the launch of 4 new Nepali start-up companies focused on Robotics-as-a-Service. 

The following images provide highlights from each of our Flying Labs: Tanzania, Peru and Nepal.

The second panel featured talks on sector based solutions starting with the International Federation of the Red Cross (IFRC). The Federation (Aarathi) spoke about their joint project with WeRobotics; looking at cross-sectoral needs for various robotics solutions in the South Pacific. IFRC is exploring at the possibility of launching a South Pacific Flying Labs with a strong focus on women and girls. Pix4D (Lorenzo) addressed the role of aerial robotics in agriculture, giving concrete examples of successful applications while providing guidance to our Flying Labs Coordinators. The Wall Street Journal (Sally) spoke about the use of aerial robotics in news gathering and investigative journalism. She specifically emphasized the importance of using flying robots for storytelling. Duke Marine Labs (David) closed the panel with an overview of their projects in nature conservation and marine life protection, highlighting their use of machine learning for automated feature detection for real-time analysis.

Panel number three addressed the transformation of transportation. UNICEF (Judith) highlighted the field tests they have been carrying out in Malawi; using cargo robotics to transport HIV samples in order to accelerate HIV testing and thus treatment. UNICEF has also launched an air corridor in Malawi to enable further field-testing of flying robots. MSF (Oriol) shared their approach to cargo delivery using aerial robotics. They shared examples from Papua New Guinea (PNG) and emphasized the importance of localizing appropriate robotics solutions that can be maintained locally. MSF also called for the launch of PNG Flying Labs. IAEA was unable to attend WeR Global, so Patrick and Adam from WeRobotics gave the talk instead. WeRobotics is teaming up with IAEA to design and test a release mechanism for sterilized mosquitos in order to reduce the incidence of Zika and other mosquito-borne illnesses. More here. Finally, Llamasoft (Sid) closed the panel with a strong emphasis on the need to collect and share structured data to accurately carry out comparative cost-benefit-analyses of cargo delivery via flying robots versus conventional means. Sid used the analogy of self-driving cars to highlight how problematic the current lack of data vis-a-vis reliably evaluating the impact of cargo robotics.

The fourth and final panel went beyond aerial robotics. Digger (Thomas) showed how they convert heavy construction vehicles into semi-autonomous platforms to clear landmines and debris in conflict zones like Iraq and Syria. Science in the Wild (Ulyana) was alas unable to attend the event, so Patrick from WeRobotics gave the talk instead. This focused on the use of swimming robots to monitor glacial lakes in the Himalaya. The purpose of the effort is to identify cracks in the lake floors before they trigger what local villagers call the tsunamis of the Himalaya. OpenROV (David) gave a talk on the use of diving robots, sharing real-world examples and providing exciting updates on the new Trident diving robot. Planet Labs (Andrew) gave the closing talk, highlighting how space robotics (satellites) are being used across a wide range of social good projects. He emphasized the importance of integrating both aerial and satellite imagery to support social good projects.

The final session at WeR Global comprised breakout groups to identify next steps for WeRobotics and the social good sector more broadly. Many quality insights and recommendations were shared during the report back. One such recommendation was to hold WeR Global again, and sooner rather than later. So we look forward to organizing WeRobotics Global 2018. We will be providing updates via our blog and email list. We will also use our blog and email list to share select videos of the individual talks from Global 2017 along with their respective slide decks.

In the meantime, a big thanks to all participants and speakers for making Global 2017 such an unforgettable event. And sincerest thanks to the Rockefeller Foundation for hosting us at their headquarters in New York City.

June 12, 2017 – June 18, 2017

News

A U.S. drone strike in Yemen reportedly killed two individuals suspected of being members of al-Qaeda. The strike targeted a vehicle in Shabwa province, one of several strongholds of al-Qaeda in the Arabian Peninsula. (Reuters)

The European Union released draft regulations for consumer and commercial drones. The blueprint was assembled by the Single European Sky Air traffic management Research Joint Undertaking, a body set up by the European Commission to study low-altitude drone operations. The EU plans to implement drone regulations by 2019. (Press Release)

Commentary, Analysis, and Art

A report by the Center for a New American Security explores possible policies designed to manage military drone proliferation.

A report by the Columbia Law School’s Human Rights Clinic and the Sana’a Center for Strategic Studies evaluates the U.S. government’s transparency on drone strikes between 2002 and 2017.

At Fast Company, Steven Melendez considers how the next generation of military drones and autonomous systems could change warfare.

At the National Interest, David Axe writes that the U.S. Air Force is planning to invest more in disposable strike drones than large complex systems.

Also at the National Interest, Dan Goure looks at how U.S. companies are focusing on ending the threat posed by rogue drone use.

At the Washington Post, Thomas Gibbons-Neff writes that U.S. officials are concerned about the ability of ISIS drones to disrupt U.S. operations.

At Lawfare, Rebecca Crootof and Frauke Renz argue that the conversation surrounding lethal autonomous weapons should seek alternative regulatory strategies beyond an outright ban.

At TechCrunch, Brian Heater looks at how RE2 Robotics is making robot control mechanisms more intuitive.

At Inc.com, Will Yakowicz writes that Saildrone, a California-based startup, aims to deploy more unmanned sailboats to measure climate change than all of the satellites in space.

A study by the Karolinska Institute in Stockholm found that defibrillator-carrying drones could cut response times for cardiac arrests by 16 minutes. (The Guardian)

An essay at the Economist explores how consumer drones are being put to work for commercial applications.  

At iRevolutions.org, Patrick Meier looks at how flying robots could be used to combat the spread of Zika.

At the University of Toronto, students and faculty discuss the opportunities presented by the development of advanced autonomy for consumer drones.

At KSHB, Belinda Post writes that drones are a popular father’s day gift this year.

At AIN Online, Vladimir Karnozov considers the history of Iranian-Russian collaboration on the development of new drones.

Know Your Drone

The U.S. Missile Defense Agency is looking to acquire a high-altitude long-endurance drone that can carry a high-energy laser to intercept intercontinental ballistic missiles. (IHS Jane’s 360)

Drone maker RaptorUAS has unveiled the Raptor EV, a vertical takeoff and landing fixed-wing drone. (Unmanned Systems Technology)

U.S. drone maker Kratos is unveiling its two new low-cost combat drones, the XQ-222 Valkyrie and the UTAP-22 Mako. (New Atlas)

The U.S. Air Force is conducting a study to estimate the service life of its MQ-9 Reaper drones. (Defense Daily)

Airbus Defence and Space will conduct test flights of its Zephyr high-altitude long-endurance drone in Australia next year. (Shephard Media)

U.K. firm Horizon Technologies is looking to mount a satellite phone monitoring sensor on small drones. (IHS Jane’s 360)

Researchers at Nvidia are developing drone navigation systems that rely on computer vision rather than GPS signals. (The Drive)

Amazon has been awarded two patents for its delivery drone system: one for foldable rotor arms and the other for a winch system to lower packages from the drone to the ground. (GeekWire)

Drones at Work

South Korean officials said that a North Korean drone that crashed in the country had taken 10 photographs of a sensitive U.S. missile defense site. (The Washington Post)

A search and rescue team in Colorado used a newly acquired drone to search for a group of missing hikers. (CBS4)

General Electric has begun a program to test drones and unmanned ground vehicles to inspect industrial facilities and infrastructure. (Reuters)

The Croatian Defense Ministry is planning to acquire drones and set up an unmanned aircraft squadron. (Defense News)

Drone Delivery Canada conducted the first beyond visual line of sight delivery test flights in Canada, flying a drone in Alberta from a control center 2,500 kilometers away in Toronto. (AUVSI)

Documents released by the U.S. Department of Justice show that there have been more than a dozen attempts to smuggle contraband into federal prisons using drones in the past five years. (USA Today)

Firefighters in London used a drone to assist in the response to the Grenfell Tower fire. (Newsweek)

The Federal Aviation Administration is investigating reports of illegal drone operations in Charlotte, North Carolina. (Charlotte Observer)

The California National Guard has relocated its fleet of MQ-9 Reaper drones from Victorville to the March Air Reserve Base. (Aviation Week)  

Security officials used a Dedrone counter-drone system at the Golden State Warriors’ basketball team’s championship parade in Oakland, California. (Recode)

Massachusetts police used drones for security during the Sail Boston boating event. (Boston Globe)

The Middlesex County prosecutor’s office in New Jersey bought a drone for criminal investigations. (TAP into Piscataway)

The Israeli air force is developing a 15-year roadmap for its fleet of unmanned aircraft. (FlightGlobal)

Police are searching for a drone operator who flew a drone close to air tankers and helicopters assisting in the response to a California brush fire. (10News)

The U.S. Navy picked the USS Dwight D. Eisenhower and USS George H.W. Bush as the first two aircraft carriers to deploy the MQ-25 Stingray unmanned refueler drone. (USNI News)

Industry Intel

The U.S. Navy awarded Boeing Insitu an $8 million contract for one RQ-21A Blackjack unmanned aircraft system for the Marine Corps. (DoD)

The Defense Advanced Research Projects Agency awarded Raytheon a $5.2 million contract for the Aerial Dragnet program.

The Defense Advanced Research Projects Agency awarded Embry-Riddle and Creare a $1 million grant to develop an autonomous flight control system for drones. (Press Release)

The Drone Racing League raised $20 million in grants from Allianz and Sky. (The Telegraph)

Kraken is partnering with Atlas Elektronik to develop a system for the Royal Canadian Navy’s Remote Mine Disposal System requirement. (IHS Jane’s 360)

Laura Ponto, an executive at Alphabet’s Project Wing, is the new chairman of the Commercial Drone Alliance, an industry advocacy organization. (Recode)

Israel’s Aeronautics, a drone manufacturer, has made an initial public offering on the Tel Aviv Stock Exchange. (IHS Jane’s 360)

For updates, news, and commentary, follow us on Twitter. The Weekly Drone Roundup is a newsletter from the Center for the Study of the Drone. It covers news, commentary, analysis and technology from the drone world. You can subscribe to the Roundup here.

While very few details have come out, Reuters reports that new proposed congressional bills on self-driving cars will reverse many of the provisions I critiqued in the NHTSA regulations last year.

One big change is a reversal of the new idea of pre-market regulation. Today, new car technologies are not regulated before they are deployed, but NHTSA proposed giving itself the power to regulate technologies even before they exist. Currently, most car technologies like adaptive cruise control, autopilots, forward collision avoidance, lane keeping and the like remain unregulated after a decade or more of deployment with few, if any, problems.

This is important because the old doctrine of “we don’t regulate until we see a problem the industry won’t fix on its own” is a much better one for innovation, and the speed of innovation is key in deciding which countries and companies lead this technology. The opposite approach of “we try to imagine what might go wrong and ban it ahead of time” may seem safer, but it’s definitely an impediment to innovation and may actually result in far more deaths through the delay of life-saving technologies.

Harder to judge is the preemption of state rules. While states are also attempting to pre-regulate, having a laboratory of 50 different competing states can also be good for innovation on the legal side. There is not one answer, and while it’s more complex to deal with 50 sets of regulations instead of one, it’s not that much more complex.

One of the few interesting and good ideas in the NHTSA regs may also vanish. NHTSA wanted all vendors to make available all sensor logs from all incidents. As I predicted, companies pushed back on this — their testing logs and the resulting test suites are very important competitive assets. The company with the best test suite is the furthest on the path to the safety needed for deployment. On the other hand, sharing this data would let everybody get further on that path, faster.

There has been lots of other news during the long road-trip I am on in Europe. This includes more entrants in the race, the retirement of Google’s 3rd generation “koala” car, more at Uber. I will report from the Autonomous Car Testing and Development conference in Stuttgart starting Tuesday.

The key takeaway from Tuesday’s RobotLabNYC forum, on “Exploring The Autonomous Future,” was humans are the key to robot adoption. Dr. Howard Morgan of First Round Capital expressed to the audience of more than 100 innovators working within the automation ecosystem, the necessity of embracing “entrepreneurial marketing” to reach customers. Tom Ryden echoed Morgan’s sentiment in his presentation about Mass Robotics, conveying his startups’ frustrations with the pace of adoption. Dr. Eric Daimler, formerly of the Obama Administration, concluded the evening succinctly by exclaiming, “we only adopt what we trust.” Trust is key for crossing the chasm.

Intuitive Surgical this past year celebrated its 17 year of operations with close to a million robotic surgeries completed last year. According to a recent Gallup Poll, medical professionals are the most trusted individuals in our society, even more than one’s clergy. The fact that robot-assisted surgery has become so routine and accepted by doctors and their patients is proof positive that in some industries we have already crossed the trust threshold.

Understanding how Intuitive’s Da Vinci robot built trust within the medical community could offer parallels to other areas of the automation industry. Robotic-assisted surgery or “telerobotics,” is the evolution of two modern technologies: 1) telepresence or telemanipulation; and 2) laparoscopic surgery. In 1987, French physician Dr. Philippe Mouret performed the first minimally invasive gallbladder surgery using an endoscope-like device to remotely guide his instruments via video to remove the damaged organ. By the 1990’s, laparoscopic surgery became commonplace, driving the demand for more precision through mechanics and computer-aided techniques. A decade later, Intuitive received FDA approval for its Da Vinci robot for general surgery, which has since been expanded for prostate, neurological, and thoracic procedures. Telerobotics evolved not just from the availability of advanced technologies, but from the demand for less invasive procedures by the most trusted people in America.

Last month, the FDA approved the Da Vinci Xi Systems, enabling Intuitive Surgical to market less expensive systems and gain marketshare with smaller medical institutions globally. “This new system enables access to Intuitive’s leading and proven robotic-assisted surgical technology at a lower price point. Customers around the globe have different needs from a clinical, cost and technology perspective; Intuitive’s goal is to meet those needs by providing a range of products and solutions: the da Vinci X System helps us continue to do so,” said CEO Dr. Gary Guthart.

According to the press release, Da Vinci X System is “a focused-quadrant surgery and features flexible port placement and 3D digital optics, while also including advanced instruments and accessories from its Xi system.” Another determining factor of Intuitive Surgical’s success is the interoperability of the instruments. Rather than just an endoscope that provides video feeds, Da Vinci is equipped with multiple end effectors that mimics traditional instruments guided by experienced surgeons telerobotically.

Patients trust the robot because it is simply augmenting their doctor’s skills with greater precision. This is reinforced by shorter recovery periods and better outcomes. Recently, Oxford published a research study which took place over a nine-year period that concluded patients who opted for robotic lobectomies had better lung cancer outcomes. As a new generation of surgeons embraces the robotic future, the market for abdominal surgical robots is expected to grow from $2.9 billion in 2017 to $12.9 billion by 2022.

Trusting robots with our bodies might seem like a difficult premise to uphold, but robots have been saving lives on the front lines since 1972. Bomb-defusing machines have been utilized in the most dangerous situations worldwide from Afghanistan to Jerusalem to New York City. Today, almost every police department and military have an arsenal of remote-controlled explosive removal devices.

Dr. Sethu Vijayakumar, director of the Edinburgh Centre for Robotics in the United Kingdom, explains, “One of the target areas, in terms of [the] use of robots, is for going into dangerous situations. Robots can go in, be operated from a safe distance, and, in a worst-case scenario, be sacrificed.”

Similar to robotic medicine, trust-based systems for the military are built by teleporting human expertise into dangerous situations. Pittsburgh-based RE2 Robotics took this concept to a new level with its Robotic Manipulation System announced last week. The RE2 System now enables users to actually use their limbs and hands to control the robot’s movements and grippers to quickly defuse explosives.

RE2 CEO explained the rationale for his new product, “Often times, you still need the human intellect to perform those tasks. But they’re dangerous, so the question is, how can we project that human capability remotely, so they’re still able to do their job and leverage the human intellect to solve a really big problem? That’s what we’re trying to do — keep the human safe, but allowing them to still do their job.”

While rover looks remarkably similar to Endeavor’s (formerly iRobot) Packbot that has been widely deployed by the US military in Iraq, Afghanistan and elsewhere, the control system is novel and more reliable in the high-pressure situations. Pedersen says, “If you’re going to project that human capability, the most human way to control it is to have it be as much like you as possible. That’s where we’ve come over the past decade, having true human-like capability. It’s no coincidence that these robots look like human torsos. These systems are a projection of you, remotely. It’s almost like an avatar, where you’re dealing with a threat out of harm’s way.”

While today the operator of RE2’s robot stands at a safe distance watching the video feed on a laptop, the company is developing a virtual reality headset accessory for the control system to enable the professional to completely immerse himself into the situation. Pedersen also plans to expand the use cases for his technology to civilian markets such as search & rescue, disaster recovery (like Fukushima) and medicine.

“Yes, people could use this technology for other means. But our charter is saving lives and extending it into new markets like health care, where we can do patient assist. [We can] help a person from a wheelchair to a bed or a wheelchair to a toilet, as the brawn for a caregiver,” touts Pedersen.

While we are years away from fully trusting autonomous systems with our lives, it appears from these two examples that the first step is enabling machines to augment our most trusted citizens. As yesterday was Father’s Day it is only appropriate I share with my readers my gift – GrillBot. The disclaimer on the box, however, does make me question when I plan to use it; fear of death is kind of a big deal!

By Peter Reuell, Harvard Staff Writer

At the beginning of the decade, George Whitesides helped rewrite the rules of what a machine could be with the development of biologically inspired “soft robots.” Now he’s poised to rewrite them again, with help from some plastic drinking straws.

Inspired by arthropod insects and spiders, Whitesides and Alex Nemiroski, a former postdoctoral fellow in Whitesides’ Harvard lab, have created a type of semi-soft robot capable of standing and walking. The team also created a robotic water strider capable of pushing itself along the liquid surface. The robots are described in a recently published paper in the journal Soft Robotics.

Unlike earlier generations of soft robots, which could stand and awkwardly walk by inflating air chambers in their bodies, the new robots are designed to be far nimbler. Though real-world applications are still far off, the researchers hope the robots eventually could be used in search operations following natural disasters or in conflict zones.

“If you look around the world, there are a lot of things, like spiders and insects, that are very agile,” said Whitesides, the Woodford L. and Ann A. Flowers University Professor at Harvard. “They can move rapidly, climb on various items, and are able to do things that large, hard robots can’t do because of their weight and form factor. They are among the most versatile organisms on the planet. The question was, how can we build something like that?”

The answer, Nemiroski said, came in the form of your average drinking straw.

“This all started with an observation that George made, that polypropylene tubes have an excellent strength-to-weight ratio. That opened the door to creating something that has more structural support than purely soft robots have,” he said. “That was the building block, and then we took inspiration from arthropods to figure out how to make a joint and how to use the tubes as an exoskeleton. From there it was a question of how far can your imagination go? Once you have a Lego brick, what kind of castle can you build with it?”

What they built, he said, is a surprisingly simple joint.

Whitesides and Nemiroski began by cutting a notch in the straws, allowing them to bend. The scientists then inserted short lengths of tubing which, when inflated, would force the joints to extend. A rubber tendon attached on either side would then cause the joint to retract when the tubing deflated.

Armed with that simple concept, the team built a one-legged robot capable of crawling, and moved up in complexity as they added a second and then a third leg, allowing the robot to stand on its own.

“With every new level of systems complexity, we would have to go back to the original joint and make modifications to make it capable of exerting more force or to be able to support the weight of larger robots,” Nemiroski said. “Eventually, when we graduated to six- or eight-legged arthrobots, making them walk became a challenge from a programming perspective. For example, we looked at the way ants and spiders sequence the motion of their limbs and then tried to figure out whether aspects of these motions were applicable to what we were doing or whether we’d need to develop our own type of walking tailored to these specific types of joints.”

While Nemiroski and colleagues were able to control simple robots by hand, using syringes, they turned to computers to control the sequencing of their limbs as the designs increased in complexity.

“We put together a microcontroller run by Arduino that uses valves and a central compressor,” he said. “That allowed us the freedom to evolve their gait rapidly.”

Though Nemiroski and colleagues were able to replicate ants’ distinctive “triangle” gait using their six-legged robot, duplicating a spider-like gait proved far trickier.

“A spider has the ability to modulate the speed at which it extends and contracts its joints to carefully time which limbs are moving forward or backward at any moment,” Nemiroski said. “But in our case, the joints’ motion is binary due to the simplicity of our valving system. Either you switch the valve to the pressure source to inflate the balloon in the joint, and thus extend the limb, or you switch the valve to atmosphere to deflate the joint and thus retract the limb. So in the case of the eight-legged robot, we had to develop our own gait compatible with the binary motion of our joints. I’m sure it’s not a brand-new gait, but we could not duplicate precisely how a spider moves for this robot.”

Developing a system that can fine-tune the speed of actuation of the legs, Nemiroski said, would be a useful goal for future research, and would require programmable control over the flow rate supplied to each joint.

“We hit that limitation in the system, which I’m actually pretty proud of, because it means we pushed it to its absolute limit,” he said. “We took the basic concept and asked how far can we go before we would have to make radical alterations to how these limbs work, and we found that limit at the eight-legged robot. We were able to make it walk, but if you wanted to make it walk faster, or to add more limbs — for example, to support a load — you would have to start rethinking the system from the ground up.”

Though it may be years before the robots find their way into real-world applications, Whitesides believes the techniques used in their development — particularly the use of everyday, off-the-shelf materials — can point the way toward future innovations.

“I don’t see any reason to reinvent wheels,” he said. “If you look at drinking straws, they can make them at, effectively, zero cost and with great strength, so why not use them? These are academic prototypes, so they’re very light weight, but it would be fairly easy to imagine building these with a lightweight structural polymer that could hold a substantial weight.”

“What’s really attractive here is the simplicity,” added Nemiroski. “This is something George has been championing for some time, and something I grew to appreciate deeply while I was in his lab. For all the complexity of movement and structural integrity we get out of these robots, they’re remarkably simple in terms of construction and control. Using a single, easy-to-find material and a single concept for an actuator, we could achieve complex, multidimensional motion.”

This post was originally published on The Harvard Gazette. Click here to view the original.

This research was supported with funding from the U.S. Department of Energy, DARPA, the Natural Sciences and Engineering Research Council of Canada, the National Science Foundation, the Swedish Research Council, and the Wyss Institute for Biologically Inspired Engineering at Harvard University.

In episode three, season three of Talking Machines, we dive into overfitting, take a listener question about unbalanced data and speak with Professor (Emeritus) Tom Dietterich from Oregon State University.

If you enjoyed this episode, you may also want to listen to:

• Talking Machines: Restricted Boltzmann Machines, with Eric Lander
• Talking Machines: Automatic Translation and t-SNE, with Hal Daume
• Talking Machines: Generative art and Hamiltonian Monte Carlo, with Doug Eck
• Talking Machines: Machine learning and the Flint water crisis, with Jake Abernethy
• Talking Machines: Gaussian processes and OpenAI, with IIya Sutskever

See all the latest robotics news on Robohub, or sign up for our weekly newsletter.

Prof. Pierre Dillenbourg and the team from the Computer-Human Interaction in Learning and Instruction (CHILI) Lab, explain how they are building robots to use in the classrooms of tomorrow. It is CHILI’s goal to deeply integrate Human-Computer Interaction (HCI) and learning sciences, especially in addressing practical problems in learning, teaching, and instruction.

If you enjoyed this ‘meet the lab’ video, you can also watch another in the NCCR Robotics series below:

• Meet the labs of NCCR Robotics: Paik Lab
• Meet the labs of NCCR Robotics: Auke Ijspeert and BioRob

It was a hectic but interesting week at the 2017 IEEE International Conference on Robotics and Automation in Singapore. Here’s a brief recap of some of my observations and experiences.

Popular Fields

Computer/robotic vision and navigation-related (SLAM, localization) are still some of the most popular, or at least well-attended fields at these conferences. My colleagues said that some of the manipulation / grasping sessions were well attended too.

The influence and growth in machine learning / deep learning seems to have slowed somewhat. This is possibly related to the fact we’re increasingly seeing some of the best robotics learning work going to machine learning or computer vision conferences, or potentially to new conferences like the Conference on Robot Learning.

Workshops continue to grow in importance

There seems to be an increasing number of attendees coming primarily to attend workshops, some of which very well attended, even at the tail end of the conference on Friday afternoon (a good sign!). This trend mirrors what we’re seeing at some of the other robotics and computer vision conferences, where there are very well attended workshops.

The event-vision based workshop, in particular, was impressive in how different it was to the 2015 incarnation, which was sparsely attended. This one had heaps of top researchers, industry, and lots of demos around the room.

Some of the mystery stealth startups in self-driving cars like Zoox showed off a little of what they are doing:

The shark tank environment has died down a little

Although I did manage to witness a couple of specific individuals spending the entire week being whisked away for recruiting lunches / dinners / drinks, the crazy recruiting environment of recent conferences seems to have died down, at least a little.

This is perhaps a testament to the fact that the fields of AI and self-driving cars are starting to mature a little – most of the major players now have a more stable, ongoing strategy so there’s not so much chaotic recruiting activity. It’s also clear that there’s still a significant talent shortage, especially at a middle seniority level – highly qualified postdocs with several years of domain experience (machine learning, perception, autonomous vehicles, SLAM) and leadership experience are like hens’ teeth!

Major local startups like NuTonomy showcased their work at a special event. I managed to get along separately and see that they are improving leaps and bounds in their capability and now have some pretty impressive capability showcases.

The bigger picture

Plenaries and keynotes like that of Hiroaki Kitano (Sony Labs, “Nobel Turing Challenge: Grand Challenge of AI, Robotics, and Systems Biology”) reminded us of the big picture regarding robotics and AI. We always seem to use inspiration from the space race:

And we got to see Peter Corke introduce ICRA2018 in Brisbane, Australia!

I enjoyed talking at the Visual Localization session (another packed out session with standing room only) on our paper, “Deep Learning Features at Scale for Visual Place Recognition“.

The social functions were good and the conference hotel was incredible, especially the infinity pool at the top of the hotel, 57 floors up, looking over the Marina. The night safari was fun too.

Overall, a great week and always great to reconnect with hundreds of colleagues and collaborators from around the world. See you next year in Brisbane!

Mosquitos kill more humans every year than any other animal on the planet and conventional methods to reduce mosquito-borne illnesses haven’t worked as well as many hoped. So we’ve been hard at work since receiving this USAID grant six months ago to reduce Zika incidence and related threats to public health.

Our partners at the joint FAO/IAEA Insect Pest Control Lab in Vienna, Austria have been working to perfect the Sterile Insect Technique (SIT) in order to sterilize and release male mosquitos in Zika hotspots. Releasing millions of said male mosquitos increases competition for female mosquitos, making it more difficult for non-sterilized males to find a mate.

We learned last year at a USAID Co-Ideation Workshop that this technique can reduce the overall mosquito population in a given area by 90%. The way this works is by releasing millions of sterilized mosquitos using cars, helicopters and/or planes, or even backpacks.

Our approach seeks to complement and extend (not replace) these existing delivery methods. The challenge with manned aircraft is that they are expensive to operate and maintain. They may also not be able to target areas with great accuracy given the altitudes they have to fly at.
Cars are less expensive, but they rely on ground infrastructure. This can be a challenge in some corners of the world when roads become unusable due to rainy seasons or natural disasters. What’s more, not everyone lives on or even close to a road.

Our IAEA colleagues thus envision establishing small mosquito breeding labs in strategic regions in order to release sterilized male mosquitos and reduce the overall mosquito population in select hotspots. The idea would be to use both ground and aerial release methods with cars and flying robots.

The real technical challenge here, besides breeding millions of sterilized mosquitos, is actually not the flying robot (drone/UAV) but rather the engineering that needs to go into developing a release mechanism that attaches to the flying robot. In fact, we’re more interested in developing a release mechanism that will work with any number of flying robots, rather than having a mechanism work with one and only one drone/UAV. Aerial robotics is evolving quickly and it is inevitable that drones/UAVs available in 6-12 months will have greater range and payload capacity than today. So we don’t want to lock our release mechanism into a platform that may be obsolete by the end of the year. So for now we’re just using a DJI Matrice M600 Pro so we can focus on engineering the release mechanism.

Developing this release mechanism is anything but trivial. Ironically, mosquitos are particularly fragile. So if they get damaged while being released, game over. What’s more, in order to pack one million mosquitos (about 2.5kg in weight) into a particularly confined space, they need to be chilled or else they’ll get into a brawl and damage each other, i.e., game over. (Recall the last time you were stuck in the middle seat in Economy class on a transcontinental flight). This means that the release mechanism has to include a reliable cooling system. But wait, there’s more. We also need to control the rate of release, i.e., to control how many thousands mosquitos are released per unit of space and time in order to drop said mosquitos in a targeted and homogenous manner. Adding to the challenge is the fact that mosquitos need time to unfreeze during free fall so they can fly away and do their thing, i.e., before they hit the ground or else, game over.

We’ve already started testing our early prototype using “mosquito substitutes” like cumin and anise as the latter came recommended by mosquito experts. Next month, we’ll be at the FAO/IAEA Pest Control Lab in Vienna to test the release mechanism indoors using dead and live mosquitos. We’ll then have 3 months to develop a second version of the prototype before heading to Latin America to field test the release mechanism with our Peru Flying Labs. One of these tests will involve the the integration of the flying robot and the release mechanism in terms of both hardware and software. In other words, we’ll be testing the integrated system over different types of terrain and weather conditions in Peru specifically.

We are already developing the mission control app pictured above to program our autonomous flights. The app will let the operator decide how many sterilized mosquitos to release at any given time and location. Our field tests in Peru will also seek to identify the optimal flight parameters for the targeted and homogenous delivery of sterilized mosquitos. For example, what is the optimal speed and altitude of the flying robot to ensure that the mosquitos are released over the intended areas?

Our Peru Flying Labs has already developed expertise and capacity in cargo drone delivery, most recently in projects in the Amazon Rainforest with the Ministry of Health (more here). This new Zika reduction project –and in particularly the upcoming field tests — will enable us to further build our Peruvian team’s capacity in cargo space. The plan is for Peru Flying Labs to operate the flying robots and release mechanisms as need once we have a more robust version of the release mechanism. The vision here is to have a fleet of flying robots at our Flying Labs equipped with release mechanisms in order to collectively release millions of sterilized mosquitos over relatively large areas. And because our Peruvian colleagues are local, they can rapidly deploy as needed.

For now, though, our WeRobotics Engineering Team (below) is busy developing the prototype out of our Zurich office. So if you happen to be passing through, definitely let us know, we’d love to show you the latest and give you a demo. We’ll also be reaching out the Technical University of Peru who are members of our Peru Flying Labs to engage with their engineers as we get closer to the field tests in country.

As an aside, our USAID colleagues recently encouraged us to consider an entirely separate, follow up project totally independently of IAEA whereby we’d be giving rides to Wolbachia treated mosquitos. Wolbachia is the name of bacteria that is used to infect male mosquitos so they can’t reproduce. IAEA does not focus on Wolbachia at all, but other USAID grantees do. Point being, the release mechanism could have multiple applications. For example, instead of releasing mosquitos, the mechanism could scatter seeds. Sound far-fetched? Think again.

RoboCup is an international scientific initiative with the goal to advance the state of the art of intelligent robots. Established in 1997, the original mission was to field a team of robots capable of winning against the human soccer World Cup champions by 2050.

To celebrate 20 years of RoboCup, the Federation is launching a video series featuring each of the leagues with one short video for those who just want a taster, and one long video for the full story. Robohub will be featuring one league every week leading up to RoboCup 2017 in Nagoya, Japan.

This week, we consider being part of the RoboCupIndustrial league. RoboCupIndustrial is a competition between industrial mobile robots focusing on logistics and warehousing systems. In anticipation of Industry 4.0, participants compete in automation through robots, autonomous systems, and mobile robot technology. You’ll hear about the history and ambitions of RoboCup from the trustees, and inspiring teams from around the world.

Short version:

Long version:

Want to watch the rest? You can view all the videos on the RoboCup playlist below:

https://www.youtube.com/playlist?list=PLEfaZULTeP_-bqFvCLBWnOvFAgkHTWbWC

Please spread the word! If you would like to join a team, click here for more information.

• RoboCup video series: 20 years of history
• RoboCup video series: Soccer league
• RoboCup video series: Rescue league
• RoboCup video series: @Home league
• What has twenty years of RoboCup taught us?
• How we evolved a winning strategy for the RoboCup competition by imitating nature

See all the latest robotics news on Robohub, or sign up for our weekly newsletter.

For the first time on Broadway human and drone performances fuse to create a new form of artistic expression. The magic happened in Cirque du Soleil’s first musical on Broadway: ‘Paramour’ at the Lyric Theatre. The show is themed on the Golden Age of Hollywood and follows the life of a poet who is forced to choose between love and art. The contributions of the technology firm Verity Studios include the choreography of the drone show segment, the frame and lighting design of the drone costumes, and all underlying drone technologies. The system was operated by the show’s automation team, with Verity Studios providing maintenance services twice per year. The dancing drones completed almost 400 shows, including more than 7,000 autonomous takeoffs, flights, and landings.

Over the past year, 398 audiences of up to 2,000 people witnessed an octet of colorful lampshades perform an airborne choreography during Cirque du Soleil’s Broadway show Paramour, which ran until April 20^th. The work behind the design and choreography of the flying lampshades, which turn out to be self-piloted drones, bears the signature of the Swiss high-tech company Verity Studios.

But how novel is it really that robots have appeared in theater? Since Karel Capek’s science fiction play R.U.R. (short for Rossum’s Universal Robots) introduced the word “robot” to the English language and to science fiction almost 100 years ago, the technical challenges of incorporating robots into live performance and theater have been overwhelming. Before these Broadway drones, nearly all theater robots were remote-controlled puppets, relying on humans hidden off-scene to steer their movements and provide their intelligence. What holds for Broadway, also holds for the even bigger picture.

It is intriguing that the aerial revolution gained momentum on the ground first: Even though the complexity of most advanced industrial automation systems found in state-of-the art factories and warehouses hardly compares to the complexity of drone show systems that allow for the autonomous navigation of dozens, hundreds, or thousands of drones in a safety-critical environment, one single example stands out. The only comparable systems that can serve as a template for operating large numbers of autonomous mobile robots with high demands for reliability and safety are those developed by the technology company Kiva Systems (bought by Amazon for USD 775 million in 2012), where Verity Studios’ founder Professor Raffaello D’Andrea and his former colleagues developed a solution for automated storage and retrieval in warehouses. His team unleashed thousands of mobile robots in warehouses, which started the robotics gold rush in the Silicon Valley. Now, Professor D’Andrea’s team is pursuing an analogous, even more ambitious goal in the air.

Placing intelligent, autonomous flying machines in live theater presents a multi-faceted challenge: creating a compelling performance with safety, reliability, and ease of operation. While the compelling performance translates into shaping a convincing creative concept around the drones’ choreography, the latter chiefly points to designing computerized systems in lieu of making use of human pilots: Verity Studios’ drones are flying mobile robots and navigate autonomously, piloting themselves, only supervised by a human operator. To navigate autonomously, these drones require a reliable method for determining their position in space. Since GPS is usually not available indoors, Verity Studios has built on more than a decade of research and development at the Flying Machine Arena of Switzerland’s Federal Institute of Technology (ETH Zurich) to provide a novel localization method.

The first groups of autonomous robots are now meeting the live event industries’ high requirements: Initially, Verity Studios set the stage for widely recognized flying machines in entertainment in 2014, by collaborating with Cirque de Soleil on Sparked, a short film in which 10 siblings of the similarly dressed 8 quadcopters from Paramour dance, hover, and flicker around a stunned human actor. Sparked was named a Winner of the 2016 New York City Drone Film Festival. However, it is one thing to feature drones in a 4-minute video, where the makers have the luxury to shoot it 100 times and then choose the best shot. Live performances on Broadway running 8 times per week in front of up to 2,000 people every time, by contrast, require the drone shows to work every single time. Verity Studios has met these requirements in the best sense: During their one-year run, the drones on Broadway safely completed more than 7,000 autonomous take-offs, flights, and landings. How was that possible?

In contrast to the long list of safety incidents involving remote-controlled drones at events, performance and reliability are key to Paramour’s dancing drones which are custom-made and hand-crafted in Switzerland. Each of the eight flying machines featured in Paramour uses 80 sensors to fly and performs roughly 1.5 billion calculations per second. Each critical calculation is double-checked every time it is performed in case any of the concerned processors makes a mistake. In other words, accidents are prevented by self-test and monitoring. And even if something does happen, a back-up is in place. For example, on the show of 2017-02-08, the battery from one of the eight vehicles could not provide sufficient power during the takeoff phase. The quadrocopter detected the problem and returned to the ground on only two propellers.

In most cases, the drones withstand any point of failure, but where a single point of failure is unavoidable, a fail-safe or weakest link design is used. The failure of any single system component cannot result in an unmanaged loss of control, but must be handled appropriately. For instance, a drone should be able to land in a controlled fashion despite a failure of any one of its motors, any part of its electronics, any one of its cables or connectors, and any one of its batteries. Similarly, loss of communication between a drone and its ground station must not create a dangerous situation. This can be achieved by designing a fully redundant system, i.e., a system that can continue operation, or trigger a safe emergency behavior, if any one of its components fails. While such designs can be more expensive to create than designs without duplication, they provide much higher safety (and help reduce insurance costs). Their decades-long history in the manned aviation industry has shown this approach’s effectiveness and provides a treasure trove of experience and evidence for the emerging drone industry.

One way to design such a redundant system is to first design a simple flight-capable system, to then duplicate all its components (e.g. sensors, processors, actuators) to achieve the necessary redundancy, and to carefully design switch-over from a failed system to its backup. Importantly, the design of such a system cannot stop with the design of fully redundant drones, but needs to extend to all other critical components of the drone show system, including the positioning system, communications architecture, e-stop systems, and control stations. In the end, this uncompromising approach allows for a degree of safety and robustness that makes those intelligent and autonomous robots suitable for performance next to theater audiences. The result is a one-of-a-kind performance that extends the traditional palette of light, sound, stage effects, and interaction with human performers by translating an intimate character beat into an unexpected visual motif.

The enticing reality is that there are many more areas to explore, ranging from live concerts to active scenography, that offer dramatic possibilities for performing robots on a much broader scale. Once again, not only such stage flyers, but also Lucie micro-drones will make history, not only on Broadway or at Amazon, but all across the domain of performing arts revolutionizing the scene with a new realm of creative expression.

Update: The response to Tertill’s crowdfunding campaign has amazed and delighted us! Pledges totalling over $250,000 have come from 1000+ backers. We’re shipping to all countries, with over a fifth of Tertill’s supporters coming from outside the United States. But the end is near; Tuesday (11 July) is the last full day of the campaign. After that Tertill’s discounted campaign price will no longer be available and delivery in time for next year’s (northern hemisphere) growing season cannot be assured.

Franklin Robotics has launched a Kickstarter campaign for Tertill, their solar-powered, garden-weeding robot.

Tertill lives in your garden, collecting sunlight to power its weed patrol, and cutting down short plants with a string trimmer/weed whacker with almost no intervention required. Available for about $300USD, the fully autonomous Tertill is the first weeding robot available to home gardeners.

Tertill is round, short, has four wheel drive and extreme camber wheels. It uses proprietary algorithms to ensure that it finds as many weeds as it can, using its sensors to distinguish between weeds and crops based on height. As Tertill sees it: small plants are weeds, big plants are crops. But what if you have seedlings? Simply place a plant collar around seedlings to inform Tertill that this plant is wanted.

Tertill doesn’t use a camera for weed discrimination because Franklin wants to put Tertill to work in your garden now. In the not-too-distant future, inexpensive vision systems may reliably distinguish between plants and crops even when both are seedlings. But, according to Franklin, such system are not yet ready.

Tertill is designed such that one robot can easily keep up with the weeds in a typical sized garden (that’s about 100 square feet in the USA). Tertill will usually handle gardens considerably larger than this, but how much larger depends on weather and local weed types. And Terrill’s can work in teams, coexisting harmoniously in the same space. Multiple Tertill robots will simply avoid each other.

Check out the video below:

But Tertill needs a small barrier to keep it from wandering off beyond the borders of your garden. A garden fence, the wooden border of a raised bed, or any sort of edging that is two or more inches tall will work.

Otherwise, Tertill is designed to live in your garden and require very little attention. Summer showers won’t bother it. And, under normal conditions, you won’t have to worry about charging Tertill—the sun will see to that. But, if Tertill has been in the dark for so long (months) that its battery is completely exhausted, a USB connection can be used to charge the battery.

Franklin believes that small, simple robots can help solve big, complex problems. Franklin’s robots aim to help gardeners by reducing the tedium and physical challenge of weeding, making gardening more fun. The data their robots collect helps gardeners garden better, improving yield and quality. Their robots aim to benefit the environment by eliminating the need for herbicides and returning organic matter to the soil.

Click here to visit Franklin’s website and learn more.

The Robot Academy is a new learning resource from Professor Peter Corke and the Queensland University of Technology (QUT), the team behind the award-winning Introduction to Robotics and Robotic Vision courses. There are over 200 lessons available, all for free.

The lessons were created in 2015 for the Introduction to Robotics and Robotic Vision courses. We describe our approach to creating the original courses in the article, An Innovative Educational Change: Massive Open Online Courses in Robotics and Robotic Vision. The courses were designed for university undergraduate students but many lessons are suitable for anybody, as you can easily see the difficulty rating for each lesson. Below are several examples of image formation and 3D vision.

The geometry of image formation

The real world has three dimensions but an image has only two. We can use linear algebra and homogeneous coordinates to understand what’s going on. This more general approach allows us to model the positions of pixels in the sensor array and to derive relationships between points on the image and points on an arbitrary plane in the scene.

Watch the rest of the Masterclass here.

How images are formed

How is an image formed? The real world has three dimensions but an image has only two: how does this happen and what are the consequences? We can use simple geometry to understand what’s going on.

Watch the rest of the Masterclass here.

3D vision

An image is a two-dimensional projection of a three-dimensional world. The big problem with this projection is that big distant objects appear the same size as small close objects. For people, and robots, it’s important to distinguish these different situations. Let’s look at how humans and robots can determine the scale of objects and estimate the 3D structure of the world based on 2D images.

Watch the rest of the Masterclass here.

If you liked this article, you may also enjoy:

• Smart Grasping System available on ROS Development Studio
• Programming your NAO robot for human interaction
• The Robot Academy: The open online robotics education resource 
• Machine Learning with OpenAI Gym on ROS Development Studio
• SICK LMS full LIDAR teardown
• Envisioning the future of robotics
• How to mount an external removable hard drive on a robot

See all the latest robotics news on Robohub, or sign up for our weekly newsletter.