Page 340 of 346
1 338 339 340 341 342 346

Robots offer the elderly a helping hand

Humanoid robots under development can be programmed to detect changes in an elderly person’s preferences and habits. Image credit: GrowMeUp

by Helen Massy-Beresford

Low birth rates and higher life expectancies mean that those over 65 years old now will account for 28.7 % of Europe’s population by 2080, according to Eurostat, the EU’s statistics arm.

It means the age-dependency ratio – the proportion of the elderly compared with the number of workers – will almost double from 28.8 % in 2015 to 51 % in 2080, straining healthcare systems and national budgets.

Yet there’s hope marching over the horizon, in the form of robots.

The creators of one humanoid robot under development for the elderly say it can understand people’s actions and learn new behaviours in response, even though it is devoid of arms.

Robots can be programmed to understand an elderly person’s preferences and habits to detect changes in behaviour: for example if a yoga devotee misses a class, it will ask why, while if an elderly person falls it will automatically alert caregivers or emergency services.

Yet there’s still a way to go before these devices will be able to bring out a tray of tea and biscuits when visitors drop by, according to its creator.

At the moment there are things the robot can perform perfectly in the lab but that still present challenges, says Dr Luís Santos from the University of Coimbra in Portugal, who has been developing the technology as part of an EU-funded research project known as GrowMeUp.

The proportion of elderly people is expected to almost double by 2080, so researchers are looking to robots to see if they can help care for the aging population. Image credit: GrowMeUp

‘There is a mismatch between what elderly people want and what science and technology can provide – some of them are expecting robots to do all types of household activities, engage them in everyday gossip or physically interact with them as another human would do,’ says Dr Santos.

The team is working on making the robot’s dialogue as natural and as intuitive as possible and improving its ability to safely navigate an older person’s home, using a low-cost laser and a camera, and a second prototype will be tested with elderly people in the coming months. Yet, Dr Santos foresees that these devices are still four to six years away from commercialisation, at least.

Revolution

He sees robotics as just a part of a wider revolution underway in how societies care for the elderly, with connectivity and augmented reality also playing a role.

‘In the future, elderly care will also be very focused on information and communications technologies – for example virtual access to doctors or care institutions and 24/7 monitoring in a non-invasive way are likely to become standard,’ he said.

Yet researchers believe that keeping the technology unobtrusive is key – no wearable devices or cumbersome cameras cluttering up people’s homes.

Dr Maria Dagioglou from the National Centre of Scientific Research ‘Demokritos’ in Greece, said: ‘We wanted to avoid a Big Brother scenario, so data privacy is important but also dignity.’

She is looking at ways to integrate robotics technology into a smart home equipped with connected devices, automation and sensors, as part of the EU-funded RADIO project.

Researchers are figuring out ways of putting robots in homes for virtual access to healthcare and constant monitoring, yet that are also non-invasive. Image credit: RADIO

Dr Stasinos Konstantopoulos, the scientific manager of the RADIO project, added: ‘All monitoring happens as the user interacts with the system to control the house, for example, to regulate the temperature, and to ask the robot to run errands, like finding misplaced items.’

Using a tablet or smartphone to interact, the equipment, which should only take a day to install, can monitor elements of an elderly person’s day-to-day life, efficiently processing and managing data to allow medical professionals to keep track of and assess their level of independence via smartphone notifications.

‘It’s a constant safety net in case something starts to be worrying,’ said Dr Dagioglou.

The goal of innovations like this is to allow people to live independently for longer.

A crucial element of this is finding ways for older people to keep up their activity levels, and this is an area where robots could really come into their own.

Dr Luigi Palopoli at the University of Trento in Italy said ‘our robot pushes them to do their exercise, to go out and about; it extracts information on their interests and on their fears and makes them part of a network.’

Barriers

‘We want to tear down the emotional barriers that make them stay at home and degrade the quality of their life,’ he said.

As part of the EU-funded Acanto project, he is developing a robot called FriWalk, following on from the progress made during a previous EU-funded project, the DALi project.

The team has worked hard to make the FriWalk robot look energetic and appealing and to ensure it offers useful services like carrying small items or giving directions.

With prototypes made, in the next few months, the researchers will start clinical trials in Spain as well as public demonstrations of the FriWalk in museums and other public spaces.

Researchers will start clinical trials in Spain of a robotic prototype designed to help elderly people to exercise. Image credit: Acanto

Further ahead, Dr Palopoli hopes for interest from established manufacturers and start-ups to bring the FriWalk technology to the market.

If you liked this article, you may also want to read:

See all the latest robotics news on Robohub, or sign up for our weekly newsletter.

Notes and pics from Xponential in Dallas, Innorobo in Paris and ICRA in Singapore

Conferences and trade shows, held in interesting locations around the world, can be entertaining, informative and an opportunity to explore new places, meet new people and renew acquaintances. Three recent examples: Xponential, the mostly defense-related unmanned land, sea and air show, held in Dallas; Innorobo, focused on service robotics, in Paris; and ICRA, the IEEE’s premier robotics conference, in Singapore.

ICRA

The 2017 IEEE International Conference on Robotics and Automation (ICRA), the IEEE’s principle forum for robotics researchers to present their work, was held this year at the Marina Bay Sands Hotel and Convention Center in Singapore. ICRA continues to have the highest number of cited research papers in the robotics field of all the various global conferences (including IROS).

In an IEEE/Spectrum review of that portion of the conference that was biomedical-related, a swallowable capsule robot capable of needle aspiration, guided by magnets, and an autonomous snake-like colonoscopy robot were two of the hits. Another reviewer found the rehab exoskeletons, haptic interfaces, modular robot components and many of the ROS-enabled solutions of merit. Overall, almost 3,000 robotics researchers attended ICRA 2017 and most found many things of interest (including Singapore and the Marina Sands Hotel).

Xponential – all things unmanned

The Association for Unmanned Vehicle Systems Internation, AUVSI, annual trade show and conference, Xponential, held this year in Dallas, Texas, showed the changing nature of the industry and offered suggestions (guesses) as to where they were going. 170,000 visitors attended while 100 speakers and over 650 exhibitors put on this choreographed show of military weaponry, defense and security systems and equipment, and commercial unmanned air, land and sea systems.

Click to enlarge

AUVSI’s membership fees are discounted for members of the military and first responders and the exhibitor list continues to favor military/defense-related companies, but most of those companies now have a growing commercial component.

Autonomous vehicles have always been the constituency of AUVSI but with all the money flowing into autonomous car startups, and the talent search to corral people to make this new industry happen, a small portion of this Xponential show was devoted to the prospect of that future (see chart above).

The folks at The National Robotics Education Foundation (NREF) produced a gallery of over 300 interesting photos from Xponential. They also produced a special set of pictures of UAS engines from the show. Unmanned vehicles used by the military, for search and rescue, in support of agriculture and mining, for infrastructure inspection, and in a variety of other circumstances must stay aloft for long periods, hence the interest in engines that can support that amount of air time.

Innorobo

I visited Innorobo. It is a necessary show in a rapidly changing arena. Over 7,000 visitors perused an eclectic group of 170 startups, integrators, component manufacturers and service robot providers exhibiting a wide range of products and services at a site on the outskirts of Paris. Over the 3-day show, 50 speakers explored topics from robotics-related AI to philosophical discussions about law and ethics to the latest innovations in personal and professional service robotics.

The IFR (International Federation of Robotics) says that robot installations in France increased by 22% to 1,400 units in 2016 (compared to 700 units in the UK), particularly within the car industry. France ranks 2nd within the EU for robot density (the UK is 10th). Innorobo started as a show to promote France’s robotics industry (there are 225+ French companies in The Robot Report’s Directories and on our Global Map). Held in Lyon, the show grew to its present size through the hard work and willpower of a small group of inventive women entrepreneurs. It grew and relocated to Paris where it’s been for the last two years. As the focus expanded from promoting in-country robotics to displaying global innovations in robotics of the startup companies, research labs and service robot companies beginning to make inroads aroud the world – the show has become a valuable mainstay for the European press, investors, business executives, students, and roboticists alike.

Events, Directories and The Robot Report’s Global Map

From time to time it becomes relevant to toot the horn of the free resources available on The Robot Report. Our events calendar, directory of companies and educational institutions involved in the robotics industry, and the global map for job seekers and researchers alike are free and always updated.

There are still 28 robotics-related events remaining in 2017. Check them out:

It’s not just self-driving cars; trains could soon be autonomous too!

Judging by the frequency that self-driving cars are mentioned in scientific discussions and the media, they are not only the next big thing, but might actually take over as our main means of transportation. Traditional industries like the railways, on the other hand, seem to have lost that race already. But what if new technologies, such as Internet of Things (IoT) devices and Artificial Intelligence (AI), were not only used to create new transportation modes, but to transform old ones as well?

If we get this digitization right, then trains, as the winners of the first industrial revolution, could in fact be here to stay.

Long-distance

It is true that the technology behind autonomous cars has enormous potential and that they might emerge as the winners when it comes to shorter distances. But I believe that trains have a very real chance at becoming the transportation of choice for long-distance travel.

How exactly could digitization make this happen?

With the help of new digital processes, rail companies could increase the capacity of their networks and resolve traffic bottlenecks. This will, in turn, help more people reach their destinations sooner. The use of emerging technologies could also mean that the trains of the future will not only be more comfortable, but also more energy-efficient, safer and faster than cars over long distances.

Some pieces of this puzzle are already in place.

What is left for the rail industry is to identify the change still necessary to become ready for the future, and to accept IoT technologies and AI as its chief enablers.

What the rail industry already has going for it

1. Rail is energy-efficient. Government institutions examine the energy efficiency of different transportation means on a frequent basis. A recent US study, for instance, shows that high-speed trains are up to eight times more efficient than commercial planes, and four times more energy-efficient than cars over the same distance. While the overall trend remains the same globally, the numbers vary for different regions.

High-speed trains in Europe need only one-third of the energy used by automotive travel. The Japanese high-speed rail industry is even more advanced – it uses only one-sixth of the energy.

2. Rail traffic is clean. Cargo transport on the road produces eight times moreCO2 emissions than freight trains. These numbers become even more clear when combining freight and passenger transport: railway companies only account for 1.3% of the total CO2 emissions in the transport sector, whereas aviation makes up 12.4%, ships 12.7% and road transport amounts to 72.2% of the emissions.

Image: Source: European Environment Agency, 2015

3. Rail is safer than other means of passenger transportation. The US Department of Transportation reports that, in 2010, the number of people injured on the highway was 304 times higher than the number of casualties in railroad accidents.

In Europe, where the predominance of car travel isn’t as pronounced as it is in North America, the numbers still show a clear trend: fifteen times as many peoplewere fatally wounded in car accidents in 2013 than in railway-related accidents.

4. Rail is already on the rise. The total length of high-speed railway lines in Central Europe has increased 16-fold since 1981 and the expansion of the European rail network is still ongoing.

In general, worldwide passenger transport by train has doubled since 1985. People seem to like taking the train and they won’t stop anytime soon.

Image: Source: UIC, 2015

What are the challenges that lie ahead and how can we tackle them?

Low network capacities and traffic bottlenecks on busy routes are among the main factors that are holding back progress in the rail industry. If we can’t figure out how to bring even more passengers and trains on railway tracks, and how to make sure that these trains arrive on time, then rail won’t be part of the “future of mobility”. The rail industry needs to adopt new technologies and operational processes in order to keep up.

IoT technologies and AI have the potential to enable this change ­– and in some areas it has already begun. Smart infrastructure components and autonomous trains will soon be interconnected and able to communicate with each other.

This machine-to-machine communication supports the efficiency of train services. It also means that smart sensors can transmit field data to the right platforms as efficiently as possible, that machine data can be used for more than just operation protocols, and that data from very diverse sources can easily be aggregated.

If train network operators combine these smart devices with machine learning algorithms, they can optimize their routes in real-time and distribute traffic more evenly.

Bottlenecks and maintenance

A very common reason for temporary traffic bottlenecks are unplanned maintenance actions. Railway lines are closed completely or speed restrictions are put into place until the damage to the infrastructure can be fixed. Even though this problem has been around for as long as rail travel exists, it does not mean we have to accept it as inevitable.

Rail companies have already started to install smart sensors in their trains and infrastructure, so that they can react faster when problems arise.

Technologies, which use both this so-called “condition-monitoring” and AI, go one step further.

These solutions not only monitor the current health of rail infrastructure, but can also predict wear and potential failures in advance, and so enable rail companies to plan their maintenance in time and prevent train delays.

Route optimization in real-time, and fewer train delays caused by unplanned maintenance would not only reduce operational costs for rail companies, but make rail travel more appealing to passengers.

Add this to helpful IoT applications for the modern traveller, such as interactive maps of train stations, mobile tickets or journey planning apps, and railway will become part of the future of transportation – especially for long-distance travel.

Thought leadership in social sector robotics

WeRobotics Global has become a premier forum for social good robotics. The feedback featured below was unsolicited. On June 1, 2017, we convened our first, annual global event, bringing together 34 organizations to New York City (full list below) to shape the global agenda and future use of robotics in the social good sector.  WeRobotics Global was kindly hosted by the Rockefeller Foundation, the first donor to support our efforts. They opened the event with welcome remarks and turned it over to Patrick Meier from WeRobotics who provided an overview of WeRobotics and the big picture context for social sector robotics.

I’ve been to countless remote sensing conferences over the past 30 years but WeRobotics Global absolutely ranks as the best event I’ve been to – Remote Sensing Expert

The event was really mind-blowing. I’ve participated in many workshops over the past 20 years. WeR Global was by far the most insightful and practical. It is also amazing how closely together everyone is working — irrespective of who is working where (NGO, UN, private sector, donor). I’ve never seen such a group of people come together this away. – Humanitarian Professional

WeRobotics Global is completely different to any development meeting or workshop I’ve been to in recent years. The discussions flowed seamlessly between real world challenges, genuine bottom-up approaches and appropriate technology solutions. Conversations were always practical and strikingly transparent. This was a highly unusual event. – International Donor

The first panel featured our Flying Labs Coordinators from Tanzania (Yussuf), Peru (Juan) and Nepal (Uttam). Each shared the hard work they’ve been doing over the past 6-10 months on localizing and applying robotics solutions. Yussuf spoke about the lab’s use of aerial robotics for disaster damage assessment following the earthquake in Bukoba and for coastal monitoring, environmental monitoring and forestry management. He emphasized the importance of community engagement and closed with new projects that Tanzania Flying Labs is working on such as mangrove monitoring for the Department of Forestry. Juan presented the work of the labs in the Amazon Rainforest, which is a joint effort with the Peruvian Ministry of Health. Together, they are field-testing the use of affordable and locally repairable flying robots for the delivery of antivenom and other medical payload between local clinics and remote villages. Juan noted that Peru Flying Labs is gearing up to carry out a record number of flight tests this summer using a larger and more diverse fleet of flying robots. Last but not least, Uttam showed how Nepal Flying Labs has been using flying robots for agriculture monitoring, damage assessment and mapping of property rights. He also gave an overview of the social entrepreneurship training and business plan competition recently organized by Nepal Flying Labs. This business incubation training has resulted in the launch of 4 new Nepali start-up companies focused on Robotics-as-a-Service. 

The following images provide highlights from each of our Flying Labs: Tanzania, Peru and Nepal.

The second panel featured talks on sector based solutions starting with the International Federation of the Red Cross (IFRC). The Federation (Aarathi) spoke about their joint project with WeRobotics; looking at cross-sectoral needs for various robotics solutions in the South Pacific. IFRC is exploring at the possibility of launching a South Pacific Flying Labs with a strong focus on women and girls. Pix4D (Lorenzo) addressed the role of aerial robotics in agriculture, giving concrete examples of successful applications while providing guidance to our Flying Labs Coordinators. The Wall Street Journal (Sally) spoke about the use of aerial robotics in news gathering and investigative journalism. She specifically emphasized the importance of using flying robots for storytelling. Duke Marine Labs (David) closed the panel with an overview of their projects in nature conservation and marine life protection, highlighting their use of machine learning for automated feature detection for real-time analysis.

Panel number three addressed the transformation of transportation. UNICEF (Judith) highlighted the field tests they have been carrying out in Malawi; using cargo robotics to transport HIV samples in order to accelerate HIV testing and thus treatment. UNICEF has also launched an air corridor in Malawi to enable further field-testing of flying robots. MSF (Oriol) shared their approach to cargo delivery using aerial robotics. They shared examples from Papua New Guinea (PNG) and emphasized the importance of localizing appropriate robotics solutions that can be maintained locally. MSF also called for the launch of PNG Flying Labs. IAEA was unable to attend WeR Global, so Patrick and Adam from WeRobotics gave the talk instead. WeRobotics is teaming up with IAEA to design and test a release mechanism for sterilized mosquitos in order to reduce the incidence of Zika and other mosquito-borne illnesses. More here. Finally, Llamasoft (Sid) closed the panel with a strong emphasis on the need to collect and share structured data to accurately carry out comparative cost-benefit-analyses of cargo delivery via flying robots versus conventional means. Sid used the analogy of self-driving cars to highlight how problematic the current lack of data vis-a-vis reliably evaluating the impact of cargo robotics.

The fourth and final panel went beyond aerial robotics. Digger (Thomas) showed how they convert heavy construction vehicles into semi-autonomous platforms to clear landmines and debris in conflict zones like Iraq and Syria. Science in the Wild (Ulyana) was alas unable to attend the event, so Patrick from WeRobotics gave the talk instead. This focused on the use of swimming robots to monitor glacial lakes in the Himalaya. The purpose of the effort is to identify cracks in the lake floors before they trigger what local villagers call the tsunamis of the Himalaya. OpenROV (David) gave a talk on the use of diving robots, sharing real-world examples and providing exciting updates on the new Trident diving robot. Planet Labs (Andrew) gave the closing talk, highlighting how space robotics (satellites) are being used across a wide range of social good projects. He emphasized the importance of integrating both aerial and satellite imagery to support social good projects.

The final session at WeR Global comprised breakout groups to identify next steps for WeRobotics and the social good sector more broadly. Many quality insights and recommendations were shared during the report back. One such recommendation was to hold WeR Global again, and sooner rather than later. So we look forward to organizing WeRobotics Global 2018. We will be providing updates via our blog and email list. We will also use our blog and email list to share select videos of the individual talks from Global 2017 along with their respective slide decks.

In the meantime, a big thanks to all participants and speakers for making Global 2017 such an unforgettable event. And sincerest thanks to the Rockefeller Foundation for hosting us at their headquarters in New York City.

The Drone Center’s Weekly Roundup: 6/19/17

The Missile Defense Agency is seeking a high-altitude unmanned aircraft that can be equipped with a high-energy laser. Credit: MDA

June 12, 2017 – June 18, 2017

News

A U.S. drone strike in Yemen reportedly killed two individuals suspected of being members of al-Qaeda. The strike targeted a vehicle in Shabwa province, one of several strongholds of al-Qaeda in the Arabian Peninsula. (Reuters)

The European Union released draft regulations for consumer and commercial drones. The blueprint was assembled by the Single European Sky Air traffic management Research Joint Undertaking, a body set up by the European Commission to study low-altitude drone operations. The EU plans to implement drone regulations by 2019. (Press Release)

Commentary, Analysis, and Art

A report by the Center for a New American Security explores possible policies designed to manage military drone proliferation.

A report by the Columbia Law School’s Human Rights Clinic and the Sana’a Center for Strategic Studies evaluates the U.S. government’s transparency on drone strikes between 2002 and 2017.

At Fast Company, Steven Melendez considers how the next generation of military drones and autonomous systems could change warfare.

At the National Interest, David Axe writes that the U.S. Air Force is planning to invest more in disposable strike drones than large complex systems.

Also at the National Interest, Dan Goure looks at how U.S. companies are focusing on ending the threat posed by rogue drone use.

At the Washington Post, Thomas Gibbons-Neff writes that U.S. officials are concerned about the ability of ISIS drones to disrupt U.S. operations.

At Lawfare, Rebecca Crootof and Frauke Renz argue that the conversation surrounding lethal autonomous weapons should seek alternative regulatory strategies beyond an outright ban.

At TechCrunch, Brian Heater looks at how RE2 Robotics is making robot control mechanisms more intuitive.

At Inc.com, Will Yakowicz writes that Saildrone, a California-based startup, aims to deploy more unmanned sailboats to measure climate change than all of the satellites in space.

A study by the Karolinska Institute in Stockholm found that defibrillator-carrying drones could cut response times for cardiac arrests by 16 minutes. (The Guardian)

An essay at the Economist explores how consumer drones are being put to work for commercial applications.  

At iRevolutions.org, Patrick Meier looks at how flying robots could be used to combat the spread of Zika.

At the University of Toronto, students and faculty discuss the opportunities presented by the development of advanced autonomy for consumer drones.

At KSHB, Belinda Post writes that drones are a popular father’s day gift this year.

At AIN Online, Vladimir Karnozov considers the history of Iranian-Russian collaboration on the development of new drones.

Know Your Drone

The U.S. Missile Defense Agency is looking to acquire a high-altitude long-endurance drone that can carry a high-energy laser to intercept intercontinental ballistic missiles. (IHS Jane’s 360)

Drone maker RaptorUAS has unveiled the Raptor EV, a vertical takeoff and landing fixed-wing drone. (Unmanned Systems Technology)

U.S. drone maker Kratos is unveiling its two new low-cost combat drones, the XQ-222 Valkyrie and the UTAP-22 Mako. (New Atlas)

The U.S. Air Force is conducting a study to estimate the service life of its MQ-9 Reaper drones. (Defense Daily)

Airbus Defence and Space will conduct test flights of its Zephyr high-altitude long-endurance drone in Australia next year. (Shephard Media)

U.K. firm Horizon Technologies is looking to mount a satellite phone monitoring sensor on small drones. (IHS Jane’s 360)

Researchers at Nvidia are developing drone navigation systems that rely on computer vision rather than GPS signals. (The Drive)

Amazon has been awarded two patents for its delivery drone system: one for foldable rotor arms and the other for a winch system to lower packages from the drone to the ground. (GeekWire)

Drones at Work

South Korean officials said that a North Korean drone that crashed in the country had taken 10 photographs of a sensitive U.S. missile defense site. (The Washington Post)

A search and rescue team in Colorado used a newly acquired drone to search for a group of missing hikers. (CBS4)

General Electric has begun a program to test drones and unmanned ground vehicles to inspect industrial facilities and infrastructure. (Reuters)

The Croatian Defense Ministry is planning to acquire drones and set up an unmanned aircraft squadron. (Defense News)

Drone Delivery Canada conducted the first beyond visual line of sight delivery test flights in Canada, flying a drone in Alberta from a control center 2,500 kilometers away in Toronto. (AUVSI)

Documents released by the U.S. Department of Justice show that there have been more than a dozen attempts to smuggle contraband into federal prisons using drones in the past five years. (USA Today)

Firefighters in London used a drone to assist in the response to the Grenfell Tower fire. (Newsweek)

The Federal Aviation Administration is investigating reports of illegal drone operations in Charlotte, North Carolina. (Charlotte Observer)

The California National Guard has relocated its fleet of MQ-9 Reaper drones from Victorville to the March Air Reserve Base. (Aviation Week)  

Security officials used a Dedrone counter-drone system at the Golden State Warriors’ basketball team’s championship parade in Oakland, California. (Recode)

Massachusetts police used drones for security during the Sail Boston boating event. (Boston Globe)

The Middlesex County prosecutor’s office in New Jersey bought a drone for criminal investigations. (TAP into Piscataway)

The Israeli air force is developing a 15-year roadmap for its fleet of unmanned aircraft. (FlightGlobal)

Police are searching for a drone operator who flew a drone close to air tankers and helicopters assisting in the response to a California brush fire. (10News)

The U.S. Navy picked the USS Dwight D. Eisenhower and USS George H.W. Bush as the first two aircraft carriers to deploy the MQ-25 Stingray unmanned refueler drone. (USNI News)

Industry Intel

The U.S. Navy awarded Boeing Insitu an $8 million contract for one RQ-21A Blackjack unmanned aircraft system for the Marine Corps. (DoD)

The Defense Advanced Research Projects Agency awarded Raytheon a $5.2 million contract for the Aerial Dragnet program.

The Defense Advanced Research Projects Agency awarded Embry-Riddle and Creare a $1 million grant to develop an autonomous flight control system for drones. (Press Release)

The Drone Racing League raised $20 million in grants from Allianz and Sky. (The Telegraph)

Kraken is partnering with Atlas Elektronik to develop a system for the Royal Canadian Navy’s Remote Mine Disposal System requirement. (IHS Jane’s 360)

Laura Ponto, an executive at Alphabet’s Project Wing, is the new chairman of the Commercial Drone Alliance, an industry advocacy organization. (Recode)

Israel’s Aeronautics, a drone manufacturer, has made an initial public offering on the Tel Aviv Stock Exchange. (IHS Jane’s 360)

For updates, news, and commentary, follow us on Twitter. The Weekly Drone Roundup is a newsletter from the Center for the Study of the Drone. It covers news, commentary, analysis and technology from the drone world. You can subscribe to the Roundup here.

 

New laissez-faire robocar rules may arise

While very few details have come out, Reuters reports that new proposed congressional bills on self-driving cars will reverse many of the provisions I critiqued in the NHTSA regulations last year.

One big change is a reversal of the new idea of pre-market regulation. Today, new car technologies are not regulated before they are deployed, but NHTSA proposed giving itself the power to regulate technologies even before they exist. Currently, most car technologies like adaptive cruise control, autopilots, forward collision avoidance, lane keeping and the like remain unregulated after a decade or more of deployment with few, if any, problems.

This is important because the old doctrine of “we don’t regulate until we see a problem the industry won’t fix on its own” is a much better one for innovation, and the speed of innovation is key in deciding which countries and companies lead this technology. The opposite approach of “we try to imagine what might go wrong and ban it ahead of time” may seem safer, but it’s definitely an impediment to innovation and may actually result in far more deaths through the delay of life-saving technologies.

Harder to judge is the preemption of state rules. While states are also attempting to pre-regulate, having a laboratory of 50 different competing states can also be good for innovation on the legal side. There is not one answer, and while it’s more complex to deal with 50 sets of regulations instead of one, it’s not that much more complex.

One of the few interesting and good ideas in the NHTSA regs may also vanish. NHTSA wanted all vendors to make available all sensor logs from all incidents. As I predicted, companies pushed back on this — their testing logs and the resulting test suites are very important competitive assets. The company with the best test suite is the furthest on the path to the safety needed for deployment. On the other hand, sharing this data would let everybody get further on that path, faster.

There has been lots of other news during the long road-trip I am on in Europe. This includes more entrants in the race, the retirement of Google’s 3rd generation “koala” car, more at Uber. I will report from the Autonomous Car Testing and Development conference in Stuttgart starting Tuesday.

Trusting robots with our lives

The Baxter robot hands off a cable to a human collaborator — an example of a co-robot in action. Photo credit: Aaron Bestick, UC Berkeley.

The key takeaway from Tuesday’s RobotLabNYC forum, on “Exploring The Autonomous Future,” was humans are the key to robot adoption. Dr. Howard Morgan of First Round Capital expressed to the audience of more than 100 innovators working within the automation ecosystem, the necessity of embracing “entrepreneurial marketing” to reach customers. Tom Ryden echoed Morgan’s sentiment in his presentation about Mass Robotics, conveying his startups’ frustrations with the pace of adoption. Dr. Eric Daimler, formerly of the Obama Administration, concluded the evening succinctly by exclaiming, “we only adopt what we trust.” Trust is key for crossing the chasm.

Intuitive Surgical this past year celebrated its 17 year of operations with close to a million robotic surgeries completed last year. According to a recent Gallup Poll, medical professionals are the most trusted individuals in our society, even more than one’s clergy. The fact that robot-assisted surgery has become so routine and accepted by doctors and their patients is proof positive that in some industries we have already crossed the trust threshold.

Photo credit: Robert Shields

Understanding how Intuitive’s Da Vinci robot built trust within the medical community could offer parallels to other areas of the automation industry. Robotic-assisted surgery or “telerobotics,” is the evolution of two modern technologies: 1) telepresence or telemanipulation; and 2) laparoscopic surgery. In 1987, French physician Dr. Philippe Mouret performed the first minimally invasive gallbladder surgery using an endoscope-like device to remotely guide his instruments via video to remove the damaged organ. By the 1990’s, laparoscopic surgery became commonplace, driving the demand for more precision through mechanics and computer-aided techniques. A decade later, Intuitive received FDA approval for its Da Vinci robot for general surgery, which has since been expanded for prostate, neurological, and thoracic procedures. Telerobotics evolved not just from the availability of advanced technologies, but from the demand for less invasive procedures by the most trusted people in America.

Last month, the FDA approved the Da Vinci Xi Systems, enabling Intuitive Surgical to market less expensive systems and gain marketshare with smaller medical institutions globally. “This new system enables access to Intuitive’s leading and proven robotic-assisted surgical technology at a lower price point. Customers around the globe have different needs from a clinical, cost and technology perspective; Intuitive’s goal is to meet those needs by providing a range of products and solutions: the da Vinci X System helps us continue to do so,” said CEO Dr. Gary Guthart.

According to the press release, Da Vinci X System is “a focused-quadrant surgery and features flexible port placement and 3D digital optics, while also including advanced instruments and accessories from its Xi system.” Another determining factor of Intuitive Surgical’s success is the interoperability of the instruments. Rather than just an endoscope that provides video feeds, Da Vinci is equipped with multiple end effectors that mimics traditional instruments guided by experienced surgeons telerobotically.

Patients trust the robot because it is simply augmenting their doctor’s skills with greater precision. This is reinforced by shorter recovery periods and better outcomes. Recently, Oxford published a research study which took place over a nine-year period that concluded patients who opted for robotic lobectomies had better lung cancer outcomes. As a new generation of surgeons embraces the robotic future, the market for abdominal surgical robots is expected to grow from $2.9 billion in 2017 to $12.9 billion by 2022.

Trusting robots with our bodies might seem like a difficult premise to uphold, but robots have been saving lives on the front lines since 1972. Bomb-defusing machines have been utilized in the most dangerous situations worldwide from Afghanistan to Jerusalem to New York City. Today, almost every police department and military have an arsenal of remote-controlled explosive removal devices.

Dr. Sethu Vijayakumar, director of the Edinburgh Centre for Robotics in the United Kingdom, explains, “One of the target areas, in terms of [the] use of robots, is for going into dangerous situations. Robots can go in, be operated from a safe distance, and, in a worst-case scenario, be sacrificed.”

Similar to robotic medicine, trust-based systems for the military are built by teleporting human expertise into dangerous situations. Pittsburgh-based RE2 Robotics took this concept to a new level with its Robotic Manipulation System announced last week. The RE2 System now enables users to actually use their limbs and hands to control the robot’s movements and grippers to quickly defuse explosives.

RE2 CEO explained the rationale for his new product, “Often times, you still need the human intellect to perform those tasks. But they’re dangerous, so the question is, how can we project that human capability remotely, so they’re still able to do their job and leverage the human intellect to solve a really big problem? That’s what we’re trying to do — keep the human safe, but allowing them to still do their job.”

While rover looks remarkably similar to Endeavor’s (formerly iRobot) Packbot that has been widely deployed by the US military in Iraq, Afghanistan and elsewhere, the control system is novel and more reliable in the high-pressure situations. Pedersen says, “If you’re going to project that human capability, the most human way to control it is to have it be as much like you as possible. That’s where we’ve come over the past decade, having true human-like capability. It’s no coincidence that these robots look like human torsos. These systems are a projection of you, remotely. It’s almost like an avatar, where you’re dealing with a threat out of harm’s way.”

While today the operator of RE2’s robot stands at a safe distance watching the video feed on a laptop, the company is developing a virtual reality headset accessory for the control system to enable the professional to completely immerse himself into the situation. Pedersen also plans to expand the use cases for his technology to civilian markets such as search & rescue, disaster recovery (like Fukushima) and medicine.

“Yes, people could use this technology for other means. But our charter is saving lives and extending it into new markets like health care, where we can do patient assist. [We can] help a person from a wheelchair to a bed or a wheelchair to a toilet, as the brawn for a caregiver,” touts Pedersen.

While we are years away from fully trusting autonomous systems with our lives, it appears from these two examples that the first step is enabling machines to augment our most trusted citizens. As yesterday was Father’s Day it is only appropriate I share with my readers my gift – GrillBot. The disclaimer on the box, however, does make me question when I plan to use it; fear of death is kind of a big deal!

From drinking straws to robots

Image: Harvard Gazette

By Peter Reuell, Harvard Staff Writer

At the beginning of the decade, George Whitesides helped rewrite the rules of what a machine could be with the development of biologically inspired “soft robots.” Now he’s poised to rewrite them again, with help from some plastic drinking straws.

Inspired by arthropod insects and spiders, Whitesides and Alex Nemiroski, a former postdoctoral fellow in Whitesides’ Harvard lab, have created a type of semi-soft robot capable of standing and walking. The team also created a robotic water strider capable of pushing itself along the liquid surface. The robots are described in a recently published paper in the journal Soft Robotics.

Unlike earlier generations of soft robots, which could stand and awkwardly walk by inflating air chambers in their bodies, the new robots are designed to be far nimbler. Though real-world applications are still far off, the researchers hope the robots eventually could be used in search operations following natural disasters or in conflict zones.

“If you look around the world, there are a lot of things, like spiders and insects, that are very agile,” said Whitesides, the Woodford L. and Ann A. Flowers University Professor at Harvard. “They can move rapidly, climb on various items, and are able to do things that large, hard robots can’t do because of their weight and form factor. They are among the most versatile organisms on the planet. The question was, how can we build something like that?”

The answer, Nemiroski said, came in the form of your average drinking straw.

“This all started with an observation that George made, that polypropylene tubes have an excellent strength-to-weight ratio. That opened the door to creating something that has more structural support than purely soft robots have,” he said. “That was the building block, and then we took inspiration from arthropods to figure out how to make a joint and how to use the tubes as an exoskeleton. From there it was a question of how far can your imagination go? Once you have a Lego brick, what kind of castle can you build with it?”

What they built, he said, is a surprisingly simple joint.

Whitesides and Nemiroski began by cutting a notch in the straws, allowing them to bend. The scientists then inserted short lengths of tubing which, when inflated, would force the joints to extend. A rubber tendon attached on either side would then cause the joint to retract when the tubing deflated.

Armed with that simple concept, the team built a one-legged robot capable of crawling, and moved up in complexity as they added a second and then a third leg, allowing the robot to stand on its own.

“With every new level of systems complexity, we would have to go back to the original joint and make modifications to make it capable of exerting more force or to be able to support the weight of larger robots,” Nemiroski said. “Eventually, when we graduated to six- or eight-legged arthrobots, making them walk became a challenge from a programming perspective. For example, we looked at the way ants and spiders sequence the motion of their limbs and then tried to figure out whether aspects of these motions were applicable to what we were doing or whether we’d need to develop our own type of walking tailored to these specific types of joints.”

While Nemiroski and colleagues were able to control simple robots by hand, using syringes, they turned to computers to control the sequencing of their limbs as the designs increased in complexity.

“We put together a microcontroller run by Arduino that uses valves and a central compressor,” he said. “That allowed us the freedom to evolve their gait rapidly.”

Though Nemiroski and colleagues were able to replicate ants’ distinctive “triangle” gait using their six-legged robot, duplicating a spider-like gait proved far trickier.

“A spider has the ability to modulate the speed at which it extends and contracts its joints to carefully time which limbs are moving forward or backward at any moment,” Nemiroski said. “But in our case, the joints’ motion is binary due to the simplicity of our valving system. Either you switch the valve to the pressure source to inflate the balloon in the joint, and thus extend the limb, or you switch the valve to atmosphere to deflate the joint and thus retract the limb. So in the case of the eight-legged robot, we had to develop our own gait compatible with the binary motion of our joints. I’m sure it’s not a brand-new gait, but we could not duplicate precisely how a spider moves for this robot.”

Developing a system that can fine-tune the speed of actuation of the legs, Nemiroski said, would be a useful goal for future research, and would require programmable control over the flow rate supplied to each joint.

“We hit that limitation in the system, which I’m actually pretty proud of, because it means we pushed it to its absolute limit,” he said. “We took the basic concept and asked how far can we go before we would have to make radical alterations to how these limbs work, and we found that limit at the eight-legged robot. We were able to make it walk, but if you wanted to make it walk faster, or to add more limbs — for example, to support a load — you would have to start rethinking the system from the ground up.”

Though it may be years before the robots find their way into real-world applications, Whitesides believes the techniques used in their development — particularly the use of everyday, off-the-shelf materials — can point the way toward future innovations.

“I don’t see any reason to reinvent wheels,” he said. “If you look at drinking straws, they can make them at, effectively, zero cost and with great strength, so why not use them? These are academic prototypes, so they’re very light weight, but it would be fairly easy to imagine building these with a lightweight structural polymer that could hold a substantial weight.”

“What’s really attractive here is the simplicity,” added Nemiroski. “This is something George has been championing for some time, and something I grew to appreciate deeply while I was in his lab. For all the complexity of movement and structural integrity we get out of these robots, they’re remarkably simple in terms of construction and control. Using a single, easy-to-find material and a single concept for an actuator, we could achieve complex, multidimensional motion.”

This post was originally published on The Harvard Gazette. Click here to view the original.

This research was supported with funding from the U.S. Department of Energy, DARPA, the Natural Sciences and Engineering Research Council of Canada, the National Science Foundation, the Swedish Research Council, and the Wyss Institute for Biologically Inspired Engineering at Harvard University.

Talking Machines: Overfitting and asking ecological questions, with Professor (Emeritus) Tom Dietterich

Credit: Wikipedia Commons

In episode three, season three of Talking Machines, we dive into overfitting, take a listener question about unbalanced data and speak with Professor (Emeritus) Tom Dietterich from Oregon State University.

If you enjoyed this episode, you may also want to listen to:

See all the latest robotics news on Robohub, or sign up for our weekly newsletter.

Meet the labs of NCCR Robotics: Dillenbourg Lab

Prof. Pierre Dillenbourg and the team from the Computer-Human Interaction in Learning and Instruction (CHILI) Lab, explain how they are building robots to use in the classrooms of tomorrow. It is CHILI’s goal to deeply integrate Human-Computer Interaction (HCI) and learning sciences, especially in addressing practical problems in learning, teaching, and instruction.

If you enjoyed this ‘meet the lab’ video, you can also watch another in the NCCR Robotics series below:

2017 IEEE International Conference on Robotics and Automation: A summary

Prof Andrew Davison from Imperial College presents at the Event-based Vision Workshop

It was a hectic but interesting week at the 2017 IEEE International Conference on Robotics and Automation in Singapore. Here’s a brief recap of some of my observations and experiences.

Popular Fields

Computer/robotic vision and navigation-related (SLAM, localization) are still some of the most popular, or at least well-attended fields at these conferences. My colleagues said that some of the manipulation / grasping sessions were well attended too.

The influence and growth in machine learning / deep learning seems to have slowed somewhat. This is possibly related to the fact we’re increasingly seeing some of the best robotics learning work going to machine learning or computer vision conferences, or potentially to new conferences like the Conference on Robot Learning.

Workshops continue to grow in importance

There seems to be an increasing number of attendees coming primarily to attend workshops, some of which very well attended, even at the tail end of the conference on Friday afternoon (a good sign!). This trend mirrors what we’re seeing at some of the other robotics and computer vision conferences, where there are very well attended workshops.

The event-vision based workshop, in particular, was impressive in how different it was to the 2015 incarnation, which was sparsely attended. This one had heaps of top researchers, industry, and lots of demos around the room.

Some of the mystery stealth startups in self-driving cars like Zoox showed off a little of what they are doing:

The shark tank environment has died down a little

Although I did manage to witness a couple of specific individuals spending the entire week being whisked away for recruiting lunches / dinners / drinks, the crazy recruiting environment of recent conferences seems to have died down, at least a little.

This is perhaps a testament to the fact that the fields of AI and self-driving cars are starting to mature a little – most of the major players now have a more stable, ongoing strategy so there’s not so much chaotic recruiting activity. It’s also clear that there’s still a significant talent shortage, especially at a middle seniority level – highly qualified postdocs with several years of domain experience (machine learning, perception, autonomous vehicles, SLAM) and leadership experience are like hens’ teeth!

Major local startups like NuTonomy showcased their work at a special event. I managed to get along separately and see that they are improving leaps and bounds in their capability and now have some pretty impressive capability showcases.

The bigger picture

Plenaries and keynotes like that of Hiroaki Kitano (Sony Labs, “Nobel Turing Challenge: Grand Challenge of AI, Robotics, and Systems Biology”) reminded us of the big picture regarding robotics and AI. We always seem to use inspiration from the space race:

And we got to see Peter Corke introduce ICRA2018 in Brisbane, Australia!

I enjoyed talking at the Visual Localization session (another packed out session with standing room only) on our paper, “Deep Learning Features at Scale for Visual Place Recognition“.

The social functions were good and the conference hotel was incredible, especially the infinity pool at the top of the hotel, 57 floors up, looking over the Marina. The night safari was fun too.

Overall, a great week and always great to reconnect with hundreds of colleagues and collaborators from around the world. See you next year in Brisbane!

How to reduce Zika using flying robots

Mosquitos kill more humans every year than any other animal on the planet and conventional methods to reduce mosquito-borne illnesses haven’t worked as well as many hoped. So we’ve been hard at work since receiving this USAID grant six months ago to reduce Zika incidence and related threats to public health.

Our partners at the joint FAO/IAEA Insect Pest Control Lab in Vienna, Austria have been working to perfect the Sterile Insect Technique (SIT) in order to sterilize and release male mosquitos in Zika hotspots. Releasing millions of said male mosquitos increases competition for female mosquitos, making it more difficult for non-sterilized males to find a mate.


We learned last year at a USAID Co-Ideation Workshop that this technique can reduce the overall mosquito population in a given area by 90%. The way this works is by releasing millions of sterilized mosquitos using cars, helicopters and/or planes, or even backpacks.

Our approach seeks to complement and extend (not replace) these existing delivery methods. The challenge with manned aircraft is that they are expensive to operate and maintain. They may also not be able to target areas with great accuracy given the altitudes they have to fly at.
Cars are less expensive, but they rely on ground infrastructure. This can be a challenge in some corners of the world when roads become unusable due to rainy seasons or natural disasters. What’s more, not everyone lives on or even close to a road.

Our IAEA colleagues thus envision establishing small mosquito breeding labs in strategic regions in order to release sterilized male mosquitos and reduce the overall mosquito population in select hotspots. The idea would be to use both ground and aerial release methods with cars and flying robots.

The real technical challenge here, besides breeding millions of sterilized mosquitos, is actually not the flying robot (drone/UAV) but rather the engineering that needs to go into developing a release mechanism that attaches to the flying robot. In fact, we’re more interested in developing a release mechanism that will work with any number of flying robots, rather than having a mechanism work with one and only one drone/UAV. Aerial robotics is evolving quickly and it is inevitable that drones/UAVs available in 6-12 months will have greater range and payload capacity than today. So we don’t want to lock our release mechanism into a platform that may be obsolete by the end of the year. So for now we’re just using a DJI Matrice M600 Pro so we can focus on engineering the release mechanism.

Developing this release mechanism is anything but trivial. Ironically, mosquitos are particularly fragile. So if they get damaged while being released, game over. What’s more, in order to pack one million mosquitos (about 2.5kg in weight) into a particularly confined space, they need to be chilled or else they’ll get into a brawl and damage each other, i.e., game over. (Recall the last time you were stuck in the middle seat in Economy class on a transcontinental flight). This means that the release mechanism has to include a reliable cooling system. But wait, there’s more. We also need to control the rate of release, i.e., to control how many thousands mosquitos are released per unit of space and time in order to drop said mosquitos in a targeted and homogenous manner. Adding to the challenge is the fact that mosquitos need time to unfreeze during free fall so they can fly away and do their thing, i.e., before they hit the ground or else, game over.

We’ve already started testing our early prototype using “mosquito substitutes” like cumin and anise as the latter came recommended by mosquito experts. Next month, we’ll be at the FAO/IAEA Pest Control Lab in Vienna to test the release mechanism indoors using dead and live mosquitos. We’ll then have 3 months to develop a second version of the prototype before heading to Latin America to field test the release mechanism with our Peru Flying Labs. One of these tests will involve the the integration of the flying robot and the release mechanism in terms of both hardware and software. In other words, we’ll be testing the integrated system over different types of terrain and weather conditions in Peru specifically.

We are already developing the mission control app pictured above to program our autonomous flights. The app will let the operator decide how many sterilized mosquitos to release at any given time and location. Our field tests in Peru will also seek to identify the optimal flight parameters for the targeted and homogenous delivery of sterilized mosquitos. For example, what is the optimal speed and altitude of the flying robot to ensure that the mosquitos are released over the intended areas?

Our Peru Flying Labs has already developed expertise and capacity in cargo drone delivery, most recently in projects in the Amazon Rainforest with the Ministry of Health (more here). This new Zika reduction project –and in particularly the upcoming field tests — will enable us to further build our Peruvian team’s capacity in cargo space. The plan is for Peru Flying Labs to operate the flying robots and release mechanisms as need once we have a more robust version of the release mechanism. The vision here is to have a fleet of flying robots at our Flying Labs equipped with release mechanisms in order to collectively release millions of sterilized mosquitos over relatively large areas. And because our Peruvian colleagues are local, they can rapidly deploy as needed.

For now, though, our WeRobotics Engineering Team (below) is busy developing the prototype out of our Zurich office. So if you happen to be passing through, definitely let us know, we’d love to show you the latest and give you a demo. We’ll also be reaching out the Technical University of Peru who are members of our Peru Flying Labs to engage with their engineers as we get closer to the field tests in country.

As an aside, our USAID colleagues recently encouraged us to consider an entirely separate, follow up project totally independently of IAEA whereby we’d be giving rides to Wolbachia treated mosquitos. Wolbachia is the name of bacteria that is used to infect male mosquitos so they can’t reproduce. IAEA does not focus on Wolbachia at all, but other USAID grantees do. Point being, the release mechanism could have multiple applications. For example, instead of releasing mosquitos, the mechanism could scatter seeds. Sound far-fetched? Think again.

RoboCup video series: Industrial league

RoboCup is an international scientific initiative with the goal to advance the state of the art of intelligent robots. Established in 1997, the original mission was to field a team of robots capable of winning against the human soccer World Cup champions by 2050.

To celebrate 20 years of RoboCup, the Federation is launching a video series featuring each of the leagues with one short video for those who just want a taster, and one long video for the full story. Robohub will be featuring one league every week leading up to RoboCup 2017 in Nagoya, Japan.

This week, we consider being part of the RoboCupIndustrial league. RoboCupIndustrial is a competition between industrial mobile robots focusing on logistics and warehousing systems. In anticipation of Industry 4.0, participants compete in automation through robots, autonomous systems, and mobile robot technology. You’ll hear about the history and ambitions of RoboCup from the trustees, and inspiring teams from around the world.

Short version:

Long version:

Want to watch the rest? You can view all the videos on the RoboCup playlist below:

https://www.youtube.com/playlist?list=PLEfaZULTeP_-bqFvCLBWnOvFAgkHTWbWC

Please spread the word! If you would like to join a team, click here for more information.

 If you liked reading this article, you may also want to read:

See all the latest robotics news on Robohub, or sign up for our weekly newsletter.

Indoor drones make history on Broadway

Photo: Cirque du Soleil – PARAMOUR on Broadway – at the Lyric Theatre. Featuring Flying Machine Design and Choreography by Verity Studios. Pictured: Ruby Lewis as ‘Indigo’ Ryan Vona as ‘Joey’. ©, Cirque du Soleil Theatrical. Photo by: Richard Termine

For the first time on Broadway human and drone performances fuse to create a new form of artistic expression. The magic happened in Cirque du Soleil’s first musical on Broadway: ‘Paramour’ at the Lyric Theatre. The show is themed on the Golden Age of Hollywood and follows the life of a poet who is forced to choose between love and art. The contributions of the technology firm Verity Studios include the choreography of the drone show segment, the frame and lighting design of the drone costumes, and all underlying drone technologies. The system was operated by the show’s automation team, with Verity Studios providing maintenance services twice per year. The dancing drones completed almost 400 shows, including more than 7,000 autonomous takeoffs, flights, and landings.

Over the past year, 398 audiences of up to 2,000 people witnessed an octet of colorful lampshades perform an airborne choreography during Cirque du Soleil’s Broadway show Paramour, which ran until April 20th. The work behind the design and choreography of the flying lampshades, which turn out to be self-piloted drones, bears the signature of the Swiss high-tech company Verity Studios.

But how novel is it really that robots have appeared in theater? Since Karel Capek’s science fiction play R.U.R. (short for Rossum’s Universal Robots) introduced the word “robot” to the English language and to science fiction almost 100 years ago, the technical challenges of incorporating robots into live performance and theater have been overwhelming. Before these Broadway drones, nearly all theater robots were remote-controlled puppets, relying on humans hidden off-scene to steer their movements and provide their intelligence. What holds for Broadway, also holds for the even bigger picture.

It is intriguing that the aerial revolution gained momentum on the ground first: Even though the complexity of most advanced industrial automation systems found in state-of-the art factories and warehouses hardly compares to the complexity of drone show systems that allow for the autonomous navigation of dozens, hundreds, or thousands of drones in a safety-critical environment, one single example stands out. The only comparable systems that can serve as a template for operating large numbers of autonomous mobile robots with high demands for reliability and safety are those developed by the technology company Kiva Systems (bought by Amazon for USD 775 million in 2012), where Verity Studios’ founder Professor Raffaello D’Andrea and his former colleagues developed a solution for automated storage and retrieval in warehouses. His team unleashed thousands of mobile robots in warehouses, which started the robotics gold rush in the Silicon Valley. Now, Professor D’Andrea’s team is pursuing an analogous, even more ambitious goal in the air.

Placing intelligent, autonomous flying machines in live theater presents a multi-faceted challenge: creating a compelling performance with safety, reliability, and ease of operation. While the compelling performance translates into shaping a convincing creative concept around the drones’ choreography, the latter chiefly points to designing computerized systems in lieu of making use of human pilots: Verity Studios’ drones are flying mobile robots and navigate autonomously, piloting themselves, only supervised by a human operator. To navigate autonomously, these drones require a reliable method for determining their position in space. Since GPS is usually not available indoors, Verity Studios has built on more than a decade of research and development at the Flying Machine Arena of Switzerland’s Federal Institute of Technology (ETH Zurich) to provide a novel localization method.

The first groups of autonomous robots are now meeting the live event industries’ high requirements: Initially, Verity Studios set the stage for widely recognized flying machines in entertainment in 2014, by collaborating with Cirque de Soleil on Sparked, a short film in which 10 siblings of the similarly dressed 8 quadcopters from Paramour dance, hover, and flicker around a stunned human actor. Sparked was named a Winner of the 2016 New York City Drone Film Festival. However, it is one thing to feature drones in a 4-minute video, where the makers have the luxury to shoot it 100 times and then choose the best shot. Live performances on Broadway running 8 times per week in front of up to 2,000 people every time, by contrast, require the drone shows to work every single time. Verity Studios has met these requirements in the best sense: During their one-year run, the drones on Broadway safely completed more than 7,000 autonomous take-offs, flights, and landings. How was that possible?

In contrast to the long list of safety incidents involving remote-controlled drones at events, performance and reliability are key to Paramour’s dancing drones which are custom-made and hand-crafted in Switzerland. Each of the eight flying machines featured in Paramour uses 80 sensors to fly and performs roughly 1.5 billion calculations per second. Each critical calculation is double-checked every time it is performed in case any of the concerned processors makes a mistake. In other words, accidents are prevented by self-test and monitoring. And even if something does happen, a back-up is in place. For example, on the show of 2017-02-08, the battery from one of the eight vehicles could not provide sufficient power during the takeoff phase. The quadrocopter detected the problem and returned to the ground on only two propellers.

In most cases, the drones withstand any point of failure, but where a single point of failure is unavoidable, a fail-safe or weakest link design is used. The failure of any single system component cannot result in an unmanaged loss of control, but must be handled appropriately. For instance, a drone should be able to land in a controlled fashion despite a failure of any one of its motors, any part of its electronics, any one of its cables or connectors, and any one of its batteries. Similarly, loss of communication between a drone and its ground station must not create a dangerous situation. This can be achieved by designing a fully redundant system, i.e., a system that can continue operation, or trigger a safe emergency behavior, if any one of its components fails. While such designs can be more expensive to create than designs without duplication, they provide much higher safety (and help reduce insurance costs). Their decades-long history in the manned aviation industry has shown this approach’s effectiveness and provides a treasure trove of experience and evidence for the emerging drone industry.

One way to design such a redundant system is to first design a simple flight-capable system, to then duplicate all its components (e.g. sensors, processors, actuators) to achieve the necessary redundancy, and to carefully design switch-over from a failed system to its backup. Importantly, the design of such a system cannot stop with the design of fully redundant drones, but needs to extend to all other critical components of the drone show system, including the positioning system, communications architecture, e-stop systems, and control stations. In the end, this uncompromising approach allows for a degree of safety and robustness that makes those intelligent and autonomous robots suitable for performance next to theater audiences. The result is a one-of-a-kind performance that extends the traditional palette of light, sound, stage effects, and interaction with human performers by translating an intimate character beat into an unexpected visual motif.

The enticing reality is that there are many more areas to explore, ranging from live concerts to active scenography, that offer dramatic possibilities for performing robots on a much broader scale. Once again, not only such stage flyers, but also Lucie micro-drones will make history, not only on Broadway or at Amazon, but all across the domain of performing arts revolutionizing the scene with a new realm of creative expression.

Tertill: A weed whacking robot to patrol your garden

Update: The response to Tertill’s crowdfunding campaign has amazed and delighted us! Pledges totalling over $250,000 have come from 1000+ backers. We’re shipping to all countries, with over a fifth of Tertill’s supporters coming from outside the United States. But the end is near; Tuesday (11 July) is the last full day of the campaign. After that Tertill’s discounted campaign price will no longer be available and delivery in time for next year’s (northern hemisphere) growing season cannot be assured.

Franklin Robotics has launched a Kickstarter campaign for Tertill, their solar-powered, garden-weeding robot.

Tertill lives in your garden, collecting sunlight to power its weed patrol, and cutting down short plants with a string trimmer/weed whacker with almost no intervention required. Available for about $300USD, the fully autonomous Tertill is the first weeding robot available to home gardeners.

Tertill is round, short, has four wheel drive and extreme camber wheels. It uses proprietary algorithms to ensure that it finds as many weeds as it can, using its sensors to distinguish between weeds and crops based on height. As Tertill sees it: small plants are weeds, big plants are crops. But what if you have seedlings? Simply place a plant collar around seedlings to inform Tertill that this plant is wanted.

Tertill doesn’t use a camera for weed discrimination because Franklin wants to put Tertill to work in your garden now. In the not-too-distant future, inexpensive vision systems may reliably distinguish between plants and crops even when both are seedlings. But, according to Franklin, such system are not yet ready.

Tertill is designed such that one robot can easily keep up with the weeds in a typical sized garden (that’s about 100 square feet in the USA). Tertill will usually handle gardens considerably larger than this, but how much larger depends on weather and local weed types. And Terrill’s can work in teams, coexisting harmoniously in the same space. Multiple Tertill robots will simply avoid each other.

Check out the video below:

But Tertill needs a small barrier to keep it from wandering off beyond the borders of your garden. A garden fence, the wooden border of a raised bed, or any sort of edging that is two or more inches tall will work.

Otherwise, Tertill is designed to live in your garden and require very little attention. Summer showers won’t bother it. And, under normal conditions, you won’t have to worry about charging Tertill—the sun will see to that. But, if Tertill has been in the dark for so long (months) that its battery is completely exhausted, a USB connection can be used to charge the battery.

Franklin believes that small, simple robots can help solve big, complex problems. Franklin’s robots aim to help gardeners by reducing the tedium and physical challenge of weeding, making gardening more fun. The data their robots collect helps gardeners garden better, improving yield and quality. Their robots aim to benefit the environment by eliminating the need for herbicides and returning organic matter to the soil.

Click here to visit Franklin’s website and learn more.

Page 340 of 346
1 338 339 340 341 342 346