In this episode, Jack Rasiel speaks with Kostas Bekris, who introduces us to tensegrity robotics: a striking robotic design which straddles the boundary between hard and soft robotics. A structure uses tensegrity if it is made of a number of isolated rigid elements which are held in compression by a network of elements that are in tension. Bekris, an Associate Professor of Computer Science, draws from a diverse set of problems to find innovative new ways to control tensegrity robots.
Kostas Bekris
Kostas Bekris is an Associate Professor of Computer Science at Rutgers, the State University of New Jersey. He is working in the area of algorithmic robotics, especially on problems related to robot motion planning and coordination. He received his PhD from Rice University in 2008 under the guidance of Lydia Kavraki. He was an Assistant Professor at the University of Nevada, Reno until 2012. His research has been supported by NSF, NASA, the DoD and DHS, including an NASA Early Career Faculty award.
In 2016, the European Union co-funded 17 new robotics projects from the Horizon 2020 Framework Programme for research and innovation. 16 of these resulted from the robotics work programme, and 1 project resulted from the Societal Challenges part of Horizon 2020. The robotics work programme implements the robotics strategy developed by SPARC, the Public-Private Partnership for Robotics in Europe (see the Strategic Research Agenda).
EuRobotics regularly publishes video interviews with projects, so that you can find out more about their activities. This week features ILIAD: ntra-Logistics with Integrated Automatic Deployment: Safe and Scalable Fleets in Shared Spaces
Objectives
ILIAD is driven by the industry needs for highly flexible robot fleets operating in spaces shared with humans. The main objectives are care-free, fast, and scalable deployment; long-term operation while learning from observed activities; on-line, self-optimising fleet management; human-aware fleets that can learn human behaviour models; compliant unpacking and palletising of goods; and a systematic study of human safety in shared environments, setting the stage for future safety certification.
Expected Impact
ILIAD’s focus is on the rapidly expanding intralogistics domain, where there is a strong market pull for flexible automated solutions, especially ones that can blend with current operations. The innovations developed in ILIAD target key hindrances identified in the logistics domain, and are essential for independent and reliable operation of collaborative AGV fleets. The expected impact extends to most multiple-actor systems where robots and humans operate together.
Robot co-workers could help out with repetitive jobs and heavy lifting by reacting to human actions. Image credit – Italian Institute of Technology
by Anthony King
Stephen Hawking and Elon Musk fear that the robotic revolution may already be underway, but automation isn’t going to take over just yet – first machines will work alongside us.
Robots across the world help out in factories by taking on heavy lifting or repetitive jobs, but the walking, talking kind may soon collaborate with people, thanks to European robotics researchers building prototypes that anticipate human actions.
‘Ideally robots should be able to sense interactional forces, like carrying a table with someone,’ said Francesco Nori, who coordinates the EU-funded An.Dy project which aims to advance human-robot collaboration. ‘(Robots) need to know what the human is about to do and what they can do to help.’
In any coordinated activity, whether dancing or lifting a table together, timing is crucial and that means a robot needs to anticipate before a person acts.
‘Today, robots just react – half a second of anticipation might be enough,’ said Nori, who works at the Italian Institute of Technology which is renowned for its humanoid robot called iCub, that will be educated in human behaviour from data collected during the An.Dy project.
The data will flow from a special high-tech suit that lies at the heart of the project – the AndySuit. This tight suit is studded with sensors to track movement, acceleration of limbs and muscle power as a person performs actions alone or in combination with a humanoid robot.
A special high-tech suit known as the AndySuit allows a person to perform actions alongside a robot. Image credit – Italian Institute of Technology
This sends data to a robot similar to iCub so that it can recognise what the human is doing and predict the next action just ahead of time. The collaborative robot – also known as a cobot – would then be programmed to support the worker.
‘The robot would recognise a good posture and a bad posture and would work so that it gives you an object in the right way to avoid injury,’ explained Nori, adding that the cobot would adapt its own actions to maximise the comfort of the human.
The robot’s capabilities will come from its library of pre-programmed models of human movement, but also from internal sensors and a mobile phone app. Special sensors that communicate with the iCub are also being developed for the AndySuit, but at the moment it is more appropriate for the robotics lab rather than a factory floor.
To get the robot and AndySuit closer to commercialisation it will be tested in three different scenarios. First, in a workspace where a person works beside a cobot. Second, when a person wears an exoskeleton, which could be useful for workers who must lift heavy loads and can be assisted by a robust metal skeleton around them.
A third scenario will be where a humanoid robot offers assistance and could take turns performing tasks. In this situation, the robot would look like the archetype sci-fi robot; like Sonny from the film iRobot.
Silicon sidekick
A different project will see a human-like prototype robot reach out a helping hand to support technicians, under an EU-funded project called SecondHands led by Ocado Technology in the UK.
‘Ask it to pass the screw driver, and it will respond asking whether you meant the one on the table or in the toolbox.’ Duncan Russel, Ocado Technology
Ocado runs giant automated warehouses that fulfil grocery orders. Its warehouse in Hatfield, north of London, is the size of several football fields and must be temporarily shut down for regular maintenance.
Duncan Russell, research coordinator at Ocado Technology explained: ‘Parts need to be cleaned and parts need replacing. The robot system is being designed to help the technicians with those tasks.’
While the technician stands on a ladder, a robot below would watch what they are doing and provide the next tool or piece of equipment when asked.
‘The robot will understand instructions in regular language – it will be cleverer than you might expect,’ said Russell. ‘Ask it to pass the screw driver, and it will respond asking whether you meant the one on the table or in the toolbox.’
The robot will feature capabilities straight from the Inspector Gadget cartoon series. An extendable torso will allow it to move upwards and telescopic limbs will give it a three metre plus reach.
‘The arm span is 3.1 metres and the torso is around 1.8 metres, which gives it a dynamic reach. This will allow it to offer assistance to technicians up on a ladder,’ said Russell.
This futuristic scenario is being brought to reality by research partners around Europe. Robotics experts at Karlsruhe Institute of Technology in Germany have built a wheeled prototype robot. The plan is for a bipedal robot to be tested in the Ocado robots lab in Hatfield, and for it to be transferred to the warehouse floor for a stint with a real technician.
Karlsruhe is also involved in teaching the robot natural language and together with the Swiss Federal Institute of Technology in Lausanne it is developing a grasping hand, so the helper robot can wield tools with care. The visions system of this silicon sidekick is being developed by researchers at University College London, UK.
The handy robotic helper could also do cross-checking for the maintenance person, perhaps offering a reminder if a particular step is missed, for example.
‘The technician will get more done and faster, so that the shutdown times for maintenance can be shortened,’ said Russell.
If you are involved in the UK Robotics and Autonomous Systems (RAS) sector, we’d love to hear from you. Please fill in this survey.
In January this year, the UK Government published a Green Paper on “Building our Industrial Strategy” (https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/611705/building-our-industrial-strategy-green-paper.pdf). In it is set an ‘open door’ challenge to industry to come to the Government with proposals to transform and upgrade their sector through ‘Sector Deals’. Businesses rather than the Government are being encouraged to identify what companies need in order to enhance their competitiveness as a sector.
This is not about the Government providing additional funding; rather, it is an open call to business to organise behind strong leadership, like the automotive and aerospace sectors, to address shared challenges and opportunities.
Government is looking for businesses to collaborate with other stakeholders, such as universities and local leaders to produce a clear proposal for boosting the productivity of their sector, setting out detailed plans to address challenges such as:
delivering upgrades in productivity, including in supply chains;
promoting competition and innovation;
facilitating long term investment and coordination between suppliers and primes;
accelerating growth across the value chain, including by identifying where the greatest value can be gained from technology development and investment;
developing and growing the strengths of particular clusters;
increasing exports; and looking at how we can use trade and investment deals to help the sector;
commercialising research across sectors; and
boosting skills and the number of high value, high productivity jobs.
To help provide evidence for the proposed Robotics Sector Deal, we would like to understand what activities are taking place in the UK that are in alignment with the existing RAS Strategy, and what new ones could be enabled by Government action. To this end we are reaching out to the UK RAS Community to collect this information. All you need to do is fill in this short survey.
When answering the questions, please endeavour to be specific and thorough. Your answers will not be publicly published, and will only be used to inform the proposed Sector Deal (and will therefore remain confidential between the RAS Special Interested Group Advisory Board and the Government).
Please feel free to give us more than one set of answers to this questionnaire. We will collate the answers and provide a high-level synthesis of them, rather than providing the details, so please don’t worry about overwhelming Government with detail!
If you are not familiar with the way we use the terms Asset, Skills, Coordination, Clusters and Challenges, then please have a quick look at the RAS UK Strategy here.
Thanks very much for your help. Your input is greatly valued and will contribute to something that will be of huge benefit to our sector, as well as the wider community.
PARAMOUR on Broadway – A Cirque du Soleil Musical. Credit: Richard Termine
Last year, Intel partnered with Lady Gaga on the Super Bowl Halftime Show to showcase its latest aerial technology called “Shooting Star.” Intel did a reprise performance of its Shooting Star technology for Singapore’s 52nd birthday this past week. Instead of fireworks, the tech-savvy country celebrated its National Day Parade with a swarm of 300 LED drones animating the night sky with shapes, logos, and even a map of the country.
Intel’s global drone chief, Anil Nanduri, explained, “There’s considerably more operational complexity in handling a 300 drone fleet, compared with 100 drones in a show. It’s like juggling balls in your hand. You may be able to juggle three, but if you juggle nine, you may have to throw them higher and faster to get more time.” Earlier this year, Intel first showcased its 300 drone show at Coachella music festival on the heels of claiming the Guinness World Record of a 500 drone performance.
Choreographed drones are winning the hearts of Cirque du Soleil theatergoers with a fleet of flying acrobatic vehicles dancing around its human performers. These drones are the brain child of Professor Raffaello D’Andrea of the ETH Zurich, Switzerland and his new startup Verity Studios. D’Andrea is probably best known as one of the three founders of Kiva Systems and now he is taking the same machine intelligence that sorts and delivers goods within Amazon’s warehouses to safely wow audiences worldwide. The flying lampshades (shown in the video below) are actually autonomous drones that magically synchronize with the dancers, without safety nets or human operators.
Verity’s customer, Cirque du Soleil’s Chief Creative Officer Jean-Francois Bouchard, said D’Andrea’s “flying machines are unquestionably one of the most important statements of the PARAMOUR show.” The key to the flying machines’ success over 7,000 autonomous flights on Broadway is its proprietary technologies that enable multiple self-piloted drones to be synchronized within flight. Verity’s drone is part of a larger performance system called “Stage Flyers.”
The Stage Flyer platform has proven itself in the field, flying next to thousands of people each evening by having built-in redundancy to any single failure. According to Verity’s website, the system is “capable of continuing operation in spite of a failed battery, a failed motor, a failed connector, a failed propeller, a failed sensor, or a failure of any other component. This is achieved through the duplication of critical components and the use of proprietary algorithms, which enable safe emergency responses to component failures.” This means that the drones can operate safely around audiences and performers alike, carrying payloads of cameras, mirrors, and special lighting effects. As shown in the above diagram, the drone system includes a fleet of self-piloted drones that utilize one positioning system and control unit. The company boasts that its system only takes a few hours to install, calibrate and learn how to operate.
Drone swarms are not just for entertainment, as today there are a number of upstarts and established players utilizing these mechanics for e-commerce fulfillment centers. Last June, Amazon was issued a patent for a “Multi-Level Fulfillment Center for Unmanned Aerial Vehicles.” The beehive-looking distribution center (above) is designed to facilitate traffic between inbound and outbound delivery drones. The patent illustration details “multiple levels with multiple landing and take-off locations, depending on local zoning regulations.”
This is all part of Amazon’s larger plan to grow its robotic workforce over the next two to three years. Instead of human truck drivers, the patent displays delivery bays that open and close automatically based on the direction of the drones and interior platforms that cycle around the hive. CB Insights reports that the patent describes “impact dampeners,” such as nets, for receiving inbound drones and “launch assist mechanisms,” such as fans, for launching outbound drones. It appears that Amazon will be looking again to technology like D’Andrea’s research to revolutionize its global network of warehouses with synchronized swarms of drones that safely soar above human workers.
Amazon’s competitor Walmart announced last summer its plans to utilize swarms of indoor drones for inventory management, replacing the need for people climbing dangerous ladders to manually scan labels. The New York Times first reported last July that the retailer applied for a FAA exemption to begin testing drones inside its massive distribution centers. Shekar Natarajan, the vice president of last mile and emerging science for Walmart, demonstrated for the newspaper how swarms of drones could easily move up and down aisles, from floor to ceiling, to scan 30 barcode images a second (an efficiency that would be impossible for even the most agile humans). Walmart has publicly boasted that it will spend close to $3 billion on new technology and other cost-saving investments to bolster its e-commerce business which is growing, but at a slower pace than its nemesis Amazon.
The race to dominate the warehouse has led to increased investments in the logistics sector and even an accelerator dedicated solely to technology around distribution centers. Chattanooga, Tennessee-based Dynamo Accelerator showcased last May its second cohort of startups. One of the most successful showings was Chicago-based Corvus Robotics, a software company that uses indoor aerial drones to scan inventory (similar to the Walmart example above). According to Dynamo’s managing directors, Corvus is building enabling tools that allow operators to fly drones autonomously, scan & sync barcodes, and enter the SKU data into the existing warehouse management system.
Santosh Sankar, the director at Dynamo, explained his accelerator’s mission succinctly in a recent blog post: “We believe our focus and hands-on approach is one of our value-adds. As such, we’re leaning into being seed investors and upholding our commitment to transforming our industry by focusing on our founders and our corporate partners. We’ve opted to not hold a quota for our programs and hone in on companies we can truly help because that ultimately makes for good seed investments.” Sankar added that several of the program participants “are already well on their way to generate ($1 million or more) in annual revenue and/or have raised their initial round of capital.”
Corvus may be the latest indoor drone startup to enter an already crowded warehouse market, which includes established players like the Hardis Group, Smartx, and DJI. Drones continue to amuse, amaze and evolve as the growing need for more unmanned systems in our lives appears to be almost insatiable. Next month, we plan to dig deeper into the drone market with our RobotLabNYC event series on September 19th at 6pm in WeWork Grand Central. Joining us in the discussions include thought-leaders from NASA, AUVSI, and Genius NY, RSVP today, as space is limited.
Australia retired the IAI Heron drone after eight years of service. The Royal Australian Air Force is currently seeking a replacement. Image via Aviation Analysis Wing
August 7, 2017 – August 13, 2017
News
Two U.S. airstrikes targeted members of al-Shabab in Somalia. In a statement, the U.S. Africa Command said the strikes were “conducted within the parameters of the proposal approved by the President in March 2017.” A spokesperson said the strikes were carried out by drones. (ABC News)
In a classified guidance issued last month, the Department of Defense authorized the U.S. military to seize or destroy drones that appear to endanger the airspace or pose a threat to military installations. Pentagon spokesperson Captain Jeff Davis told reporters that the move was a response to the “increase of commercial and private drones” in the U.S. (Reuters)
An Iranian drone interfered with a U.S. F/A-18E Super Hornet jet in the Persian Gulf. In a statement, the U.S. military said that the drone flew within 100 feet of the manned fighter as it was preparing to land on the USS Nimitz. (Washington Post)
Turkish authorities have detained a Russian citizen with ties to ISIS for allegedly planning to use a drone to attack a U.S. military base. Police in Adana claim that Renad Bakiev admitted to reconnoitering Incirlik Air Base in southern Turkey. (Associated Press)
Commentary, Analysis, and Art
At the Financial Times, Louise Lucas writes that China-based drone manufacturer DJI is considering making a move toward the commercial sector.
The Los Angeles Times editorial board argues that the Los Angeles County Sheriff should adopt a more transparent process for integrating drones into police work.
At the Wall Street Journal, Nicole Friedman writes that insurance companies are increasingly relying on drones to inspect physical damage to properties.
At the San Francisco Chronicle, Carolyn Said looks at how robots and drones are taking on more roles in food delivery.
At WFTV, Lauren Seabrook writes that a new state law in Florida that offers more opportunities for drone businesses conflicts with local drone ordinances.
Kratos Defense and Security Solutions announced that a classified military drone that it is developing for an unnamed program will enter into production this year. (FlightGlobal)
Northrop Grumman is using an X-47B drone as a testbed for the Navy’s MQ-25A Stingray aerial refueling drone. (Aviation Week) For more on the X-47B, click here.
The San Francisco Public Utilities Commission approved a policy to use drones for construction management, environmental monitoring, and inspection. (San Francisco Examiner)
The Worldview International Foundation is planning to use drones to plant tree seeds as part of a reforestation effort in Myanmar. (Fast Company)
The Kansas Department of Transportation and app maker AirMap are partnering to develop a drone air traffic management system. (The Wichita Eagle)
The Israeli Defence Ministry is investigating reports that defense firm Aeronautics was asked by Azerbaijan to carry out a live demonstration of a loitering munition drone against Armenian forces. (Jerusalem Post)
The Muriwai Surf Life Saving Club in New Zealand is planning to use drones for patrolling a popular beach. (News Hub)
Researchers who used a drone last year to collect pollutant samples from the open burning of waste at an Army ammunition facility in Virginia found arsenic and other pollutants. (Phys.org)
For updates, news, and commentary, follow us on Twitter. The Weekly Drone Roundup is a newsletter from the Center for the Study of the Drone. It covers news, commentary, analysis and technology from the drone world. You can subscribe to the Roundup here.
In episode six of season three we chat about the difference between frequentists and Bayesians, take a listener question about techniques for panel data, and have an interview with Katherine Heller of Duke.
If you enjoyed this episode, you may also want to listen to:
The U.S. Army has ordered its members to stop using drones made by Chinese manufacturer SZ DJI Technology because of “cyber vulnerabilities.” The directive applies to all DJI drones and systems that use DJI components or software. It requires service members to “cease all use, uninstall all DJI applications, remove all batteries and storage media and secure equipment for follow-on direction.”
DJI has about 70% of the global commercial and consumer drone market according to Goldman Sachs analysts. The market, including military, is expected to be worth more than $100 billion over the next five years.
The Army's move appears to follow studies conducted by the Army Research Laboratory and the Navy which said there were risks and vulnerabilities in DJI products. The directive cites a classified Army Research Laboratory report and a Navy memo, as references for the order to cease use of DJI drones and related equipment.
DJI responded with the following statement on their website:
Some recent news stories have claimed DJI routinely shares customer information and drone video with authorities in China, where DJI is headquartered. This is false. A junior DJI staffer misspoke during an impromptu interview with reporters who were touring the DJI headquarters; we have attempted to correct the facts since then, but inaccurate stories are still posted online.
We want to emphasize that DJI does not routinely share customer information or drone video with Chinese authorities — or any authorities Any claims to the contrary are false.
In other DJI-related news, 3D Robotics (3DR), a previous camera drone competitor, announced a product partnership with DJI. Its 'Site Scan' aerial data analytics software platform now works with DJI drones, and is aimed at large construction and engineering companies using drones.
DJI director of strategic partnerships Michael Perry stated: “This integration is a significant milestone for the AEC industry. We’re excited that 3DR Site Scan users can now use DJI drones to convert images into actionable data that helps project stakeholders save time and manage costs.”
As AI surpasses human abilities in Go and poker – two decades after Deep Blue trounced chess grandmaster Garry Kasparov – it is seeping into our lives in ever more profound ways. It affects the way we search the web, receive medical advice and whether we receive finance from our banks.
The most innovative AI breakthroughs, and the companies that promote them – such as DeepMind, Magic Pony, Aysadi, Wolfram Alpha and Improbable – have their origins in universities. Now AI will transform universities.
We believe AI is a new scientific infrastructure for research and learning that universities will need to embrace and lead, otherwise they will become increasingly irrelevant and eventually redundant.
Through their own brilliant discoveries, universities have sown the seeds of their own disruption. How they respond to this AI revolution will profoundly reshape science, innovation, education – and society itself.
Deep Mind was created by three scientists, two of whom met while working at University College London. Demis Hassabis, one of Deep Mind’s founders, who has a PhD in cognitive neuroscience from UCL and has undertaken postdoctoral studies at MIT and Harvard, is one of many scientists convinced that AI and machine learning will improve the process of scientific discovery.
It is already eight years since scientists at the University of Aberystwyth created a robotic system that carried out an entire scientific process on its own: formulating hypotheses, designing and running experiments, analysing data, and deciding which experiments to run next.
Complex data sets
Applied in science, AI can autonomously create hypotheses, find unanticipated connections, and reduce the cost of gaining insights and the ability to be predictive.
AI is being used by publishers such as Reed Elsevier for automating systematic academic literature reviews, and can be used for checking plagiarism and misuse of statistics. Machine learning can potentially flag unethical behaviour in research projects prior to their publication.
AI can combine ideas across scientific boundaries. There are strong academic pressures to deepen intelligence within particular fields of knowledge, and machine learning helps facilitate the collision of different ideas, joining the dots of problems that need collaboration between disciplines.
As AI gets more powerful, it will not only combine knowledge and data as instructed, but will search for combinations autonomously. It can also assist collaboration between universities and external parties, such as between medical research and clinical practice in the health sector.
The implications of AI for university research extend beyond science and technology.
Philosophical questions
In a world where so many activities and decisions that were once undertaken by people will be replaced or augmented by machines, profound philosophical questions arise about what it means to be human. Computing pioneer Douglas Engelbert – whose inventions include the mouse, windows and cross-file editing – saw this in 1962 when he wrote of “augmenting human intellect”.
Expertise in fields such as psychology and ethics will need to be applied to thinking about how people can more rewardingly work alongside intelligent machines and systems.
Research is needed into the consequences of AI on the levels and quality of employment and the implications, for example, for public policy and management.
When it comes to AI in teaching and learning, many of the more routine academic tasks (and least rewarding for lecturers), such as grading assignments, can be automated. Chatbots, intelligent agents using natural language, are being developed by universities such as the Technical University of Berlin; these will answer questions from students to help plan their course of studies.
Virtual assistants can tutor and guide more personalized learning. As part of its Open Learning Initiative (OLI), Carnegie Mellon University has been working on AI-based cognitive tutors for a number of years. It found that its OLI statistics course, run with minimal instructor contact, resulted in comparable learning outcomes for students with fewer hours of study. In one course at the Georgia Institute of Technology, students could not tell the difference between feedback from a human being and a bot.
Global classroom
Mixed reality and computer vision can provide a high-fidelity, immersive environment to stimulate interest and understanding. Simulations and games technology encourage student engagement and enhance learning in ways that are more intuitive and adaptive. They can also engage students in co-developing knowledge, involving them more in university research activities. The technologies also allow people outside of the university and from across the globe to participate in scientific discovery through global classrooms and participative projects such as Galaxy Zoo.
As well as improving the quality of education, AI can make courses available to many more people. Previously access to education was limited by the size of the classroom. With developments such as Massive Open Online Courses (MOOCs) over the last five years, tens of thousands of people can learn about a wide range of university subjects.
It still remains the case, however, that much advanced learning, and its assessment, requires personal and subjective attention that cannot be automated. Technology has ‘flipped the classroom’, forcing universities to think about where we can add real value – such as personalised tuition, and more time with hands-on research, rather than traditional lectures.
Monitoring performance
University administrative processes will benefit from utilising AI on the vast amounts of data they produce during their research and teaching activities. This can be used to monitor performance against their missions, be it in research, education or promotion of diversity, and can be produced frequently to assist more responsive management. It can enhance the quality of performance league tables, which are often based on data with substantial time lags. It can allow faster and more efficient applicant selection.
AI allows the tracking of individual student performance, and universities such as Georgia State and Arizona State are using it to predict marks and indicate when interventions are needed to allow students to reach their full potential and prevent them from dropping out.
Such data analytics of students and staff raises weighty questions about how to respect privacy and confidentiality, that require judicious codes of practice.
The blockchain is being used to record grades and qualifications of students and staff in an immediately available and incorruptible format, helping prevent unethical behaviour, and could be combined with AI to provide new insights into student and career progression.
Universities will need to be attuned to the new opportunities AI produces for supporting multidisciplinarity. In research this will require creating new academic departments and jobs, with particular demands for data scientists. Curricula will need to be responsive, educating the scientists and technologists who are creating and using AI, and preparing students in fields as diverse as medicine, accounting, law and architecture, whose future work and careers will depend on how successfully they ally their skills with the capabilities of machines.
New curricula should allow for the unpredictable path of AI’s development, and should be based on deep understanding, not on the immediate demands of companies.
Addressing the consequences
Universities are the drivers of disruptive technological change, like AI and automation. It is the duty of universities to reflect on their broader social role, and create opportunities that will make society resilient to this disruption.
We must address the consequences of technological unemployment, and universities can help provide skills and opportunities for people whose jobs have been adversely affected.
There is stiff competition for people skilled in the development and use of AI, and universities see many of their talented staff attracted to work in the private sector. One of the most pressing AI challenges for universities is the need for them to develop better employment conditions and career opportunities to retain and incentivize their own AI workers. They need to create workplaces that are flexible, agile and responsive to interactions with external sources of ideas, and are open to the mixing of careers as people move between universities and business.
The fourth industrial revolution is profoundly affecting all elements of contemporary societies and economies. Unlike the previous revolutions, where the structure and organization of universities were relatively unaffected, the combinations of technologies in AI is likely to shake them to their core. The very concept of ‘deep learning’, central to progress in AI, clearly impinges on the purpose of universities, and may create new competition for them.
If done right, AI can augment and empower what universities already do; but continuing their missions of research, teaching and external engagement will require fundamental reassessment and transformation. Are universities up to the task?
This article was originally posted on the World Economic Forum. Click here to view the original.
Top 3 Robotic Applications in Primary Food Processing
Primary processing involves handling raw food products, which are cleaned, sorted, chopped, packaged, etc. Some foods, like raw vegetables, will only undergo primary processing before they are packaged for the consumer. Other foods will undergo secondary processing before packaging.
Up until quite recently, robotic processing at this stage has been limited or non-existent. Raw foods are variable in size, weight and shape. This makes it difficult for robots to handle them. However, recent developments in sensing and soft gripping has made it possible for robots to handle many raw foods.
1. Robotic Butchery
Butchery is a very difficult task to automate. Every animal carcass is different. A skilled butcher will adapt each cut to the shape and position of bones and meat. Some butchery tasks are simpler to automate than others. For example, high-volume chicken leg deboning is an established part of the meat processing industry.
Beef butchery has traditionally been very difficult to automate. Recently,beef manufacturer JBS has started looking for ways to introduce robots into their factories. Parts of the process are very dangerous for human workers. Rib cutting, for example, involves operating a high-speed circular saw for several hours. JBS has managed to automate this action using robot manipulators and various vision sensors. The application has improved safety and product consistency.
2. Fruit and Vegetable Pick and Place
Fruits and vegetables are challenging to handle with a robot due to their variable sizes and shapes. They also require delicate handling to avoid damage. For these reasons they have traditionally been handled by human workers. However, recent developments in gripping technologies look to change all that. Soft Robotics Inc has introduced a flexible gripper which can handle very delicate foods, even individual lettuce leaves!
Another example is Lacquey’s gripper, which uses paddles to lift soft fruits and vegetables.
3. Robotic Cutting and Slicing
Some cutting and slicing tasks are easy to automate. For example, even kitchen food processors can slice vegetables into uniform shapes. Robots are not needed for this type of simple automation.
For more advanced cutting and slicing, however, the food industry has relied on human workers but robotics is starting to make its way into the industry. Fish cutting, for example, involves detecting and removing defects from the fish as well as cutting fillets to uniform shapes and sizes.
Top 3 Robotic Applications in Secondary Food Processing
Secondary processing involves handling products which have already undergone primary processing. Robots have been used for several applications for a long time, particularly pick and place. However, recent developments have opened the door to even more advanced applications.
1. Product Pick and Place
You may be familiar with the high speed delta robots which are used to move food products around a production line. If not, here is a video:
This is an example of secondary processing pick and place. It is distinct from the vegetable pick and place mentioned above because the products are more uniform in shape and size. Uniform foods are much easier to handle robotically, so this application has been available in the food industry for many years.
2. Cake Decorating
One impressive application is robotic cake decoration. This involves using a robotic arm much like a 3D printer to pipe icing onto a cake. The Deco-Bot from Unifiller can pipe hand-drawn decorations onto cakes on a moving conveyor.
Cake cutting can also be done robotically, like the Katana waterjet cutting robot which can cut out intricate shapes in cakes using high pressure water.
3. Pizza Making
Artisan food producers sometimes worry that adding robots their process will make their products less “hand-made.” However, Silicon Valley pizza producer Zume is showing how robots can be produced to look like they have the human touch. Their pizzeria uses two robots: a delta robot to spread the tomato sauce and a ABB manipulator to tend the pre-baking ovens. While their system is far from fully automated, their goal is to make the pizza delivery industry a labor-free business.
Finally… Washing Up!
Contaminated food causes 48 million people in the USA to become sick annually. Robotic food processing has the potential to reduce this, by removing human workers from parts of the process, but this is only possible if the robots themselves do not cause contamination.
One of the more challenging issues for food automation is the fact that every piece of machinery must be thoroughly cleaned to avoid contamination. Robot manufacturers have been working to make their robot casings smoother, with better ingress ratings and no loose wires. This allows them to be thoroughly washed down at the end of each cycle.
In this system from JMP Automation, the two robots wash down the workcell with high powered water, and even wash down each other:
Researchers have devised a new way to monitor sleep stages without sensors attached to the body. Their device uses an advanced artificial intelligence algorithm to analyze the radio signals around the person and translate those measurements into sleep stages: light, deep, or rapid eye movement (REM). Image: Christine Daniloff/MIT
More than 50 million Americans suffer from sleep disorders, and diseases including Parkinson’s and Alzheimer’s can also disrupt sleep. Diagnosing and monitoring these conditions usually requires attaching electrodes and a variety of other sensors to patients, which can further disrupt their sleep.
To make it easier to diagnose and study sleep problems, researchers at MIT and Massachusetts General Hospital have devised a new way to monitor sleep stages without sensors attached to the body. Their device uses an advanced artificial intelligence algorithm to analyze the radio signals around the person and translate those measurements into sleep stages: light, deep, or rapid eye movement (REM).
“Imagine if your Wi-Fi router knows when you are dreaming, and can monitor whether you are having enough deep sleep, which is necessary for memory consolidation,” says Dina Katabi, the Andrew and Erna Viterbi Professor of Electrical Engineering and Computer Science, who led the study. “Our vision is developing health sensors that will disappear into the background and capture physiological signals and important health metrics, without asking the user to change her behavior in any way.”
Katabi worked on the study with Matt Bianchi, chief of the division of sleep medicine at MGH, and Tommi Jaakkola, the Thomas Siebel Professor of Electrical Engineering and Computer Science and a member of the Institute for Data, Systems, and Society at MIT. Mingmin Zhao, an MIT graduate student, is the paper’s first author, and Shichao Yue, another MIT graduate student, is also a co-author.
The researchers will present their new sensor at the International Conference on Machine Learning on Aug. 9.
Remote sensing
Katabi and members of her group in MIT’s Computer Science and Artificial Intelligence Laboratory have previously developed radio-based sensors that enable them to remotely measure vital signs and behaviors that can be indicators of health. These sensors consist of a wireless device, about the size of a laptop computer, that emits low-power radio frequency (RF) signals. As the radio waves reflect off of the body, any slight movement of the body alters the frequency of the reflected waves. Analyzing those waves can reveal vital signs such as pulse and breathing rate.
“It’s a smart Wi-Fi-like box that sits in the home and analyzes these reflections and discovers all of these changes in the body, through a signature that the body leaves on the RF signal,” Katabi says.
Katabi and her students have also used this approach to create a sensor called WiGait that can measure walking speed using wireless signals, which could help doctors predict cognitive decline, falls, certain cardiac or pulmonary diseases, or other health problems.
After developing those sensors, Katabi thought that a similar approach could also be useful for monitoring sleep, which is currently done while patients spend the night in a sleep lab hooked up to monitors such as electroencephalography (EEG) machines.
“The opportunity is very big because we don’t understand sleep well, and a high fraction of the population has sleep problems,” says Zhao. “We have this technology that, if we can make it work, can move us from a world where we do sleep studies once every few months in the sleep lab to continuous sleep studies in the home.”
To achieve that, the researchers had to come up with a way to translate their measurements of pulse, breathing rate, and movement into sleep stages. Recent advances in artificial intelligence have made it possible to train computer algorithms known as deep neural networks to extract and analyze information from complex datasets, such as the radio signals obtained from the researchers’ sensor. However, these signals have a great deal of information that is irrelevant to sleep and can be confusing to existing algorithms. The MIT researchers had to come up with a new AI algorithm based on deep neural networks, which eliminates the irrelevant information.
“The surrounding conditions introduce a lot of unwanted variation in what you measure. The novelty lies in preserving the sleep signal while removing the rest,” says Jaakkola. Their algorithm can be used in different locations and with different people, without any calibration.
Using this approach in tests of 25 healthy volunteers, the researchers found that their technique was about 80 percent accurate, which is comparable to the accuracy of ratings determined by sleep specialists based on EEG measurements.
“Our device allows you not only to remove all of these sensors that you put on the person, and make it a much better experience that can be done at home, it also makes the job of the doctor and the sleep technologist much easier,” Katabi says. “They don’t have to go through the data and manually label it.”
Sleep deficiencies
Other researchers have tried to use radio signals to monitor sleep, but these systems are accurate only 65 percent of the time and mainly determine whether a person is awake or asleep, not what sleep stage they are in. Katabi and her colleagues were able to improve on that by training their algorithm to ignore wireless signals that bounce off of other objects in the room and include only data reflected from the sleeping person.
The researchers now plan to use this technology to study how Parkinson’s disease affects sleep.
“When you think about Parkinson’s, you think about it as a movement disorder, but the disease is also associated with very complex sleep deficiencies, which are not very well understood,” Katabi says.
The sensor could also be used to learn more about sleep changes produced by Alzheimer’s disease, as well as sleep disorders such as insomnia and sleep apnea. It may also be useful for studying epileptic seizures that happen during sleep, which are usually difficult to detect.
Instead of worrying so much about robots taking away jobs, maybe we should worry more about wages being too low for robots to even get a chance. Seasonal labor for harvesting agricultural products, particularly fruits and vegetables, is dependent on human labor from a diminishing universe of willing workers.
Robots that can supplement or replace human workers in the harvesting process are being developed and tested in startups and academia, but almost all are not yet ready for prime time.
In a NY Times article written by Neil Irwin entitled Rethinking Low Productivity, productivity growth has been on a downward path since the Financial Crisis. Irwin, who writes about economic trends, asks whether the downward trend is the cause of low growth, or the result, a troubling question in the dynamics of the agriculture industry.
“Inventors and business innovators are always developing better ways to do things, but it takes a labor shortage and high wages to coax firms to deploy the investment it takes to actually put those innovations into widespread use.”
Those two phenomena are happening today in the U.S. agricultural industry. Labor rates are rising while willing laborers are diminishing — yet farmers are not yet investing in robotics. In fact, they are accommodating to the labor crisis by planting less and changing the crops they grow to be less labor intensive.
J.W. Mason, the author of a paper by the Roosevelt Institute cited as the basis for the thesis of Irwin’s article, says:
“If the labor market tightens and wages rise, that will be the impetus to get companies to consider more big-ticket innovations that generate productivity growth so that we don’t perpetuate the present conundrum in which both arguments cannot be true:
“On Mondays and Wednesdays, economists argue that wages are low because robots are taking people’s jobs.
On Tuesdays and Thursdays, it’s that we can’t have wages rise because productivity growth is low.”
This situation cannot continue without radical changes else we will become buyers of foreign fruits and vegetables paying prices set by foreign providers and dependent on them for availability and quality.
A number of factors are causing a reset in the ag industry in addition to the declining availability of farm workers: the challenges and complexities of employing and retaining farm labor; the rising cost of farm workers; changing farmlands; climate change; the growth of indoor farming; and the broader automation of the agriculture industry. All are propelling farmers to make changes in how they farm (or change downward the product mix they farm (which is often a path toward failure)). Market challenges for the sector include unclear value propositions, limited awareness of robotic systems among growers, insufficient robotic solutions, the difficulty of matching human-like dexterity with machines, fragmented technology development, and weak support.
Tractica, in their report on agricultural robotics, forecast an optimistic resolution to this temporary conundrum in the very near term and that that shipments of agricultural robots will increase significantly in the years ahead, rising from 32,000 units in 2016 to 594,000 units annually by 2024, by which time the market is expected to reach $74 billion in annual revenue. Certainly the time is ripe and, like Mason said, “Both arguments can’t be true.”
If you would like to receive the Weekly Roundup in your inbox, please subscribe at the bottom of the page.
At the Center for the Study of the Drone
In an interview with OpenGov, Center for the Study of the Drone co-director Arthur Holland Michel discusses the main trendlines in the ongoing evolution of drone technology.
News
A U.S. drone strike in Somalia reportedly killed a member of al-Shabab. In a statement, the U.S. Africa Command said that the strike took place in the Lower Shabelle region, an al-Shabab stronghold. (Associated Press)
The Trump administration is reviewing a drone exports policy established by the Obama administration. According to an official who spoke to DefenseNews, the review is part of a broader effort to find “smarter new approaches to U.S. defense trade policy.” The Obama administration placed controls on drone technology exports to U.S. allies in 2015.
A small tethered drone will help the U.S. Secret Service provide perimeter security during President Trump’s visit to the Trump National Golf Club in Bedminster, New Jersey this month. In an announcement, the agency said that the test is part of an initiative to explore new technologies for security operations. (Reuters)
Citing cyber vulnerabilities, the U.S. Army has instructed its units to discontinue the use of all drones made by DJI, the popular Chinese manufacturer. The decision appears to have been based on a classified study and a Navy memo on security issues in DJI products. (Reuters)
At an event hosted by the Center for Strategic and International Studies and the U.S. Naval Institute, Adm. Paul Zukunft discussed the Coast Guard’s history with drone acquisition and operations. (USNI News)
The China Aerospace Science and Technology Corporation has made a number of upgrades to its CH-4 Rainbow surveillance and strike drone. (IHS Jane’s International Defence Review)
A team of security researchers has demonstrated that sonic blasts can be used to hack a number of electronic devices, including drones. (Fox News)
Researchers at the Swiss Federal Institute of Technology and Zurich University of the Arts have developed a hexacopter with independently rotating propellers that is capable of flying in far more acrobatic ways than traditional multirotor drones. (Yanko Design)
The University of Michigan has announced that it is developing an outdoor flight testing facility for drones. (Unmanned Systems Technology)
A team at the China Aerospace Science and Technology Corporation is developing an app-based management system for large military drones. (IHS Jane’s International Defence Review)
Following a 10-month definition process, the Organisation for Joint Armament Cooperation has decided that its European Medium-Altitude Long-Endurance drone will have a twin turboprop design. (IHS Jane’s International Defence Review)
Ukraine’s SpetsTechnoExport has conducted a weapons test of its Fantom-2 unmanned ground vehicle. (IHS Jane’s International Defence Review)
The Federal Aviation Administration is investigating an incident in which a drone was spotted near a runway at Newark International Airport. (USA Today)
China’s People’s Liberation Army confirmed that it is now operating the CH-901, a loitering munition drone. (Popular Science) For more on loitering munitions, click here.
The Duluth Fire Department in Minnesota is testing EMILY, an unmanned surface vehicle designed for saving stranded swimmers, with an eye to possibly acquiring the system to use on Lake Superior. (Grand Forks Herald)
Sen. Sheldon Whitehouse (D-RI) and Rep. Jim Langevin (D-RI) introduced a bill that makes it illegal to fly drones near airports without permission. (The Hill)
The Fort Wayne Police Department in Indiana has acquired two drones for a range of operations, including emergency response and environmental surveys. (News Sentinel)
Kentucky governor Matt Bevin has accused a local news channel of invading his privacy after it flew a drone over his private property. (CNET)
The U.S. Army and the Army of the Republic of Macedonia are constructing a 300m-long runway for drones in the Krivolak Training Area. (IHS Jane’s Defense Weekly)
The North Dakota Air National Guard took delivery of its first new MQ-9 Reaper drone. (Associated Press)
Snap is reportedly negotiating to buy Zero Zero Robotics, the China-based manufacturer of the Hover Camera selfie drone, for between $150 and $200 million. (TechCrunch)
The U.S. Navy awarded Northrop Grumman Systems a $19.9 million contract to identify solutions to “near-term emergent obsolescence issues” for the MQ-4C Triton. (DoD)
The U.S. Navy awarded Northrop Grumman Systems a $2.94 million contract for MQ-8 Fire Scout logistics and training sustainment. (FBO)
If you are involved in the UK Robotics and Autonomous Systems (RAS) sector, we’d love to hear from you. Please fill in this 
