“One of the dreams I had as a kid was about the first day of school, and being able to build and be creative, and it was the happiest day of my life. And at MIT, I felt like that dream became reality,” says Ballesteros. Credit: Ryan A Lannom, Jet Propulsion Laboratory.
By Jennifer Chu
Growing up in the suburban town of Spring, Texas, just outside of Houston, Erik Ballesteros couldn’t help but be drawn in by the possibilities for humans in space.
It was the early 2000s, and NASA’s space shuttle program was the main transport for astronauts to the International Space Station (ISS). Ballesteros’ hometown was less than an hour from Johnson Space Center (JSC), where NASA’s mission control center and astronaut training facility are based. And as often as they could, he and his family would drive to JSC to check out the center’s public exhibits and presentations on human space exploration.
For Ballesteros, the highlight of these visits was always the tram tour, which brings visitors to JSC’s Astronaut Training Facility. There, the public can watch astronauts test out spaceflight prototypes and practice various operations in preparation for living and working on the International Space Station.
“It was a really inspiring place to be, and sometimes we would meet astronauts when they were doing signings,” he recalls. “I’d always see the gates where the astronauts would go back into the training facility, and I would think: One day I’ll be on the other side of that gate.”
Today, Ballesteros is a PhD student in mechanical engineering at MIT, and has already made good on his childhood goal. Before coming to MIT, he interned on multiple projects at JSC, working in the training facility to help test new spacesuit materials, portable life support systems, and a propulsion system for a prototype Mars rocket. He also helped train astronauts to operate the ISS’ emergency response systems.
Those early experiences steered him to MIT, where he hopes to make a more direct impact on human spaceflight. He and his advisor, Harry Asada, are building a system that will quite literally provide helping hands to future astronauts. The system, dubbed SuperLimbs, consists of a pair of wearable robotic arms that extend out from a backpack, similar to the fictional Inspector Gadget, or Doctor Octopus (“Doc Ock,” to comic book fans). Ballesteros and Asada are designing the robotic arms to be strong enough to lift an astronaut back up if they fall. The arms could also crab-walk around a spacecraft’s exterior as an astronaut inspects or makes repairs.
Ballesteros is collaborating with engineers at the NASA Jet Propulsion Laboratory to refine the design, which he plans to introduce to astronauts at JSC in the next year or two, for practical testing and user feedback. He says his time at MIT has helped him make connections across academia and in industry that have fueled his life and work.
“Success isn’t built by the actions of one, but rather it’s built on the shoulders of many,” Ballesteros says. “Connections — ones that you not just have, but maintain — are so vital to being able to open new doors and keep great ones open.”
Getting a jumpstart
Ballesteros didn’t always seek out those connections. As a kid, he counted down the minutes until the end of school, when he could go home to play video games and watch movies, “Star Wars” being a favorite. He also loved to create and had a talent for cosplay, tailoring intricate, life-like costumes inspired by cartoon and movie characters.
In high school, he took an introductory class in engineering that challenged students to build robots from kits, that they would then pit against each other, BattleBots-style. Ballesteros built a robotic ball that moved by shifting an internal weight, similar to Star Wars’ fictional, sphere-shaped BB-8.
“It was a good introduction, and I remember thinking, this engineering thing could be fun,” he says.
After graduating high school, Ballesteros attended the University of Texas at Austin, where he pursued a bachelor’s degree in aerospace engineering. What would typically be a four-year degree stretched into an eight-year period during which Ballesteros combined college with multiple work experiences, taking on internships at NASA and elsewhere.
In 2013, he interned at Lockheed Martin, where he contributed to various aspects of jet engine development. That experience unlocked a number of other aerospace opportunities. After a stint at NASA’s Kennedy Space Center, he went on to Johnson Space Center, where, as part of a co-op program called Pathways, he returned every spring or summer over the next five years, to intern in various departments across the center.
While the time at JSC gave him a huge amount of practical engineering experience, Ballesteros still wasn’t sure if it was the right fit. Along with his childhood fascination with astronauts and space, he had always loved cinema and the special effects that forged them. In 2018, he took a year off from the NASA Pathways program to intern at Disney, where he spent the spring semester working as a safety engineer, performing safety checks on Disney rides and attractions.
During this time, he got to know a few people in Imagineering — the research and development group that creates, designs, and builds rides, theme parks, and attractions. That summer, the group took him on as an intern, and he worked on the animatronics for upcoming rides, which involved translating certain scenes in a Disney movie into practical, safe, and functional scenes in an attraction.
“In animation, a lot of things they do are fantastical, and it was our job to find a way to make them real,” says Ballesteros, who loved every moment of the experience and hoped to be hired as an Imagineer after the internship came to an end. But he had one year left in his undergraduate degree and had to move on.
After graduating from UT Austin in December 2019, Ballesteros accepted a position at NASA’s Jet Propulsion Laboratory in Pasadena, California. He started at JPL in February of 2020, working on some last adjustments to the Mars Perseverance rover. After a few months during which JPL shifted to remote work during the Covid pandemic, Ballesteros was assigned to a project to develop a self-diagnosing spacecraft monitoring system. While working with that team, he met an engineer who was a former lecturer at MIT. As a practical suggestion, she nudged Ballesteros to consider pursuing a master’s degree, to add more value to his CV.
“She opened up the idea of going to grad school, which I hadn’t ever considered,” he says.
Full circle
In 2021, Ballesteros arrived at MIT to begin a master’s program in mechanical engineering. In interviewing with potential advisors, he immediately hit it off with Harry Asada, the Ford Professor of Enginering and director of the d’Arbeloff Laboratory for Information Systems and Technology. Years ago, Asada had pitched JPL an idea for wearable robotic arms to aid astronauts, which they quickly turned down. But Asada held onto the idea, and proposed that Ballesteros take it on as a feasibility study for his master’s thesis.
The project would require bringing a seemingly sci-fi idea into practical, functional form, for use by astronauts in future space missions. For Ballesteros, it was the perfect challenge. SuperLimbs became the focus of his master’s degree, which he earned in 2023. His initial plan was to return to industry, degree in hand. But he chose to stay at MIT to pursue a PhD, so that he could continue his work with SuperLimbs in an environment where he felt free to explore and try new things.
“MIT is like nerd Hogwarts,” he says. “One of the dreams I had as a kid was about the first day of school, and being able to build and be creative, and it was the happiest day of my life. And at MIT, I felt like that dream became reality.”
Ballesteros and Asada are now further developing SuperLimbs. The team recently re-pitched the idea to engineers at JPL, who reconsidered, and have since struck up a partnership to help test and refine the robot. In the next year or two, Ballesteros hopes to bring a fully functional, wearable design to Johnson Space Center, where astronauts can test it out in space-simulated settings.
In addition to his formal graduate work, Ballesteros has found a way to have a bit of Imagineer-like fun. He is a member of the MIT Robotics Team, which designs, builds, and runs robots in various competitions and challenges. Within this club, Ballesteros has formed a sub-club of sorts, called the Droid Builders, that aim to build animatronic droids from popular movies and franchises.
“I thought I could use what I learned from Imagineering and teach undergrads how to build robots from the ground up,” he says. “Now we’re building a full-scale WALL-E that could be fully autonomous. It’s cool to see everything come full circle.”
While AI coders push the tech to ever-loftier heights, one thing we already know for sure is AI can write emails at the world-class level — in a flash.
Yes, long-term, AI may one day trigger a world in which AI-powered machines do all the work as we navigate a world resplendent with abundance.
But in the here and now, AI is already saving businesses and organizations serious coin in terms of slashing time spent on email, synthesizing ideas in new ways, boosting morale and ending email drudgery we know it.
Essentially: There are all sorts of reasons for businesses and organizations to bring-in bleeding edge AI tools like ChatGPT, Gemini, Anthropic, Claude and similar to take over the heavy lifting when it comes to email.
Here are the top ten:
*Expect Real Time Savings: 68,000 employees at Vodafone are saving an average of three hours each week on emails after switching to Copilot – a Microsoft chatbot that offers ChatGPT as its primary AI engine.
Workers say the gains come from the AI’s ability to quickly draft emails, dig-up information, and more. Nearly 90% of workers in Vodafone’s pilot trial of Microsoft Copilot rated the new tool as beneficial. And 60% said that along with speed, AI-assisted email also improved their overall work performance.
*Be More Efficient With Every Email: Twenty companies that have adopted AI-powered email across a wide spectrum of departments – including finance, HR and operations – say their workers are able to shave minutes off every, single email they auto-write with AI.
Managers especially love AI’s knack for just the right tone, with 47% saying the emails auto-written by AI sound both more professional and less robotic – and forever dump in the trash-bin of history the line, “per my last email.”
*Generate First-Drafts in an Eyeblink: 90% of workers at Amadeus – an IT services provider for the travel industry – find they’re able to cut 30-60 minutes off the first draft of important emails by using AI writing powered by Copilot, which uses ChatGPT as its primary AI engine.
In fact, one Amadeus user reports she’s able to auto-write a working draft for any email in an average of 5-10 minutes. And another says he was able to reduce his nearly 1,000 email queue of unread messages to less than 100 by turning over first-draft writing of emails to AI.
*Expect a Much Deeper Frame-of-Reference With Every Email: Gmail’s AI-assisted ‘Smart Replies’ now goes beyond simply reading the email you’re responding to when auto-writing a reply.
Instead, the AI tool has been enhanced to also draw information and insight for its reply from related emails in your inbox, as well as related data – such as PDFs and docs – that you have stored in your Google Drive.
*Email Effortlessly in Multiple Languages: While English-to-another-language auto-translation has been with us for a number of years now, Google has made it even easier to use by building the function into Gmail’s ‘Help Me Write.’
Now, once you’re finished using Help Me Write to auto-write an email, select its tone and edit it for clarity, word-length or similar, you can use the same AI tool to auto-translate the email into Italian, French, German, Spanish and Portuguese.
*Get More Email Done on Mobile: Google has also made it easier to use AI writing on your smartphone with its next generation of ‘Smart Replies.’
Going beyond auto-generating quick, one-line replies to your emails, Smart Replies can now read multiple threads before responding to an email and send longer, more context aware emails on your behalf – often with just a few taps.
*Auto-Synthesize Sales Notes and Buyer Intent in Sales Email Replies: AI sales email tool Outreach helps teams come up with the perfect email at any moment. Sales reps choose buyer cues and sales assets they want the AI to work with — and seconds later, a draft email emerges offering the optimum combination of all.
The overarching approach: Once sales reps have a working draft, they can quickly tweak and further humanize the copy to create an ideal message.
*Auto-Write More Empathetic, More Human-Sounding Emails: Allstate has grown so enamored with AI, nearly all of its 50,000 customer service emails are now drafted with the tech – helping free-up 23,000 claims reps to do higher-end tasks.
The result: The insurer says the AI emails come across as more empathetic – even though they’re written by a machine. Plus, they also feature much less jargon.
In a phrase: So long clunky abbreviations, insider gobbledygook and toneless prose.
*End Email Drudgery As We Know It: Customer service staff at Zendesk – a customer support software provider – report that since AI has been tasked to handle common requests coming in via email, they’re able to spend more time handling more complex cases that require judgment and caring.
All told, early pilots found that AI can handle up to 60% of incoming customer emails at Zendesk. And there’s been a 22% reduction in ‘ticket fatigue,’ or the human burnout triggered by replying to hundreds-upon-hundreds of the same kind of emails, week after week.
*Boost Morale: 20,000 U.K. civil servants in a three-month trial of Copilot – a Microsoft chatbot powered primarily by ChatGPT – report their moods are a lot brighter, now that AI has taken on a huge bulk of their email and related chores.
Specifically, more than 70% of those surveyed said Copilot eliminated a significant swath of workday drudgery. And more than 80% say they’ll never go back to hand-hewn messaging.
Share a Link: Please consider sharing a link to https://RobotWritersAI.com from your blog, social media post, publication or emails. More links leading to RobotWritersAI.com helps everyone interested in AI-generated writing.
–Joe Dysart is editor of RobotWritersAI.com and a tech journalist with 20+ years experience. His work has appeared in 150+ publications, including The New York Times and the Financial Times of London.
The post Bringing in ChatGPT for Email appeared first on Robot Writers AI.
This past week in New York, Google didn’t just launch a new set of phones; it laid out its most cohesive and aggressive vision yet for an AI-powered future, presenting a direct and compelling challenge to Apple’s dominance. The event […]
The post Google’s AI-Powered Ambition: A New Pixel Ecosystem Takes Aim at Apple appeared first on TechSpective.
RoboCup@Work League teams at the event in Brazil.
RoboCup is an international scientific initiative with the goal of advancing the state of the art of intelligent robots, AI and automation. The annual RoboCup event, where teams gather from across the globe to take part in competitions across a number of leagues, this year took place in Salvador, Brazil from 15-21 July. In a series of interviews, we’ve been meeting some of the RoboCup trustees, committee members, and participants, to find out more about their respective leagues. Christoph Steup is an Executive Committee member and oversees the @Work League. Ahead of the event in Brazil, we spoke to Christoph to find out more about the @Work League, the tasks that teams need to complete, and future plans for the League.
The @Work League, along with the Logistics League, forms the Industrial League. Our goal is to mimic some of the aspects of industrial production systems. An important aspect of this is factory automization and trying to mimic the factory of the future, where you have autonomous robots building products according to customer design. In these factories of the future, a single piece would be produced individually for each customer. Factories nowadays have big conveyor belts and a lot of automization, with the tasks mostly done in the same way, and you can only build stuff efficiently if you build millions of items. We are working on building individual pieces, where automization is still possible, and even a single piece can be built effectively. But obviously, in our RoboCup competitions, we are not interested in building on a factory scale – we are doing it on a very small scale. That means our robots are typically 80 centimeters long, the largest are around 70 centimeters wide, and some of them are also 80 centimeters high. So let’s say they fit in a one metre cubed box. Also, all our operations are done on the ground. This is just for simplification because building big tables to make it more realistic would also increase the cost for RoboCup and wouldn’t give much additional value.
What our robots need to do is transport objects from different workstations. So we have a default configuration where the arena starts, and there are workstations with objects lying on them, and some of these objects need to be transported to other workstations. The robot needs to do that completely autonomously. So this is one of the special things about the @Work League, that it’s completely autonomous and there is only a single restart allowed per team. So that means the robot really needs to be reliable. One of the big differences between medium teams and very good teams is that the very good teams perform well all the time whereas the medium teams have some good runs and some bad runs.
There are some special tasks in our league, like the precision placement task where the robot needs to fit an object into a cavity that is essentially the same shape and size as the object. It’s a little bit like the game that babies do to train their dexterity.
We also have a task that is inspired by a conveyor belt, but we are using a table that is constantly turning. The robots need to grasp stuff while the table is turning. This looks a little bit silly because no one would actually put a rotating table in a factory, however this is our way of actually mimicking a conveyor belt. The conveyor belt itself would be really, really difficult to integrate into the competition, so we just abstracted that and use this rotating table to actually have the same challenge but in a more manageable way. And it’s still a very, very hard challenge.
Then there are some special challenges that we integrate. For example, that robots need to report their state back so that we can observe what the robot is doing. We also have a challenge where humans are in the loop. For example, the robot brings pieces to a certain workstation where a human is present, the human assembles the pieces, and then the human needs to give a sign to the robot, and then the robot will take the piece away and put it somewhere else. This is designed to really mimic the automated factory flow.
In the past we also had a challenge where the robots needed to open a drawer, take something out and then close the drawer again. We’ve also had tasks where the robot has to handle fragile objects, like sweets, where the robot really needed to be careful in manipulating them. So in general, what differentiates us most from the Logistics League is that we are focusing a lot on manipulation and all the difficulties that come with manipulation and unknown objects, whereas Logistics is more tailored towards large-scale logistics processes with all their optimization and planning.
Yes, this difference in approaches is related to the history of our League, which is a little bit similar to the Logistics League. The Logistics League was originally a sponsored demonstration by Festo, which is a large company from Germany that creates tools, but they also have a didactics area where they provide tools to help people understand factory optimization. The @Work League was sponsored by Kuka, the robotics company, and, in the beginning, they required every team to compete with the Kuka youBot. So this was pretty much the default platform for our league, but at some point Kuka dropped from a sponsor to just an advisor to the league, and nowadays they are not part of the league at all. So when the Kuka youBot was going out of commission, the teams searched for alternatives and now we are presented with a wide variety of robots that are competing in the league, which I personally find really cool. Now we have all these different robots, all these different approaches, and some work better in some scenarios and worse in others. So we really have a scientific approach to the problem and we are really getting some insights into how you can tackle this problem on multiple levels.
In 2018 we introduced a challenge of so-called arbitrary surfaces which are surfaces unknown to the teams that are put on top of the workstations. The teams need to be able to deal with these surfaces. There are two surfaces that are really, really awful for the teams – one is grass that we pretty much stole from the soccer competitions! We just thought it would be funny to try it, and it was a really interesting problem, especially for some of the grippers of the different teams. For example, the current world champion, they have a rigid gripper so they can have force feedback when they grasp. However, the grass is really difficult for them – because of their rigidity, they always grasp the grass itself and then they pull up the grass with the object. And this led to some interesting problems, like they are transporting the actual surface around and not only the object. This isn’t a problem for teams using a flexible gripper. However, on the other hand, the flexible gripper makes it really difficult to assess if you have grasped the object because you have very bad force feedback. So there are two different approaches that have their pros and cons in different scenarios.
Three robots from the @Work competition in Brazil.
Yes and no. So actually we are introducing a completely new challenge which is different from what we’ve done before. The new challenge is the so-called smart farming challenge, which is opening our league to a whole new field of applications, because we are now looking at agriculture. We are working on this with Studica, a robotics company from Canada, whose hardware we are using. We’ve already given it a try at the German Open. This challenge comes with some new specifics and one these is that the teams only get the robot shortly before the competition. So they don’t really know the robot largely in advance, and they need to assemble, program and design the robot in a very short time. To compensate for this, we reduce the amount of optimization and robustness that is necessary. Because it’s an agriculture setting, we have different objects, like fruits, that the teams need to handle. This makes it a little bit more complicated because fruits have a more arbitrary shape and different levels of ripeness that need to be detected. We also have some grapes that are hanging on a wall, which is a completely different kind of manipulation task than before, because before the teams just needed to grasp things from surfaces, but now they really need to pluck stuff from a wall in a reliable way. So this is the new challenge. It also comes with a lot of software challenges because the computational power of this robot is very limited because it only has a Raspberry Pi. For example, there is not a lot of image processing possible, especially compared to the current robots, some of which even have GPUs embedded.
Yeah, I think one big change I observed over the years was a switch from custom neural networks for object detection to off-the-shelf components. So pretty much all teams nowadays use YOLO networks, which you can get pre-trained and they just deploy them on GPUs that they embedded into their robots. This is also one of the reasons why the robots really grew in size over the last few years because they needed space for the larger computational power. This actually made it possible for a lot of teams to reliably detect the objects. Object detection was a big problem in the beginning of the league and nowadays it’s not really a big issue – most teams are really good at that. Sometimes they are a little bit startled with decoy objects – these are objects in the arena that are not really part of the task, and they are unknown to the teams beforehand. Sometimes they are, let’s say, evil decoys that look like an object and there’s some mismatches that the teams do, but this is becoming very rare.
I think the second big change is a switch to larger manipulators with more degrees of freedom. So in the beginning, everyone had a very small manipulator with only five degrees of freedom, which limited the operating range, and nowadays pretty much all teams have a six degree of freedom manipulator with a large range. This means that they don’t need to move their robot when they are in front of a workstation, which makes them much faster and also much more precise.
There are a few things we are thinking about.
With regards to the competition itself, we had a discussion with the teams about what they are interested in doing in the future. Two things came up that they really want to have. One is mobile obstacles, so they want other objects to move autonomously through the arena. We’re in the process of creating that, in cooperation with EduArt, which is a company from Germany that also provides small educational robots. And the second thing we want to introduce is a kind of humanoid robot that the teams can use to actually handle special manipulation tasks that cannot be done simply with a robot manipulator.
In terms of creating an entry-level League, we have been working on this and one potential idea is to use the smart-farming challenge as the entry point. Through the collaboration with Studica, we can provide teams with the robot and they get to keep it after the competition. At the German Open I spoke to the Rapidly-Manufactured Rescue League about this crossover between the Rescue and the Junior Leagues, and they are very keen to collaborate.
We’re also talking with the Logistics League. Their sponsor, Festo, has dropped out of their league and now they need to reorganize. We are wondering if it would be worthwhile to bring our leagues closer together, or even fuse them together to a single RoboCup Industrial league. The Logistics League wants to do more manipulation, and the @Work League wants to do more planning, so we are closing the gap naturally between the two. However, this is just a thought at the moment – we need to see how the teams react to that.
|
Christoph Steup is an active researcher specializing in various fields of robotics, including swarm robotics, precision farming, and weather-resilient autonomous driving. He currently works at the Fraunhofer Institute for Transportation and Infrastructure Systems (IVI), where he leads the Swarm Technology Group. Prior to this role, he headed the Computational Intelligence in Robotics group at the Otto von Guericke University Magdeburg. Christoph’s involvement with RoboCup began in 2015 when he joined the robOTTO team of Otto von Guericke University as team leader. His contributions to the RoboCup community expanded as he became a member of the Technical Committee for the @Work League in 2017. In 2019, he further advanced his participation by joining the Executive Committee of the league. |