• Follow us

Social Media

Why is Facebook doing robotics research? – TechCrunch

It’s a bit strange to hear that the world’s leading social network is pursuing research in robotics rather than, say, making search useful, but Facebook is a big organization with many competing priorities. And while these robots aren’t directly going to affect your Facebook experience, what the company learns from them could be impactful in surprising ways.

Though robotics is a new area of research for Facebook, its reliance on and bleeding-edge work in AI are well known. Mechanisms that could be called AI (the definition is quite hazy) govern all sorts of things, from camera effects to automated moderation of restricted content.

AI and robotics are naturally overlapping magisteria — it’s why we have an event covering both — and advances in one often do the same, or open new areas of inquiry, in the other. So really it’s no surprise that Facebook, with its strong interest in using AI for a variety of tasks in the real and social media worlds, might want to dabble in robotics to mine for insights.

What then could be the possible wider applications of the robotics projects it announced today? Let’s take a look.

Learning to walk from scratch

“Daisy,” the hexapod robot

Walking is a surprisingly complex action, or series of actions, especially when you’ve got six legs, like the robot used in this experiment. You can program in how it should move its legs to go forward, turn around, and so on, but doesn’t that feel a bit like cheating? After all, we had to learn on our own, with no instruction manual or settings to import. So the team looked into having the robot teach itself to walk.

This isn’t a new type of research — lots of roboticists and AI researchers are into it. Evolutionary algorithms (different but related) go back a long way, and we’ve already seen interesting papers like this one:

By giving their robot some basic priorities like being “rewarded” for moving forward, but no real clue how to work its legs, the team let it experiment and try out different things, slowly learning and refining the model by which it moves. The goal is to reduce the amount of time it takes for the robot to go from zero to reliable locomotion from weeks to hours.

What could this be used for? Facebook is a vast wilderness of data, complex and dubiously structured. Learning to navigate a network of data is of course very different from learning to navigate an office — but the idea of a system teaching itself the basics on a short timescale given some simple rules and goals is shared.

Learning how AI systems teach themselves, and how to remove roadblocks like mistaken priorities, cheating the rules, weird data-hoarding habits and other stuff is important for agents meant to be set loose in both real and virtual worlds. Perhaps the next time there is a humanitarian crisis that Facebook needs to monitor on its platform, the AI model that helps do so will be informed by the auto-didactic efficiencies that turn up here.

Leveraging “curiosity”

Researcher Akshara Rai adjusts a robot arm in the robotics AI lab in Menlo Park (Facebook)

This work is a little less visual, but more relatable. After all, everyone feels curiosity to a certain degree, and while we understand that sometimes it kills the cat, most times it’s a drive that leads us to learn more effectively. Facebook applied the concept of curiosity to a robot arm being asked to perform various ordinary tasks.

Now, it may seem odd that they could imbue a robot arm with “curiosity,” but what’s meant by that term in this context is simply that the AI in charge of the arm — whether it’s seeing or deciding how to grip, or how fast to move — is given motivation to reduce uncertainty about that action.

That could mean lots of things — perhaps twisting the camera a little while identifying an object gives it a little bit of a better view, improving its confidence in identifying it. Maybe it looks at the target area first to double check the distance and make sure there’s no obstacle. Whatever the case, giving the AI latitude to find actions that increase confidence could eventually let it complete tasks faster, even though at the beginning it may be slowed by the “curious” acts.

What could this be used for? Facebook is big on computer vision, as we’ve seen both in its camera and image work and in devices like Portal, which (some would say creepily) follows you around the room with its “face.” Learning about the environment is critical for both these applications and for any others that require context about what they’re seeing or sensing in order to function.

Any camera operating in an app or device like those from Facebook is constantly analyzing the images it sees for usable information. When a face enters the frame, that’s the cue for a dozen new algorithms to spin up and start working. If someone holds up an object, does it have text? Does it need to be translated? Is there a QR code? What about the background, how far away is it? If the user is applying AR effects or filters, where does the face or hair stop and the trees behind begin?

If the camera, or gadget, or robot, left these tasks to be accomplished “just in time,” they will produce CPU usage spikes, visible latency in the image and all kinds of stuff the user or system engineer doesn’t want. But if it’s doing it all the time, that’s just as bad. If instead the AI agent is exerting curiosity to check these things when it senses too much uncertainty about the scene, that’s a happy medium. This is just one way it could be used, but given Facebook’s priorities it seems like an important one.

Seeing by touching

Although vision is important, it’s not the only way that we, or robots, perceive the world. Many robots are equipped with sensors for motion, sound and other modalities, but actual touch is relatively rare. Chalk it up to a lack of good tactile interfaces (though we’re getting there). Nevertheless, Facebook’s researchers wanted to look into the possibility of using tactile data as a surrogate for visual data.

If you think about it, that’s perfectly normal — people with visual impairments use touch to navigate their surroundings or acquire fine details about objects. It’s not exactly that they’re “seeing” via touch, but there’s a meaningful overlap between the concepts. So Facebook’s researchers deployed an AI model that decides what actions to take based on video, but instead of actual video data, fed it high-resolution touch data.

Turns out the algorithm doesn’t really care whether it’s looking at an image of the world as we’d see it or not — as long as the data is presented visually, for instance as a map of pressure on a tactile sensor, it can be analyzed for patterns just like a photographic image.

What could this be used for? It’s doubtful Facebook is super interested in reaching out and touching its users. But this isn’t just about touch — it’s about applying learning across modalities.

Think about how, if you were presented with two distinct objects for the first time, it would be trivial to tell them apart with your eyes closed, by touch alone. Why can you do that? Because when you see something, you don’t just understand what it looks like, you develop an internal model representing it that encompasses multiple senses and perspectives.

Similarly, an AI agent may need to transfer its learning from one domain to another — auditory data telling a grip sensor how hard to hold an object, or visual data telling the microphone how to separate voices. The real world is a complicated place and data is noisier here — but voluminous. Being able to leverage that data regardless of its type is important to reliably being able to understand and interact with reality.

So you see that while this research is interesting in its own right, and can in fact be explained on that simpler premise, it is also important to recognize the context in which it is being conducted. As the blog post describing the research concludes:

We are focused on using robotics work that will not only lead to more capable robots but will also push the limits of AI over the years and decades to come. If we want to move closer to machines that can think, plan, and reason the way people do, then we need to build AI systems that can learn for themselves in a multitude of scenarios — beyond the digital world.

As Facebook continually works on expanding its influence from its walled garden of apps and services into the rich but unstructured world of your living room, kitchen and office, its AI agents require more and more sophistication. Sure, you won’t see a “Facebook robot” any time soon… unless you count the one they already sell, or the one in your pocket right now.

Read More



Leave A Comment

More News

TechCrunch » Social

Facebook still a great place to amplify pre-election 2019-05-21 07:34:54A study carried out by academics at Oxford University to investigate how junk news is being shared on social media in Europe ahead of regional electio

Snap appoints new execs as it aims to 2019-05-20 19:15:14Snap has another appointment in the apt saga of its ephemeral CFOs. Four months after losing its CFO Tim Stone following a reported “personality

Maisie Williams’ talent discovery startup Daisie raises $2.5 2019-05-20 16:17:57Maisie Williams’ time on Game of Thrones may have come to an end, but her talent discovery app Daisie is just getting started. Co-founded by fil

Why is Facebook doing robotics research? 2019-05-20 16:06:41It's a bit strange to hear that the world's leading social network is pursuing research in robotics rather than, say, making search useful, but Face

Instagram’s IGTV copies TikTok’s AI, Snapchat’s design 2019-05-20 15:49:40Instagram conquered Stories, but it’s losing the battle for the next video formats. TikTok is blowing up with an algorithmically suggested verti

On the Internet of Women with Moira Weigel 2019-05-20 12:15:26“Feminism,” the writer and editor Marie Shear famously said in an often-misattributed quote, “is the radical notion that women are p

TikTok owner ByteDance’s long-awaited chat app is here 2019-05-19 22:49:55In WeChat -dominated China, there’s no shortage of challengers out there claiming to create an alternative social experience. The latest creatio

Facebook changes algorithm to promote worthwhile & close 2019-05-16 11:14:04Facebook is updating the News Feed ranking algorithm to incorporate data from surveys about who you say are your closest friends and which links you f

Instagram adds Stories to Explore tab. Here’s how 2019-05-16 09:59:47Instagram’s pivot to Stories continues with an overhaul of Explore designed to let users dig deeper into their niche interests. Stories are now

Instagram is killing Direct, its standalone Snapchat clone 2019-05-16 07:09:53As Facebook pushes ahead with its strategy to consolidate more of the backend of its various apps on to a single platform, it’s also doing a lit

Facebook introduces ‘one strike’ policy to combat abuse 2019-05-15 02:09:27Facebook is cracking down on its live-streaming service after it was used to broadcast the shocking mass shootings that left 50 dead at two Christchur

Twitter launches new search features to stop the 2019-05-14 23:05:26As measles outbreaks in the United States and other countries continue to get worse, Twitter is introducing new search tools meant to help users find

Mashable

Watch these brave humans risk everything to chase 2019-05-28 11:43:23Some people will do anything to get cheese, no matter the cost. Contestants at the annual Gloucestershire cheese rolling festival risked injuries as t

'Super Mario 2' hands-on: What a delight 2019-05-28 11:39:39Super Mario Maker 2 is so much fun. I only played about an hour of Super Mario Maker 2 for the Nintendo Switch at a preview event, jumping between the

Save $70 on a Dell 24-inch monitor *and* 2019-05-28 11:34:01Your computer monitor can really make or break your work experience. If you have a shitty monitor it can be difficult to focus or your work might take

Tesla raced one car above ground versus another 2019-05-28 11:32:38Elon Musk’s idea for underground travel in California was tested recently by racing two Tesla cars; one through normal traffic, and the other th

Snag the Samsung Galaxy Tab A on sale 2019-05-28 11:18:05Memorial Day weekend marked the unofficial start of beach-read season, which means a new lightweight tablet should be at the top of your "to-buy" li

MacKenzie Bezos pledges to donate half her fortune 2019-05-28 11:13:47MacKenzie Bezos has pledged to give half her estimated $36.6 billion fortune to charity. Her ex-husband hasn't, though! The newly independent billion

Ring’s outdoor smart lighting system is $30 off 2019-05-28 11:12:39You’ve probably heard of smart lighting systems for your home before — the Philips Hue setup is very popular among consumers and smart hom

'Killing Eve' and the TV tightrope of escalating 2019-05-28 11:11:32Warning: The following post contains spoilers for Killing Eve's Season 2 finale. If Eve Polastri's work-life balance was complicated before, she's

Amazon Fire TV devices are up to $100 2019-05-28 11:07:59Arguably one of the most annoying parts about watching TV is losing the remote. It can have you flipping over couch cushions and losing all trust in y

Viral 'Egg Boy' announces he's donated his GoFundMe 2019-05-28 11:00:05Once again, Australia's "Egg Boy" has proven to be not the hero we deserve, but the one we need. Will Connolly, you may recall, is the teenager who

Netgear Orbi, Sandisk SD Cards, Western Digital Hard 2019-05-28 10:57:43First day back to work after a long weekend is never easy. What better to ease the pain than with some online retail therapyAmazon deals of the day ga

Weatherman goes off after 'Bachelorette' fans complain about 2019-05-28 10:35:55Will you accept this rose? No? Well, we hope you can at least accept this urgent safety interruption. Fans on the edge of their seat during Monday nig

The Next Web

IOTA wants to ditch its most centralized component, 2019-05-28 11:02:38IOTA, a distributed ledger protocol for the Internet of Things, has released a new white paper detailing an upcoming software upgrade that promises to

Kik raised $98M with a potentially illegal ICO. 2019-05-28 10:30:17Kik, the embattled messaging startup behind the Kin cryptocurrency, is now crowd-sourcing donations to help fund its legal battle with US regulat

Facebook is so insanely big, it had to 2019-05-28 10:21:41You can tell a lot about the direction of a company by looking at its tech stack. A great example of this comes from Facebook, which today announced t

Apple updates iPod Touch with A10 fusion chip 2019-05-28 09:21:45Apple today released a new iPod Touch with A10 fusion chip that supports group FaceTime chats and improved augmented reality capabilities. The rest of

Catalyze your data science education with this $20 2019-05-28 09:00:00Over six courses packed with 130 hours of training, this is where to start understanding today’s data revolution. From key programming disciplin

Nvidia adds ray-tracing support to Quake 2 with 2019-05-28 08:58:26Now this brings me back. Remember Quake 2? This iconic first-person shooter was released towards the tail-end of the 1990’s, and boasted fast-pa

This website turns Bitcoin blockchain activity into ASMR 2019-05-28 08:19:50Holding cryptocurrency can be exhilarating, yet absolutely depressing. Luckily, a website automatically transmogrifies Bitcoin activity into soft

CHEAP: Project your true feelings with 33% off 2019-05-28 08:00:20Love hosting movie nights? Want to watch a game with your friends, but don’t have a big-screen TV? Then hop on to the deal wagon and grab this&n

This super-slim laptop stand raised over $1 million 2019-05-28 08:00:00The solution to the solution is the MOFT, or, as it’s better known, the “invisible” laptop stand. Right now, you can get the MOFT an

HP’s Envy laptops get a sexy new wood 2019-05-28 07:32:06It’s interesting to see the continuing evolution of HP’s laptop division into a more premium, aspirational brand. That shift is typified b

Google stored some G Suite passwords in plaintext 2019-05-22 04:33:12Google revealed that it recently discovered a bug that caused a subset of its enterprise G Suite customers to have their passwords stored in an unhash

The privacy-focused Tor browser is now officially on 2019-05-22 04:28:57After a long wait, privacy-focused browser Tor is finally on Android with a stable release. Last September, the Tor project team launched an alph

Entrepreneur

Death by Investing: How a 10 Percent Loss 2019-05-28 11:30:00Stock market declines are linked to early death, illness, and fatal accidents. Are you at risk?

12 Ways That Writers, Speakers and Experts Can 2019-05-28 11:19:58Information and inspiration are valuable commodities in the entrepreneurial world.

10 User Experience Design Trends You Need to 2019-05-28 11:00:00You might already know about augmented reality, but do you know about foldable phones and three-dimensional design?

Apple Launches a New iPod Touch 2019-05-28 10:58:21It's been nearly four years since the 6th generation iPod touch was released, but today Apple upgraded it with an A10 Fusion chip, augmented reality,

Why Entrepreneurship Alone Isn't Enough To Make You 2019-05-28 10:30:00You can't just be savvy about your business strategy. Keep these steps in mind to make your money work for you.

3 Ways That Even 'Nonhuman' AI Can Help 2019-05-28 10:30:00How about immediate customer feedback, efficient customer support and personalization?

Laptop Full of Malware Sells for $1.3 Million 2019-05-28 10:24:19It's an art piece containing six pieces of malware responsible for $95 billion worth of damage, and it just sold at auction for $1.345 million.

6 Tips for Starting a Business That's an 2019-05-28 09:30:00Looking to start a business that resonates with locals? Take a cue from Proper Hospitality co-founder Brian De Lowe, who makes sure each of his new ho

'If You Don't Stand for Something, You Seem 2019-05-28 09:00:00Marshall Rader and his brother encountered plenty of naysayers for their business. They proved them wrong.

Greg Flynn Owns 1,245 Restaurants and Makes $2 2019-05-28 09:00:00He bought his first Applebee's 20 years ago, and since then has redefined what's possible in the franchise industry. His philosophy: Be different, t

Mergers May Mean More Money, but You Can't 2019-05-28 08:00:00You may be tempted by that flashy merger deal, but here are a few reasons you should think twice before diving in.

Most States Provide No Legal Protection If You're 2019-05-28 08:00:00There are 33 states where medical marijuana is legal but only 13 where you have recourse if you're fired for it.

E-Commerce Times

Leveraging the Tools That Fuel E-Commerce Growth 2019-05-25 08:00:00E-commerce technologies have been innovating fast. It's no surprise, considering e-commerce in North America grew by 15 percent in 2018, to reach mor

Where CEOs Go Wrong With Brand ID 2019-05-24 12:10:52Brand ID is key to every company's success and growth. Why then do so many senior executives at so many different companies screw it up? When you com

ARM Joins Firms Shunning Huawei's Business 2019-05-23 05:41:59British mobile device software design firm ARM has ordered its staff to stop working with Chinese smartphone giant Huawei, in compliance with a ban is

Better Customer Satisfaction Through AI-Enabled CRM 2019-05-22 10:00:00You don't have to be entrenched in the tech world to have heard the term, "artificial intelligence," but what is artificial intelligence, or AI, a

EU's Counterattack on Junk News May Help Protect 2019-05-22 05:56:48Government efforts to minimize the effects of junk and fake news circulating on social media ahead of this week's EU parliamentary elections may have

Cybercriminals Score Billions in Cryptocurrency Thefts 2019-05-21 13:05:56Is anyone surprised to learn that in just the first quarter of 2019 more than $1.2 billion worth of cryptocurrency was stolen? Probably not. This stor

5 Effective Talent Retention Strategies for Security Teams 2019-05-20 15:39:41In IT, we've been hearing about the "cybersecurity skills shortage" for a few years. There is no shortage of statistics and data about it: More tha

Omnichannel Retail: Big Data Is Nice, Fast Data 2019-05-18 08:00:00Any retailer that wants to be competitive knows it must offer a seamless omnichannel experience to its customers. However, many retailers aren't awar

US Mobile: Another Bait-and-Switch Disappointment 2019-05-16 08:00:00I just dumped US Mobile after less than four months, setting a new speed record for hitting my tolerance-for-b.s. ceiling. I'd had high hopes for thi

Walmart Enters High-Stakes Next-Day Delivery Game 2019-05-15 13:11:29Walmart has announced free one-day delivery for 220,000 of its most-frequently purchased items. The service will be available first in Phoenix and Las

Technology Is Filling a Need in Philanthropy 2019-05-14 15:30:17It's surprising that philanthropy as an industry has gotten by for so long without technology. That's changing, however. The cost of technology has

Flexa Launches Crypto-Based Payment App 2019-05-14 12:55:54Flexa has launched a new digital payment network that uses cryptocurrencies to cut processing costs, eliminate fraud and preserve users' privacy. The


Disclaimer and Notice:WorldProNews.com is not responsible of these news or any information published on this website.