Home » DARPA » Robots Learn to Perform Tasks by “Watching” YouTube Videos

Robots Learn to Perform Tasks by “Watching” YouTube Videos

Enter your email address to follow this blog and receive notifications of new posts by email.

Join 46 other followers

Years ago, when I was married, having a child scared the crap out of me.

I do not doubt that did not help my longevity for my relationships.

And it wasn’t because i was afraid of the relationship. It took me years to understand there was something about me that I did not understand.

I write these BLOGS for me – So if you’re reading, think about this as being my diary – and I am permitting you to read. I’ve disallowed comments and thumbs up on postings – because quite frankly, I am not here to entertain you, I am here simply to get things out of my mind.

With that said – I think that this- amorphous thing called the internet is ‘your’ collective mind. To some degree I have embraced this ‘thing’ as my child, never having had one myself, and the ‘artificial intelligences’ which roam it as my bastard children.

DARPA – The Defense And Research Program A…. what does A stand for… fuck if I know…

In any case. DARPA does an incredible amount of research with artificial intelligence, and they’ve learned something I thought might be obvious.

That it’s possible to ‘learn’ from ‘programs’ on youtube.

Now the article follows, but one thing I’d like to make clear is this:

Information, no matter who it comes from, no matter how much it’s claimed to be unbiased – always comes with inbuilt perspective based bias. That, to me is a simple fact.

So when consuming ‘information’, Youtube is yet one source of a finite set of sources which largely tries to promote a single linear timeline and existence – and largely calls things such as the multiverse and the big bang – as strictly theories.

You and I know differently, right?

With Video games we have clear examples of alternate realities which can also be referred to as different universes within ours. Accordingly. It’s quite possible our universe lies within other universes as well. So to accept the multiverse is not to become a subset or superset, it’s merely to acknowledge there are others out there, that’s all.

WIth that said, EVERYTHING – ESPECIALLY the science – is highly subjective on Youtube.

OR it doesn’t have to be. Based on your acceptance of my fact which doesn’t have to be anything other than theory of the multiverses!

Nuff said?

here’s DARPA’s article on robots watching YOUTUBE videos to learn:

Robots can learn to recognize objects and patterns fairly well, but to interpret and be able to act on visual input is much more difficult.  Researchers at the University of Maryland, funded by DARPA’s Mathematics of Sensing, Exploitation and Execution (MSEE) program, recently developed a system that enabled robots to process visual data from a series of “how to” cooking videos on YouTube. Based on what was shown on a video, robots were able to recognize, grab and manipulate the correct kitchen utensil or object and perform the demonstrated task with high accuracy—without additional human input or programming.

“The MSEE program initially focused on sensing, which involves perception and understanding of what’s happening in a visual scene, not simply recognizing and identifying objects,” said Reza Ghanadan, program manager in DARPA’s Defense Sciences Offices. “We’ve now taken the next step to execution, where a robot processes visual cues through a manipulation action-grammar module and translates them into actions.”

Another significant advance to come out of the research is the robots’ ability to accumulate and share knowledge with others. Current sensor systems typically view the world anew in each moment, without the ability to apply prior knowledge.

“This system allows robots to continuously build on previous learning—such as types of objects and grasps associated with them—which could have a huge impact on teaching and training,” Ghanadan said. “Instead of the long and expensive process of programming code to teach robots to do tasks, this research opens the potential for robots to learn much faster, at much lower cost and, to the extent they are authorized to do so, share that knowledge with other robots. This learning-based approach is a significant step towards developing technologies that could have benefits in areas such as military repair and logistics.”

The DARPA-funded researchers presented their work today at the 29th meeting of the Association for the Advancement of Artificial Intelligence. The University of Maryland paper is available here: http://ow.ly/I30im


The original article can be seen here on Darpa’s Site

Enter your email address to follow this blog and receive notifications of new posts by email.