Video: Adobe dabbles in video-object manipulation
Hey you, hot-shot movie cutter! Now that we've got your attention, have a look at this. Adobe's research laboratory has been toiling away with a sophisticated interactive video-object manipulation system, which gives video editors all sorts of creative windows with next to no rendering lag. An After Effects demonstration shows an editor selecting the outside of a cab and typing "taxi" -- once the text is imprinted on the vehicle, it stays on the car as it moves up and down the street. We know, you're totally scratching your head trying to envision what we just said, so why not just head past the break and give it a look?
Interactive Video Object Manipulation from Dan Goldman on Vimeo.
Interactive Video Object Manipulation from Dan Goldman on Vimeo.






















Wow that is pretty amazing actually ZOMG
"Blog about it"? That's Adobe's feedback mechanism?
It's all well and good to implement SIGGRAPH papers, but Adobe can't even field working updaters or a decent UI for Photoshop or Illustrator. They need to clean up the wretched mess that is the Creative Suite before dicking around with anything else.
And they can start by listening to customers, which they essentially NEVER do. Just look at their "feature request" forums.
@ Information Central
I'm totally high-ranking you, man! I feel the same way about Adobe. Their PS CS4 is a UI sluggish hell! I don't use much of their other apps, but PS is a foundation for my DCC work! And I DEMAND it to NOT slow me down when I want to work on whatever I want to work!
My mind has officially been blown. It was way too early in the morning for this lol
I have been longing for software like this so I can teach my mom how to work on my projects!
:/
Yep, it's pretty amazing how easy those features are to use. Here's hoping they appear in the next version of Adobe Premiere Elements!...
Information Central, I couldn't agree more on the updates. It's damn near impossible to maintain patches on thousands of Adobe Acrobat Reader, Flash, etc., because their patching mechanisms suck. You'd think they'd want to save on bandwidth when possible, but it seems like they WANT people to get all their patches and updates for each client, each time through automatic updater.
How long until we see airbrushing of models in recorded events, say fashion shows?
Information Central: Adobe does have different departments, you know.
The department responsible for Photoshop CS4's UI is not the same one that makes stuff to tag objects in videos.
(Disclaimer: I haven't used CS4.)
I want to grab some video titties and move them around.
Now I can see what my graffiti looks like before I start tagging up city.
bring a sweater, it's chilly outside this time of year.
Very cool, and I didn't know you guys worked around the clock!
Spoiler:
The background scenery behind Dan Goldman is actually...AFTER EFFECTS.
No. The background is really Seattle. The bridge is the Aurora Avenue Bridge (US-99) and is a popular jumping off place.
Haha, I actually live right behind the camera man, and I'm pretty sure that's real...
How many people who've jumped off would reccomend it?
Nothing I can't do with pftrack and after effects....
Holy crap I've been waiting for this FOREVER!!
Cool. Maybe those geniuses at Adobe have it in them to put together a version of Acrobat Reader that doesn't hog 20% of my CPU or take ten seconds to start up.
We all know that's never going to happen.
You mean, like, evince?
or maybe one that doesn't crash on my vista system every time, even after i have installed every update.
Foxit PDF reader is the way to go, it takes up almost no CPU or memory.
I used to use Foxit, but too many PDFs gave me problems; then I found PDF-XCHANGE VIEWER, and never looked back.
If this system consistently works as well as the video demonstrates, there's only one word: AWESOME.
This is the kind of natural interaction that computers should be about. Make things work by doing what "feels right", not by doing an hour's work for ten seconds of footage in AfterEffects.
I've got no problem doing hours of work in After Effects for 10 seconds of footage that a client is willing to pay $100,000 for... think commercial motion graphics. Concept consumer apps like this can't enable such scenarios. Don't get me wrong they're sick and I want 'em, but there's always going to be a time and a place for robust editing tools like AE.
@Wulile, why do you think that such an app wouldn't be good for commercial purposes? Simply because it's consumer-oriented? Wouldn't you rather get paid that amount of cash for doing the same job in half the time? It's not definite that it would work, and yes, there will always be a place for powerful apps like AE, but you shouldn't shun it just because it's geared for consumers.
Sorry, I don't recall shunning it, I actually said I wanted it so calm down. I think applications like this are brilliant and fun. The idea of providing this sort of power to a novice is one of the most liberating parts of software design. I'm just pointing out that complexity, like you find in AE isn't always bad. I think quite often its necessary and healthy. Trying too hard to eliminate complexity can lead to bad design. I think it's much more useful to try and manage it.
Statements like "this is the kind of natural interaction that computers should be about. Make things work by doing what 'feels right'..." sound to me like naive Apple fanboy-isms. And before you flame me again, keep in mind I own an iPhone and I love it.
I would prefer that they dabble in a 64-bit version of Flash. Please, Adobe?
64-bit flash is available on linux, why not use that if it is so important?
Wow, you're absolutely right. I must have been living in the gutter for rhe last couple of weeks to miss that announcement. Sorry about my eagerness to bash Adobe. =D
LBP meets Adobe! Epic.
you gotta wonder how powerful of a system that's running on though, it might run like in the video on an 8-core mac pro, but how's it gonna run on the average schmo's computer?
Probably just like Acrobat Reader... =\
The average schmo won't be able to afford this software.
@Josh
Let me introduce you to the internet.
There are people out there who pay for adobe?
Made on a Mac. Just sayin'.
Thanks for telling me!!!
oh yeah. It appears to use plain-ol' gtk+ widgets.
oooh... motion tracking. Can anyone say "shake"?
Yes there are several ways of accomplishing this already. Shake has a pretty steep learning curve IMHO though and is not that widely used by the masses... thus everyones surprise...
I use to use this type of technology eons ago when I use to work in special effects (I now create games) way before Shake. . . and after Apple bought Shake and dropped Window version.
Can't wait to get to work on my first bit of blackmail video.
How many cores do I need to process one second of video in under an hour?
only one, so long as its liquid nitrogen cooled and oc'd to at least 6 ghz
...And that you are not running Acrobat at the same time. We all know you cannot run Acrobat alongside another application (Yes, the OS is also included in this generalization)
that was amazing
his friends look 12
I still would.
not much mind boggling. if u can do facetracking with webcam on laptop, why can can you do this with little more resources.
This motion tracking software works just about as well as the software I used for a company that does the virtual first downlines in football. You would be amazed at how quickly you can set 1 area to track on and as long as there are no swift camera moves and no major lighting changes it works like a charm. Though the equipment I used had 3 computers working together to accomplish this in realtime. This kind of thing would be a huge addition to the average editors toolbox. I can't wait to use this at home.
WE DANCED HERE LAST NIGHT????
WHERE WAS THE STAGE???
YOU WERE HOTTER LAST NIGHT!
Ooooooh if only Adobe showed Linux a little love I wouldent have to use WINE when they finally, if they finally, release this in a suite.
Oh GOD YES!
Its the single biggest reason I am not able to use ubuntu boot on my desktop regularly.
Download link or it didn't happen.
The comic in me hopes you were joking. You know, torrent humour.
The cynic in my thinks you were serious.
Which is it?
I believe the correct terminology is "Which is it /b/?"
Does the boat make it under the bridge?
LMFAO, that's exactly what I was thinking.
he copied the scrolling thing from someone else, but his is better cause the other guy needed a path to be predrawn for the video and for the video, it couldn't generate on its own, but to be fair he didn't work for a big name like Adobe
The graffiti effect is similar to that of ZunaVision: http://www.downloadsquad.com/2008/11/29/zunavision-lets-you-place-images-and-videos-inside-your-videos/
Im suprised im the first post to mention:
PYTHON!
On Tiger and xp..
You can already play around with something like this. They call it the Direct Manipulation Video Player.
http://www.aviz.fr/dimp/
did anyone else notice the irony of him using the iPhone as the example
The technology is there for years, not so fresh like you say it is.
This appears to be an extension to work done independently by people at Apple and the University of Toronto:
http://doi.acm.org/10.1145/1357054.1357096
http://doi.acm.org/10.1145/1357054.1357097
The work shown here is much more advanced, and very cool, so I don't mean to detract from it. Nevertheless it helps to understand where it came from.
After Effects 64bit please... its the most memory entensive app out there and the top is 3gb.
They say it's in the pipeline, but it might be one of those pipelines in afghanistan or iraq or siberia I fear :/
-
Nothing surprising really. It has been done atleast 12 years before by some small software company. I may even have the software lying somewhere.
It just that Adobe does it and people get to know.
Many small MM companies have done many interesting work before, but did not have Adobe's financial clout to survive.
[ I have huge respect for Adobe.]
But just don't go wild with excitement.
Hehe, the possibilities.
OMG, make porn do what you want when you want!
Who needs a cam girl anymore?
I do.
ok now this is something that I really want.Way to go adobe!
We've just walked into a new era of visual effects in films man... imagine what editors and directors could do with this!
If an actor was misplaced in a scene you can move em to match em with the rest of the footage... during editing you can keep continuity to the very last frame of your choice without having to worry about the other things in the scene cuz you can essentially freeze them...
This is so cool!
-
Did u check Elastic Reality ?
As is said in the video after a while, this stuff is pretty old now (although in the beginning the guy tries to claim it's new) and it has been used in almost all movies for at least the last 5 years, and almost all commercials too.
perfect, now i can blurr out the titties in my "home vids" ;-)
Why the hell would you do that?
-
Try Elastic Reality
Nobody a bit annoyed about how you can trust ANYTHING anymore? Nothing you hear or see on video and in images and on soundrecordings is real, plus it's now for some reason accepted and taught to fake stuff for 'documentaries' too, so once even homemovies are fakeable so easily by even the ignorant.. the next generation will have grown up in a big (or even bigger) vat of bullshit with no way to even remotely check what's real.
Chris is cute
Kid in the screenshot @ 3:15: Okay guys, laughing at my XXL yellow shirt is getting old now.
Is that Hippie Glenn in 1:25??
Is it possible R Kelly had access to an early beta? I mean did he just copy and paste his face on to that..... wait I mean he is not guilty right?
Very cool. I could use this feature for educational videos.
Finally. This is easily 30% of my workload. I would embrace anything that made motion matching less fiddly. Even if it is from Adobe! Just kidding my dark overlord, I kiss your acrid, blackened feet. Do not smite me...
that is sick! makes motion tracking so much easier
I guess this is a rip of what Microsoft has been doing only not quite as good.
http://www.boreme.com/boreme/funny-2008/microsoft-mosaics-p1.php
Oh man, I'm going to have to construct many additional pylons just to have enough energy to run this thing at full speed on my computer...
Seems very limited!
Microsoft did it first...
http://research.microsoft.com/unwrap/
http://www.youtube.com/watch?v=mNLx9pclMKU
Motion tracking not just in shaek. But Apple Motion has had it for the past 2 years as well.
first it was photo shop, then it was video shop
This is brilliant, a great companion to Augmented Reality.