myconid Posted July 25, 2012 Report Share Posted July 25, 2012 I'm sure everyone knows what the Kinect is and what it's for.So, it just occurred to me, since people have been writing open source drivers and plugins for Blender that can do in realtime, why can't we push the envelope and use it for motion capture of actual game animations?The motivation would be that this can both lower the barrier of entry for modders wishing to produce their own animations, but can also allow the team to produce a larger volume of animations for large-scale campaigns like those in AoE/AoM. Of course the price is that the captured animations will often need to be tweaked manually by the artists, multiple takes will be necessary, the cost of the hardware etc, however I think that if such a system could work it would be a huge step forward for the hobbyist game-dev scene (since most modern commercial games depend on mo-cap for much of their animation work, and we are at a disadvantage), and it would certainly get 0ad some headlines aside from the increased productivity.I know it's a wild idea (one can certainly dream). I'm just saying, think of the implications if it really works...(To be clear, I don't own a Kinect, so I'm interested in opinions of both artists and technical people who might have tried something related to this) Quote Link to comment Share on other sites More sharing options...
MishFTW Posted July 25, 2012 Report Share Posted July 25, 2012 Sounds epic. But on a side note, have you heard of Leap? Its more accurate. It hasn't been released fully yet, but they seem open to developers. Quote Link to comment Share on other sites More sharing options...
zoot Posted July 25, 2012 Report Share Posted July 25, 2012 The motion capture demos that Emjer did definitely were a big improvement over anything that we can do by hand, and I think it would make a significant difference if something like that made it into the game.I'm a bit doubtful about how good results can be achieved with Kinect, but I obviously don't have any evidence to base that on. Quote Link to comment Share on other sites More sharing options...
myconid Posted July 25, 2012 Author Report Share Posted July 25, 2012 Sounds epic. But on a side note, have you heard of Leap? Its more accurate. It hasn't been released fully yet, but they seem open to developers.That doesn't do full-body motion capture, though.The motion capture demos that Emjer did definitely were a big improvement over anything that we can do by hand, and I think it would make a significant difference if something like that made it into the game.I'm a bit doubtful about how good results can be achieved with Kinect, but I obviously don't have any evidence to base that on.Niiice! Looking further in the thread it looks like this idea isn't nearly as wild as I thought! Quote Link to comment Share on other sites More sharing options...
quantumstate Posted July 25, 2012 Report Share Posted July 25, 2012 I'm no expert but from what I have read I think that the quality from the kinect is pretty poor so you can only use it as a rough template for the animation. It would probably be easier just to use normal video to "trace".The kinect way is significantly cooler though. Quote Link to comment Share on other sites More sharing options...
myconid Posted July 25, 2012 Author Report Share Posted July 25, 2012 That would need more work from the artists, though. Maybe if we did the movements at half-speed we'd get more accurate results? Dunno. Quote Link to comment Share on other sites More sharing options...
zoot Posted July 25, 2012 Report Share Posted July 25, 2012 How about putting colored tags on crucial parts of the motion capture actor's body and then tracking the movement of the tags with computer vision software? I've only heard good things about OpenCV. Quote Link to comment Share on other sites More sharing options...
myconid Posted July 25, 2012 Author Report Share Posted July 25, 2012 How about putting colored tags on crucial parts of the motion capture actor's body and then tracking the movement of the tags with computer vision software? I've only heard good things about OpenCV.OpenCV is awesome (I had to use it for some work stuff a while back), but it's mostly for 2d things like tracking of items across a scene, face detection, stereo matching etc... The Kinect actually has 3d input from its sensor, which is what lets it to "pattern-match" a stick figure to a person relatively accurately. Quote Link to comment Share on other sites More sharing options...
zoot Posted July 25, 2012 Report Share Posted July 25, 2012 How many 5$ webcams do we need to match up in OpenCV to achieve equivalent accuracy? Quote Link to comment Share on other sites More sharing options...
quantumstate Posted July 26, 2012 Report Share Posted July 26, 2012 OpenCV is awesome (I had to use it for some work stuff a while back), but it's mostly for 2d things like tracking of items across a scene, face detection, stereo matching etc... The Kinect actually has 3d input from its sensor, which is what lets it to "pattern-match" a stick figure to a person relatively accurately.Set up two cameras at 90 degrees, after a quick calibration the maths is pretty simple for getting 3d points out of 2d tracking. Quote Link to comment Share on other sites More sharing options...
zoot Posted July 26, 2012 Report Share Posted July 26, 2012 (edited) I dare either of you to turn your living room into the official Wildfire Games mocap studio. The programming related work would certainly be an interesting challenge. Edited July 26, 2012 by zoot Quote Link to comment Share on other sites More sharing options...
myconid Posted July 26, 2012 Author Report Share Posted July 26, 2012 Set up two cameras at 90 degrees, after a quick calibration the maths is pretty simple for getting 3d points out of 2d tracking.Haha, good luck with that. I'd use one high-quality camera, but try a method like this one, which is similar to what the Kinect does, but in 2d. I doubt you'd get the same quality of results as a 3d sensor, though. Quote Link to comment Share on other sites More sharing options...
quantumstate Posted July 26, 2012 Report Share Posted July 26, 2012 Haha, good luck with that. I'd use one high-quality camera, but try a method like this one, which is similar to what the Kinect does, but in 2d. I doubt you'd get the same quality of results as a 3d sensor, though.It would genuinely be really easy. The hardest bit is calibration, which in the spirit of all good maths textbooks is left as an exercise to the reader. Once you know the two camera positions for every point you now have two lines which it lies on in space. Just find the intersection point (or in reality the point halfway along the perpendicular between both lines). With two high quality cameras this should give good results. More cameras gives a more accurate point. Quote Link to comment Share on other sites More sharing options...
zoot Posted July 26, 2012 Report Share Posted July 26, 2012 Maybe some of our outreach guys would like to ask around in Kinect and computer vision communities? Don't know how fruitful it would be, though. But it certainly would be a boon for indy developers if it could be made to work. Quote Link to comment Share on other sites More sharing options...
myconid Posted July 27, 2012 Author Report Share Posted July 27, 2012 It would genuinely be really easy. The hardest bit is calibration, which in the spirit of all good maths textbooks is left as an exercise to the reader. Once you know the two camera positions for every point you now have two lines which it lies on in space. Just find the intersection point (or in reality the point halfway along the perpendicular between both lines). With two high quality cameras this should give good results. More cameras gives a more accurate point.Well, if you use high-speed, high-quality cameras and markers on the actors then I agree it would work (and even then, two cameras won't be enough).But $5 webcams? For full-body pose estimation? No way. Maybe for hand gestures... Quote Link to comment Share on other sites More sharing options...
Lion.Kanzen Posted September 25, 2013 Report Share Posted September 25, 2013 is possibly do it? Quote Link to comment Share on other sites More sharing options...
Radagast. Posted March 27, 2014 Report Share Posted March 27, 2014 I think it's possible. Though what about the flying animation. Any stunt(wo)man around? My worries are how to clean the clutter of animation data, so that the essential frames are still there. Otherwise filesize might be big, though I could be wrong... Quote Link to comment Share on other sites More sharing options...
Stan` Posted March 27, 2014 Report Share Posted March 27, 2014 I have a kinect at home. But before doing anything like this, you wanna make sure we will not try to fix skeletons. 1 Quote Link to comment Share on other sites More sharing options...
Lion.Kanzen Posted March 27, 2014 Report Share Posted March 27, 2014 I have a kinect at home. But before doing anything like this, you wanna make sure we will not try to fix skeletons. wow I hope we can. Quote Link to comment Share on other sites More sharing options...
Stan` Posted March 27, 2014 Report Share Posted March 27, 2014 I have swords too. And I can find shields. Quote Link to comment Share on other sites More sharing options...
Lion.Kanzen Posted March 27, 2014 Report Share Posted March 27, 2014 I have swords too. And I can find shields.I can try find ancient movement fightings like roman techniques.(HBO Rome, have good visual roman movements) Quote Link to comment Share on other sites More sharing options...
Radagast. Posted March 28, 2014 Report Share Posted March 28, 2014 But before doing anything like this, you wanna make sure we will not try to fix skeletons. Definitely, it's on my list. Don't worry .. Unfortunately I doubt it will make sense to do anything other than to wait for blender's GaiaClary to help us out. For Maya he already did. Perhaps we should go from 3DSMax to Maya and then to blender? Afterwards Kinect. Time will tell if it will multiply our efforts by hundreds. Quote Link to comment Share on other sites More sharing options...
Lion.Kanzen Posted March 28, 2014 Report Share Posted March 28, 2014 (edited) Today I read about a new version of Kinect.http://www.microsoft.com/en-us/kinectforwindowsdev/newdevkit.aspx Edited March 28, 2014 by Lion.Kanzen Quote Link to comment Share on other sites More sharing options...
Stan` Posted March 28, 2014 Report Share Posted March 28, 2014 I ´d need to get my hands on a trial of 3dsmax 2013 to get the open collada to work. This need to be tried since it is the best collada exporter. I ´m also looking at the settlers files and looking for a way to open anim files to see if I can find other exports formats. In the settlers files are dff´s openable by zmodeler (not zbrush) and anm file. I can open dff for they seem to match the gta sa format but i can ´t open anms nor export.I need to test collada import in blender 2.70.Export tooI wasn ´t able to find max 2013 but maya i can find do you know version he fixed ?About kinect i ´ll take a look at liońs post.I never tried to connect the kinect to my pc Quote Link to comment Share on other sites More sharing options...
niektb Posted March 28, 2014 Report Share Posted March 28, 2014 Are you a student? If yes, you can obtain a free students license via Autodesk.http://www.autodesk.com/education/student-software Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.