Labels

Sunday 21 October 2012

How to create a Virtual Character.

What makes a Virtual character 'Real'?

'Hideo Kojima', the Designer behind the 'Metal Gear Solid' games has sparked my interest this week and as it's been a while since my last blog I thought I'd turn this into a larger look at the challenges behind Virtual Characters.

Which Avatars have sparked your imagination - from Film to Science to Games - Use the comments section to let me know examples you can think of and why you think they stand out. :-)

Graphics
Often when asked what makes a virtual character Look real people talk of about graphics or animations. After all it's difficult to consider a character real when they're made of a few hundred polygons with boxed shaped heads. But now characters are can be so detailed that the Uncanny Valley is also mentioned. This  - where we might have a character look 'realistic' yet something doesn't feel right the 'illusion of life' can suddenly drop away (often leaving a very surreal mixed set of emotions with the viewer). Picture for example a character that could look real in still motion but suddenly feels very false when animated. Even a crooked smile can destroy the best of models.

Personally I feel Benjamin Button [VFX by Digital Domain : Directed by David Fincher in 2008] is still one of the best examples of a believable character. If you've not seen it I highly recommend the film. Here's a sneak peak behind the scenes into its effects.

But films can afford massive computations to create each frame - Real-time graphics have to be generated in around 1/30 of a second! Hence different techniques are used. Here's another of my favourites from the same year as Ben' Button [2008] showing Nvidia using multiple texture composites to create a real-time head [a method similar to modern games which use deferred rendering with multiple passes of screen renders]

Computer Games have also advanced with their animation - from marker based motion capture, to phosphor painted or videoed actor faces recording subtle skin movements, ie performance capture.

Here's a good example from 'Janimation' of human facial expression/animation being retargeted onto a CG character using marker based motion capture im 2011. Or take a look at the cutting edge performance capture tech' used behind the game L.A. Noire in 2010


Intelligence
Hold on a minute though. There is a key difference between film and other forms of avatars. It's one thing to watch a character that has been skillfully crafted and presented to us by a whole gaggle ['technical term' ;-)] of artists, but what happens if we can interact with it. The best looking virtual character will seems pretty dull if it responds to us like a 1970's robot.

One way to see how well a computer can mimic human behaviour is the Turing test. Essentially this is measured not by the avatars behaviour but our response to it. ie If 'we' can't tell that a computer is controlling it then it 'must' be behaving like a real person... Hmmm. Personally I don't like this test and find it quite flawed. Nevertheless it has been used many times.

It used to be said that a computer could never beat a Grandmaster at chess. This was because although it was relatively easy to program it to follow the rules of chess, to play at such a high level requires a deeper understanding of the human psyche. So it was quite a shock to many when IBM's
BigBlue defeated Gary Kasparov in May 1997.

I find it interesting to note that this 'test' was measured over a 'game' of chess... So perhaps it is not surprising to find that on the 27th September 2012 a computer games "bot" passed the Turing Test, as it hunted down and killed opponents in a video game was judged to have displayed behaviour that was indistinguishable from a human. Something many had said would be 'impossible'...

If we take this notion a little further we can see computer 'intelligence' [mimicking behaviour] spreading wider afield. For example this summer Google set a new landmark in the field of artificial intelligence with software that learnt how to recognise cats, people, and other things simply by watching YouTube videos . This takes us into the realms of 'learning behaviour' and neural networks... something I'll come back to another day I'm sure. What will it mean when search engines adopt 'intuitive behviour'?

Games are often the first adopters to new technology and being able to 'deliver' realistic and believable character to our living rooms has been a dream goal to many a developer. How though will this effect us - We may accept Tamagotchie's needing feeding, but how would we respond to a computer not wanting to play because it feels a little down..? ;-)
Microsoft have skirted around the concept of realistic avatars several times. In particular
'Project Natal' [June 2009] gave us a glimpse of what may be to come.

Character & Personality
The true beauty of this technology for me is that we are at last able to put to test the subject that philosophers have debated for 1000's of years. What makes us human and how do we define 'the person'. Modern culture refers to us as 'Mind, Body and Spirit'. Perhaps this is why Virtual Avatars are following the same path. ie Body = Graphics, Mind = Artificial Intelligence, and Spirit... hmmm this is a more tricky one.

If we are make a virtual character believable it not only must be visually detailed and 'perform' as if it has an 'awareness', it crucially needs one more thing. 'Spirit' - and how can we recreate that?
Well perhaps this can be represented by the traits which we associate with a persons character of personality. Do we care about the character enough to value their 'life'. This, imo, is the real challenge behind making a Virtual Character believable - sure we need the graphics, animations and A.I. (artificial intelligence), but can we go further? I say yes we can but it may not be quite the way we might imagine it to be. Just as with the Turing test, we may only need to mimic personality in order for us to believe in it. After all how many people name their cars and anthropomorphise them?

Video games have a unique angle upon the person who interacts with them. Not only the 'percieved freedom' but also the length of time a player will invest into a game; long enough to create an emotional bond or attachment to the characters they 'play' with. For me Video Games will take another leap forward when we truly care about the characters in them. Perhaps my favourite examples of this to date have been:-

GTA IV: Grand Theft Auto, a game more usually associated to violence and scale. Yet I would argue this scale/backdrop provides a depth that we need to relate to one another. And the huge range of interactions with the game mean the virtual world does not appear to be linear, as such the player allows themselves the subconscious freedom that 'autonomous' players are always going about their business. This is illustrated beautifully when in GTA IV the player is asked to kill another character, but they are given a choice. This is crucial as in that moment the ground is unclear - we have been taken away from a computers Ones and Zeros. If the player does not shoot, or does, the game [ie your character journey/'life'] will continue. There is no 'play again' option, instead there is a sense of forging ones destiny. You 'choose' your Fate. Simply gaming genius imo.

Heavy Rain: For me, this was one of the most beautiful games ever made. An example, similar in execution to GTA's but forced upon the player early on. Your character has two sons and you are out with them in a simple shopping mall. packed with people... Your son has a balloon and, as must be one of the most frightening nightmares for parents, you suddenly find that your child is missing. Fighting through the crowd, chasing after a balloon in the distance, the camera sweeps as you are buffeted between the shoppers... I found this to be genuinely heart racing - 'careing' about the safety of this vulnerable child. Again the player is given a situation - find your son or not... the game will continue either way. Consequences upon your actions but ALSO upon your emotional attachment to your virtual character. Would you feel guilt playing a character whilst also feeling/knowing that you were responsible for loosing their/your son?

Pushing this even further and returning to where I began. Hideo Kojima's talk was about Metal Gear and a particular character that he introduced, which had traits from a real person he knew in his life. He made this character behave in ways more 'real' than any other (for example, calling when you were busy and talking about their problems, rather then fixating upon yours). Curiously this was the character above all others which people/players rejected... It seemed that being real was not what people were after in an escapists world... I really recommend listening and reflecting upon this fascinating observation.

Conclusion
So what does this mean? Is there a point when 'real' becomes 'too real'? Do we desire 2 dimensional character in our virtual 3 dimensional worlds? Do we seek clarity in quality and avoid ambiguity?

I believe the answer is that, just as in real life,  we cannot separate the character from their context/surroundings. How often have you asked a persons 'how are you' simply out of politeness. We choose when to be intimate and share ourselves with others. In this was so too will our virtual characters of the future need to adapt their virtual behaviour to their surroundings. Then tomorrow's game designers will really have something to play with. Imagine fighting alongside your team mate only to find out their motivations are different to yours, or having to live with the remorse shown in other characters over 100 hours of game play, due to your actions. Consequence and Context will imo define tomorrows game play.

And Finally... what of the individual character. When they look and move as real as us, How will we judge them? To project personality upon a virtual character takes one more special trait imo. Integrity. A belief that the character will react in ways that mimic all forms of human emotion. Based upon their surroundings, history, personality and more. To create a truly believable virtual character will need lots of work, far more than an a SubSurfaceScattering rendering of skin. But just as movement can be synthesised (eg Natural Motion endorphin engine) so to will these other qualities...

It it my belief that the Uncanny Valley is only the beginnings of what we will experience with our virtual characters. hmmm perhaps I should create my own Turing test... one for the 21st Century and our virtual worlds. ;-)

---phew, that's a blog and a half--- If you're still with me, please share your thoughts/comments in the box below. Can you name any cool virtual characters? :-)

Tuesday 9 October 2012

Kinect on your wrist!

Microsoft have just made a mini Kinect that fits on your wrist to scan and record your hand/finger positions Pretty nifty if you ask me... To see their tech in action take a look at this video on the  'Microsofresearch' youtube channel

For me, Kinect is very cool tech'. Not only did it take a whole motion capture studio and placed it inside a box, but it's also cheap enough to be bundled with a games console... Sure, I know some will argue that it's not that accurate, but you know what - there are always those wanting to spread doubt.

This new device is why I find Kinect cool - not because of what it can do, but because of what it will do. Remember Kinect is still the first version (2nd if you count the PC version). There are other companies making similar devices - in fact, this tech is not new at all... but it's packaging and delivery to the mass market is a game changer on many levels.

In a couple of years it's likely that Kinect 2 will be out with improved accuracy, finger and face recognition. From this there will be all sorts of applications (and some social questions too - not least Health and Safety) - A revolution of sensor/positioning/gesture/scanning tech is about to happen imo and even more importantly this revolution will combine these multi-disciplines in to one single product.

From mapping our world through LIDER (Light Detection And Ranging) as I mentioned in my 'Mapping the Future blogpost on the 25th September 2012' to Disney's new Augmented Reality Cake patent (!) This can of worm's has only just been pierced. Some-one hand me a can opener! ;-)

Friday 5 October 2012

3D Printing - Who pays the postage?

For those of you who don't know '3D printing' is a magic process that makes something from nothing.

Ok ok, maybe there's a little more to it than that... Most stereolithography (to give 3D printing its proper name) builds a real tangible object, by solidifying a gel one thin layer upon another. If an object (real or virtual) can be sliced up, then 3D printing can put it back together... But, don't limit your thinking - check my links below and you'll see the sky is much higher.

I've noticed quite a surge of news about the topic recently so thought I'd put together a few news articles too. Before I list them though - I can remember a 'think tank' (hmm - I wonder if we could map/print thoughts one day?) saying that in 40 years printing objects will be as common as sending emails... well I don't know about that, but I do think if we said 40 years ago that we would communicate through emails and text we'd be seen as crazy. So you never know...

03-10-12 Printing Guns... Warning: Red Alert.

03-10-12 Printing toys and LEDs - Disney Attacks!
13-08-12 Don't want to wait for you model to be delivered - build your own printer!

02-08-12 Virtual Characters come alive - Print your own virtual avatar!

02-07-12 Feeling Low? Print with Sugar to make a new Liver (Onions still need to be bought)

06-04-12 Feeling Hungry - Print with Chocolate!
http://www.bbc.co.uk/news/technology-17623424 

So, what will this new printing age mean to us? Will we really be as keen at 3D Printing as we are with emailing? Perhaps cost will be a factor, or maybe acceptance? I find it curious that last week the BBC ran two stories on the subject and chose to use toys and guns? One thing is for sure. The costs are tumbling and there are even machines now that can print themselves - maybe the phrase 'parts and labour' will be replaced with 'Printing and Labour' - although I suspect the use of these machines will be more related to the materials they use rather than cost (what good is a washing machine part made of cheese - other than a tasty sandwich).

Imagine a car showroom where you design your dream car and as you sip a coffee it gets printed next door... 'sounds like science-fiction? We'll see...

Saturday 29 September 2012

Vimeo / Video anyone?

I thought you might like a video?

Whilst Youtube is the Internet Video Behemoth there are other video sharing sites out there - so here's a couple 'inspirational tech vids' that caught my eye recently, from Vimeo...

Giant Spiders - A 'cute' video projection method to give the illusion of real life giant spiders. I can't help but think how this would be if set up in a room with 100's of Spiders projected crawling out from the TV - sounds like a great game/art sequence to me [btw - If Capcom add this to future Resident Evil game remember where you heard it first ;-)]
https://vimeo.com/37176398#

Secondly a warning to us about out reliance upon computer tech'. Don't get me wrong - tech has so many applications, I'm not so much fearing what would happen if it was wiped out - For me it's more  a question of if we need to live our lives in a digital or analogue state? Can't we have both..? Anyway the vid's quite cool too. Enjoy!
https://vimeo.com/49425975

Friday 28 September 2012

4K TV anyone?

A while I mentioned Sony's 4K TV ['4x fullHD resolution - 3840x2160'] hitting the mass market.
http://www.digitalartsonline.co.uk/news/video-post-production/toshiba-plans-three-4k-tvs-next-year/

While some might argue that the content isn't available yet - that's always going to be a 'chicken and egg issue' - The sooner the TV's are out the sooner prices can fall and content can be made available for all those hungry consumers...

Hence now we have Toshiba following up with the promise to release 3 new 4K TV's next year (upto 84"). Compare this with the introduction of the first LCD's and I'd say in 3-5 years 4K TV will be affordable for the mass-market. I guess we'll have to wait to see for sure - but personally I'm looking forward to 8/16K displays - it's not that I need a larger screen - it's more that I'd like to drop the notion of a TV completely and replace it with an interactive wall. A true window upon the world...

Oh and as far as lack of content goes rumours are flying around that the New Playstation(4) might support the format. LARGE screen immersion may be sooner that you think...

PS - I wonder when TV's get so big and the images so clear that we stop to think what we're looking at on them..?

Living on the Edge

Well Adobes new Web Animation software has finally been released - even more impressive is that it's free to use! (for the first version - but you will need to register a free Creative Cloud account 1st).
http://www.adobe.com/aboutadobe/pressroom/pressreleases/201209/092412AdobeCreatetheWeb.html

So what is Edge? Well, Adobe won't say this out loud, but it's the 'the replacement' software for Flash. Ever since Apple decided that it didn't like Flash (boo hiss), Adobe have been in a little trouble... Not least as Apples move gave Flash a bad rap, when imo it's pretty good software. Part of the confusion came from Flash being such a general term, from the software, embedded swf files, movie players to full blown games. Flash is capable of so much in the right hands - and despite its criticisms it did dominate the internet when it came to delivering movies...

Yet time waits for no developer software... So when it comes to creating animated content for web pages a new tool is needed - and Edge looks set to become a new standard. With an interface similar to Flash, combined with a timeline more akin to AfterEffects, Edge gives a familiar interface and controls. Yet under it's surface, actionscript has been thrown out and replaced with HTML, CSS and JAVAscript - compatible with 'modern' browsers and rich in features.

So what are you waiting for - go check it out (oh and btw - Adobe pay me nothing for this - lol)

Tuesday 25 September 2012

Mapping the future...

[ Update! Here's a link to MIT's own video showing their 'mapping monster' in action... http://www.youtube.com/watch?v=SY7rScDd5h8&feature=g-all-lik ]

It's amazing to me just how mapping technology has moved forwards over recent years. It wasn't long ago that technology like 'GoogleEarth/Maps' would have been considered as spying...

Now look - not only can we can view almost anywhere around the world from from space whilst in our own homes but it's overlaid with multiple layers of information. From terrain mapping to your local coffee shop... it's amazing, yet this is where we are now. What about in '10' years time?

Today it's reported that MIT have 'bolted together some' tech to allow a wearable 3D scanning mapping device. http://www.bbc.co.uk/news/technology-19716723 Whilst much of the tech is quite basic combining it and making it portable opens up a whole new box of magic.

There have/are projects that combine photographs taken by mobile phones in giant global database of location based imagery. Other companies collate information to present within mapping systems, but what would (will?) happen if MIT's device one day gets miniaturised and placed inside mobile phones or a pair of Augmented Glasses? [or in the very least driven around like one of Google's photo mapping cars].

Picture if everyone way able to create a 3d model/scan of where they go - Then picture that information being collated into a giant database... A Real World Detailed 3D model of the world! Every city, street, office block, building and even the rooms inside... Even the items in the rooms!!

This would truely be revolutionary. Who would own such information? How would it be used?

If this sounds to far fetched then go back 30 years - look at the progression of the Internet, mobile devices, mapping - consider the rate of change in computing power. Consider the change between a paperback map book and our ability now, to view street photos on GoogleMaps tracked in realtime to your position... Perhaps then this will not seem a question of if, but when.

3D Maps and our connection to them is only just starting... ;-)

Monday 24 September 2012

Electronic Arts - More jobs - less work?

For those new to the Games Industry, if you want evidence of it's fickle nature take a look at EA's recent ups and down...

300 New Jobs in Galway - 18th September
The other day EA announced 300 New jobs in Galway in the republic of Ireland (read 'tax incentives'). Yay I hear Developers Cheer - More Jobs! - but wait - read a little closer and you'll see that this is for 300 jobs at it's 'Customer Service' centre... Hmm...
http://www.bbc.co.uk/news/business-19638173


Developer's Studio Closed
So, days after EA announce new service centre jobs (with headlines on the BBC) EA announce the closure of  PopCap's Dublin Studio. I wish the '100' Developers good luck on finding new work.
http://www.develop-online.net/news/42047/EA-closes-PopCap-Dublin-studio

PS - Last year PopCap was bought by EA for $750... Fickle? You'd better believe it.


Tuesday 11 September 2012

Looking Back (to see ahead)...


I announce this Blog Open!

Well it’s been a busy summer. From a ‘Visual Technology’aspect the Olympics were staggering. I’m still amazed at how smoothly and accurate the athletes were filmed, not to mention the funky stereoHD cameras being used (it’s not often you see the cameras themselves on the screen).

As technologies have been continuing to advance and promise cool new applications, the global economic situation seems to be taking its toll upon the Interactive Media Industry with many companies closing their doors for good… Let’s just remember that as one door closes, another further ado I announce this blog ‘open’ and offer you a few ‘virtual’ headlines that caught my eye one opens.

So let me start this blog taking a look at and reflecting upon where we are today. By understanding past events and watching trends we’re more likely to be prepared for those ahead. So with no recently. Enjoy.

 

REALTIME GRAPHICS

Realtime Global Illumination - 25th Aug
Lighting is cool – everyone knows that. Take something ordinary and light it up to make it sparkle! The same goes for CG – Even a basic model can become beautiful when it’s lit/rendered well, but the more accurate lighting systems used the longer render time takes. Global Illumination bounces light around a scene to produce High Quality renders – but you’ve usually got to wait a day or so before you can see the results… Or do we? Check out this new method for GI.


 

Unreal 3 on a Tablet - Aug 29th
Computers keep getting smaller and more powerful and the same goes for Games Engines… Here’s Unity 3 running on a Tablet! It wasn’t long ago that you needed a High End PC to run this and tablet were good for propping upon the freezer door on hot summers day. ;-)
The key thing here is that this tablet is simply based Upon Nvidia’s Tegra 3, bringing high end 3d graphics ‘general’ hand held PC’s - ‘should make for some interesting new games when matched with a Tablets free roaming ability…



 

 

HARDWARE 'SUPER-SIZED'

4k TV for sale - Aug 31st
How are you doing with that brand new HD TV? Prices are dropping every day, but wait a minute, just as displays have changed from Cathode Ray to LCD/LED/OLED and we’ve grown accustomed to larger/thinner displays there’s a new kid on the block. Whilst there’s been talk of resolutions to supersede HD for years, Sony’s first 4K [4x full 1080p HD) TV has gone on sale. Of course, you might need a new home 1
st to get the 84” monster through the door… [curiously rumours are flying about the PS4 supporting 4k too… let’s remember how the PS3 was an early adopter of ‘regular HD’]


 

8K TV approved 24th Aug
Did you rush out and bye Sony’s new 4K TV? You probably wouldn’t like to hear that the 8K standard was approved by the UN only a week before…


 

ECONOMIC REALITY

Psygnosis Studio Closed - 22nd Aug
‘Times are hard’ – No more proof is needed than Sony shutting down ‘Psygnosis’[Developers of the playstation classic ‘Wipeout’]. Being one of the UK’s oldest video game studios it just goes to show that you’re only as good as your last game…


Autodesk Lays off 7% of Entire Staff - 23rd Aug
Following on the heels of Psygnosis being closed Autodesk [The largest creator of 3d creation software in ‘the universe’] also announce Laying off 7% of its entire staff. What influence will this have upon our tools and their development I wonder?


‘Fuel VFX’ into Administrationon avengers/promethius – Aug 28th
After completing FX work on hits such as Prometheus, Mission Impossible and The Avengers, Fuel VFX have closed their doors… 100 talented staff from the Film Industry follow those Games Developers above.


 

WHEN GOLIATH'S CLASH

Apple Vs Samsung - 25th Aug
So is the unending legal battle over? Who copied who? Who got caught? Who Cares? Well obviously Samsung is a little concerned, now that a US court order it to pay Apple $1bn… (ouch!)


 
Samsung Vs Apple – 31st Aug
Hubba Hubba Hubba – Who do you believe. After the US ruling in favour of Apple, a Japanese Judge has ruled in favour of Samsung. Hmmm… Law is a funny thing. ;-)


 
Google Vs Apple – 10th Sep
Ah, I remember the old days when it used to be Intel Vs AMD, or AliasWavefront Vs Discreet… Hmm, Whenever you look back there are always Big Companies battling it out, but what happens to the tech behind the battles. How will the winners shape our futures… One of the New Battles will be for Virtual Maps. We often forget how powerful and precious maps have been and now with integrated 3d Models with Augmented reality we’re really seeing the Industry Goliaths fighting to plant thier Virtual Flags!



 

CUTTING EDGE GRAPHICS

Knitting time - May 12th
Although a little time ago this tech’ to render knitted garments caught my eye. On the face of it a ‘knitted pattern’ simulator may not seem that exciting, but think of all the woollen materials in our world and how flat life would be without them. Anyway, ignoring that - it’s some great tech’ imo.


 
Realistic Hair – Aug 23rd
To complement the Knitting post, ‘Ornatrix’ have released new videos showing their Hair simulation software in action. Creating ‘organic’motion (hair/wool/fur/etc) has always been a struggle for the CG artist – it’s great to see these barriers being knocked down so that imaginations can finally be realised on screen!

 
 

That's it for now... Keep checking back for shorter but more regular posts. :-)

 

Saturday 1 September 2012

Stop living in the past - Come into the future Now!

Welcome to 'Virtual Whispers'
- Cutting edge Virtual Technology News and Views!

From Visual Effects and Software Advances to Industry News...
2d, 3d and Virtual - It's all real....

And while we're at it, between the news, I'll ask the odd question.
After decades of working in and around 3D technologies - It's time to share.
Hopfeully you will join me by adding your own comments and news...
Maybe together we can even make sense of this crazy Virtual World... ;-)