Thursday, July 30, 2009

Sitting Down with Rajiv Shah

It has been a busy past few months, but I recently had the opportunity to chat with Rajiv Shah, an adjunct assistant professor in the Department of Communication at the University of Illinois at Chicago, and the author of the Smart Cameras blog. Below are some of my answers to his questions around privacy, vendor comparisons, industry connections to academia and the future of the smart camera market.

Again, very excited to share them with the growing IHF readership. Feel free to make comments on any of the responses or questions, and I will be sure to address them.

Also, check out Rajiv's Smart Cameras blog -- it focuses on developments in Chicago's use of video surveillance, as well as other "smart cameras" that utilize additional sensors and/or computer processing techniques. Cool read and a staple on my blogroll.

1. Privacy: What should the industry approach be towards privacy? Should they incorporate features that protect privacy? Should they have default settings that protect privacy or delete information? Or should we not worry about this? Is there a need for an industry-wide approach to this issue?

Conventional wisdom presents ‘privacy vs. security’ as a zero-sum game, one in which gains in one arena necessitate sacrifices in the other. And while there is certainly much truth in this, it is also equally true that in a modern society neither principle can exist without the other. There can be no security without privacy, and no privacy without security.

Today, any meaningful national security failure could create a response that curtails our civil liberties quite broadly. And conversely, next-generation security technologies deployed without adequate privacy and civil liberties protections likely face the crippling backlash of a concerned public. As a result, the security industry needs to take issues of privacy VERY seriously.

For me, an approach to privacy in the context of surveillance starts with a few key principles designed (1) to narrowly tailor a system’s use and (2) to ensure that system access is adequately controlled and audited. Today, conventional “dumb” surveillance systems offer none of these benefits. A large video wall in a security room or command center does nothing to distinguish between security threats and the average person; these systems cast an unnecessarily wide net, relying on human expertise and interest to filter down to focus in on actual security threats.

The issue of what to delete or keep in terms of surveillance becomes much less important on systems where this kind of ‘all-or-nothing’ approach to data access doesn’t exist. For instance, on a 3VR, an investigator might search through many months worth of video information looking for matches or clues relating to the kidnapping of a little girl. However, because this query is done algorithmically using facial recognition, and because the search request is logged and audited, there is ultimately much less concern about the overall retention of video data. The public generally has very little problem with legitimate surveillance investigation that doesn’t subject them to what they feel is needless voyeurism.

Retention of video also becomes less of a concern in the context of new blurring and encryption algorithms designed to protect individual privacy. These new technologies prevent generally tracking and identification of the pubic using surveillance, while preserving the ability of law enforcement and security officials to detect and investigate crime. To better understand what I mean by this, you should take a look at the recent article in New Scientist on some of what we are working on in 3VR labs right now.

In any case, issues of data retention, encryption, access control and the like are often more policy issues than industry issues. Instead, our focus should be enabling decision and policy makers to make, monitor and enforce these choices themselves. Our solutions should present options to do all of this...and more. Today, most security solutions don’t include any privacy protections whatsoever. That needs to change; asking someone to chose between security and privacy isn’t much choice at all.

2. Comparing Vendor Solutions: What can be done to make it simpler for end users to compare and contrast different solutions? It's very confusing now for end users to sort through claims by tens of companies on effectiveness, costs, technology, etc.

Normally, I would say that the answer to this question solely involves the emergence of various standards groups, independent testing and analysis organizations -- that is because the best response to confusion is nearly always more good information. And, I do think there is some good news on the horizon in both of those areas with new security analysts, bloggers and agencies entering the marketplace of ideas every day.

However, because many new solutions’ claims today are so specific and require real-world deployment for actual evaluation, the only way for end-users to fully educate themselves may be through pilot and testing projects that they conduct themselves. New technologies being offered today represent a quantum leap over previous generations of security and surveillance solutions, and end users will ultimately need to make a very significant investment in time and money to educate themselves on their benefits.

3. Connections to Academia: Explain if anything needs to be done to expand the connection between industry and academia. After all, much of the engineering talent has come directly from universities. Are there any suggestions you have for universities and their research?

The disconnect between commercial markets and academia is a classic problem seen across many industries, but I have noticed is a particular problem in the security industry. And as a partial result, there has been comparatively little innovation at the core of this market in recent decades. The surveillance methods used to catch criminals hasn't changed drastically with investigators still found staring at video walls or fast-forwarding through video stores looking for needles in haystacks. Plus, the innovations responsible for rapid productivity gains in knowledge workers in other industry segments seems to have largely passed this industry by. Who are security’s Googles, Microsofts, and Oracles?

To begin to address this issue, I think that most importantly security needs to become the province of innovative and interesting companies again. Only by tackling big, tough and important problems can the security industry hope to lure academia’s best and brightest, or focus them on its problems.

As for universities and their research, there is one problem faced by the security industry today greater than all others…and that is a crisis of our own making. It’s “information overload.” There are quite simply too many cameras and sensors today generating way too much information today, and the resulting torrent of data threatens to overrun our entire industry. Identify ways to process and sort and make meaningful this flood, and you will have done us all a great service…and there is probably a job waiting for you at 3VR, as well.

4. Future Growth of Smart Cameras: Have cameras hit a period of steady growth or do you foresee a potential boom ahead? If so, what are the crucial factors that you see that are limiting growth of that will cause growth to increase? Do we need to improve technology, better end-user experience, etc.

Cameras have seen explosive growth already -- sales worldwide are booming. Not only that, but the general sense of a 'camera' is evolving dramatically; dumb cameras, smart cameras, cameras that record at 200 frames per second, cameras integrated with iPods – they're popping up all over the place and exploding in ways that people could not have anticipated. Not only are the types of cameras available growing exponentially, but the data being collected by cameras has increased by a geometric factor far beyond that. New cameras have higher resolution, higher frame rates. More of just about everything!

As a result, we're stuck drinking from the firehose for the time being. We're inundated with data and have no idea what to do with it due to the sheer volume we're faced with. It's coming in too quickly to comprehend, and as a result, we've discovered that it's not the volume of data you collect, but what you can do with that video (and how quickly) that matters.

The modality of staring at a wall of video screens broadcasting camera streams broke down a long time ago – and we're better off for it. However, as camera volume, quality and speed explodes, we need to figure out how to comprehend and process this volume of data. If we're going to manage the growth of cameras, they don't need to be smarter – we're already capturing more data than we need – but rather more searchable and enable efficient retrieval of vital information.

Labels: , , , , , ,


Tuesday, July 21, 2009

Face.com Launches New Photo Tagger

(Photo via ReadWriteWeb)

First Face.com brought us Photo Finder, which started the process of scanning through the 15 billion pictures on Facebook (9,000 images per minute!), and now ReadWriteWeb reports that the company is using the same facial recognition algorithm – the "hybrid descriptor-based funneled" model – to launch Photo Tagger. While very similar in nature to the original Photo Finder, Photo Tagger "...scans through select online albums to automate the tagging process" to speed up the monotonous process of tagging albums. It doesn't matter if the album is yours or a friend's – Photo Tagger will take care of the entire process and save you endless hours of manual tagging.

While I'm not sure how Photo Finder and Photo Tagger differ exactly – of course I have a few ideas – with more and more facial recognition technologies finding their ways to online photo services, I do know it will be tougher and tougher to hide your face online. Bad lighting, odd angling and unfocused photographs look to be no match for Face.com (and the plethora of other photo applications).

Labels: , ,


Thursday, July 16, 2009

3VR Featured in New Scientist!

This just in! Check out 3VR's image-scrambling technology in the most recent issue of New Scientist out this week.

I spoke with Paul Marks, New Scientist's chief technology correspondent, a little while back around our new method of scrambling CCTV images to preserve the privacy of innocent persons, and he discusses this technology in the issue out this week. Just another example of how we're bringing structure to the world of surveillance to eliminate the 'all-or-nothing' nature of such data collection.

Check out a longer post about the piece on 3VR's blog here.


Labels: , , , ,


Friday, July 10, 2009

I Can't Help It -- More iPhone MacRumors

MacRumors is back at it. Today, they're reporting additional patent filings around object recognition and facial detection extensions, continuing to push forward some of these technologies that I've posted about recently. While these take time to come to fruition, I can't help being excited -- the possible adaptations of these ideas are endless. Let's take a look.

The object recognition capability in which an iPhone would be able to "detect an object via camera, RFID sensor or other means and have their device automatically identify and provide additional information on the object" looks to be potentially quite useful. In the patent background, Apple used the example of an art museum:
"...a user might take a photo of a piece of art and wish to have it automatically identified and additional information on it provided, or engage in an audio tour or podcast and wish to access additional content beyond that provided in the audio files."
Think of all the possible ways to leverage this technology -- other than trying to distinguish between two pieces of art, maybe you can use it to uncover the name of that actress in the recent blockbuster movie that you can't recall but swear looks familiar. Or perhaps you will be able to identify the name of a certain wallpaper color swatch -- and be able to access its brand, serial number and all retail locations withing a five mile radius. Well, both of those might be a bit far off -- not sure the iPhone camera can yet detect the subtle difference between eggshell and off-white or has facial recognition capabilities on par with those of 3VR, but you catch my drift. ZDNet also noted using the technology for price comparisons between retail products.

As far as facial detection developments, it seems that iPhone engineers are indirectly attempting to remedy the device's often woefully poor battery life. New patents look to "determine whether a user is passively interacting with the device" -- meaning not watching the TV show they've downloaded or listening to a song on iTunes -- and if so, turn on a screensaver of some type (similar to the setting on a normal laptop or desktop) to save energy. The iPhone would use its internal camera to detect a user's presence, and while the idea may be antiquated, bringing this technology to a mobile device will be welcomed with open arms.

Labels: , , , , ,


Thursday, July 2, 2009

Are You the Next Susan Boyle?


MacRumors is leaking information about a few new patents that were recently filed. Intriguing stuff.

I wrote about a patent for a biometric reader to secure Apple devices with either fingerprint or facial recognition, but it looks like Apple will eventually add command functionality from fingerprint patterns.

Want to delete an email? Simply touch your index finger to the screen. Need to compose a new email? Use that pinkie finger. Sick of a song playing in iTunes? Your ring finger can take care of that and seek to the next song. Very cool.

The other patent (related to my previous post) is a RFID reader. As MacRumors divulges:
"Finally, the last notable application covers the dual use of a touch screen as an RFID reader. RFID tags are small circuits that can be embedded in objects for identification using a special reader. Apple suggests that the an RFID antenna can be placed in the touch sensor panel itself, allowing it to also be used as a RFID reader. As RFID tags become more prevalent, this could add a very useful function to future touch screen devices."
There are also rumors of haptic feedback -- essentially, display technologies will allow for tactile feedback from touch screen displays so users can "feel" different surfaces as their finger moves across it. As MacRumors explains, "As an example, a display could include a virtual click wheel which vibrates at a different frequency as the center. Users could easily sense the difference and use the click wheel without having to look at it."

Warm up those pipes, because also in the works a karaoke-like application that provides feedback on tone, pitch and overall quality of singing ability. No need to try out for American Idol anymore -- you'll be able to use iPhone rather than audition in front of Simon Cowell to know you're no Susan Boyle.

Labels: , , , , ,


Latest Posts