Posts Tagged ‘HD’

High Dynamic Range Video: Part 2

Last week we discussed briefly the production of still photographs in high dynamic range.  Just recently, there has been some activity in doing ultra high fidelity video, using all the pieces of hi-def, plus increasing dynamic range and color bit depth.  Whether these technologies will make it into our living rooms in the near future is anybody’s guess, but they probably will see some type of implementation in the long term.

The upside we’ve already covered a bit in last week’s post.  Moving video to a dynamic range that more closely resembles what the eye is capable of perceiving is a good thing.  In the case of TV, it would resemble more “looking out the window” rather than at a TV screen.

The short video sample I posted last week was produced literally as a series of still HDR photographs (processed as I described last week), resembling more time lapse photography (which it truly was) rather than actual video.  If the same technique were to be used to produce video, the camera would need to take at least 3 pictures 24 times a second, or 72 frames per second to equal the current cinema standard of 24 fps.  (See discussion on this frame rate in this previous post.)  Then, that data stream would have to be processed in real time combining the over and under exposures of the same frame into one and sending it down the wire 24 times a second.  That’s alot of processing horsepower, and because of the complexity of the process, I do not think that this technique will ever be used for serious video production.

There are, however, those out there who are experimenting with High Dynamic Range capable CMOS sensors and associated A/D codecs.  There are some prototype sensors out there that are flirting with the 12 f-stop dynamic range specification, which is very close to the dynamic range of the eye.  But even with this vastly simpler technology, because of the additional digital information required, changes will have to be made.

One such camera is in the hands of Professor Alan Chalmers of the University of Warrick, UK.  With a 1080p resolution, his camera produces 24 meg of digital information per frame.  By my calculations, that would mean that a minute of footage would require 36 gig of storage space, and the superfast network architecture to support that storage/transmission.  This is 27 gig more per minute than standard uncompressed 1080p HD video.  Transmission and storage over existing infrastructure would require compression algorithms of nearly 100:1.  (See discussion of video codecs here.) That kind of compression, while theoretically possible, is certain to come with its own artifacts and compromises.

Production would also have to change.  As we all know, some actors and actresses have not benefited from the increased resolution of HD video.  This problem would be exacerbated in HDR.  More care (read money) would also have to be exercised in production of HDR; the guy behind the Rockefeller Center studio window making hand signals will be seen.

I personally hope that some of these technologies do take hold.  Increasing picture resolution through HD technology over the last few years has made a vast difference in the viewing experience for most of us.  I suspect that these next iterations of ultra high fidelity video have the potential to be at least as significant as hi-def has been in the last decade.  Present examples of this technology actually compress the tone-maps to make them viewable within present media constraints.  When/if genuine HDR television comes of age, we will see that HD was just the beginning.

More examples to view

Until next time….

High Dynamic Range Video: Part 1

I spent some time this past weekend mounting a couple of prints from my trip to my ancestral Montana home last summer for my office at work.  As an avid amateur photographer, I’m always trying new techniques to produce the strongest photographs possible.  One of my favorite techniques that I use quite often is known as HDR (high dynamic range) photography in pro and serious amateur photography circles.  It is a relatively new technique, though not a new idea, made possible by the strong digital processing options available to digital photographers today.

Here’s the thing.  If we are to consider the action of the pupil in the eye adjusting to varying light, the eye has almost 24 f-stops of dynamic range–said another way, we can see a starlit sky in the dead of the arctic night all the way to sun blazing off of a placid lake on the equator at noon-an increase of one f-stop essentially doubling the brightness perceived.  But even at a static pupil aperture, the eye can still detect between 11 and 14 f-stops of dynamic range, and we use the dynamic range of that wonderful instrument daily to see detail that no past or present camera (including film) technology can capture.

The state of the art dynamic range available from the sensors on high end digital cameras or video cameras today is about 8.5 f-stops–material outside of that shows up as either straight black or straight white.  So while an eye can look at a scene and see 11-14 f-stops of dynamic range, a digital camera/video camera will only detect slightly more than 8 f-stops, and because this is a logarithmic scale, this is a significant difference in performance.

The technique I presently use in my digital photography is to bracket three quick exposures, one under exposed, one properly exposed, and the final over exposed.  Both my cameras can be set to do this automatically, and both support “rapid fire” exposures–up to 8 frames per second.  So this can be done quickly as one is shooting the picture(s), but (and here’s the rub) these three negatives must then be combined digitally using computer processing techniques to create a single high dynamic range image.  In other words, almost 64 megabits of data from multiple negatives must be processed to create a single 20 megapixel image in HDR.  The results are stunning–detail that looks realistic to the eye when properly done.  Like anything else, this technique can be taken to the extreme and not all HDR pictures are particularly life-like.

So what does this have to do with my TV?  Most current video displays have the raw ability (if not the actual circuitry) to display dynamic range that simply isn’t available in most video content.  It is possible that the “next big thing” in video will be getting the content, storage, transmission streams, etc. to move to true high fidelity video (not just high definition) by increasing the dynamic range to something closer to what the human eye can perceive.  My sense is that this element may be more important to video cognoscenti than 3D in terms of actually enhancing the video experience.

Next week, I’ll discuss the fine points of this future technology and the ramifications to the industry should it be adopted.  In the meantime, take a look at this sample of HDR video–understand it’s highly compressed and just a rough approximation of what is possible, but very intriguing nonetheless.

HDR video sample

Until next week….

3D Pundits-Gotta love ‘em

In followup to my post last week, Studio Daily, a great web site dedicated to the professional motion picture/audio industry, has posted the latest forecasts for sales of flat panel internet-enabled HDTVs.  Interestingly, from a professional group who has heavily promoted the idea and pushed acceptance of 3DTV, they are now willing to admit that for this year anyway, sales of 3DTV are a bit of a “bust”– 4.2 million 3DTV units contrasted with 27.7 million units of Internet Enabled TV (IETV).

“Despite aggressive promotions from the industry and intense consumer interest generated by the blockbuster Avatar and other titles, the 3D TV market in 2010 will be limited to a small pool of enthusiastic early adopters,” said Riddhi Patel, director and principal analyst for television systems at iSuppli. “In contrast, IETV is entering the mainstream in 2010. This is because 3D is still dealing with a number of barriers, including cost, content availability and interoperability, while IETV provides immediate benefits by allowing TV viewers to access a range of content readily available on the Internet.”

Duh!!  Obviously a true statement, but I get the feeling that the industry in general and content providers specifically would much rather have had 3D enter the mainstream in 2010 rather than that “internet thing” where video has become something of an industry phenomenon.  Loads of “free” (You Tube) and “commercial reduced” content is made available on the internet, ironically by many of the same content providers who extract premium prices for the same content from cable companies and other more traditional distribution mechanisms.  I’m not complaining, particularly as a consumer, but it points out the schizophrenia that is rampant in the business at present.

As I’ve discussed before, 3D will enter the mainstream if and only if it is embraced by a broad consumer spectrum.  My sense is that consumers may not be willing to pay a premium for 3D equipment and content.  I’m already seeing that at my local theatre–it has one screen playing a local 3D release in 3D (at a $3 price premium) and 3 other screens playing the same release in 2D.  Local folks don’t seem that enamored by the experience, particularly at $12+ per ticket.  (Having said that, IMAX has proven that there is a niche for “enhanced” visual experience, and one of my local theatre contacts indicated that there seems to be some customer excitement when those two technologies are combined, even at a $5 price delta.)  The question remains as to whether 3D will be accepted as mainstream, or simply remain a niche for certain content.  Message to industry–if the primary goal of 3D production is to extract additional profit as opposed to truly enhancing the visual experience on appropriate content, good luck on selling that to a broad consumer base.

Until next time….

Video Servers–TiVo

A couple of years at the NCTA (The Cable Show) I spent some time in the TiVo booth, talking with representatives of the company on how they were moving their product forward.  At the time, I was struck by the elegance of their on-screen GUI, the intuitiveness of their remote, and in general, the direction the company seemed to be heading.  Like the SA/Cisco DVR, a TiVo box is not a server in the classic sense of a DLNA based system, (more of a client really), but, like AppleTV, can function as a server for a single video system.  TiVo has enough uniqueness that I feel it bears some discussion here.

TiVo is representative of an increasing trend where video consumers purchase hardware that allows access to a number of digital video and music sources; i.e., cable, Netflix, YouTube, Amazon, etc.  TiVo can function as a classic DVR, with the full feature set associated with that device.  But in addition, all of the new TiVo products are internet savvy, which allows access to popular digital sources available on the internet as well.

One of the most controversial aspects of TiVo is the monthly subscription fee, which, unlike cable video services or Netflix, does not buy access to any content.  It only buys access to the programming guide which is tightly integrated into the DVR system.  Cost per month varies from about $12.95 to a little under $7.00, depending on how long a contract is chosen.  Without the service contract, according to TiVo, the box “will have very limited functions…the only thing you would be able to do is record live TV.”  Basically a paperweight…

While as mentioned before, the box (currently the Premiere® or the Premiere XL®) is well designed generally, there are a few goofy things that should have been anticipated by the company.  For example, it lacks a built-in 802.11n network access point, and, if you want the internet enabled features over wireless, you must plunk down another $90 for the external adapter (another wired goober to hide somewhere).  If you have wired ethernet near your video set up, no problem.  But this is a design flaw that the company should have anticipated with its new set top design.

Most of the folks I have talked to that have the TiVo service think it’s great–it enhances the experience from cable, Netflix, and other video services.  The TiVo system does have a 30-day money back guarantee.

As we have covered some of the new generation HD sets available, it appears that many of them are incorporating internet savvy applications to access video content from a number of sources.  I’m anxious for the day when it will be possible to interface an external hard disk to the TV, and DVR functionality would then be part of the set’s interface.  That may not be that far off.

In the meantime, TiVo is a viable option out there to increase access to and usability of digital content in a sophisticated home theatre set up.  Whether it’s precisely the best alternative for you (as a video server or client) depends on your needs and tastes.

Until next time….

Video Servers–Apple TV

Last week we discussed perhaps the most ubiquitous video server technology out there–the DVR.  This week, we’ll discuss Apple TV, a fairly mature video server/client technology that has fairly widespread deployment throughout the country.  Again, the basic functions of a video server are to record/download content, store, catalog, and retrieve for viewing.  External to this basic definition, there are a host of feature sets that are attached to various approaches in this space, and Apple TV is no exception.

Apple TV meets the basic definition of a video server, but it can also function as a client in that it has the ability to tie into video content from several computer systems (which then act as the servers) to which it is linked via wi-fi or ethernet.  Apple gives the user access to any video content nested in iTunes (on either a PC or Mac platform), plus YouTube and content from the iTunes Store.  The device gives you the choice of either streaming from or syncing with a primary computer system, plus gives streaming access to all content on additional computers on the network as well.   This includes music, video, podcasts, photos, and other digital content that a user might wish to access on the primary theatre/sound system in the home.

In typical Apple fashion, the interface is intuitive, and set up is pretty easy.  As alluded to, the Apple TV can be a self contained server for a single video system, or it can act as a client for content stored elsewhere on computer systems in the home.  The one thing that it can’t do is record “off air” like a DVR or TIVO.  It is primarily designed as a portal for commercial free, costed content out of the Apple Store, or to access other digital content from YouTube or other mpeg-4 files stored locally within the home on various computers.  Video quality is excellent (particularly in HD), and the user experience is very straightforward and satisfying.

Additional specific features include:

1)  Ability to do full discrete Dolby 5.1 sound, if the source material was properly encoded.  (most of Apple’s “available for purchase or rent” content is 5.1, but other sources may not be)

2)  Full wi-fi capability.  If your local home network is 802.11(b,g,n) compatible, no additional wiring is needed to either stream or download content from local computers or the internet.

3)  That famously simple Apple interface–Very simple remote operation with a handheld the size of three postage stamps laid back to back.  Also, there’s a nice (free) app out there that let’s you control AppleTV with your iPhone, iPad, or iPod touch.

Some have described Apple TV as an iPod on steroids.  I don’t necessarily agree with that assessment, but I do wish that Apple would do more with this product.  Here is my specific wish list:

1)  Support for Netflix and other video streaming sites available on the web.

2)  Support for 1080p content.  At present, Apple TV only supports 720p content–still great video, but technology marches on.  Even my home videos aren’t in 720p anymore.

3)  Support for add on QAM or ATSC tuner(s) that would allow recording from linear broadcasts.  This basic DVR functionality would allow users more flexibility in content choices.

I suspect that my suggestions are antithetical to Apple’s business model surrounding this product.  But I’d still like to see it happen.  Steve Jobs, are you listening?

Next week, DLNA servers…..