Can a dreaming AI fix low res digital photos in the edit?

Europe


Can a deep dreaming AI transform low res photos into crisply detailed high res images?

Let’s Enhance is an Estonia-based startup that’s using a so-called ‘hallucinating AI’ deep neural network to power a freemium photo upscaling service. On its website it claims the learning software “hallucinates missing details to make image look natural”.

It launched the online tool at the end of October, garnering a bit of early press coverage.  

I tried it out at the time but results seemed mixed and it was hard to judge how useful it might be without a proper use case to test it on.

So I bided my time and this month happened to find myself with just the sort of digital photo challenge that I thought the service might be able to help with — in that photos I wanted to gift as framed prints didn’t have a great resolution for producing a decent sized print.

 

Low res photo problems? AI to the rescue!

One of the photos was just a fun smartphone snap. But others were a bit more high stakes — being from a wedding.

And after attempting (unsuccessfully) to source their full res versions — attendees’ photos having been collectively shared after the fact via iCloud; and no one could apparently remember who had taken the specific shots I was after (or on what device) — I decided to run them and the more casual portrait through Let’s Enhance to see if I could boost the resolution and have a chance at turning them into gift-able prints.

The service is freemium and caps the number of photos you can run through it per day. It also locks out at 10 free photos total before you’re pushed towards one of its subscription plans. But as I only had a few shots to upscale I was able to run everything through the freemium gate without needing to sign up for a subscription or buy a cost bundle (which they also offer).

Each photo you upload to Let’s Enhance’s AI gets returned to you after seconds (or maybe up to a minute or two) of processing time in three versions, reflecting the different stages applied to try to AI-enhance it. So per photo you get three files back, which are given the following labels: Anti-jpeg, boring and magic.

The ‘anti-jpeg’ version of the image does not upscale the actual size — it just appears to lightly polish out some compression artifacts. Though I found its results to be pretty subtle, at least on the shots I tried and comparing original vs anti-jpeg images on a screen.

The ‘boring’ and ‘magic’ techniques always upscale the image by 4x so I was able to turn — for example — a 520KB digital photo file with a resolution of 898×1600 into 21.8MB with a full 3492×6400 pixels. So — in theory at least — the upscaled version could be printed poster sized.

The results from the boring and magic techniques applied to this particular portrait photo seemed visually impressive on screen. Though the portrait was taken at a fair distance and its cluttered graffiti stairwell background is probably a pretty forgiving canvas for concealing upscaling imperfections.

To my eye there wasn’t a huge difference between the two processing techniques when applied to this photo — the magic version produced a very slightly fuzzier result. But again, for this particular shot either file would probably have yielded a fine framable print.

The photos from the wedding were definitely a lot more challenging. Two of the original shots appear to have been taken with a smartphone camera of fairly standard quality, so while they look nice on a screen their low resolution of just 1024 × 577 meant the max size you could reasonably expect to print them would be a tiddly ~4-inches.

After cropping one of these shots to remove an incidental bystander and upscaling via Let’s Enhance the image came back with a resolution of 3408×2304. So at least technically large enough to produce a decent sized print.

An added challenge with the second image was that it had been taken at a distance, in portrait orientation, and I wanted a close up of the faces — which meant major cropping into a smaller landscape format and an attempt to focus on what had been pretty remote details to start with.

After upscaling and cropping I got an image with a resolution of 2182×1684. Again, in theory, a small print could work at that resolution.

However the AI upscaling had produced an effect that was definitely a lot more vaseline screen than fine outlining — doubtless on account of the original shot not being great quality to begin with.

Let’s Enhance CEO Oleksandr Savsunenko did warn me that: “If the picture is too much zoomed or pixelized, the system will ‘consider’ it as natural pattern and will not change it.”

So I wasn’t exactly expecting miracles. But even the slightly larger of the two photos did not look exactly crisp in terms of detailing after its AI trip.

Of the two processing layers, boring again appeared to have worked best — with magic resulting in a lot more fuzz/artifacts in both of the shots. Including giving the edge of what should be some skin a kind of fabric-style fringing.

That must be the AI pattern-spotter at work…

A third image from the wedding was a full res photo, so didn’t have the same quality problems. But again I was after just a cropped detail — so I used Let’s Enhance to upscale the crop to enhance its resolution. This mean I went from a reasonable 2032×2355 to a generous 8128×9416.

As well as being a better quality image to start with this wasn’t such a close up portrait so the upscaling seemed to work better here, especially across a cityscape/landscape background with the couple only being shown in profile. Although, here too, details on the magic version came out slightly fuzzier than the others.

Now, armed with my upscaled files — and at least a chance of some passable prints, I loaded the images onto a thumb drive and headed down to the photo shop.

 

So how did the prints look?

As expected, the upscaled crop from the high res original wedding photo came out well — in all versions I printed.

A 20 x 15cm print looked great and had clear and vivid details. A non-professional wouldn’t guess it was just a section from a larger shot. Although whether this was down to the AI’s skilled upscaling or really more a case of having a reasonable resolution to begin with for a print that size is less clear.

When it came to two lower quality original AI-upscaled wedding photos, the quality of the ~6 x 4-inch prints I got back wasn’t great — reflecting the enduring fuzziness of the digital versions. Some of the darker skintones had also been given a weirdly grey-ish hue.

The less challenging of the two shots would be just about passable in a photo album. But neither print was gift quality. The portrait with slightly clearer detail to begin with printed up looking almost irritatingly just out of focus. At least to a human eye.

Clearly a hallucinating AI is no substitute for having a full res original.

That said, if you only have an average quality mobile snap to start with then you have to work with what you’ve got. And I’d probably been able to produce the best quality prints I could hope for, given the low quality source material.

The casual smartphone snap fared a lot better. A print of around 8 x 6-inches looked great framed up — and had especially impressive background detail.

The maximum size the print shop suggested for poster printing the image based on its file size was a full meter high(!). Which would clearly have been pushing it. I opted for a poster print half that size — and the resulting print definitely did not have as impressively crisp details as the photo print.

You could now pretty clearly see visible artifacting in the background graphics and graffiti — so I was definitely getting to the limits of what you can do with an AI-upscaled image at this point…

Even so, given the grungy subject matter, the poster still came out looking pretty cool overall. So for this use-case I was pleased.



Source link

Articles You May Like

Facebook shouldn’t block you from finding friends on competitors – TechCrunch
Pornhub now accepting cryptocurrency (CNET News)
Crypto-collectibles and Kitties marketplace Rare Bits raises $6M – TechCrunch
Data experts on Facebook’s GDPR changes: Expect lawsuits – TechCrunch
The Skagen Falster is a high fashion Android wearable – TechCrunch

Leave a Reply

Your email address will not be published. Required fields are marked *