Warning: mysql_get_server_info(): Access denied for user 'indiamee'@'localhost' (using password: NO) in /home/indiamee/public_html/e-music/wp-content/plugins/gigs-calendar/gigs-calendar.php on line 872

Warning: mysql_get_server_info(): A link to the server could not be established in /home/indiamee/public_html/e-music/wp-content/plugins/gigs-calendar/gigs-calendar.php on line 872
Indian E-music – The right mix of Indian Vibes… » 2020 » February » 04

AI upscaling makes this Lumiere Bros film look new – and you can use the same technique

Delivered... Peter Kirn | Scene | Tue 4 Feb 2020 11:17 pm

A.I.! Good gawd y’all – what is it good for? Absolutely … upscaling, actually. Some of machine learning’s powers may prove to be simple but transformative.

And in fact, this “enhance” feature we always imagined from sci-fi becomes real. Just watch as a pioneering Lumiere Brothers film is transformed so it seems like something shot with money from the Polish government and screened at a big arty film festival, not 1896. It’s spooky.

It’s the work of Denis Shiryaev. (If you speak Russian, you can also follow his Telegram channel.) Here’s the original source, which isn’t necessarily even a perfect archive:

It’s easy to see the possibilities here – this is a dream both for archivists and people wanting to economically and creatively push the boundaries of high-framerate and slow-motion footage. What’s remarkable is that there’s a workflow here you might use on your own computer.

And while there are legitimate fears of AI in black boxes controlled by states and large corporations, here the results are either open source or available commercially. There are two tools here.

Enlarging photos and videos is the work of a commercial tool, which promises 600% scaling improvements “while preserving image quality.”

It’s US$99.99, which seems well worth it for the quality payoff. (More for commercial licenses. There’s also a free trial available.) Uniquely, that tool also is optimized for Intel Core processors with Iris Plus, so you don’t need to fire up a specific GPU like the NVIDIA. They don’t say a lot about how it works, other than it’s a deep learning neural network.

We can guess, though. The trick is that machine learning trains on existing data of high-res images to allow mathematical prediction on lower-resolution images. There’s been copious documentation of AI-powered upscaling, and why it works mathematically better than traditional interpolation algorithms. (This video is an example.) Many of those used GANs (generative adverserial networks), though, and I think it’s a safe bet that Gigapixel is closer to this (also slightly implied by the language Gigapixel uses):

Deep learning based super resolution, without using a GAN [Towards data science]

Some more expert data scientists may be able to fill in details, but at least that article would get you started if you’re curious to roll your own solution for a custom solution. (Unless you’re handy with Intel optimization, it’s worth the hundred bucks, but for those of you who are advanced coders and data scientists, knock yourself out.)

The quality of motion may be just as important, and that side of this example is free. To increase the framerate, they employ a technique developed by an academic-private partnership (Google, University of California Merced, and Shanghai’s Jiao Tong University):

Depth-Aware Video Frame Interpolation

Short version – you combine some good old-fashioned optical flow prediction together with convolutional neural networks, and then use a depth map so that big objects moving through the frame don’t totally screw up the processing.

Result – freakin’ awesome slow mo go karts, that’s what! Go, math!

This also illustrates that automation isn’t necessarily the enemy. Remember watching huge lists of low-wage animators scroll past at the end of movies? That might well be something you want to automate (in-betweening) in favor of more-skilled design. Watch this:

A lot of the public misperception of AI is that it will make the animated movie, because technology is “always getting better” (which rather confuses Moore’s Law and the human brain – not related). It may be more accurate to say that these processes will excel at pushing the boundaries of some of our tech (like CCD sensors, which eventually run into the laws of physics). And they may well automate processes that were rote work to begin with, like in-betweening frames of animation, which is a tedious task that was already getting pushed to cheap labor markets.

I don’t want to wade into that, necessarily – animation isn’t my field, let alone labor practices. But suffice to say even a quick Google search will quickly come up with stories like this article on Filipino animators and low wages and poor conditions. Of course, the bad news is, just as those workers collectivize, AI could automate their job away entirely. But it might also mean a Filipino animation company would face a level playing field using this software with the companies that once hired them, only now with the ability to do actual creative work.

Anyway, that’s only animation; you can’t outsource your crappy video and photos, so it’s a moot point there.

Another common misconception – perhaps one even shared by some sloppy programmers – is that processes improve the more computational resources you throw at them. That’s not necessarily the case – objectively even not always the case. In any event, the fact that these work now, and in ways that are pleasing to the eye, means you don’t have to mess with ill-informed hypothetical futures.

I spotted this on the VJ Union Facebook group, where Sean Caruso suggests this workflow: since you can only use Topaz on sequences of images, you can import into After Effects and go on and use Twixtor Pro to double framerate, too. Of course, coders and people handy with tools like ffmpeg won’t need the Adobe subscription. (ffmpeg, not so much? There’s a CDM story for that, with some useful comment thread, too.)

Having blabbered on like this, I’m sure someone can now say something more intelligent or something I’ve missed – which I would welcome, fire away!

Now if you’ll excuse me, I want to escape to that 1896 train platform again. Ahhhh…

The post AI upscaling makes this Lumiere Bros film look new – and you can use the same technique appeared first on CDM Create Digital Music.

Samplr, the genius sampling app for iPad, is also getting a long-awaited update

Delivered... Peter Kirn | Scene | Tue 4 Feb 2020 7:12 pm

Samplr, one of the best music-making apps on iOS, is getting its first update since 2014.

And how about that timing. If you asked someone to say “what’s the best live sound manipulation tool” for iOS, the two answers you’d like get first would be Borderlands Granular (for granular sounds) and Samplr (for loop manipulation). They’re both deeply intuitive, immediate apps ideal for live performance. But there was a long, bleak period where neither got updates – before this week, Borderlands Granular hadn’t seen an update since March 2015, and Samplr since December 2014.

Apparently Chris and Marcos ate at the same Waffle House and talked about the iOS SDK or something, because now we get a new Samplr release, too.

Samplr is just wonderful – a one-screen interface that lets you capture sounds, then freely loop, slice, and navigate them. It’s not a hardware looper stuck on a touchscreen, either – it’s rather really freshly designed around the touch paradigm.

Here’s me playing live with it in 2017. A kalimba and the internal mic (and my voice) were enough to make a whole set. (I also used the WretchUp app I helped develop with Mouse on Mars.) And that’s really what you hope technology would do for you – give you a chance to just explore your ideas with some freedom, to really improvise.

New in this version:

Ableton Link support. This is probably the best and most awaited feature, because it means easily syncing and jamming with other apps, with other iPads and mobile devices, or with desktop software – not use Live, but tools like Reason or even Pure Data, too. (Oh yeah, wait, SuperCollider? Let’s check. Yes, of course.)

Higher resolution interface – ready for the latest iPads. The whole UI is now redrawn at higher res.

New MIDI sync. Marcos says he’s done a ground-up rewrite of the MIDI sync support, so it now works much more effectively.

Fixed audio recording under iOS 12.

File import improvements. Full updated support for Dropbox and Audioshare, so you can load your own samples from elsewhere.

New, updated, high-res UI.

Marcos says he’s already started work on the next update. No word yet on AUv3 – it’s support for this on both Samplr and Borderlands that will make them more future proof. Heck, both these developers should set up a tip jar; some of us are happy, loyal users.

For everyone else, if you haven’t spent the few bucks on Samplr yet and you own an iPad, go do it. Skip Disney+ or whatever. Samplr is all the entertainment you need.

Still relevant:

The post Samplr, the genius sampling app for iPad, is also getting a long-awaited update appeared first on CDM Create Digital Music.

Sound and Style: CTM Festival Champions the Global Cutting Edge

Delivered... whitney | Scene | Tue 4 Feb 2020 4:59 pm

This past Sunday, CTM Festival drew to a close, marking another year of importing adventurous and outré club music from all around the world into Berlin’s hallowed venues. Inviting such acts as the Brazilian band and political provocateurs Teto Preto, French multidimensional producer BORA, and Ugandan Nyege Nyege affiliate and cross-genre DJ Hibotep, the week-long event was both an exploration of...


Red Bull Off The Roof: RITVIZ, Kaam Bhaari and Spitfire – Red Bull

Delivered... | Scene | Tue 4 Feb 2020 11:19 am
Red Bull Off The Roof: RITVIZ, Kaam Bhaari and Spitfire  Red Bull

News | Jockstrap Sign To Warp And Share New Track – The Quietus

Delivered... | Scene | Tue 4 Feb 2020 9:00 am
News | Jockstrap Sign To Warp And Share New Track  The Quietus

Reviews | Squarepusher – The Quietus

Delivered... | Scene | Tue 4 Feb 2020 9:00 am
Reviews | Squarepusher  The Quietus

News | Houghton Reveals 2020 Line-Up – The Quietus

Delivered... | Scene | Tue 4 Feb 2020 9:00 am
News | Houghton Reveals 2020 Line-Up  The Quietus
TunePlus Wordpress Theme